Sep 07 09:52:02 devstack cinder-volume[76100]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 07 09:52:02 devstack cinder-volume[76100]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 07 09:52:02 devstack cinder-volume[76100]: we strongly recommend against using it for new projects. Sep 07 09:52:02 devstack cinder-volume[76100]: If you are already using Eventlet, we recommend migrating to a different Sep 07 09:52:02 devstack cinder-volume[76100]: framework. For more detail see Sep 07 09:52:02 devstack cinder-volume[76100]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 07 09:52:02 devstack cinder-volume[76100]: import eventlet # noqa Sep 07 09:52:05 devstack cinder-volume[76100]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=76100) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 07 09:52:05 devstack cinder-volume[76100]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=76100) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 07 09:52:05 devstack cinder-volume[76100]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=76100) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 07 09:52:06 devstack cinder-volume[76100]: INFO dbcounter [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] Registered counter for database cinder Sep 07 09:52:06 devstack cinder-volume[76100]: DEBUG oslo_db.sqlalchemy.engines [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76100) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 07 09:52:06 devstack cinder-volume[76100]: DEBUG dbcounter [-] [76100] Writer thread running {{(pid=76100) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 07 09:52:06 devstack cinder-volume[76100]: INFO cinder.rpc [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 07 09:52:06 devstack cinder-volume[76100]: INFO cinder.rpc [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 07 09:52:06 devstack cinder-volume[76100]: DEBUG oslo_db.sqlalchemy.engines [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76100) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 07 09:52:06 devstack cinder-volume[76100]: INFO cinder.volume.manager [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] Determined volume DB was empty at startup. Sep 07 09:52:06 devstack cinder-volume[76100]: DEBUG cinder.volume.manager [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] Cinder Volume DB check: vol_db_empty=True {{(pid=76100) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 07 09:52:06 devstack cinder-volume[76100]: INFO cinder.volume.manager [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] Service not found for updating active_backend_id, assuming default for driver init. Sep 07 09:52:06 devstack cinder-volume[76100]: WARNING stevedore.named [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 07 09:52:06 devstack cinder-volume[76100]: WARNING castellan.key_manager [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 07 09:52:06 devstack cinder-volume[76100]: WARNING cinder.keymgr.conf_key_mgr [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 07 09:52:06 devstack cinder-volume[76100]: DEBUG cinder.volume.drivers.lvm [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=76100) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}} Sep 07 09:52:06 devstack cinder-volume[76100]: DEBUG oslo_concurrency.processutils [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=76100) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_concurrency.processutils [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] CMD "cinder-rtstool verify" returned: 0 in 0.506s {{(pid=76100) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_db.sqlalchemy.engines [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76100) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 07 09:52:07 devstack cinder-volume[76100]: INFO cinder.rpc [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Sep 07 09:52:07 devstack cinder-volume[76100]: INFO cinder.rpc [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Sep 07 09:52:07 devstack cinder-volume[76100]: WARNING stevedore.named [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 07 09:52:07 devstack cinder-volume[76100]: WARNING castellan.key_manager [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 07 09:52:07 devstack cinder-volume[76100]: INFO cinder.volume.manager [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] Image-volume cache enabled for host devstack@lvmdriver-1. Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_db.sqlalchemy.engines [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76100) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 07 09:52:07 devstack cinder-volume[76100]: INFO oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] Starting 1 workers Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] Started child 76285 {{(pid=76100) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] Full set of CONF: {{(pid=76100) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] ******************************************************************************** {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] Configuration options gathered from: {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] ================================================================================ {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] allow_availability_zone_fallback = False {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] allow_compression_on_image_upload = False {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] allowed_direct_url_schemes = [] {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] api_rate_limit = True {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:52:07 devstack cinder-volume[76285]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] auth_strategy = keystone {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] az_cache_duration = 3600 {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] backend_availability_zone = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] backend_host = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] backend_name = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] backend_stats_polling_interval = 60 {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] backup_api_class = cinder.backup.api.API {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] backup_name_template = backup-%s {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] backup_use_same_host = False {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] backup_use_temp_snapshot = False {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] chap_password = **** {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] chap_username = {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] cinder_internal_tenant_project_id = 15f6f37df5c948c4bf4d6a35f26fa2c5 {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] cinder_internal_tenant_user_id = a5df98f8ca5c4fc88c9e8fd34523c7d9 {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] cloned_volume_same_az = True {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] cluster = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] compression_format = gzip {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] compute_api_class = cinder.compute.nova.API {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] config_dir = [] {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] config_source = [] {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] control_exchange = openstack {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] debug = True {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] default_availability_zone = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] default_group_type = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] default_volume_type = lvmdriver-1 {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] disk_geometry = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] driver_client_cert = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] driver_client_cert_key = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] driver_data_namespace = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] driver_ssl_cert_path = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] driver_ssl_cert_verify = False {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] driver_use_ssl = False {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] enable_force_upload = False {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] enable_new_services = True {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] enable_unsupported_driver = False {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] enabled_backends = ['lvmdriver-1'] {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] enforce_multipath_for_image_xfer = False {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] filter_function = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] glance_api_insecure = False {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] glance_api_servers = ['http://192.168.122.74/image'] {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] glance_api_ssl_compression = False {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] glance_ca_certificates_file = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] glance_catalog_info = image:glance:publicURL {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] glance_certfile = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] glance_keyfile = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] glance_num_retries = 3 {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] glance_request_timeout = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] goodness_function = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] graceful_shutdown_timeout = 5 {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] group_api_class = cinder.group.api.API {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] host = devstack {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] image_compress_on_upload = True {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] image_conversion_address_space_limit = 1 {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] image_conversion_cpu_limit = 60 {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] image_conversion_disable = False {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] image_upload_use_cinder_backend = False {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] image_upload_use_internal_tenant = False {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] image_volume_cache_enabled = False {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] image_volume_cache_max_count = 0 {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] image_volume_cache_max_size_gb = 0 {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] init_host_max_objects_retrieval = 0 {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] instance_format = [instance: %(uuid)s] {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] iscsi_target_flags = {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] iscsi_write_cache = on {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] iser_helper = tgtadm {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] iser_ip_address = 192.168.122.74 {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] iser_port = 3260 {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] log_color = False {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] log_config_append = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] log_dir = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] log_file = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] log_options = True {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] log_rotate_interval = 1 {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] log_rotate_interval_type = days {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] log_rotation_type = none {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] max_age = 0 {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] max_logfile_count = 30 {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] max_logfile_size_mb = 200 {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] max_over_subscription_ratio = 20.0 {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] message_reap_interval = 86400 {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] message_ttl = 2592000 {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] migration_create_volume_timeout_secs = 300 {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] monkey_patch = False {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] monkey_patch_modules = [] {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] my_ip = 192.168.122.74 {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] no_snapshot_gb_quota = False {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] num_iser_scan_tries = 3 {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:52:07 devstack cinder-volume[76285]: INFO cinder.volume.manager [None req-0e8305f6-e903-499c-85a4-f6ab19c6229c None None] Starting volume driver LVMVolumeDriver (3.0.0) Sep 07 09:52:07 devstack cinder-volume[76285]: DEBUG oslo_concurrency.processutils [None req-0e8305f6-e903-499c-85a4-f6ab19c6229c None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76285) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] num_shell_tries = 3 {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] num_volume_device_scan_tries = 3 {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] nvmeof_conn_info_version = 1 {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] nvmet_ns_id = 10 {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] nvmet_port_id = 1 {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] osapi_max_limit = 1000 {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] osapi_volume_ext_list = [] {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] osapi_volume_listen = 0.0.0.0 {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] osapi_volume_listen_port = 8776 {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] osapi_volume_use_ssl = False {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] osapi_volume_workers = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] per_volume_size_limit = -1 {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] periodic_fuzzy_delay = 60 {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] periodic_interval = 60 {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] project_id_regex = [0-9a-f\-]+ {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] public_endpoint = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] publish_errors = False {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] quota_backup_gigabytes = 1000 {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] quota_backups = 10 {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] quota_gigabytes = 1000 {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] quota_groups = 10 {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] quota_snapshots = 10 {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] quota_volumes = 10 {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] rate_limit_burst = 0 {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] rate_limit_except_level = CRITICAL {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] rate_limit_interval = 0 {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] reinit_driver_count = 3 {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] replication_device = **** {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] report_discard_supported = False {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] report_interval = 120 {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] reservation_clean_interval = 86400 {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] reservation_expire = 86400 {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] reserved_image_namespaces = [] {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] reserved_percentage = 0 {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] rpc_response_timeout = 120 {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] run_external_periodic_tasks = True {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] scst_target_driver = iscsi {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] scst_target_iqn_name = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] service_down_time = 720 {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] shell_completion = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] snapshot_name_template = snapshot-%s {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] snapshot_same_host = True {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] split_loggers = False {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] state_path = /opt/stack/data/cinder {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] storage_availability_zone = nova {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] storage_protocol = iSCSI {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] syslog_log_facility = LOG_USER {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] target_helper = lioadm {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] target_ip_address = 192.168.122.74 {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] target_port = 3260 {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] target_protocol = iscsi {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:52:07 devstack cinder-volume[76285]: DEBUG oslo_concurrency.processutils [None req-0e8305f6-e903-499c-85a4-f6ab19c6229c None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.040s {{(pid=76285) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] target_secondary_ip_addresses = [] {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] trace_flags = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] transfer_api_class = cinder.transfer.api.API {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] transport_url = **** {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] until_refresh = 0 {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] use_chap_auth = False {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] use_default_quota_class = True {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] use_journal = False {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] use_json = False {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:52:07 devstack cinder-volume[76285]: DEBUG oslo_concurrency.processutils [None req-0e8305f6-e903-499c-85a4-f6ab19c6229c None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76285) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] use_multipath_for_image_xfer = False {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] use_stderr = False {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] use_syslog = False {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] verify_glance_signatures = enabled {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] volume_api_class = cinder.volume.api.API {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] volume_backend_name = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] volume_clear = zero {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] volume_clear_ionice = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] volume_clear_size = 0 {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] volume_copy_bps_limit = 0 {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] volume_dd_blocksize = 1M {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] volume_name_template = volume-%s {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] volume_service_inithost_offload = False {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] volume_usage_audit_period = month {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] zoning_mode = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] oslo_concurrency.disable_process_locking = False {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] os_brick.lightos_discovery_client_address = localhost {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] os_brick.wait_mpath_device_interval = 1 {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] keystone_authtoken.auth_section = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] keystone_authtoken.auth_type = password {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] keystone_authtoken.auth_version = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] keystone_authtoken.cache = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] keystone_authtoken.certfile = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] keystone_authtoken.delay_auth_decision = False {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] keystone_authtoken.http_connect_timeout = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] keystone_authtoken.include_service_catalog = True {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] keystone_authtoken.insecure = False {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] keystone_authtoken.interface = public {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] keystone_authtoken.keyfile = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] keystone_authtoken.memcache_password = **** {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] keystone_authtoken.memcache_secret_key = **** {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] keystone_authtoken.memcache_security_strategy = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] keystone_authtoken.memcache_username = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] keystone_authtoken.region_name = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] keystone_authtoken.service_token_roles_required = True {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] keystone_authtoken.service_type = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] keystone_authtoken.token_cache_time = 300 {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.74/identity {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] cache.backend = dogpile.cache.null {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] cache.backend_argument = **** {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] cache.backend_expiration_time = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] cache.config_prefix = cache.oslo {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] cache.debug_cache_backend = False {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] cache.enable_retry_client = False {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] cache.enable_socket_keepalive = False {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] cache.enabled = False {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] cache.expiration_time = 600 {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] cache.hashclient_dead_timeout = 60.0 {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] cache.hashclient_retry_attempts = 2 {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] cache.hashclient_retry_timeout = 1.0 {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] cache.memcache_dead_retry = 300 {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] cache.memcache_pool_maxsize = 10 {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] cache.memcache_pool_unused_timeout = 60 {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] cache.memcache_sasl_enabled = False {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] cache.memcache_servers = ['localhost:11211'] {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] cache.password = **** {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] cache.proxies = [] {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] cache.redis_db = 0 {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] cache.redis_sentinel_service_name = mymaster {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] cache.redis_server = localhost:6379 {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] cache.retry_attempts = 2 {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] cache.retry_delay = 0.0 {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] cache.socket_keepalive_count = 1 {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] cache.socket_keepalive_idle = 1 {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] cache.socket_keepalive_interval = 1 {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] cache.socket_timeout = 1.0 {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] cache.tls_allowed_ciphers = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] cache.tls_cafile = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] cache.tls_certfile = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] cache.tls_enabled = False {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] cache.tls_keyfile = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] cache.username = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] coordination.backend_url = **** {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] database.asyncio_connection = **** {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] database.asyncio_slave_connection = **** {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] database.backend = sqlalchemy {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] database.connection = **** {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] database.connection_debug = 0 {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] database.connection_parameters = {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] database.connection_recycle_time = 3600 {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] database.connection_trace = False {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] database.db_inc_retry_interval = True {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] database.db_max_retries = 20 {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] database.db_max_retry_interval = 10 {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] database.db_retry_interval = 1 {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76285]: DEBUG oslo_concurrency.processutils [None req-0e8305f6-e903-499c-85a4-f6ab19c6229c None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.048s {{(pid=76285) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:52:07 devstack cinder-volume[76285]: DEBUG oslo_concurrency.processutils [None req-0e8305f6-e903-499c-85a4-f6ab19c6229c None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76285) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] database.max_overflow = 50 {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] database.max_pool_size = 5 {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] database.max_retries = 10 {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] database.mysql_sql_mode = TRADITIONAL {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] database.mysql_wsrep_sync_wait = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] database.pool_timeout = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] database.retry_interval = 10 {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] database.slave_connection = **** {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] database.sqlite_synchronous = True {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] database.synchronous_reader = True {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] database.use_db_reconnect = False {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] oslo_messaging_metrics.metrics_process_name = {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] oslo_messaging_tracing.insecure = False {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] profiler.connection_string = messaging:// {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] profiler.enabled = False {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] profiler.es_doc_type = notification {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] profiler.es_scroll_size = 10000 {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] profiler.es_scroll_time = 2m {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] profiler.filter_error_trace = False {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] profiler.hmac_keys = **** {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] profiler.sentinel_service_name = mymaster {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] profiler.socket_timeout = 0.1 {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] profiler.trace_requests = False {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] profiler.trace_sqlalchemy = False {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] profiler_jaeger.process_tags = {} {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] profiler_jaeger.service_name_prefix = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] profiler_otlp.service_name_prefix = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] oslo_policy.enforce_new_defaults = True {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] oslo_policy.policy_default_rule = default {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] oslo_policy.policy_file = policy.yaml {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] oslo_policy.remote_timeout = 60.0 {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] privsep_osbrick.capabilities = [21, 2] {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] privsep_osbrick.group = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] privsep_osbrick.helper_command = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] privsep_osbrick.log_daemon_traceback = False {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] privsep_osbrick.thread_pool_size = 4 {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] privsep_osbrick.user = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] cinder_sys_admin.group = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] cinder_sys_admin.helper_command = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] cinder_sys_admin.user = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76285]: DEBUG oslo_concurrency.processutils [None req-0e8305f6-e903-499c-85a4-f6ab19c6229c None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.033s {{(pid=76285) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] service_user.auth_section = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] service_user.auth_type = password {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] service_user.cafile = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] service_user.certfile = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] service_user.collect_timing = False {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] service_user.insecure = False {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] service_user.keyfile = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] service_user.send_service_user_token = True {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] service_user.split_loggers = False {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] service_user.timeout = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76285]: DEBUG oslo_concurrency.processutils [None req-0e8305f6-e903-499c-85a4-f6ab19c6229c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=76285) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] service_user.tls_ciphers = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] service_user.tls_min_version = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] glance.auth_section = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] glance.auth_type = password {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] glance.certfile = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] glance.collect_timing = False {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] glance.insecure = False {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] glance.keyfile = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] glance.region_name = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] glance.split_loggers = False {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] glance.timeout = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] glance.tls_ciphers = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] glance.tls_min_version = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] backend_defaults.backend_availability_zone = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] backend_defaults.chap_password = **** {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] backend_defaults.chap_username = {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] backend_defaults.disk_geometry = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] backend_defaults.driver_client_cert = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] backend_defaults.driver_client_cert_key = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] backend_defaults.driver_data_namespace = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] backend_defaults.driver_ssl_cert_path = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] backend_defaults.driver_use_ssl = False {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] backend_defaults.enable_unsupported_driver = False {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] backend_defaults.extra_capabilities = {} {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] backend_defaults.filter_function = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] backend_defaults.goodness_function = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] backend_defaults.image_volume_cache_enabled = False {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] backend_defaults.iscsi_target_flags = {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] backend_defaults.iscsi_write_cache = on {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] backend_defaults.iser_helper = tgtadm {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] backend_defaults.iser_ip_address = 192.168.122.74 {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] backend_defaults.iser_port = 3260 {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] backend_defaults.lvm_mirrors = 0 {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] backend_defaults.lvm_share_target = False {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] backend_defaults.lvm_type = auto {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] backend_defaults.num_shell_tries = 3 {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] backend_defaults.nvmet_ns_id = 10 {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] backend_defaults.nvmet_port_id = 1 {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] backend_defaults.replication_device = **** {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] backend_defaults.report_discard_supported = False {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] backend_defaults.reserved_percentage = 0 {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] backend_defaults.scst_target_driver = iscsi {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] backend_defaults.scst_target_iqn_name = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] backend_defaults.storage_protocol = iSCSI {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] backend_defaults.target_helper = tgtadm {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] backend_defaults.target_ip_address = 192.168.122.74 {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] backend_defaults.target_port = 3260 {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] backend_defaults.target_protocol = iscsi {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] backend_defaults.trace_flags = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] backend_defaults.unique_fqdn_network = True {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] backend_defaults.use_chap_auth = False {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] backend_defaults.volume_backend_name = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] backend_defaults.volume_clear = zero {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] backend_defaults.volume_clear_ionice = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] backend_defaults.volume_clear_size = 0 {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack sudo[76296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack sudo[76296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] backend_defaults.volume_group = cinder-volumes {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] oslo_reports.file_event_handler = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] oslo_reports.file_event_handler_interval = 1 {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] oslo_reports.log_dir = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] lvmdriver-1.backend_availability_zone = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] lvmdriver-1.backend_host = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] lvmdriver-1.chap_password = **** {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] lvmdriver-1.chap_username = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] lvmdriver-1.chiscsi_conf = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] lvmdriver-1.disk_geometry = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] lvmdriver-1.driver_client_cert = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] lvmdriver-1.driver_client_cert_key = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] lvmdriver-1.driver_data_namespace = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] lvmdriver-1.driver_use_ssl = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] lvmdriver-1.extra_capabilities = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] lvmdriver-1.filter_function = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] lvmdriver-1.goodness_function = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] lvmdriver-1.iscsi_target_flags = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] lvmdriver-1.iscsi_write_cache = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] lvmdriver-1.iser_helper = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] lvmdriver-1.iser_ip_address = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] lvmdriver-1.iser_port = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] lvmdriver-1.iser_target_prefix = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] lvmdriver-1.lvm_conf_file = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] lvmdriver-1.lvm_mirrors = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] lvmdriver-1.lvm_share_target = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] lvmdriver-1.lvm_type = auto {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] lvmdriver-1.num_shell_tries = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] lvmdriver-1.nvmet_ns_id = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] lvmdriver-1.nvmet_port_id = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] lvmdriver-1.replication_device = **** {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] lvmdriver-1.report_discard_supported = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] lvmdriver-1.reserved_percentage = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] lvmdriver-1.scst_target_driver = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] lvmdriver-1.storage_protocol = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] lvmdriver-1.target_helper = lioadm {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] lvmdriver-1.target_ip_address = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] lvmdriver-1.target_port = 3260 {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] lvmdriver-1.target_protocol = iscsi {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] lvmdriver-1.trace_flags = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] lvmdriver-1.unique_fqdn_network = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] lvmdriver-1.use_chap_auth = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] lvmdriver-1.volume_clear = zero {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] lvmdriver-1.volume_clear_ionice = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] lvmdriver-1.volume_clear_size = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] lvmdriver-1.volumes_dir = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] oslo_messaging_rabbit.hostname = devstack {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] oslo_messaging_rabbit.ssl = False {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] oslo_messaging_rabbit.ssl_version = {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] oslo_messaging_notifications.driver = [] {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] oslo_messaging_notifications.retry = -1 {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] oslo_messaging_notifications.transport_url = **** {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] key_manager.fixed_key = **** {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] barbican.barbican_api_version = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] barbican.barbican_endpoint = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] barbican.barbican_endpoint_type = public {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] barbican.barbican_region_name = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] barbican.cafile = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] barbican.certfile = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] barbican.collect_timing = False {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] barbican.insecure = False {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] barbican.keyfile = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] barbican.number_of_retries = 60 {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] barbican.retry_delay = 1 {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] barbican.send_service_user_token = False {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] barbican.split_loggers = False {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] barbican.timeout = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] barbican.tls_ciphers = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] barbican.tls_min_version = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] barbican.verify_ssl = True {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] barbican.verify_ssl_path = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] barbican_service_user.auth_section = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] barbican_service_user.auth_type = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] barbican_service_user.cafile = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] barbican_service_user.certfile = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] barbican_service_user.collect_timing = False {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] barbican_service_user.insecure = False {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] barbican_service_user.keyfile = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] barbican_service_user.split_loggers = False {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] barbican_service_user.timeout = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] barbican_service_user.tls_ciphers = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] barbican_service_user.tls_min_version = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] vault.approle_role_id = **** {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] vault.approle_secret_id = **** {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] vault.auth_method = approle {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] vault.auth_path = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] vault.kv_mountpoint = secret {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] vault.kv_path = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] vault.kv_version = 2 {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] vault.namespace = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] vault.root_token_id = **** {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] vault.ssl_ca_crt_file = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] vault.timeout = 60.0 {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] vault.token_file = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] vault.token_role = None {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] vault.use_ssl = False {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:52:07 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] ******************************************************************************** {{(pid=76100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 07 09:52:08 devstack sudo[76296]: pam_unix(sudo:session): session closed for user root Sep 07 09:52:08 devstack cinder-volume[76285]: DEBUG oslo_concurrency.processutils [None req-0e8305f6-e903-499c-85a4-f6ab19c6229c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.291s {{(pid=76285) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:52:08 devstack cinder-volume[76285]: DEBUG oslo_concurrency.processutils [None req-0e8305f6-e903-499c-85a4-f6ab19c6229c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76285) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:52:08 devstack sudo[76444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 07 09:52:08 devstack sudo[76444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:52:08 devstack sudo[76444]: pam_unix(sudo:session): session closed for user root Sep 07 09:52:08 devstack cinder-volume[76285]: DEBUG oslo_concurrency.processutils [None req-0e8305f6-e903-499c-85a4-f6ab19c6229c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.256s {{(pid=76285) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:52:08 devstack cinder-volume[76285]: DEBUG oslo_concurrency.processutils [None req-0e8305f6-e903-499c-85a4-f6ab19c6229c None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=76285) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 07 09:52:08 devstack cinder-volume[76285]: INFO cinder.brick.local_dev.lvm [None req-0e8305f6-e903-499c-85a4-f6ab19c6229c None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Sep 07 09:52:08 devstack cinder-volume[76285]: DEBUG oslo_concurrency.processutils [None req-0e8305f6-e903-499c-85a4-f6ab19c6229c None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76285) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:52:08 devstack cinder-volume[76285]: DEBUG oslo_concurrency.processutils [None req-0e8305f6-e903-499c-85a4-f6ab19c6229c None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=76285) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:52:08 devstack cinder-volume[76285]: DEBUG oslo_concurrency.processutils [None req-0e8305f6-e903-499c-85a4-f6ab19c6229c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76285) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:52:08 devstack sudo[76542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 07 09:52:08 devstack sudo[76542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:52:08 devstack sudo[76542]: pam_unix(sudo:session): session closed for user root Sep 07 09:52:08 devstack cinder-volume[76285]: DEBUG oslo_concurrency.processutils [None req-0e8305f6-e903-499c-85a4-f6ab19c6229c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.264s {{(pid=76285) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:52:08 devstack cinder-volume[76285]: DEBUG cinder.brick.local_dev.lvm [None req-0e8305f6-e903-499c-85a4-f6ab19c6229c None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=76285) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}} Sep 07 09:52:08 devstack cinder-volume[76285]: DEBUG oslo_concurrency.processutils [None req-0e8305f6-e903-499c-85a4-f6ab19c6229c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76285) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:52:08 devstack sudo[76630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 07 09:52:08 devstack sudo[76630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:52:09 devstack sudo[76630]: pam_unix(sudo:session): session closed for user root Sep 07 09:52:09 devstack cinder-volume[76285]: DEBUG oslo_concurrency.processutils [None req-0e8305f6-e903-499c-85a4-f6ab19c6229c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.486s {{(pid=76285) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:52:09 devstack cinder-volume[76285]: DEBUG oslo_concurrency.processutils [None req-0e8305f6-e903-499c-85a4-f6ab19c6229c None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76285) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:52:09 devstack cinder-volume[76285]: DEBUG oslo_concurrency.processutils [None req-0e8305f6-e903-499c-85a4-f6ab19c6229c None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=76285) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:52:09 devstack cinder-volume[76285]: DEBUG oslo_concurrency.processutils [None req-0e8305f6-e903-499c-85a4-f6ab19c6229c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76285) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:52:09 devstack sudo[76815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 07 09:52:09 devstack sudo[76815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:52:09 devstack sudo[76815]: pam_unix(sudo:session): session closed for user root Sep 07 09:52:09 devstack cinder-volume[76285]: DEBUG oslo_concurrency.processutils [None req-0e8305f6-e903-499c-85a4-f6ab19c6229c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.316s {{(pid=76285) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:52:09 devstack cinder-volume[76285]: DEBUG oslo_concurrency.processutils [None req-0e8305f6-e903-499c-85a4-f6ab19c6229c None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76285) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:52:09 devstack cinder-volume[76285]: DEBUG oslo_concurrency.processutils [None req-0e8305f6-e903-499c-85a4-f6ab19c6229c None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.020s {{(pid=76285) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:52:09 devstack cinder-volume[76285]: DEBUG oslo_concurrency.processutils [None req-0e8305f6-e903-499c-85a4-f6ab19c6229c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=76285) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:52:09 devstack sudo[76899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Sep 07 09:52:09 devstack sudo[76899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:52:09 devstack sudo[76899]: pam_unix(sudo:session): session closed for user root Sep 07 09:52:09 devstack cinder-volume[76285]: DEBUG oslo_concurrency.processutils [None req-0e8305f6-e903-499c-85a4-f6ab19c6229c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.278s {{(pid=76285) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:52:09 devstack cinder-volume[76285]: DEBUG oslo_concurrency.processutils [None req-0e8305f6-e903-499c-85a4-f6ab19c6229c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76285) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:52:09 devstack sudo[76906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 07 09:52:09 devstack sudo[76906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:52:10 devstack sudo[76906]: pam_unix(sudo:session): session closed for user root Sep 07 09:52:10 devstack cinder-volume[76285]: DEBUG oslo_concurrency.processutils [None req-0e8305f6-e903-499c-85a4-f6ab19c6229c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.330s {{(pid=76285) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:52:10 devstack cinder-volume[76285]: DEBUG oslo_concurrency.processutils [None req-0e8305f6-e903-499c-85a4-f6ab19c6229c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76285) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:52:10 devstack sudo[76986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 07 09:52:10 devstack sudo[76986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:52:10 devstack sudo[76986]: pam_unix(sudo:session): session closed for user root Sep 07 09:52:10 devstack cinder-volume[76285]: DEBUG oslo_concurrency.processutils [None req-0e8305f6-e903-499c-85a4-f6ab19c6229c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.267s {{(pid=76285) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:52:10 devstack cinder-volume[76285]: DEBUG oslo_concurrency.processutils [None req-0e8305f6-e903-499c-85a4-f6ab19c6229c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76285) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:52:10 devstack sudo[76994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 07 09:52:10 devstack sudo[76994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:52:10 devstack sudo[76994]: pam_unix(sudo:session): session closed for user root Sep 07 09:52:10 devstack cinder-volume[76285]: DEBUG oslo_concurrency.processutils [None req-0e8305f6-e903-499c-85a4-f6ab19c6229c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.305s {{(pid=76285) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:52:10 devstack cinder-volume[76285]: DEBUG oslo_concurrency.processutils [None req-0e8305f6-e903-499c-85a4-f6ab19c6229c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76285) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:52:10 devstack sudo[77078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 07 09:52:10 devstack sudo[77078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:52:10 devstack sudo[77078]: pam_unix(sudo:session): session closed for user root Sep 07 09:52:10 devstack cinder-volume[76285]: DEBUG oslo_concurrency.processutils [None req-0e8305f6-e903-499c-85a4-f6ab19c6229c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.260s {{(pid=76285) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:52:10 devstack cinder-volume[76285]: DEBUG oslo_concurrency.processutils [None req-0e8305f6-e903-499c-85a4-f6ab19c6229c None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76285) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:52:10 devstack cinder-volume[76285]: DEBUG oslo_concurrency.processutils [None req-0e8305f6-e903-499c-85a4-f6ab19c6229c None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=76285) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:52:10 devstack cinder-volume[76285]: DEBUG oslo_concurrency.processutils [None req-0e8305f6-e903-499c-85a4-f6ab19c6229c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76285) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:52:10 devstack sudo[77082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 07 09:52:10 devstack sudo[77082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:52:11 devstack sudo[77082]: pam_unix(sudo:session): session closed for user root Sep 07 09:52:11 devstack cinder-volume[76285]: DEBUG oslo_concurrency.processutils [None req-0e8305f6-e903-499c-85a4-f6ab19c6229c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.297s {{(pid=76285) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:52:11 devstack cinder-volume[76285]: INFO cinder.volume.drivers.lvm [None req-0e8305f6-e903-499c-85a4-f6ab19c6229c None None] Enabling LVM thin provisioning by default because a thin pool exists. Sep 07 09:52:11 devstack cinder-volume[76285]: DEBUG oslo_concurrency.processutils [None req-0e8305f6-e903-499c-85a4-f6ab19c6229c None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76285) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:52:11 devstack cinder-volume[76285]: DEBUG oslo_concurrency.processutils [None req-0e8305f6-e903-499c-85a4-f6ab19c6229c None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.016s {{(pid=76285) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:52:11 devstack cinder-volume[76285]: DEBUG oslo_concurrency.processutils [None req-0e8305f6-e903-499c-85a4-f6ab19c6229c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76285) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:52:11 devstack sudo[77092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 07 09:52:11 devstack sudo[77092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:52:11 devstack sudo[77092]: pam_unix(sudo:session): session closed for user root Sep 07 09:52:11 devstack cinder-volume[76285]: DEBUG oslo_concurrency.processutils [None req-0e8305f6-e903-499c-85a4-f6ab19c6229c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.247s {{(pid=76285) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:52:11 devstack cinder-volume[76285]: DEBUG cinder.volume.drivers.lvm [None req-0e8305f6-e903-499c-85a4-f6ab19c6229c None None] Updating volume stats {{(pid=76285) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 07 09:52:11 devstack cinder-volume[76285]: DEBUG oslo_concurrency.processutils [None req-0e8305f6-e903-499c-85a4-f6ab19c6229c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76285) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:52:11 devstack sudo[77095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 07 09:52:11 devstack sudo[77095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:52:11 devstack sudo[77095]: pam_unix(sudo:session): session closed for user root Sep 07 09:52:11 devstack cinder-volume[76285]: DEBUG oslo_concurrency.processutils [None req-0e8305f6-e903-499c-85a4-f6ab19c6229c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.250s {{(pid=76285) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:52:11 devstack cinder-volume[76285]: DEBUG oslo_concurrency.processutils [None req-0e8305f6-e903-499c-85a4-f6ab19c6229c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76285) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:52:11 devstack sudo[77098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 07 09:52:11 devstack sudo[77098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:52:11 devstack sudo[77098]: pam_unix(sudo:session): session closed for user root Sep 07 09:52:11 devstack cinder-volume[76285]: DEBUG oslo_concurrency.processutils [None req-0e8305f6-e903-499c-85a4-f6ab19c6229c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.248s {{(pid=76285) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:52:11 devstack cinder-volume[76285]: DEBUG oslo_concurrency.processutils [None req-0e8305f6-e903-499c-85a4-f6ab19c6229c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76285) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:52:11 devstack sudo[77101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 07 09:52:11 devstack sudo[77101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:52:12 devstack sudo[77101]: pam_unix(sudo:session): session closed for user root Sep 07 09:52:12 devstack cinder-volume[76285]: DEBUG oslo_concurrency.processutils [None req-0e8305f6-e903-499c-85a4-f6ab19c6229c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.259s {{(pid=76285) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:52:12 devstack cinder-volume[76285]: DEBUG oslo_concurrency.processutils [None req-0e8305f6-e903-499c-85a4-f6ab19c6229c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76285) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:52:12 devstack sudo[77104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 07 09:52:12 devstack sudo[77104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:52:12 devstack sudo[77104]: pam_unix(sudo:session): session closed for user root Sep 07 09:52:12 devstack cinder-volume[76285]: DEBUG oslo_concurrency.processutils [None req-0e8305f6-e903-499c-85a4-f6ab19c6229c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.266s {{(pid=76285) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:52:12 devstack cinder-volume[76285]: INFO cinder.volume.driver [None req-0e8305f6-e903-499c-85a4-f6ab19c6229c None None] Driver hasn't implemented _init_vendor_properties() Sep 07 09:52:12 devstack cinder-volume[76285]: DEBUG cinder.volume.driver [None req-0e8305f6-e903-499c-85a4-f6ab19c6229c None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=76285) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 07 09:52:12 devstack cinder-volume[76285]: DEBUG oslo_db.sqlalchemy.engines [None req-0e8305f6-e903-499c-85a4-f6ab19c6229c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76285) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 07 09:52:12 devstack cinder-volume[76285]: DEBUG dbcounter [-] [76285] Writer thread running {{(pid=76285) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 07 09:52:12 devstack cinder-volume[76285]: DEBUG cinder.db.api [None req-0e8305f6-e903-499c-85a4-f6ab19c6229c None None] Building query based on filter {{(pid=76285) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 07 09:52:12 devstack cinder-volume[76285]: DEBUG cinder.image.image_utils [None req-0e8305f6-e903-499c-85a4-f6ab19c6229c None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=76285) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Sep 07 09:52:12 devstack cinder-volume[76285]: INFO cinder.keymgr.migration [None req-f642b15d-8f07-4087-a753-05d0e605e518 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 07 09:52:12 devstack cinder-volume[76285]: DEBUG cinder.volume.drivers.lvm [None req-0e8305f6-e903-499c-85a4-f6ab19c6229c None None] Updating volume stats {{(pid=76285) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 07 09:52:12 devstack cinder-volume[76285]: DEBUG oslo_concurrency.processutils [None req-0e8305f6-e903-499c-85a4-f6ab19c6229c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76285) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:52:12 devstack sudo[77108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 07 09:52:12 devstack sudo[77108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:52:12 devstack sudo[77108]: pam_unix(sudo:session): session closed for user root Sep 07 09:52:12 devstack cinder-volume[76285]: DEBUG oslo_concurrency.processutils [None req-0e8305f6-e903-499c-85a4-f6ab19c6229c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.286s {{(pid=76285) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:52:12 devstack cinder-volume[76285]: DEBUG oslo_concurrency.processutils [None req-0e8305f6-e903-499c-85a4-f6ab19c6229c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76285) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:52:12 devstack sudo[77113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 07 09:52:12 devstack sudo[77113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:52:13 devstack sudo[77113]: pam_unix(sudo:session): session closed for user root Sep 07 09:52:13 devstack cinder-volume[76285]: DEBUG oslo_concurrency.processutils [None req-0e8305f6-e903-499c-85a4-f6ab19c6229c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.274s {{(pid=76285) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:52:13 devstack cinder-volume[76285]: DEBUG oslo_concurrency.processutils [None req-0e8305f6-e903-499c-85a4-f6ab19c6229c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76285) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:52:13 devstack sudo[77116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 07 09:52:13 devstack sudo[77116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:52:13 devstack sudo[77116]: pam_unix(sudo:session): session closed for user root Sep 07 09:52:13 devstack cinder-volume[76285]: DEBUG oslo_concurrency.processutils [None req-0e8305f6-e903-499c-85a4-f6ab19c6229c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.264s {{(pid=76285) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:52:13 devstack cinder-volume[76285]: DEBUG oslo_concurrency.processutils [None req-0e8305f6-e903-499c-85a4-f6ab19c6229c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76285) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:52:13 devstack sudo[77119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 07 09:52:13 devstack sudo[77119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:52:13 devstack sudo[77119]: pam_unix(sudo:session): session closed for user root Sep 07 09:52:13 devstack cinder-volume[76285]: DEBUG oslo_concurrency.processutils [None req-0e8305f6-e903-499c-85a4-f6ab19c6229c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.263s {{(pid=76285) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:52:13 devstack cinder-volume[76285]: DEBUG cinder.manager [None req-0e8305f6-e903-499c-85a4-f6ab19c6229c None None] Notifying Schedulers of capabilities ... {{(pid=76285) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 09:52:13 devstack cinder-volume[76285]: INFO cinder.volume.manager [None req-0e8305f6-e903-499c-85a4-f6ab19c6229c None None] Driver initialization completed successfully. Sep 07 09:52:13 devstack cinder-volume[76285]: INFO cinder.manager [None req-0e8305f6-e903-499c-85a4-f6ab19c6229c None None] Initiating service 2 cleanup Sep 07 09:52:13 devstack cinder-volume[76285]: INFO cinder.manager [None req-0e8305f6-e903-499c-85a4-f6ab19c6229c None None] Service 2 cleanup completed. Sep 07 09:52:13 devstack cinder-volume[76285]: DEBUG cinder.service [None req-0e8305f6-e903-499c-85a4-f6ab19c6229c None None] Creating RPC server for service cinder-volume {{(pid=76285) start /opt/stack/cinder/cinder/service.py:231}} Sep 07 09:52:13 devstack cinder-volume[76285]: DEBUG cinder.service [None req-0e8305f6-e903-499c-85a4-f6ab19c6229c None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=76285) start /opt/stack/cinder/cinder/service.py:237}} Sep 07 09:52:13 devstack cinder-volume[76285]: INFO cinder.volume.manager [None req-0e8305f6-e903-499c-85a4-f6ab19c6229c None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Sep 07 09:52:13 devstack cinder-volume[76285]: DEBUG cinder.volume.drivers.lvm [None req-0e8305f6-e903-499c-85a4-f6ab19c6229c None None] Updating volume stats {{(pid=76285) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 07 09:52:13 devstack cinder-volume[76285]: DEBUG oslo_concurrency.processutils [None req-0e8305f6-e903-499c-85a4-f6ab19c6229c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76285) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:52:13 devstack sudo[77123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 07 09:52:13 devstack sudo[77123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:52:14 devstack sudo[77123]: pam_unix(sudo:session): session closed for user root Sep 07 09:52:14 devstack cinder-volume[76285]: DEBUG oslo_concurrency.processutils [None req-0e8305f6-e903-499c-85a4-f6ab19c6229c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.266s {{(pid=76285) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:52:14 devstack cinder-volume[76285]: DEBUG oslo_concurrency.processutils [None req-0e8305f6-e903-499c-85a4-f6ab19c6229c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76285) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:52:14 devstack sudo[77127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 07 09:52:14 devstack sudo[77127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:52:14 devstack sudo[77127]: pam_unix(sudo:session): session closed for user root Sep 07 09:52:14 devstack cinder-volume[76285]: DEBUG oslo_concurrency.processutils [None req-0e8305f6-e903-499c-85a4-f6ab19c6229c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.254s {{(pid=76285) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:52:14 devstack cinder-volume[76285]: DEBUG oslo_concurrency.processutils [None req-0e8305f6-e903-499c-85a4-f6ab19c6229c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76285) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:52:14 devstack sudo[77133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 07 09:52:14 devstack sudo[77133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:52:14 devstack sudo[77133]: pam_unix(sudo:session): session closed for user root Sep 07 09:52:14 devstack cinder-volume[76285]: DEBUG oslo_concurrency.processutils [None req-0e8305f6-e903-499c-85a4-f6ab19c6229c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.251s {{(pid=76285) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:52:14 devstack cinder-volume[76285]: DEBUG oslo_concurrency.processutils [None req-0e8305f6-e903-499c-85a4-f6ab19c6229c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76285) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:52:14 devstack sudo[77136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 07 09:52:14 devstack sudo[77136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:52:14 devstack sudo[77136]: pam_unix(sudo:session): session closed for user root Sep 07 09:52:14 devstack cinder-volume[76285]: DEBUG oslo_concurrency.processutils [None req-0e8305f6-e903-499c-85a4-f6ab19c6229c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.250s {{(pid=76285) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:52:14 devstack cinder-volume[76285]: INFO cinder.volume.manager [None req-0e8305f6-e903-499c-85a4-f6ab19c6229c None None] Driver post RPC initialization completed successfully. Sep 07 09:52:15 devstack cinder-volume[76285]: DEBUG oslo_service.periodic_task [None req-d5208bff-0954-4751-8afe-d53b60b3c712 None None] Running periodic task VolumeManager._thread_info {{(pid=76285) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 09:52:15 devstack cinder-volume[76285]: DEBUG cinder.volume.manager [None req-d5208bff-0954-4751-8afe-d53b60b3c712 None None] thread count: 6 {{(pid=76285) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 07 09:52:15 devstack cinder-volume[76285]: DEBUG cinder.volume.manager [None req-d5208bff-0954-4751-8afe-d53b60b3c712 None None] thread info: [<_MainThread(MainThread, started 129268457140352)>, , , , , ] {{(pid=76285) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 07 09:52:17 devstack cinder-volume[76100]: DEBUG dbcounter [-] [76100] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=76100) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 09:52:24 devstack cinder-volume[76285]: DEBUG dbcounter [-] [76285] Writing DB stats cinder:SELECT=3 {{(pid=76285) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 09:52:24 devstack cinder-volume[76285]: DEBUG dbcounter [-] [76285] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=76285) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 09:53:15 devstack cinder-volume[76285]: DEBUG oslo_service.periodic_task [None req-d5208bff-0954-4751-8afe-d53b60b3c712 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76285) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 09:53:15 devstack cinder-volume[76285]: DEBUG cinder.volume.drivers.lvm [None req-d5208bff-0954-4751-8afe-d53b60b3c712 None None] Updating volume stats {{(pid=76285) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 07 09:53:15 devstack cinder-volume[76285]: DEBUG oslo_concurrency.processutils [None req-d5208bff-0954-4751-8afe-d53b60b3c712 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76285) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:53:15 devstack sudo[79160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 07 09:53:15 devstack sudo[79160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:53:16 devstack sudo[79160]: pam_unix(sudo:session): session closed for user root Sep 07 09:53:16 devstack cinder-volume[76285]: DEBUG oslo_concurrency.processutils [None req-d5208bff-0954-4751-8afe-d53b60b3c712 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.245s {{(pid=76285) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:53:16 devstack cinder-volume[76285]: DEBUG oslo_concurrency.processutils [None req-d5208bff-0954-4751-8afe-d53b60b3c712 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76285) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:53:16 devstack sudo[79190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 07 09:53:16 devstack sudo[79190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:53:16 devstack sudo[79190]: pam_unix(sudo:session): session closed for user root Sep 07 09:53:16 devstack cinder-volume[76285]: DEBUG oslo_concurrency.processutils [None req-d5208bff-0954-4751-8afe-d53b60b3c712 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.241s {{(pid=76285) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:53:16 devstack cinder-volume[76285]: DEBUG oslo_concurrency.processutils [None req-d5208bff-0954-4751-8afe-d53b60b3c712 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76285) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:53:16 devstack sudo[79193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 07 09:53:16 devstack sudo[79193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:53:16 devstack sudo[79193]: pam_unix(sudo:session): session closed for user root Sep 07 09:53:16 devstack cinder-volume[76285]: DEBUG oslo_concurrency.processutils [None req-d5208bff-0954-4751-8afe-d53b60b3c712 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.241s {{(pid=76285) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:53:16 devstack cinder-volume[76285]: DEBUG oslo_concurrency.processutils [None req-d5208bff-0954-4751-8afe-d53b60b3c712 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76285) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:53:16 devstack sudo[79196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 07 09:53:16 devstack sudo[79196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:53:16 devstack sudo[79196]: pam_unix(sudo:session): session closed for user root Sep 07 09:53:16 devstack cinder-volume[76285]: DEBUG oslo_concurrency.processutils [None req-d5208bff-0954-4751-8afe-d53b60b3c712 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.244s {{(pid=76285) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:53:16 devstack cinder-volume[76285]: DEBUG cinder.manager [None req-d5208bff-0954-4751-8afe-d53b60b3c712 None None] Notifying Schedulers of capabilities ... {{(pid=76285) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 09:53:16 devstack cinder-volume[76285]: DEBUG oslo_service.periodic_task [None req-d5208bff-0954-4751-8afe-d53b60b3c712 None None] Running periodic task VolumeManager._thread_info {{(pid=76285) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 09:53:16 devstack cinder-volume[76285]: DEBUG cinder.volume.manager [None req-d5208bff-0954-4751-8afe-d53b60b3c712 None None] thread count: 6 {{(pid=76285) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 07 09:53:16 devstack cinder-volume[76285]: DEBUG cinder.volume.manager [None req-d5208bff-0954-4751-8afe-d53b60b3c712 None None] thread info: [<_MainThread(MainThread, started 129268457140352)>, , , , , ] {{(pid=76285) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 07 09:54:15 devstack cinder-volume[76285]: DEBUG oslo_service.periodic_task [None req-d5208bff-0954-4751-8afe-d53b60b3c712 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76285) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 09:54:15 devstack cinder-volume[76285]: DEBUG cinder.volume.drivers.lvm [None req-d5208bff-0954-4751-8afe-d53b60b3c712 None None] Updating volume stats {{(pid=76285) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 07 09:54:15 devstack cinder-volume[76285]: DEBUG oslo_concurrency.processutils [None req-d5208bff-0954-4751-8afe-d53b60b3c712 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76285) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:54:15 devstack sudo[82542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 07 09:54:15 devstack sudo[82542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:54:16 devstack sudo[82542]: pam_unix(sudo:session): session closed for user root Sep 07 09:54:16 devstack cinder-volume[76285]: DEBUG oslo_concurrency.processutils [None req-d5208bff-0954-4751-8afe-d53b60b3c712 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.255s {{(pid=76285) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:54:16 devstack cinder-volume[76285]: DEBUG oslo_concurrency.processutils [None req-d5208bff-0954-4751-8afe-d53b60b3c712 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76285) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:54:16 devstack sudo[82549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 07 09:54:16 devstack sudo[82549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:54:16 devstack sudo[82549]: pam_unix(sudo:session): session closed for user root Sep 07 09:54:16 devstack cinder-volume[76285]: DEBUG oslo_concurrency.processutils [None req-d5208bff-0954-4751-8afe-d53b60b3c712 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.266s {{(pid=76285) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:54:16 devstack cinder-volume[76285]: DEBUG oslo_concurrency.processutils [None req-d5208bff-0954-4751-8afe-d53b60b3c712 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76285) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:54:16 devstack sudo[82553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 07 09:54:16 devstack sudo[82553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:54:16 devstack sudo[82553]: pam_unix(sudo:session): session closed for user root Sep 07 09:54:16 devstack cinder-volume[76285]: DEBUG oslo_concurrency.processutils [None req-d5208bff-0954-4751-8afe-d53b60b3c712 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.249s {{(pid=76285) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:54:16 devstack cinder-volume[76285]: DEBUG oslo_concurrency.processutils [None req-d5208bff-0954-4751-8afe-d53b60b3c712 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76285) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:54:16 devstack sudo[82556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 07 09:54:16 devstack sudo[82556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:54:17 devstack sudo[82556]: pam_unix(sudo:session): session closed for user root Sep 07 09:54:17 devstack cinder-volume[76285]: DEBUG oslo_concurrency.processutils [None req-d5208bff-0954-4751-8afe-d53b60b3c712 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.270s {{(pid=76285) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:54:17 devstack cinder-volume[76285]: DEBUG cinder.manager [None req-d5208bff-0954-4751-8afe-d53b60b3c712 None None] Notifying Schedulers of capabilities ... {{(pid=76285) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 09:54:17 devstack cinder-volume[76285]: DEBUG oslo_service.periodic_task [None req-d5208bff-0954-4751-8afe-d53b60b3c712 None None] Running periodic task VolumeManager._thread_info {{(pid=76285) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 09:54:17 devstack cinder-volume[76285]: DEBUG cinder.volume.manager [None req-d5208bff-0954-4751-8afe-d53b60b3c712 None None] thread count: 6 {{(pid=76285) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 07 09:54:17 devstack cinder-volume[76285]: DEBUG cinder.volume.manager [None req-d5208bff-0954-4751-8afe-d53b60b3c712 None None] thread info: [<_MainThread(MainThread, started 129268457140352)>, , , , , ] {{(pid=76285) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 07 09:54:24 devstack cinder-volume[76285]: DEBUG dbcounter [-] [76285] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=76285) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 09:55:15 devstack cinder-volume[76285]: DEBUG oslo_service.periodic_task [None req-d5208bff-0954-4751-8afe-d53b60b3c712 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76285) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 09:55:15 devstack cinder-volume[76285]: DEBUG cinder.volume.drivers.lvm [None req-d5208bff-0954-4751-8afe-d53b60b3c712 None None] Updating volume stats {{(pid=76285) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 07 09:55:15 devstack cinder-volume[76285]: DEBUG oslo_concurrency.processutils [None req-d5208bff-0954-4751-8afe-d53b60b3c712 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76285) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:55:15 devstack sudo[84990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 07 09:55:15 devstack sudo[84990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:55:16 devstack sudo[84990]: pam_unix(sudo:session): session closed for user root Sep 07 09:55:16 devstack cinder-volume[76285]: DEBUG oslo_concurrency.processutils [None req-d5208bff-0954-4751-8afe-d53b60b3c712 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.290s {{(pid=76285) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:55:16 devstack cinder-volume[76285]: DEBUG oslo_concurrency.processutils [None req-d5208bff-0954-4751-8afe-d53b60b3c712 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76285) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:55:16 devstack sudo[84993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 07 09:55:16 devstack sudo[84993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:55:16 devstack sudo[84993]: pam_unix(sudo:session): session closed for user root Sep 07 09:55:16 devstack cinder-volume[76285]: DEBUG oslo_concurrency.processutils [None req-d5208bff-0954-4751-8afe-d53b60b3c712 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.298s {{(pid=76285) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:55:16 devstack cinder-volume[76285]: DEBUG oslo_concurrency.processutils [None req-d5208bff-0954-4751-8afe-d53b60b3c712 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76285) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:55:16 devstack sudo[84999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 07 09:55:16 devstack sudo[84999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:55:16 devstack sudo[84999]: pam_unix(sudo:session): session closed for user root Sep 07 09:55:16 devstack cinder-volume[76285]: DEBUG oslo_concurrency.processutils [None req-d5208bff-0954-4751-8afe-d53b60b3c712 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.255s {{(pid=76285) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:55:16 devstack cinder-volume[76285]: DEBUG oslo_concurrency.processutils [None req-d5208bff-0954-4751-8afe-d53b60b3c712 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76285) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:55:16 devstack sudo[85002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 07 09:55:16 devstack sudo[85002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:55:17 devstack sudo[85002]: pam_unix(sudo:session): session closed for user root Sep 07 09:55:17 devstack cinder-volume[76285]: DEBUG oslo_concurrency.processutils [None req-d5208bff-0954-4751-8afe-d53b60b3c712 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.250s {{(pid=76285) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:55:17 devstack cinder-volume[76285]: DEBUG cinder.manager [None req-d5208bff-0954-4751-8afe-d53b60b3c712 None None] Notifying Schedulers of capabilities ... {{(pid=76285) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 09:56:15 devstack cinder-volume[76285]: DEBUG oslo_service.periodic_task [None req-d5208bff-0954-4751-8afe-d53b60b3c712 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76285) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 09:56:15 devstack cinder-volume[76285]: DEBUG cinder.volume.drivers.lvm [None req-d5208bff-0954-4751-8afe-d53b60b3c712 None None] Updating volume stats {{(pid=76285) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 07 09:56:15 devstack cinder-volume[76285]: DEBUG oslo_concurrency.processutils [None req-d5208bff-0954-4751-8afe-d53b60b3c712 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76285) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:56:15 devstack sudo[86257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 07 09:56:15 devstack sudo[86257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:56:16 devstack sudo[86257]: pam_unix(sudo:session): session closed for user root Sep 07 09:56:16 devstack cinder-volume[76285]: DEBUG oslo_concurrency.processutils [None req-d5208bff-0954-4751-8afe-d53b60b3c712 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.265s {{(pid=76285) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:56:16 devstack cinder-volume[76285]: DEBUG oslo_concurrency.processutils [None req-d5208bff-0954-4751-8afe-d53b60b3c712 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76285) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:56:16 devstack sudo[86271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 07 09:56:16 devstack sudo[86271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:56:16 devstack sudo[86271]: pam_unix(sudo:session): session closed for user root Sep 07 09:56:16 devstack cinder-volume[76285]: DEBUG oslo_concurrency.processutils [None req-d5208bff-0954-4751-8afe-d53b60b3c712 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.254s {{(pid=76285) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:56:16 devstack cinder-volume[76285]: DEBUG oslo_concurrency.processutils [None req-d5208bff-0954-4751-8afe-d53b60b3c712 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76285) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:56:16 devstack sudo[86274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 07 09:56:16 devstack sudo[86274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:56:16 devstack sudo[86274]: pam_unix(sudo:session): session closed for user root Sep 07 09:56:16 devstack cinder-volume[76285]: DEBUG oslo_concurrency.processutils [None req-d5208bff-0954-4751-8afe-d53b60b3c712 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.245s {{(pid=76285) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:56:16 devstack cinder-volume[76285]: DEBUG oslo_concurrency.processutils [None req-d5208bff-0954-4751-8afe-d53b60b3c712 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76285) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:56:16 devstack sudo[86277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 07 09:56:16 devstack sudo[86277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:56:17 devstack sudo[86277]: pam_unix(sudo:session): session closed for user root Sep 07 09:56:17 devstack cinder-volume[76285]: DEBUG oslo_concurrency.processutils [None req-d5208bff-0954-4751-8afe-d53b60b3c712 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.278s {{(pid=76285) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:56:17 devstack cinder-volume[76285]: DEBUG cinder.manager [None req-d5208bff-0954-4751-8afe-d53b60b3c712 None None] Notifying Schedulers of capabilities ... {{(pid=76285) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 09:56:17 devstack cinder-volume[76285]: DEBUG oslo_service.periodic_task [None req-d5208bff-0954-4751-8afe-d53b60b3c712 None None] Running periodic task VolumeManager._thread_info {{(pid=76285) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 09:56:17 devstack cinder-volume[76285]: DEBUG cinder.volume.manager [None req-d5208bff-0954-4751-8afe-d53b60b3c712 None None] thread count: 6 {{(pid=76285) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 07 09:56:17 devstack cinder-volume[76285]: DEBUG cinder.volume.manager [None req-d5208bff-0954-4751-8afe-d53b60b3c712 None None] thread info: [<_MainThread(MainThread, started 129268457140352)>, , , , , ] {{(pid=76285) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 07 09:56:24 devstack cinder-volume[76285]: DEBUG dbcounter [-] [76285] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=76285) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 09:56:29 devstack cinder-volume[76100]: INFO oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] Caught SIGTERM, stopping children Sep 07 09:56:29 devstack cinder-volume[76100]: DEBUG oslo_concurrency.lockutils [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] Acquiring lock "singleton_lock" {{(pid=76100) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 07 09:56:29 devstack cinder-volume[76100]: DEBUG oslo_concurrency.lockutils [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] Acquired lock "singleton_lock" {{(pid=76100) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 07 09:56:29 devstack cinder-volume[76100]: DEBUG oslo_concurrency.lockutils [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] Releasing lock "singleton_lock" {{(pid=76100) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 07 09:56:29 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] Stop services. {{(pid=76100) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Sep 07 09:56:29 devstack cinder-volume[76100]: DEBUG oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] Killing children. {{(pid=76100) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Sep 07 09:56:29 devstack cinder-volume[76100]: INFO oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] Waiting on 1 children to exit Sep 07 09:56:33 devstack cinder-volume[76285]: DEBUG oslo_concurrency.lockutils [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] Acquiring lock "singleton_lock" {{(pid=76285) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 07 09:56:33 devstack cinder-volume[76285]: DEBUG oslo_concurrency.lockutils [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] Acquired lock "singleton_lock" {{(pid=76285) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 07 09:56:33 devstack cinder-volume[76285]: DEBUG oslo_concurrency.lockutils [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] Releasing lock "singleton_lock" {{(pid=76285) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 07 09:56:33 devstack cinder-volume[76285]: WARNING amqp [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 07 09:56:33 devstack cinder-volume[76285]: WARNING amqp [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 07 09:56:33 devstack cinder-volume[76100]: INFO oslo_service.backend._eventlet.service [None req-a9c9fa69-aae7-48c7-9f34-651ce20a613c None None] Child 76285 exited with status 0 Sep 07 09:56:34 devstack cinder-volume[86690]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 07 09:56:34 devstack cinder-volume[86690]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 07 09:56:34 devstack cinder-volume[86690]: we strongly recommend against using it for new projects. Sep 07 09:56:34 devstack cinder-volume[86690]: If you are already using Eventlet, we recommend migrating to a different Sep 07 09:56:34 devstack cinder-volume[86690]: framework. For more detail see Sep 07 09:56:34 devstack cinder-volume[86690]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 07 09:56:34 devstack cinder-volume[86690]: import eventlet # noqa Sep 07 09:56:36 devstack cinder-volume[86690]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86690) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 07 09:56:36 devstack cinder-volume[86690]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86690) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 07 09:56:36 devstack cinder-volume[86690]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86690) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 07 09:56:36 devstack cinder-volume[86690]: INFO dbcounter [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] Registered counter for database cinder Sep 07 09:56:36 devstack cinder-volume[86690]: DEBUG oslo_db.sqlalchemy.engines [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86690) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG dbcounter [-] [86690] Writer thread running {{(pid=86690) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 07 09:56:37 devstack cinder-volume[86690]: INFO cinder.rpc [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 07 09:56:37 devstack cinder-volume[86690]: INFO cinder.rpc [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_db.sqlalchemy.engines [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86690) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 07 09:56:37 devstack cinder-volume[86690]: INFO cinder.volume.manager [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] Determined volume DB was empty at startup. Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG cinder.volume.manager [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86690) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 07 09:56:37 devstack cinder-volume[86690]: INFO cinder.volume.manager [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] Service not found for updating active_backend_id, assuming default for driver init. Sep 07 09:56:37 devstack cinder-volume[86690]: WARNING stevedore.named [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 07 09:56:37 devstack cinder-volume[86690]: WARNING castellan.key_manager [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 07 09:56:37 devstack cinder-volume[86690]: WARNING cinder.keymgr.conf_key_mgr [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 07 09:56:37 devstack cinder-volume[86690]: INFO cinder.volume.manager [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] Image-volume cache disabled for host devstack@QuobyteHD. Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_db.sqlalchemy.engines [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86690) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 07 09:56:37 devstack cinder-volume[86690]: INFO oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] Starting 1 workers Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] Started child 86863 {{(pid=86690) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] Full set of CONF: {{(pid=86690) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] ******************************************************************************** {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 07 09:56:37 devstack cinder-volume[86863]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] Configuration options gathered from: {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] ================================================================================ {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] allow_availability_zone_fallback = False {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] allow_compression_on_image_upload = False {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] allowed_direct_url_schemes = [] {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] api_rate_limit = True {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] auth_strategy = keystone {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] backend_availability_zone = None {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] backend_host = None {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] backend_name = None {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] backend_stats_polling_interval = 60 {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] backup_api_class = cinder.backup.api.API {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] backup_name_template = backup-%s {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] backup_use_same_host = False {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] backup_use_temp_snapshot = False {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] chap_password = **** {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] chap_username = {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] cinder_internal_tenant_project_id = 15f6f37df5c948c4bf4d6a35f26fa2c5 {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] cinder_internal_tenant_user_id = a5df98f8ca5c4fc88c9e8fd34523c7d9 {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] cluster = None {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] compression_format = gzip {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] compute_api_class = cinder.compute.nova.API {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] config_dir = [] {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] config_source = [] {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] control_exchange = openstack {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] debug = True {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] default_availability_zone = None {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] default_group_type = None {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] default_volume_type = QuobyteHD {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] disk_geometry = None {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] driver_client_cert = None {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] driver_client_cert_key = None {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] driver_data_namespace = None {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] driver_ssl_cert_path = None {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] driver_ssl_cert_verify = False {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] driver_use_ssl = False {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] enable_new_services = True {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] enable_unsupported_driver = False {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] enabled_backends = ['QuobyteHD'] {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] enforce_multipath_for_image_xfer = False {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] filter_function = None {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] glance_api_insecure = False {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] glance_api_servers = ['http://192.168.122.74/image'] {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] glance_api_ssl_compression = False {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] glance_ca_certificates_file = None {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] glance_catalog_info = image:glance:publicURL {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] glance_certfile = None {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] glance_keyfile = None {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] glance_num_retries = 3 {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] glance_request_timeout = None {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] goodness_function = None {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] graceful_shutdown_timeout = 5 {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] group_api_class = cinder.group.api.API {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] host = devstack {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] image_compress_on_upload = True {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] image_conversion_address_space_limit = 1 {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] image_conversion_cpu_limit = 60 {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:37 devstack cinder-volume[86863]: INFO cinder.volume.manager [None req-b0683e13-d524-421f-bc51-966122df43f6 None None] Starting volume driver QuobyteDriver (1.2.1) Sep 07 09:56:37 devstack cinder-volume[86863]: DEBUG cinder.volume.drivers.remotefs [None req-b0683e13-d524-421f-bc51-966122df43f6 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86863) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] image_conversion_disable = False {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] image_upload_use_cinder_backend = False {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] image_upload_use_internal_tenant = False {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] image_volume_cache_enabled = False {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] image_volume_cache_max_count = 0 {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] image_volume_cache_max_size_gb = 0 {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] init_host_max_objects_retrieval = 0 {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] instance_format = [instance: %(uuid)s] {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] iscsi_target_flags = {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] iscsi_write_cache = on {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] iser_helper = tgtadm {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] iser_ip_address = 192.168.122.74 {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] iser_port = 3260 {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] log_color = False {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] log_config_append = None {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] log_dir = None {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] log_file = None {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] log_options = True {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] log_rotate_interval = 1 {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] log_rotate_interval_type = days {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] log_rotation_type = none {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] max_age = 0 {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] max_logfile_count = 30 {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] max_logfile_size_mb = 200 {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] max_over_subscription_ratio = 20.0 {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] message_reap_interval = 86400 {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] message_ttl = 2592000 {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] migration_create_volume_timeout_secs = 300 {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] monkey_patch = False {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] monkey_patch_modules = [] {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] my_ip = 192.168.122.74 {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] no_snapshot_gb_quota = False {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] num_iser_scan_tries = 3 {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] num_shell_tries = 3 {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] num_volume_device_scan_tries = 3 {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] nvmeof_conn_info_version = 1 {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] nvmet_ns_id = 10 {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] nvmet_port_id = 1 {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] osapi_max_limit = 1000 {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] osapi_volume_ext_list = [] {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] osapi_volume_listen = 0.0.0.0 {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] osapi_volume_listen_port = 8776 {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] osapi_volume_use_ssl = False {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] osapi_volume_workers = None {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] per_volume_size_limit = -1 {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] periodic_fuzzy_delay = 60 {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] periodic_interval = 60 {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] project_id_regex = [0-9a-f\-]+ {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] public_endpoint = None {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] publish_errors = False {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] quota_backup_gigabytes = 1000 {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] quota_backups = 10 {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] quota_gigabytes = 1000 {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] quota_groups = 10 {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] quota_snapshots = 10 {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] quota_volumes = 10 {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] rate_limit_burst = 0 {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] rate_limit_except_level = CRITICAL {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] rate_limit_interval = 0 {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] reinit_driver_count = 3 {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] replication_device = **** {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] report_discard_supported = False {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] report_interval = 120 {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] reservation_clean_interval = 86400 {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] reservation_expire = 86400 {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] reserved_image_namespaces = [] {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] reserved_percentage = 0 {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] rpc_response_timeout = 120 {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] run_external_periodic_tasks = True {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] scst_target_driver = iscsi {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] scst_target_iqn_name = None {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] service_down_time = 720 {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] shell_completion = None {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] snapshot_name_template = snapshot-%s {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] split_loggers = False {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] state_path = /opt/stack/data/cinder {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] storage_availability_zone = nova {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] storage_protocol = iSCSI {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] syslog_log_facility = LOG_USER {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] target_helper = lioadm {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] target_ip_address = 192.168.122.74 {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] target_port = 3260 {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] target_protocol = iscsi {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] target_secondary_ip_addresses = [] {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] trace_flags = None {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] transfer_api_class = cinder.transfer.api.API {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] transport_url = **** {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] until_refresh = 0 {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] use_chap_auth = False {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] use_default_quota_class = True {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] use_journal = False {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] use_json = False {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] use_multipath_for_image_xfer = False {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] use_stderr = False {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] use_syslog = False {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] verify_glance_signatures = enabled {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] volume_api_class = cinder.volume.api.API {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] volume_backend_name = None {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] volume_clear = zero {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] volume_clear_ionice = None {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] volume_clear_size = 0 {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] volume_copy_bps_limit = 0 {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] volume_dd_blocksize = 1M {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] volume_name_template = volume-%s {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] volume_service_inithost_offload = False {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] volume_usage_audit_period = month {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] zoning_mode = None {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] oslo_concurrency.disable_process_locking = False {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] keystone_authtoken.auth_section = None {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] keystone_authtoken.auth_type = password {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] keystone_authtoken.auth_version = None {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] keystone_authtoken.cache = None {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] keystone_authtoken.certfile = None {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] keystone_authtoken.delay_auth_decision = False {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] keystone_authtoken.http_connect_timeout = None {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] keystone_authtoken.include_service_catalog = True {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] keystone_authtoken.insecure = False {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] keystone_authtoken.interface = public {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] keystone_authtoken.keyfile = None {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] keystone_authtoken.memcache_password = **** {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86863]: DEBUG cinder.volume.drivers.quobyte [None req-b0683e13-d524-421f-bc51-966122df43f6 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86863) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Sep 07 09:56:37 devstack cinder-volume[86863]: WARNING cinder.volume.drivers.quobyte [None req-b0683e13-d524-421f-bc51-966122df43f6 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Sep 07 09:56:37 devstack cinder-volume[86863]: WARNING cinder.volume.drivers.quobyte [None req-b0683e13-d524-421f-bc51-966122df43f6 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Sep 07 09:56:37 devstack cinder-volume[86863]: DEBUG oslo_concurrency.processutils [None req-b0683e13-d524-421f-bc51-966122df43f6 None None] Running cmd (subprocess): mount.quobyte {{(pid=86863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] keystone_authtoken.memcache_username = None {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] keystone_authtoken.region_name = None {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] keystone_authtoken.service_token_roles_required = True {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] keystone_authtoken.service_type = None {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] keystone_authtoken.token_cache_time = 300 {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.74/identity {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] cache.backend = dogpile.cache.null {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] cache.backend_argument = **** {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] cache.backend_expiration_time = None {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] cache.config_prefix = cache.oslo {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] cache.debug_cache_backend = False {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] cache.enable_retry_client = False {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] cache.enable_socket_keepalive = False {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] cache.enabled = False {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] cache.expiration_time = 600 {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] cache.hashclient_retry_attempts = 2 {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] cache.memcache_dead_retry = 300 {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] cache.memcache_pool_maxsize = 10 {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] cache.memcache_sasl_enabled = False {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] cache.password = **** {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] cache.proxies = [] {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] cache.redis_db = 0 {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] cache.redis_sentinel_service_name = mymaster {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] cache.redis_server = localhost:6379 {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] cache.retry_attempts = 2 {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] cache.retry_delay = 0.0 {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] cache.socket_keepalive_count = 1 {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] cache.socket_keepalive_idle = 1 {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] cache.socket_keepalive_interval = 1 {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] cache.socket_timeout = 1.0 {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] cache.tls_allowed_ciphers = None {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] cache.tls_cafile = None {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] cache.tls_certfile = None {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] cache.tls_enabled = False {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] cache.tls_keyfile = None {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] cache.username = None {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] coordination.backend_url = **** {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] database.asyncio_connection = **** {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] database.asyncio_slave_connection = **** {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] database.backend = sqlalchemy {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] database.connection = **** {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] database.connection_debug = 0 {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] database.connection_parameters = {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] database.connection_recycle_time = 3600 {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] database.connection_trace = False {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] database.db_inc_retry_interval = True {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] database.db_max_retries = 20 {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] database.db_max_retry_interval = 10 {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] database.db_retry_interval = 1 {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] database.max_overflow = 50 {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] database.max_pool_size = 5 {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] database.max_retries = 10 {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] database.mysql_wsrep_sync_wait = None {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] database.pool_timeout = None {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] database.retry_interval = 10 {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] database.slave_connection = **** {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] database.sqlite_synchronous = True {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] database.synchronous_reader = True {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] database.use_db_reconnect = False {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] oslo_messaging_tracing.insecure = False {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] profiler.connection_string = messaging:// {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] profiler.enabled = False {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] profiler.es_doc_type = notification {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] profiler.es_scroll_size = 10000 {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] profiler.es_scroll_time = 2m {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] profiler.filter_error_trace = False {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] profiler.hmac_keys = **** {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] profiler.sentinel_service_name = mymaster {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] profiler.socket_timeout = 0.1 {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] profiler.trace_requests = False {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] profiler.trace_sqlalchemy = False {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] profiler_jaeger.process_tags = {} {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] profiler_jaeger.service_name_prefix = None {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] profiler_otlp.service_name_prefix = None {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] oslo_policy.enforce_new_defaults = True {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] oslo_policy.policy_default_rule = default {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] oslo_policy.policy_file = policy.yaml {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] oslo_policy.remote_timeout = 60.0 {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] privsep_osbrick.group = None {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] privsep_osbrick.helper_command = None {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] privsep_osbrick.user = None {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] cinder_sys_admin.group = None {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] cinder_sys_admin.helper_command = None {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] cinder_sys_admin.user = None {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] service_user.auth_section = None {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] service_user.auth_type = password {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] service_user.cafile = None {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] service_user.certfile = None {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] service_user.collect_timing = False {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] service_user.insecure = False {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] service_user.keyfile = None {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] service_user.send_service_user_token = True {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] service_user.split_loggers = False {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] service_user.timeout = None {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] service_user.tls_ciphers = None {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] service_user.tls_min_version = None {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] glance.auth_section = None {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] glance.auth_type = password {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] glance.certfile = None {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] glance.collect_timing = False {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] glance.insecure = False {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] glance.keyfile = None {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] glance.region_name = None {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] glance.split_loggers = False {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] glance.timeout = None {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] glance.tls_ciphers = None {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] glance.tls_min_version = None {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] backend_defaults.backend_availability_zone = None {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] backend_defaults.chap_password = **** {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] backend_defaults.chap_username = {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] backend_defaults.disk_geometry = None {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] backend_defaults.driver_client_cert = None {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] backend_defaults.driver_client_cert_key = None {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] backend_defaults.driver_data_namespace = None {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] backend_defaults.driver_use_ssl = False {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] backend_defaults.enable_unsupported_driver = False {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] backend_defaults.extra_capabilities = {} {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] backend_defaults.filter_function = None {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] backend_defaults.goodness_function = None {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] backend_defaults.iscsi_target_flags = {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] backend_defaults.iscsi_write_cache = on {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack quobyte-client[86912]: Reading configuration file: /etc/quobyte/client.cfg Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] backend_defaults.iser_helper = tgtadm {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] backend_defaults.iser_ip_address = 192.168.122.74 {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack quobyte-client[86912]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Sep 07 09:56:37 devstack cinder-volume[86863]: DEBUG oslo_concurrency.processutils [None req-b0683e13-d524-421f-bc51-966122df43f6 None None] CMD "mount.quobyte" returned: 1 in 0.118s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:56:37 devstack cinder-volume[86863]: DEBUG oslo_concurrency.lockutils [None req-b0683e13-d524-421f-bc51-966122df43f6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] backend_defaults.iser_port = 3260 {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86863]: DEBUG oslo_concurrency.lockutils [None req-b0683e13-d524-421f-bc51-966122df43f6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:56:37 devstack cinder-volume[86863]: DEBUG cinder.volume.drivers.quobyte [None req-b0683e13-d524-421f-bc51-966122df43f6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=86863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 09:56:37 devstack cinder-volume[86863]: INFO cinder.volume.drivers.quobyte [None req-b0683e13-d524-421f-bc51-966122df43f6 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c ... Sep 07 09:56:37 devstack cinder-volume[86863]: DEBUG oslo_concurrency.processutils [None req-b0683e13-d524-421f-bc51-966122df43f6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a -c /etc/quobyte/client-cinder.cfg {{(pid=86863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] backend_defaults.nas_host = {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] backend_defaults.nas_login = admin {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] backend_defaults.nas_mount_options = None {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] backend_defaults.nas_password = **** {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] backend_defaults.nas_private_key = {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] backend_defaults.nas_share_path = {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] backend_defaults.nas_ssh_port = 22 {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] backend_defaults.num_shell_tries = 3 {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] backend_defaults.nvmet_port_id = 1 {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] backend_defaults.quobyte_client_cfg = None {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] backend_defaults.quobyte_volume_url = None {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] backend_defaults.replication_device = **** {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] backend_defaults.report_discard_supported = False {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] backend_defaults.reserved_percentage = 0 {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] backend_defaults.scst_target_driver = iscsi {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] backend_defaults.scst_target_iqn_name = None {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] backend_defaults.storage_protocol = iSCSI {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] backend_defaults.target_helper = tgtadm {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] backend_defaults.target_ip_address = 192.168.122.74 {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] backend_defaults.target_port = 3260 {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] backend_defaults.target_protocol = iscsi {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] backend_defaults.trace_flags = None {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] backend_defaults.unique_fqdn_network = True {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] backend_defaults.use_chap_auth = False {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] backend_defaults.volume_backend_name = None {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] backend_defaults.volume_clear = zero {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] backend_defaults.volume_clear_ionice = None {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] backend_defaults.volume_clear_size = 0 {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] oslo_reports.file_event_handler = None {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] oslo_reports.log_dir = None {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] QuobyteHD.backend_availability_zone = None {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] QuobyteHD.backend_host = None {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] QuobyteHD.chap_password = **** {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] QuobyteHD.chap_username = None {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] QuobyteHD.chiscsi_conf = None {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] QuobyteHD.disk_geometry = None {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] QuobyteHD.driver_client_cert = None {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] QuobyteHD.driver_client_cert_key = None {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] QuobyteHD.driver_data_namespace = None {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] QuobyteHD.driver_use_ssl = None {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] QuobyteHD.enable_unsupported_driver = None {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] QuobyteHD.extra_capabilities = None {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] QuobyteHD.filter_function = None {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] QuobyteHD.goodness_function = None {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack sudo[86913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a -c /etc/quobyte/client-cinder.cfg Sep 07 09:56:37 devstack sudo[86913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] QuobyteHD.iscsi_target_flags = None {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] QuobyteHD.iscsi_write_cache = None {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] QuobyteHD.iser_helper = None {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] QuobyteHD.iser_ip_address = None {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] QuobyteHD.iser_port = None {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] QuobyteHD.iser_target_prefix = None {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] QuobyteHD.nas_host = None {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] QuobyteHD.nas_login = None {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] QuobyteHD.nas_mount_options = None {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] QuobyteHD.nas_password = **** {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] QuobyteHD.nas_private_key = None {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] QuobyteHD.nas_share_path = None {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] QuobyteHD.nas_ssh_port = None {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] QuobyteHD.num_shell_tries = None {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] QuobyteHD.nvmet_ns_id = None {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] QuobyteHD.nvmet_port_id = None {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] QuobyteHD.replication_device = **** {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] QuobyteHD.report_discard_supported = None {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] QuobyteHD.reserved_percentage = None {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] QuobyteHD.scst_target_driver = None {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] QuobyteHD.storage_protocol = None {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] QuobyteHD.target_helper = None {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] QuobyteHD.target_ip_address = None {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] QuobyteHD.target_port = None {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] QuobyteHD.target_prefix = None {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] QuobyteHD.target_protocol = None {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] QuobyteHD.trace_flags = None {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] QuobyteHD.unique_fqdn_network = None {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] QuobyteHD.use_chap_auth = None {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] QuobyteHD.volume_clear = None {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] QuobyteHD.volume_clear_ionice = None {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] QuobyteHD.volume_clear_size = None {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:37 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:38 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:38 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] QuobyteHD.volumes_dir = None {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:38 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:38 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:38 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:38 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:38 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:38 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:38 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:38 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:38 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:38 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:38 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:38 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:38 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:38 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:38 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:38 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:38 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:38 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:38 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:38 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:38 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:38 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:38 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:38 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:38 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:38 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:38 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:38 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:38 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:38 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] oslo_messaging_rabbit.ssl = False {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:38 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:38 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:38 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:38 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:38 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:38 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] oslo_messaging_rabbit.ssl_version = {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:38 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:38 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] oslo_messaging_notifications.driver = [] {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:38 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] oslo_messaging_notifications.retry = -1 {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:38 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:38 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] oslo_messaging_notifications.transport_url = **** {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:38 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:38 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] key_manager.fixed_key = **** {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:38 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:38 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] barbican.barbican_api_version = None {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:38 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] barbican.barbican_endpoint = None {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:38 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] barbican.barbican_endpoint_type = public {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:38 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] barbican.barbican_region_name = None {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:38 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] barbican.cafile = None {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:38 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] barbican.certfile = None {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:38 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] barbican.collect_timing = False {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:38 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] barbican.insecure = False {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:38 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] barbican.keyfile = None {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:38 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] barbican.number_of_retries = 60 {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:38 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] barbican.retry_delay = 1 {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:38 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] barbican.send_service_user_token = False {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:38 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] barbican.split_loggers = False {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:38 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] barbican.timeout = None {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:38 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] barbican.tls_ciphers = None {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:38 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] barbican.tls_min_version = None {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:38 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] barbican.verify_ssl = True {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:38 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] barbican.verify_ssl_path = None {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:38 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] barbican_service_user.auth_section = None {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:38 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] barbican_service_user.auth_type = None {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:38 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] barbican_service_user.cafile = None {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:38 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] barbican_service_user.certfile = None {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:38 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] barbican_service_user.collect_timing = False {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:38 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] barbican_service_user.insecure = False {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:38 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] barbican_service_user.keyfile = None {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:38 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] barbican_service_user.split_loggers = False {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:38 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] barbican_service_user.timeout = None {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:38 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] barbican_service_user.tls_ciphers = None {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:38 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] barbican_service_user.tls_min_version = None {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:38 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] vault.approle_role_id = **** {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:38 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] vault.approle_secret_id = **** {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:38 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] vault.auth_method = approle {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:38 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] vault.auth_path = None {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:38 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] vault.kv_mountpoint = secret {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:38 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] vault.kv_path = None {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:38 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] vault.kv_version = 2 {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:38 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] vault.namespace = None {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:38 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] vault.root_token_id = **** {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:38 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] vault.ssl_ca_crt_file = None {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:38 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] vault.timeout = 60.0 {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:38 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] vault.token_file = None {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:38 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] vault.token_role = None {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:38 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] vault.use_ssl = False {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:38 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:38 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] ******************************************************************************** {{(pid=86690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 07 09:56:38 devstack sudo[86913]: pam_unix(sudo:session): session closed for user root Sep 07 09:56:38 devstack cinder-volume[86863]: DEBUG oslo_concurrency.processutils [None req-b0683e13-d524-421f-bc51-966122df43f6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.498s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:56:38 devstack cinder-volume[86863]: INFO cinder.volume.drivers.quobyte [None req-b0683e13-d524-421f-bc51-966122df43f6 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c succeeded Sep 07 09:56:38 devstack cinder-volume[86863]: DEBUG cinder.volume.drivers.quobyte [None req-b0683e13-d524-421f-bc51-966122df43f6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=86863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 09:56:38 devstack cinder-volume[86863]: DEBUG oslo_concurrency.lockutils [None req-b0683e13-d524-421f-bc51-966122df43f6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.511s {{(pid=86863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:56:38 devstack cinder-volume[86863]: DEBUG oslo_concurrency.processutils [None req-b0683e13-d524-421f-bc51-966122df43f6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a {{(pid=86863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:56:38 devstack sudo[86987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a Sep 07 09:56:38 devstack sudo[86987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:56:38 devstack sudo[86987]: pam_unix(sudo:session): session closed for user root Sep 07 09:56:38 devstack cinder-volume[86863]: DEBUG oslo_concurrency.processutils [None req-b0683e13-d524-421f-bc51-966122df43f6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a" returned: 0 in 0.264s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:56:38 devstack cinder-volume[86863]: INFO cinder.volume.driver [None req-b0683e13-d524-421f-bc51-966122df43f6 None None] Driver hasn't implemented _init_vendor_properties() Sep 07 09:56:38 devstack cinder-volume[86863]: DEBUG cinder.volume.driver [None req-b0683e13-d524-421f-bc51-966122df43f6 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.600959777832, 'free_capacity_gb': 1773.600959777832, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86863) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 07 09:56:38 devstack cinder-volume[86863]: DEBUG oslo_db.sqlalchemy.engines [None req-b0683e13-d524-421f-bc51-966122df43f6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86863) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 07 09:56:38 devstack cinder-volume[86863]: DEBUG dbcounter [-] [86863] Writer thread running {{(pid=86863) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 07 09:56:38 devstack cinder-volume[86863]: DEBUG cinder.db.api [None req-b0683e13-d524-421f-bc51-966122df43f6 None None] Building query based on filter {{(pid=86863) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 07 09:56:38 devstack cinder-volume[86863]: DEBUG cinder.image.image_utils [None req-b0683e13-d524-421f-bc51-966122df43f6 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86863) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Sep 07 09:56:38 devstack cinder-volume[86863]: INFO cinder.keymgr.migration [None req-5b283062-8590-4557-b364-a9d2c685038a None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 07 09:56:38 devstack cinder-volume[86863]: DEBUG oslo_concurrency.lockutils [None req-b0683e13-d524-421f-bc51-966122df43f6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:56:38 devstack cinder-volume[86863]: DEBUG oslo_concurrency.lockutils [None req-b0683e13-d524-421f-bc51-966122df43f6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:56:38 devstack cinder-volume[86863]: DEBUG cinder.volume.drivers.quobyte [None req-b0683e13-d524-421f-bc51-966122df43f6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=86863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 09:56:38 devstack cinder-volume[86863]: DEBUG cinder.volume.drivers.quobyte [None req-b0683e13-d524-421f-bc51-966122df43f6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=86863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 09:56:38 devstack cinder-volume[86863]: DEBUG oslo_concurrency.lockutils [None req-b0683e13-d524-421f-bc51-966122df43f6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:56:38 devstack cinder-volume[86863]: DEBUG oslo_concurrency.processutils [None req-b0683e13-d524-421f-bc51-966122df43f6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a {{(pid=86863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:56:38 devstack sudo[86990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a Sep 07 09:56:38 devstack sudo[86990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:56:39 devstack sudo[86990]: pam_unix(sudo:session): session closed for user root Sep 07 09:56:39 devstack cinder-volume[86863]: DEBUG oslo_concurrency.processutils [None req-b0683e13-d524-421f-bc51-966122df43f6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a" returned: 0 in 0.237s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:56:39 devstack cinder-volume[86863]: DEBUG cinder.manager [None req-b0683e13-d524-421f-bc51-966122df43f6 None None] Notifying Schedulers of capabilities ... {{(pid=86863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 09:56:39 devstack cinder-volume[86863]: INFO cinder.volume.manager [None req-b0683e13-d524-421f-bc51-966122df43f6 None None] Driver initialization completed successfully. Sep 07 09:56:39 devstack cinder-volume[86863]: INFO cinder.manager [None req-b0683e13-d524-421f-bc51-966122df43f6 None None] Initiating service 3 cleanup Sep 07 09:56:39 devstack cinder-volume[86863]: INFO cinder.manager [None req-b0683e13-d524-421f-bc51-966122df43f6 None None] Service 3 cleanup completed. Sep 07 09:56:39 devstack cinder-volume[86863]: DEBUG cinder.service [None req-b0683e13-d524-421f-bc51-966122df43f6 None None] Creating RPC server for service cinder-volume {{(pid=86863) start /opt/stack/cinder/cinder/service.py:231}} Sep 07 09:56:39 devstack cinder-volume[86863]: DEBUG cinder.service [None req-b0683e13-d524-421f-bc51-966122df43f6 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86863) start /opt/stack/cinder/cinder/service.py:237}} Sep 07 09:56:39 devstack cinder-volume[86863]: INFO cinder.volume.manager [None req-b0683e13-d524-421f-bc51-966122df43f6 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Sep 07 09:56:39 devstack cinder-volume[86863]: DEBUG oslo_concurrency.lockutils [None req-b0683e13-d524-421f-bc51-966122df43f6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:56:39 devstack cinder-volume[86863]: DEBUG oslo_concurrency.lockutils [None req-b0683e13-d524-421f-bc51-966122df43f6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:56:39 devstack cinder-volume[86863]: DEBUG cinder.volume.drivers.quobyte [None req-b0683e13-d524-421f-bc51-966122df43f6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=86863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 09:56:39 devstack cinder-volume[86863]: DEBUG cinder.volume.drivers.quobyte [None req-b0683e13-d524-421f-bc51-966122df43f6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=86863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 09:56:39 devstack cinder-volume[86863]: DEBUG oslo_concurrency.lockutils [None req-b0683e13-d524-421f-bc51-966122df43f6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:56:39 devstack cinder-volume[86863]: DEBUG oslo_concurrency.processutils [None req-b0683e13-d524-421f-bc51-966122df43f6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a {{(pid=86863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:56:39 devstack sudo[86993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a Sep 07 09:56:39 devstack sudo[86993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:56:39 devstack sudo[86993]: pam_unix(sudo:session): session closed for user root Sep 07 09:56:39 devstack cinder-volume[86863]: DEBUG oslo_concurrency.processutils [None req-b0683e13-d524-421f-bc51-966122df43f6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a" returned: 0 in 0.252s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:56:39 devstack cinder-volume[86863]: INFO cinder.volume.manager [None req-b0683e13-d524-421f-bc51-966122df43f6 None None] Driver post RPC initialization completed successfully. Sep 07 09:56:43 devstack cinder-volume[86690]: INFO oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] Caught SIGTERM, stopping children Sep 07 09:56:43 devstack cinder-volume[86690]: DEBUG oslo_concurrency.lockutils [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] Acquiring lock "singleton_lock" {{(pid=86690) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 07 09:56:43 devstack cinder-volume[86690]: DEBUG oslo_concurrency.lockutils [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] Acquired lock "singleton_lock" {{(pid=86690) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 07 09:56:43 devstack cinder-volume[86690]: DEBUG oslo_concurrency.lockutils [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] Releasing lock "singleton_lock" {{(pid=86690) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 07 09:56:43 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] Stop services. {{(pid=86690) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Sep 07 09:56:43 devstack cinder-volume[86690]: DEBUG oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] Killing children. {{(pid=86690) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Sep 07 09:56:43 devstack cinder-volume[86690]: INFO oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] Waiting on 1 children to exit Sep 07 09:56:47 devstack cinder-volume[86863]: DEBUG oslo_concurrency.lockutils [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] Acquiring lock "singleton_lock" {{(pid=86863) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 07 09:56:47 devstack cinder-volume[86863]: DEBUG oslo_concurrency.lockutils [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] Acquired lock "singleton_lock" {{(pid=86863) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 07 09:56:47 devstack cinder-volume[86863]: DEBUG oslo_concurrency.lockutils [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] Releasing lock "singleton_lock" {{(pid=86863) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 07 09:56:47 devstack cinder-volume[86863]: WARNING amqp [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 07 09:56:47 devstack cinder-volume[86863]: WARNING amqp [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 07 09:56:47 devstack cinder-volume[86690]: INFO oslo_service.backend._eventlet.service [None req-8fa94a05-3a36-4420-b833-789e19f3ec1e None None] Child 86863 exited with status 0 Sep 07 09:56:48 devstack cinder-volume[87196]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 07 09:56:48 devstack cinder-volume[87196]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 07 09:56:48 devstack cinder-volume[87196]: we strongly recommend against using it for new projects. Sep 07 09:56:48 devstack cinder-volume[87196]: If you are already using Eventlet, we recommend migrating to a different Sep 07 09:56:48 devstack cinder-volume[87196]: framework. For more detail see Sep 07 09:56:48 devstack cinder-volume[87196]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 07 09:56:48 devstack cinder-volume[87196]: import eventlet # noqa Sep 07 09:56:50 devstack cinder-volume[87196]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=87196) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 07 09:56:50 devstack cinder-volume[87196]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=87196) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 07 09:56:50 devstack cinder-volume[87196]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=87196) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 07 09:56:51 devstack cinder-volume[87196]: INFO dbcounter [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] Registered counter for database cinder Sep 07 09:56:51 devstack cinder-volume[87196]: DEBUG oslo_db.sqlalchemy.engines [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87196) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG dbcounter [-] [87196] Writer thread running {{(pid=87196) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 07 09:56:52 devstack cinder-volume[87196]: INFO cinder.rpc [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 07 09:56:52 devstack cinder-volume[87196]: INFO cinder.rpc [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_db.sqlalchemy.engines [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87196) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 07 09:56:52 devstack cinder-volume[87196]: INFO cinder.volume.manager [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] Determined volume DB was empty at startup. Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG cinder.volume.manager [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=87196) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 07 09:56:52 devstack cinder-volume[87196]: WARNING stevedore.named [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 07 09:56:52 devstack cinder-volume[87196]: WARNING castellan.key_manager [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 07 09:56:52 devstack cinder-volume[87196]: WARNING cinder.keymgr.conf_key_mgr [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 07 09:56:52 devstack cinder-volume[87196]: INFO cinder.volume.manager [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] Image-volume cache disabled for host devstack@QuobyteHD. Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_db.sqlalchemy.engines [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87196) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 07 09:56:52 devstack cinder-volume[87196]: INFO oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] Starting 1 workers Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] Started child 87515 {{(pid=87196) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] Full set of CONF: {{(pid=87196) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] ******************************************************************************** {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] Configuration options gathered from: {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] ================================================================================ {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] allow_availability_zone_fallback = False {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] allow_compression_on_image_upload = False {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] allowed_direct_url_schemes = [] {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] api_rate_limit = True {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:52 devstack cinder-volume[87515]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] auth_strategy = keystone {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] backend_availability_zone = None {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] backend_host = None {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] backend_name = None {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] backend_stats_polling_interval = 60 {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] backup_api_class = cinder.backup.api.API {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] backup_name_template = backup-%s {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] backup_use_same_host = False {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] backup_use_temp_snapshot = False {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] chap_password = **** {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] chap_username = {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] cinder_internal_tenant_project_id = 15f6f37df5c948c4bf4d6a35f26fa2c5 {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] cinder_internal_tenant_user_id = a5df98f8ca5c4fc88c9e8fd34523c7d9 {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] cluster = None {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] compression_format = gzip {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] compute_api_class = cinder.compute.nova.API {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] config_dir = [] {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] config_source = [] {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] control_exchange = openstack {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] debug = True {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] default_availability_zone = None {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] default_group_type = None {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] default_volume_type = QuobyteHD {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] disk_geometry = None {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] driver_client_cert = None {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] driver_client_cert_key = None {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] driver_data_namespace = None {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] driver_ssl_cert_path = None {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] driver_ssl_cert_verify = False {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] driver_use_ssl = False {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] enable_new_services = True {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] enable_unsupported_driver = False {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] enabled_backends = ['QuobyteHD'] {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] enforce_multipath_for_image_xfer = False {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] filter_function = None {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] glance_api_insecure = False {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] glance_api_servers = ['http://192.168.122.74/image'] {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] glance_api_ssl_compression = False {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] glance_ca_certificates_file = None {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] glance_catalog_info = image:glance:publicURL {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] glance_certfile = None {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] glance_keyfile = None {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] glance_num_retries = 3 {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] glance_request_timeout = None {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] goodness_function = None {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] graceful_shutdown_timeout = 5 {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] group_api_class = cinder.group.api.API {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] host = devstack {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] image_compress_on_upload = True {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] image_conversion_address_space_limit = 1 {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] image_conversion_cpu_limit = 60 {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] image_conversion_disable = False {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] image_upload_use_cinder_backend = False {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] image_upload_use_internal_tenant = False {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] image_volume_cache_enabled = False {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] image_volume_cache_max_count = 0 {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] image_volume_cache_max_size_gb = 0 {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] init_host_max_objects_retrieval = 0 {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] instance_format = [instance: %(uuid)s] {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] iscsi_target_flags = {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] iscsi_write_cache = on {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] iser_helper = tgtadm {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] iser_ip_address = 192.168.122.74 {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] iser_port = 3260 {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] log_color = False {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] log_config_append = None {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:52 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-a652638b-346d-44e3-9bf9-b210475c54cb None None] Starting volume driver QuobyteDriver (1.2.1) Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] log_dir = None {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] log_file = None {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] log_options = True {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] log_rotate_interval = 1 {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] log_rotate_interval_type = days {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] log_rotation_type = none {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] max_age = 0 {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:52 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-a652638b-346d-44e3-9bf9-b210475c54cb None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=87515) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] max_logfile_count = 30 {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] max_logfile_size_mb = 200 {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] max_over_subscription_ratio = 20.0 {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] message_reap_interval = 86400 {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] message_ttl = 2592000 {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] migration_create_volume_timeout_secs = 300 {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] monkey_patch = False {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] monkey_patch_modules = [] {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] my_ip = 192.168.122.74 {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] no_snapshot_gb_quota = False {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] num_iser_scan_tries = 3 {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] num_shell_tries = 3 {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] num_volume_device_scan_tries = 3 {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] nvmeof_conn_info_version = 1 {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] nvmet_ns_id = 10 {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] nvmet_port_id = 1 {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] osapi_max_limit = 1000 {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] osapi_volume_ext_list = [] {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] osapi_volume_listen = 0.0.0.0 {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] osapi_volume_listen_port = 8776 {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] osapi_volume_use_ssl = False {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] osapi_volume_workers = None {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] per_volume_size_limit = -1 {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] periodic_fuzzy_delay = 60 {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] periodic_interval = 60 {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] project_id_regex = [0-9a-f\-]+ {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] public_endpoint = None {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] publish_errors = False {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] quota_backup_gigabytes = 1000 {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] quota_backups = 10 {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] quota_gigabytes = 1000 {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] quota_groups = 10 {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] quota_snapshots = 10 {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] quota_volumes = 10 {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] rate_limit_burst = 0 {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] rate_limit_except_level = CRITICAL {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] rate_limit_interval = 0 {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] reinit_driver_count = 3 {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] replication_device = **** {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] report_discard_supported = False {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] report_interval = 120 {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] reservation_clean_interval = 86400 {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] reservation_expire = 86400 {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] reserved_image_namespaces = [] {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] reserved_percentage = 0 {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] rpc_response_timeout = 120 {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] run_external_periodic_tasks = True {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] scst_target_driver = iscsi {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] scst_target_iqn_name = None {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] service_down_time = 720 {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] shell_completion = None {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] snapshot_name_template = snapshot-%s {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] split_loggers = False {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] state_path = /opt/stack/data/cinder {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] storage_availability_zone = nova {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] storage_protocol = iSCSI {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] syslog_log_facility = LOG_USER {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] target_helper = lioadm {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] target_ip_address = 192.168.122.74 {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] target_port = 3260 {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] target_protocol = iscsi {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] target_secondary_ip_addresses = [] {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] trace_flags = None {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] transfer_api_class = cinder.transfer.api.API {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] transport_url = **** {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] until_refresh = 0 {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] use_chap_auth = False {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] use_default_quota_class = True {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] use_journal = False {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] use_json = False {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] use_multipath_for_image_xfer = False {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] use_stderr = False {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] use_syslog = False {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] verify_glance_signatures = enabled {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] volume_api_class = cinder.volume.api.API {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] volume_backend_name = None {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] volume_clear = zero {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] volume_clear_ionice = None {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] volume_clear_size = 0 {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] volume_copy_bps_limit = 0 {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] volume_dd_blocksize = 1M {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] volume_name_template = volume-%s {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] volume_service_inithost_offload = False {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] volume_usage_audit_period = month {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] zoning_mode = None {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] oslo_concurrency.disable_process_locking = False {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] keystone_authtoken.auth_section = None {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] keystone_authtoken.auth_type = password {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] keystone_authtoken.auth_version = None {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] keystone_authtoken.cache = None {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] keystone_authtoken.certfile = None {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] keystone_authtoken.delay_auth_decision = False {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] keystone_authtoken.http_connect_timeout = None {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] keystone_authtoken.include_service_catalog = True {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] keystone_authtoken.insecure = False {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] keystone_authtoken.interface = public {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] keystone_authtoken.keyfile = None {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] keystone_authtoken.memcache_password = **** {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-a652638b-346d-44e3-9bf9-b210475c54cb None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=87515) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Sep 07 09:56:52 devstack cinder-volume[87515]: WARNING cinder.volume.drivers.quobyte [None req-a652638b-346d-44e3-9bf9-b210475c54cb None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87515]: WARNING cinder.volume.drivers.quobyte [None req-a652638b-346d-44e3-9bf9-b210475c54cb None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-a652638b-346d-44e3-9bf9-b210475c54cb None None] Running cmd (subprocess): mount.quobyte {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] keystone_authtoken.memcache_username = None {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] keystone_authtoken.region_name = None {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] keystone_authtoken.service_token_roles_required = True {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] keystone_authtoken.service_type = None {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] keystone_authtoken.token_cache_time = 300 {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.74/identity {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] cache.backend = dogpile.cache.null {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] cache.backend_argument = **** {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] cache.backend_expiration_time = None {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] cache.config_prefix = cache.oslo {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] cache.debug_cache_backend = False {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] cache.enable_retry_client = False {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] cache.enable_socket_keepalive = False {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] cache.enabled = False {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] cache.expiration_time = 600 {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] cache.hashclient_retry_attempts = 2 {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] cache.memcache_dead_retry = 300 {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] cache.memcache_pool_maxsize = 10 {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] cache.memcache_sasl_enabled = False {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] cache.password = **** {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] cache.proxies = [] {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] cache.redis_db = 0 {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] cache.redis_sentinel_service_name = mymaster {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] cache.redis_server = localhost:6379 {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] cache.retry_attempts = 2 {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] cache.retry_delay = 0.0 {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] cache.socket_keepalive_count = 1 {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] cache.socket_keepalive_idle = 1 {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] cache.socket_keepalive_interval = 1 {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] cache.socket_timeout = 1.0 {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] cache.tls_allowed_ciphers = None {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] cache.tls_cafile = None {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] cache.tls_certfile = None {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] cache.tls_enabled = False {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] cache.tls_keyfile = None {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] cache.username = None {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] coordination.backend_url = **** {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] database.asyncio_connection = **** {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] database.asyncio_slave_connection = **** {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] database.backend = sqlalchemy {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] database.connection = **** {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] database.connection_debug = 0 {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] database.connection_parameters = {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] database.connection_recycle_time = 3600 {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] database.connection_trace = False {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] database.db_inc_retry_interval = True {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] database.db_max_retries = 20 {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] database.db_max_retry_interval = 10 {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] database.db_retry_interval = 1 {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] database.max_overflow = 50 {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] database.max_pool_size = 5 {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] database.max_retries = 10 {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] database.mysql_wsrep_sync_wait = None {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] database.pool_timeout = None {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] database.retry_interval = 10 {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] database.slave_connection = **** {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] database.sqlite_synchronous = True {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] database.synchronous_reader = True {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] database.use_db_reconnect = False {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] oslo_messaging_tracing.insecure = False {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] profiler.connection_string = messaging:// {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] profiler.enabled = False {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] profiler.es_doc_type = notification {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] profiler.es_scroll_size = 10000 {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack quobyte-client[87516]: Reading configuration file: /etc/quobyte/client.cfg Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] profiler.es_scroll_time = 2m {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] profiler.filter_error_trace = False {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack quobyte-client[87516]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] profiler.hmac_keys = **** {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] profiler.sentinel_service_name = mymaster {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] profiler.socket_timeout = 0.1 {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] profiler.trace_requests = False {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] profiler.trace_sqlalchemy = False {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] profiler_jaeger.process_tags = {} {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] profiler_jaeger.service_name_prefix = None {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] profiler_otlp.service_name_prefix = None {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] oslo_policy.enforce_new_defaults = True {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] oslo_policy.policy_default_rule = default {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] oslo_policy.policy_file = policy.yaml {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] oslo_policy.remote_timeout = 60.0 {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] privsep_osbrick.group = None {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] privsep_osbrick.helper_command = None {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] privsep_osbrick.user = None {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] cinder_sys_admin.group = None {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] cinder_sys_admin.helper_command = None {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-a652638b-346d-44e3-9bf9-b210475c54cb None None] CMD "mount.quobyte" returned: 1 in 0.064s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:56:52 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-a652638b-346d-44e3-9bf9-b210475c54cb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:56:52 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-a652638b-346d-44e3-9bf9-b210475c54cb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] cinder_sys_admin.user = None {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] service_user.auth_section = None {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] service_user.auth_type = password {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] service_user.cafile = None {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-a652638b-346d-44e3-9bf9-b210475c54cb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] service_user.certfile = None {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] service_user.collect_timing = False {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] service_user.insecure = False {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] service_user.keyfile = None {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] service_user.send_service_user_token = True {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] service_user.split_loggers = False {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] service_user.timeout = None {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] service_user.tls_ciphers = None {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] service_user.tls_min_version = None {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] glance.auth_section = None {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] glance.auth_type = password {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] glance.certfile = None {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] glance.collect_timing = False {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] glance.insecure = False {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] glance.keyfile = None {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] glance.region_name = None {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] glance.split_loggers = False {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] glance.timeout = None {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] glance.tls_ciphers = None {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] glance.tls_min_version = None {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] backend_defaults.backend_availability_zone = None {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] backend_defaults.chap_password = **** {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] backend_defaults.chap_username = {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-a652638b-346d-44e3-9bf9-b210475c54cb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 09:56:52 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-a652638b-346d-44e3-9bf9-b210475c54cb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:56:52 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-a652638b-346d-44e3-9bf9-b210475c54cb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] backend_defaults.disk_geometry = None {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] backend_defaults.driver_client_cert = None {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] backend_defaults.driver_client_cert_key = None {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] backend_defaults.driver_data_namespace = None {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] backend_defaults.driver_use_ssl = False {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] backend_defaults.enable_unsupported_driver = False {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] backend_defaults.extra_capabilities = {} {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] backend_defaults.filter_function = None {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] backend_defaults.goodness_function = None {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] backend_defaults.iscsi_target_flags = {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] backend_defaults.iscsi_write_cache = on {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] backend_defaults.iser_helper = tgtadm {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] backend_defaults.iser_ip_address = 192.168.122.74 {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] backend_defaults.iser_port = 3260 {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] backend_defaults.nas_host = {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] backend_defaults.nas_login = admin {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] backend_defaults.nas_mount_options = None {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] backend_defaults.nas_password = **** {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] backend_defaults.nas_private_key = {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] backend_defaults.nas_share_path = {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] backend_defaults.nas_ssh_port = 22 {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] backend_defaults.num_shell_tries = 3 {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] backend_defaults.nvmet_port_id = 1 {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] backend_defaults.quobyte_client_cfg = None {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack sudo[87517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a Sep 07 09:56:52 devstack sudo[87517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] backend_defaults.quobyte_volume_url = None {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] backend_defaults.replication_device = **** {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] backend_defaults.report_discard_supported = False {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] backend_defaults.reserved_percentage = 0 {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] backend_defaults.scst_target_driver = iscsi {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] backend_defaults.scst_target_iqn_name = None {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] backend_defaults.storage_protocol = iSCSI {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] backend_defaults.target_helper = tgtadm {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] backend_defaults.target_ip_address = 192.168.122.74 {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] backend_defaults.target_port = 3260 {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] backend_defaults.target_protocol = iscsi {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] backend_defaults.trace_flags = None {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] backend_defaults.unique_fqdn_network = True {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] backend_defaults.use_chap_auth = False {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] backend_defaults.volume_backend_name = None {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] backend_defaults.volume_clear = zero {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] backend_defaults.volume_clear_ionice = None {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] backend_defaults.volume_clear_size = 0 {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] oslo_reports.file_event_handler = None {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] oslo_reports.log_dir = None {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] QuobyteHD.backend_availability_zone = None {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] QuobyteHD.backend_host = None {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] QuobyteHD.chap_password = **** {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] QuobyteHD.chap_username = None {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] QuobyteHD.chiscsi_conf = None {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] QuobyteHD.disk_geometry = None {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] QuobyteHD.driver_client_cert = None {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] QuobyteHD.driver_client_cert_key = None {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] QuobyteHD.driver_data_namespace = None {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] QuobyteHD.driver_use_ssl = None {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] QuobyteHD.extra_capabilities = None {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] QuobyteHD.filter_function = None {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] QuobyteHD.goodness_function = None {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] QuobyteHD.iscsi_target_flags = None {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] QuobyteHD.iscsi_write_cache = None {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] QuobyteHD.iser_helper = None {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] QuobyteHD.iser_ip_address = None {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] QuobyteHD.iser_port = None {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] QuobyteHD.iser_target_prefix = None {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] QuobyteHD.nas_host = None {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] QuobyteHD.nas_login = None {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] QuobyteHD.nas_mount_options = None {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] QuobyteHD.nas_password = **** {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] QuobyteHD.nas_private_key = None {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] QuobyteHD.nas_share_path = None {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] QuobyteHD.nas_ssh_port = None {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] QuobyteHD.num_shell_tries = None {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] QuobyteHD.nvmet_ns_id = None {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] QuobyteHD.nvmet_port_id = None {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] QuobyteHD.replication_device = **** {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] QuobyteHD.report_discard_supported = None {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] QuobyteHD.reserved_percentage = None {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] QuobyteHD.scst_target_driver = None {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] QuobyteHD.storage_protocol = None {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] QuobyteHD.target_helper = None {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] QuobyteHD.target_ip_address = None {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] QuobyteHD.target_port = None {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] QuobyteHD.target_prefix = None {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] QuobyteHD.target_protocol = None {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] QuobyteHD.trace_flags = None {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] QuobyteHD.unique_fqdn_network = None {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] QuobyteHD.use_chap_auth = None {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] QuobyteHD.volume_clear = None {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] QuobyteHD.volume_clear_ionice = None {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] QuobyteHD.volume_clear_size = None {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] QuobyteHD.volumes_dir = None {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] oslo_messaging_rabbit.ssl = False {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] oslo_messaging_rabbit.ssl_version = {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] oslo_messaging_notifications.driver = [] {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] oslo_messaging_notifications.retry = -1 {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] oslo_messaging_notifications.transport_url = **** {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] key_manager.fixed_key = **** {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] barbican.barbican_api_version = None {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] barbican.barbican_endpoint = None {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] barbican.barbican_endpoint_type = public {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] barbican.barbican_region_name = None {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] barbican.cafile = None {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] barbican.certfile = None {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] barbican.collect_timing = False {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] barbican.insecure = False {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] barbican.keyfile = None {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] barbican.number_of_retries = 60 {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] barbican.retry_delay = 1 {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] barbican.send_service_user_token = False {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] barbican.split_loggers = False {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] barbican.timeout = None {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] barbican.tls_ciphers = None {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] barbican.tls_min_version = None {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] barbican.verify_ssl = True {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] barbican.verify_ssl_path = None {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] barbican_service_user.auth_section = None {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] barbican_service_user.auth_type = None {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] barbican_service_user.cafile = None {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] barbican_service_user.certfile = None {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] barbican_service_user.collect_timing = False {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] barbican_service_user.insecure = False {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] barbican_service_user.keyfile = None {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] barbican_service_user.split_loggers = False {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] barbican_service_user.timeout = None {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] barbican_service_user.tls_ciphers = None {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] barbican_service_user.tls_min_version = None {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] vault.approle_role_id = **** {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] vault.approle_secret_id = **** {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] vault.auth_method = approle {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] vault.auth_path = None {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] vault.kv_mountpoint = secret {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] vault.kv_path = None {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] vault.kv_version = 2 {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] vault.namespace = None {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] vault.root_token_id = **** {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] vault.ssl_ca_crt_file = None {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] vault.timeout = 60.0 {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] vault.token_file = None {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] vault.token_role = None {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] vault.use_ssl = False {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 09:56:52 devstack cinder-volume[87196]: DEBUG oslo_service.backend._eventlet.service [None req-58a6a995-53a2-46c0-bbad-ee9f33b11517 None None] ******************************************************************************** {{(pid=87196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 07 09:56:52 devstack sudo[87517]: pam_unix(sudo:session): session closed for user root Sep 07 09:56:52 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-a652638b-346d-44e3-9bf9-b210475c54cb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a" returned: 0 in 0.238s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:56:52 devstack cinder-volume[87515]: INFO cinder.volume.driver [None req-a652638b-346d-44e3-9bf9-b210475c54cb None None] Driver hasn't implemented _init_vendor_properties() Sep 07 09:56:52 devstack cinder-volume[87515]: DEBUG cinder.volume.driver [None req-a652638b-346d-44e3-9bf9-b210475c54cb None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.5995826721191, 'free_capacity_gb': 1773.5995826721191, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87515) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 07 09:56:52 devstack cinder-volume[87515]: DEBUG oslo_db.sqlalchemy.engines [None req-a652638b-346d-44e3-9bf9-b210475c54cb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87515) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 07 09:56:52 devstack cinder-volume[87515]: DEBUG dbcounter [-] [87515] Writer thread running {{(pid=87515) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 07 09:56:52 devstack cinder-volume[87515]: DEBUG cinder.db.api [None req-a652638b-346d-44e3-9bf9-b210475c54cb None None] Building query based on filter {{(pid=87515) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 07 09:56:52 devstack cinder-volume[87515]: DEBUG cinder.image.image_utils [None req-a652638b-346d-44e3-9bf9-b210475c54cb None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=87515) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Sep 07 09:56:52 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-a652638b-346d-44e3-9bf9-b210475c54cb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:56:52 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-a652638b-346d-44e3-9bf9-b210475c54cb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:56:52 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-a652638b-346d-44e3-9bf9-b210475c54cb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 09:56:52 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-a652638b-346d-44e3-9bf9-b210475c54cb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 09:56:52 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-a652638b-346d-44e3-9bf9-b210475c54cb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:56:52 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-a652638b-346d-44e3-9bf9-b210475c54cb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:56:52 devstack cinder-volume[87515]: INFO cinder.keymgr.migration [None req-6029a4d5-22d3-4275-9959-b3d48afb4eec None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 07 09:56:52 devstack sudo[87529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a Sep 07 09:56:52 devstack sudo[87529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:56:53 devstack sudo[87529]: pam_unix(sudo:session): session closed for user root Sep 07 09:56:53 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-a652638b-346d-44e3-9bf9-b210475c54cb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a" returned: 0 in 0.244s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:56:53 devstack cinder-volume[87515]: DEBUG cinder.manager [None req-a652638b-346d-44e3-9bf9-b210475c54cb None None] Notifying Schedulers of capabilities ... {{(pid=87515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 09:56:53 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-a652638b-346d-44e3-9bf9-b210475c54cb None None] Driver initialization completed successfully. Sep 07 09:56:53 devstack cinder-volume[87515]: INFO cinder.manager [None req-a652638b-346d-44e3-9bf9-b210475c54cb None None] Initiating service 3 cleanup Sep 07 09:56:53 devstack cinder-volume[87515]: INFO cinder.manager [None req-a652638b-346d-44e3-9bf9-b210475c54cb None None] Service 3 cleanup completed. Sep 07 09:56:53 devstack cinder-volume[87515]: DEBUG cinder.service [None req-a652638b-346d-44e3-9bf9-b210475c54cb None None] Creating RPC server for service cinder-volume {{(pid=87515) start /opt/stack/cinder/cinder/service.py:231}} Sep 07 09:56:53 devstack cinder-volume[87515]: DEBUG cinder.service [None req-a652638b-346d-44e3-9bf9-b210475c54cb None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=87515) start /opt/stack/cinder/cinder/service.py:237}} Sep 07 09:56:53 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-a652638b-346d-44e3-9bf9-b210475c54cb None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Sep 07 09:56:53 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-a652638b-346d-44e3-9bf9-b210475c54cb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:56:53 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-a652638b-346d-44e3-9bf9-b210475c54cb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:56:53 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-a652638b-346d-44e3-9bf9-b210475c54cb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 09:56:53 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-a652638b-346d-44e3-9bf9-b210475c54cb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 09:56:53 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-a652638b-346d-44e3-9bf9-b210475c54cb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:56:53 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-a652638b-346d-44e3-9bf9-b210475c54cb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:56:53 devstack sudo[87542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a Sep 07 09:56:53 devstack sudo[87542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:56:53 devstack sudo[87542]: pam_unix(sudo:session): session closed for user root Sep 07 09:56:53 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-a652638b-346d-44e3-9bf9-b210475c54cb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a" returned: 0 in 0.234s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:56:53 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-a652638b-346d-44e3-9bf9-b210475c54cb None None] Driver post RPC initialization completed successfully. Sep 07 09:57:02 devstack cinder-volume[87196]: DEBUG dbcounter [-] [87196] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=87196) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 09:57:03 devstack cinder-volume[87515]: DEBUG dbcounter [-] [87515] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=87515) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 09:57:03 devstack cinder-volume[87515]: DEBUG dbcounter [-] [87515] Writing DB stats cinder:SELECT=3 {{(pid=87515) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 09:57:11 devstack cinder-volume[87515]: DEBUG oslo_service.periodic_task [None req-cebd6a9d-3073-42a1-b65a-b38d444d85ed None None] Running periodic task VolumeManager._thread_info {{(pid=87515) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 09:57:11 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-cebd6a9d-3073-42a1-b65a-b38d444d85ed None None] thread count: 6 {{(pid=87515) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 07 09:57:11 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-cebd6a9d-3073-42a1-b65a-b38d444d85ed None None] thread info: [<_MainThread(MainThread, started 131647121809536)>, , , , , ] {{(pid=87515) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 07 09:57:50 devstack cinder-volume[87515]: DEBUG cinder.volume.flows.manager.create_volume [req-c8e76adc-c49f-457e-9360-ef315bcb0528 req-02ef4e1f-d2eb-4d11-ade9-7f70f0f22f71 tempest-VolumesSnapshotsTestJSON-108327077 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 09:57:50 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [req-c8e76adc-c49f-457e-9360-ef315bcb0528 req-02ef4e1f-d2eb-4d11-ade9-7f70f0f22f71 tempest-VolumesSnapshotsTestJSON-108327077 None] Flow 'volume_create_manager' (30422501-127e-4d9b-be7e-ca37f10f59ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 09:57:50 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [req-c8e76adc-c49f-457e-9360-ef315bcb0528 req-02ef4e1f-d2eb-4d11-ade9-7f70f0f22f71 tempest-VolumesSnapshotsTestJSON-108327077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b56edf11-84e0-4689-8545-5baabf6caac1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:57:50 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [req-c8e76adc-c49f-457e-9360-ef315bcb0528 req-02ef4e1f-d2eb-4d11-ade9-7f70f0f22f71 tempest-VolumesSnapshotsTestJSON-108327077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b56edf11-84e0-4689-8545-5baabf6caac1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T07:57:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1244009769',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a6283cb-3a47-40e3-9f13-2a0b619b106f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1cf642d43ad447485e77170c87a76a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T07:57:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T07:57:50Z,use_quota=True,user_id='b01634692d004472ae3d907c263f3bcb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3a092cd-7947-4cbf-abff-4ba9567becf0),volume_type_id=f3a092cd-7947-4cbf-abff-4ba9567becf0)' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:57:50 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [req-c8e76adc-c49f-457e-9360-ef315bcb0528 req-02ef4e1f-d2eb-4d11-ade9-7f70f0f22f71 tempest-VolumesSnapshotsTestJSON-108327077 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4eaa32be-6086-464f-90ad-2ab2caf8dfb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:57:50 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [req-c8e76adc-c49f-457e-9360-ef315bcb0528 req-02ef4e1f-d2eb-4d11-ade9-7f70f0f22f71 tempest-VolumesSnapshotsTestJSON-108327077 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4eaa32be-6086-464f-90ad-2ab2caf8dfb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:57:50 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [req-c8e76adc-c49f-457e-9360-ef315bcb0528 req-02ef4e1f-d2eb-4d11-ade9-7f70f0f22f71 tempest-VolumesSnapshotsTestJSON-108327077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2078b745-502e-4976-a4e8-1fd32cb64884) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:57:50 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [req-c8e76adc-c49f-457e-9360-ef315bcb0528 req-02ef4e1f-d2eb-4d11-ade9-7f70f0f22f71 tempest-VolumesSnapshotsTestJSON-108327077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2078b745-502e-4976-a4e8-1fd32cb64884) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0a6283cb-3a47-40e3-9f13-2a0b619b106f', 'volume_name': 'volume-0a6283cb-3a47-40e3-9f13-2a0b619b106f', 'volume_size': 1}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:57:50 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [req-c8e76adc-c49f-457e-9360-ef315bcb0528 req-02ef4e1f-d2eb-4d11-ade9-7f70f0f22f71 tempest-VolumesSnapshotsTestJSON-108327077 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c8deffc-52b9-417d-a69f-b7cb72dc5c75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:57:50 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [req-c8e76adc-c49f-457e-9360-ef315bcb0528 req-02ef4e1f-d2eb-4d11-ade9-7f70f0f22f71 tempest-VolumesSnapshotsTestJSON-108327077 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c8deffc-52b9-417d-a69f-b7cb72dc5c75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:57:50 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [req-c8e76adc-c49f-457e-9360-ef315bcb0528 req-02ef4e1f-d2eb-4d11-ade9-7f70f0f22f71 tempest-VolumesSnapshotsTestJSON-108327077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0adf6093-7117-4c6d-9181-7e7a0b904924) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:57:50 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [req-c8e76adc-c49f-457e-9360-ef315bcb0528 req-02ef4e1f-d2eb-4d11-ade9-7f70f0f22f71 tempest-VolumesSnapshotsTestJSON-108327077 None] Volume 0a6283cb-3a47-40e3-9f13-2a0b619b106f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0a6283cb-3a47-40e3-9f13-2a0b619b106f', 'volume_size': 1} Sep 07 09:57:50 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [req-c8e76adc-c49f-457e-9360-ef315bcb0528 req-02ef4e1f-d2eb-4d11-ade9-7f70f0f22f71 tempest-VolumesSnapshotsTestJSON-108327077 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:57:50 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [req-c8e76adc-c49f-457e-9360-ef315bcb0528 req-02ef4e1f-d2eb-4d11-ade9-7f70f0f22f71 tempest-VolumesSnapshotsTestJSON-108327077 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:57:50 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [req-c8e76adc-c49f-457e-9360-ef315bcb0528 req-02ef4e1f-d2eb-4d11-ade9-7f70f0f22f71 tempest-VolumesSnapshotsTestJSON-108327077 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T07:57:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1244009769',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a6283cb-3a47-40e3-9f13-2a0b619b106f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1cf642d43ad447485e77170c87a76a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T07:57:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T07:57:50Z,use_quota=True,user_id='b01634692d004472ae3d907c263f3bcb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3a092cd-7947-4cbf-abff-4ba9567becf0),volume_type_id=f3a092cd-7947-4cbf-abff-4ba9567becf0)}" {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 09:57:50 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [req-c8e76adc-c49f-457e-9360-ef315bcb0528 req-02ef4e1f-d2eb-4d11-ade9-7f70f0f22f71 tempest-VolumesSnapshotsTestJSON-108327077 None] Creating volume 0a6283cb-3a47-40e3-9f13-2a0b619b106f {{(pid=87515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 09:57:50 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [req-c8e76adc-c49f-457e-9360-ef315bcb0528 req-02ef4e1f-d2eb-4d11-ade9-7f70f0f22f71 tempest-VolumesSnapshotsTestJSON-108327077 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:57:50 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [req-c8e76adc-c49f-457e-9360-ef315bcb0528 req-02ef4e1f-d2eb-4d11-ade9-7f70f0f22f71 tempest-VolumesSnapshotsTestJSON-108327077 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:57:50 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [req-c8e76adc-c49f-457e-9360-ef315bcb0528 req-02ef4e1f-d2eb-4d11-ade9-7f70f0f22f71 tempest-VolumesSnapshotsTestJSON-108327077 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 09:57:50 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [req-c8e76adc-c49f-457e-9360-ef315bcb0528 req-02ef4e1f-d2eb-4d11-ade9-7f70f0f22f71 tempest-VolumesSnapshotsTestJSON-108327077 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 09:57:50 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [req-c8e76adc-c49f-457e-9360-ef315bcb0528 req-02ef4e1f-d2eb-4d11-ade9-7f70f0f22f71 tempest-VolumesSnapshotsTestJSON-108327077 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:57:50 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [req-c8e76adc-c49f-457e-9360-ef315bcb0528 req-02ef4e1f-d2eb-4d11-ade9-7f70f0f22f71 tempest-VolumesSnapshotsTestJSON-108327077 None] Selected osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c as target Quobyte volume. {{(pid=87515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 09:57:50 devstack cinder-volume[87515]: INFO cinder.volume.drivers.remotefs [req-c8e76adc-c49f-457e-9360-ef315bcb0528 req-02ef4e1f-d2eb-4d11-ade9-7f70f0f22f71 tempest-VolumesSnapshotsTestJSON-108327077 None] casted to osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c Sep 07 09:57:50 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [req-c8e76adc-c49f-457e-9360-ef315bcb0528 req-02ef4e1f-d2eb-4d11-ade9-7f70f0f22f71 tempest-VolumesSnapshotsTestJSON-108327077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-0a6283cb-3a47-40e3-9f13-2a0b619b106f 1073741824 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:57:50 devstack sudo[87892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-0a6283cb-3a47-40e3-9f13-2a0b619b106f 1073741824 Sep 07 09:57:50 devstack sudo[87892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:57:51 devstack sudo[87892]: pam_unix(sudo:session): session closed for user root Sep 07 09:57:51 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [req-c8e76adc-c49f-457e-9360-ef315bcb0528 req-02ef4e1f-d2eb-4d11-ade9-7f70f0f22f71 tempest-VolumesSnapshotsTestJSON-108327077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-0a6283cb-3a47-40e3-9f13-2a0b619b106f 1073741824" returned: 0 in 0.723s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:57:51 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [req-c8e76adc-c49f-457e-9360-ef315bcb0528 req-02ef4e1f-d2eb-4d11-ade9-7f70f0f22f71 tempest-VolumesSnapshotsTestJSON-108327077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-0a6283cb-3a47-40e3-9f13-2a0b619b106f {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:57:51 devstack sudo[88229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-0a6283cb-3a47-40e3-9f13-2a0b619b106f Sep 07 09:57:51 devstack sudo[88229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:57:51 devstack sudo[88229]: pam_unix(sudo:session): session closed for user root Sep 07 09:57:51 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [req-c8e76adc-c49f-457e-9360-ef315bcb0528 req-02ef4e1f-d2eb-4d11-ade9-7f70f0f22f71 tempest-VolumesSnapshotsTestJSON-108327077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-0a6283cb-3a47-40e3-9f13-2a0b619b106f" returned: 0 in 0.337s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:57:51 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [req-c8e76adc-c49f-457e-9360-ef315bcb0528 req-02ef4e1f-d2eb-4d11-ade9-7f70f0f22f71 tempest-VolumesSnapshotsTestJSON-108327077 None] <== create_volume: return (1144ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'} {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 09:57:51 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [req-c8e76adc-c49f-457e-9360-ef315bcb0528 req-02ef4e1f-d2eb-4d11-ade9-7f70f0f22f71 tempest-VolumesSnapshotsTestJSON-108327077 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.147s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:57:51 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [req-c8e76adc-c49f-457e-9360-ef315bcb0528 req-02ef4e1f-d2eb-4d11-ade9-7f70f0f22f71 tempest-VolumesSnapshotsTestJSON-108327077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0adf6093-7117-4c6d-9181-7e7a0b904924) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0a6283cb-3a47-40e3-9f13-2a0b619b106f', 'volume_size': 1}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:57:51 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [req-c8e76adc-c49f-457e-9360-ef315bcb0528 req-02ef4e1f-d2eb-4d11-ade9-7f70f0f22f71 tempest-VolumesSnapshotsTestJSON-108327077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (802d7664-bd23-43c8-9d65-99a84593f09a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:57:51 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [req-c8e76adc-c49f-457e-9360-ef315bcb0528 req-02ef4e1f-d2eb-4d11-ade9-7f70f0f22f71 tempest-VolumesSnapshotsTestJSON-108327077 None] Volume volume-0a6283cb-3a47-40e3-9f13-2a0b619b106f (0a6283cb-3a47-40e3-9f13-2a0b619b106f): created successfully Sep 07 09:57:51 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [req-c8e76adc-c49f-457e-9360-ef315bcb0528 req-02ef4e1f-d2eb-4d11-ade9-7f70f0f22f71 tempest-VolumesSnapshotsTestJSON-108327077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (802d7664-bd23-43c8-9d65-99a84593f09a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:57:51 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [req-c8e76adc-c49f-457e-9360-ef315bcb0528 req-02ef4e1f-d2eb-4d11-ade9-7f70f0f22f71 tempest-VolumesSnapshotsTestJSON-108327077 None] Flow 'volume_create_manager' (30422501-127e-4d9b-be7e-ca37f10f59ff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 09:57:51 devstack cinder-volume[87515]: INFO cinder.volume.manager [req-c8e76adc-c49f-457e-9360-ef315bcb0528 req-02ef4e1f-d2eb-4d11-ade9-7f70f0f22f71 tempest-VolumesSnapshotsTestJSON-108327077 None] Created volume successfully. Sep 07 09:57:53 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [req-dd2f9960-c2e3-4549-94fa-90ce68d611ac req-75e3e65e-c5dc-45f9-9a12-1746c46ada3a tempest-VolumesSnapshotsTestJSON-108327077 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:57:53 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [req-dd2f9960-c2e3-4549-94fa-90ce68d611ac req-75e3e65e-c5dc-45f9-9a12-1746c46ada3a tempest-VolumesSnapshotsTestJSON-108327077 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:57:53 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [req-dd2f9960-c2e3-4549-94fa-90ce68d611ac req-75e3e65e-c5dc-45f9-9a12-1746c46ada3a tempest-VolumesSnapshotsTestJSON-108327077 None] Creating offline snapshot f9285e0e-ce15-4b9a-84bb-0f8ee1a37d2b of volume 0a6283cb-3a47-40e3-9f13-2a0b619b106f {{(pid=87515) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 09:57:53 devstack cinder-volume[87515]: INFO oslo.privsep.daemon [req-dd2f9960-c2e3-4549-94fa-90ce68d611ac req-75e3e65e-c5dc-45f9-9a12-1746c46ada3a tempest-VolumesSnapshotsTestJSON-108327077 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpn9n1w1eo/privsep.sock'] Sep 07 09:57:53 devstack sudo[88270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpn9n1w1eo/privsep.sock Sep 07 09:57:53 devstack sudo[88270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:57:55 devstack cinder-volume[87515]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning: Sep 07 09:57:55 devstack cinder-volume[87515]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 07 09:57:55 devstack cinder-volume[87515]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Sep 07 09:57:55 devstack cinder-volume[87515]: WARNING oslo.privsep.daemon [-] privsep log: Sep 07 09:57:55 devstack cinder-volume[87515]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Sep 07 09:57:55 devstack cinder-volume[87515]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Sep 07 09:57:55 devstack cinder-volume[87515]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 07 09:57:55 devstack cinder-volume[87515]: WARNING oslo.privsep.daemon [-] privsep log: Sep 07 09:57:55 devstack cinder-volume[87515]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Sep 07 09:57:55 devstack sudo[88270]: pam_unix(sudo:session): session closed for user root Sep 07 09:57:55 devstack cinder-volume[87515]: INFO oslo.privsep.daemon [req-dd2f9960-c2e3-4549-94fa-90ce68d611ac req-75e3e65e-c5dc-45f9-9a12-1746c46ada3a tempest-VolumesSnapshotsTestJSON-108327077 None] Spawned new privsep daemon via rootwrap Sep 07 09:57:55 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [req-dd2f9960-c2e3-4549-94fa-90ce68d611ac req-75e3e65e-c5dc-45f9-9a12-1746c46ada3a tempest-VolumesSnapshotsTestJSON-108327077 None] Accepted privsep connection to /tmp/tmpn9n1w1eo/privsep.sock {{(pid=87515) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Sep 07 09:57:55 devstack cinder-volume[87515]: INFO oslo.privsep.daemon [-] privsep daemon starting Sep 07 09:57:55 devstack cinder-volume[87515]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Sep 07 09:57:55 devstack cinder-volume[87515]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Sep 07 09:57:55 devstack cinder-volume[87515]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 88332 Sep 07 09:57:55 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7ed1179-a7fc-430a-874c-402c30b6e6da]: (2,) {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 09:57:55 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[37915193-776c-43cb-98b1-492080fa246a]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 09:57:55 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [req-dd2f9960-c2e3-4549-94fa-90ce68d611ac req-75e3e65e-c5dc-45f9-9a12-1746c46ada3a tempest-VolumesSnapshotsTestJSON-108327077 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-0a6283cb-3a47-40e3-9f13-2a0b619b106f {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:57:55 devstack sudo[88352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-0a6283cb-3a47-40e3-9f13-2a0b619b106f Sep 07 09:57:55 devstack sudo[88352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:57:55 devstack sudo[88352]: pam_unix(sudo:session): session closed for user root Sep 07 09:57:56 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [req-dd2f9960-c2e3-4549-94fa-90ce68d611ac req-75e3e65e-c5dc-45f9-9a12-1746c46ada3a tempest-VolumesSnapshotsTestJSON-108327077 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-0a6283cb-3a47-40e3-9f13-2a0b619b106f" returned: 0 in 0.554s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:57:56 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [req-dd2f9960-c2e3-4549-94fa-90ce68d611ac req-75e3e65e-c5dc-45f9-9a12-1746c46ada3a tempest-VolumesSnapshotsTestJSON-108327077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-0a6283cb-3a47-40e3-9f13-2a0b619b106f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-0a6283cb-3a47-40e3-9f13-2a0b619b106f.f9285e0e-ce15-4b9a-84bb-0f8ee1a37d2b 1G {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:57:56 devstack sudo[88360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-0a6283cb-3a47-40e3-9f13-2a0b619b106f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-0a6283cb-3a47-40e3-9f13-2a0b619b106f.f9285e0e-ce15-4b9a-84bb-0f8ee1a37d2b 1G Sep 07 09:57:56 devstack sudo[88360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:57:56 devstack sudo[88360]: pam_unix(sudo:session): session closed for user root Sep 07 09:57:56 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [req-dd2f9960-c2e3-4549-94fa-90ce68d611ac req-75e3e65e-c5dc-45f9-9a12-1746c46ada3a tempest-VolumesSnapshotsTestJSON-108327077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-0a6283cb-3a47-40e3-9f13-2a0b619b106f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-0a6283cb-3a47-40e3-9f13-2a0b619b106f.f9285e0e-ce15-4b9a-84bb-0f8ee1a37d2b 1G" returned: 0 in 0.696s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:57:56 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [req-dd2f9960-c2e3-4549-94fa-90ce68d611ac req-75e3e65e-c5dc-45f9-9a12-1746c46ada3a tempest-VolumesSnapshotsTestJSON-108327077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0a6283cb-3a47-40e3-9f13-2a0b619b106f -F qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-0a6283cb-3a47-40e3-9f13-2a0b619b106f.f9285e0e-ce15-4b9a-84bb-0f8ee1a37d2b {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:57:56 devstack sudo[88374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0a6283cb-3a47-40e3-9f13-2a0b619b106f -F qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-0a6283cb-3a47-40e3-9f13-2a0b619b106f.f9285e0e-ce15-4b9a-84bb-0f8ee1a37d2b Sep 07 09:57:56 devstack sudo[88374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:57:57 devstack sudo[88374]: pam_unix(sudo:session): session closed for user root Sep 07 09:57:57 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [req-dd2f9960-c2e3-4549-94fa-90ce68d611ac req-75e3e65e-c5dc-45f9-9a12-1746c46ada3a tempest-VolumesSnapshotsTestJSON-108327077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0a6283cb-3a47-40e3-9f13-2a0b619b106f -F qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-0a6283cb-3a47-40e3-9f13-2a0b619b106f.f9285e0e-ce15-4b9a-84bb-0f8ee1a37d2b" returned: 0 in 0.353s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:57:57 devstack cinder-volume[87515]: WARNING cinder.volume.drivers.remotefs [req-dd2f9960-c2e3-4549-94fa-90ce68d611ac req-75e3e65e-c5dc-45f9-9a12-1746c46ada3a tempest-VolumesSnapshotsTestJSON-108327077 None] /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-0a6283cb-3a47-40e3-9f13-2a0b619b106f.f9285e0e-ce15-4b9a-84bb-0f8ee1a37d2b is being set with open permissions: ugo+rw Sep 07 09:57:57 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [req-dd2f9960-c2e3-4549-94fa-90ce68d611ac req-75e3e65e-c5dc-45f9-9a12-1746c46ada3a tempest-VolumesSnapshotsTestJSON-108327077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-0a6283cb-3a47-40e3-9f13-2a0b619b106f.f9285e0e-ce15-4b9a-84bb-0f8ee1a37d2b {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:57:57 devstack sudo[88381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-0a6283cb-3a47-40e3-9f13-2a0b619b106f.f9285e0e-ce15-4b9a-84bb-0f8ee1a37d2b Sep 07 09:57:57 devstack sudo[88381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:57:57 devstack sudo[88381]: pam_unix(sudo:session): session closed for user root Sep 07 09:57:57 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [req-dd2f9960-c2e3-4549-94fa-90ce68d611ac req-75e3e65e-c5dc-45f9-9a12-1746c46ada3a tempest-VolumesSnapshotsTestJSON-108327077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-0a6283cb-3a47-40e3-9f13-2a0b619b106f.f9285e0e-ce15-4b9a-84bb-0f8ee1a37d2b" returned: 0 in 0.285s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:57:57 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [req-dd2f9960-c2e3-4549-94fa-90ce68d611ac req-75e3e65e-c5dc-45f9-9a12-1746c46ada3a tempest-VolumesSnapshotsTestJSON-108327077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-0a6283cb-3a47-40e3-9f13-2a0b619b106f.info {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:57:57 devstack sudo[88385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-0a6283cb-3a47-40e3-9f13-2a0b619b106f.info Sep 07 09:57:57 devstack sudo[88385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:57:57 devstack sudo[88385]: pam_unix(sudo:session): session closed for user root Sep 07 09:57:57 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [req-dd2f9960-c2e3-4549-94fa-90ce68d611ac req-75e3e65e-c5dc-45f9-9a12-1746c46ada3a tempest-VolumesSnapshotsTestJSON-108327077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-0a6283cb-3a47-40e3-9f13-2a0b619b106f.info" returned: 0 in 0.362s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:57:57 devstack cinder-volume[87515]: WARNING cinder.volume.drivers.remotefs [req-dd2f9960-c2e3-4549-94fa-90ce68d611ac req-75e3e65e-c5dc-45f9-9a12-1746c46ada3a tempest-VolumesSnapshotsTestJSON-108327077 None] /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-0a6283cb-3a47-40e3-9f13-2a0b619b106f.info is being set with open permissions: ugo+rw Sep 07 09:57:57 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [req-dd2f9960-c2e3-4549-94fa-90ce68d611ac req-75e3e65e-c5dc-45f9-9a12-1746c46ada3a tempest-VolumesSnapshotsTestJSON-108327077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-0a6283cb-3a47-40e3-9f13-2a0b619b106f.info {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:57:57 devstack sudo[88388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-0a6283cb-3a47-40e3-9f13-2a0b619b106f.info Sep 07 09:57:57 devstack sudo[88388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:57:58 devstack sudo[88388]: pam_unix(sudo:session): session closed for user root Sep 07 09:57:58 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [req-dd2f9960-c2e3-4549-94fa-90ce68d611ac req-75e3e65e-c5dc-45f9-9a12-1746c46ada3a tempest-VolumesSnapshotsTestJSON-108327077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-0a6283cb-3a47-40e3-9f13-2a0b619b106f.info" returned: 0 in 0.459s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:57:58 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [req-dd2f9960-c2e3-4549-94fa-90ce68d611ac req-75e3e65e-c5dc-45f9-9a12-1746c46ada3a tempest-VolumesSnapshotsTestJSON-108327077 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.894s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:57:58 devstack cinder-volume[87515]: INFO cinder.volume.manager [req-dd2f9960-c2e3-4549-94fa-90ce68d611ac req-75e3e65e-c5dc-45f9-9a12-1746c46ada3a tempest-VolumesSnapshotsTestJSON-108327077 None] Create snapshot completed successfully Sep 07 09:57:58 devstack cinder-volume[87515]: DEBUG cinder.coordination [req-52e7c151-666a-4963-92d9-beb62ab99bdb req-1ceef3ab-ff3a-4c35-a692-9f0d583f64fd tempest-VolumesSnapshotsTestJSON-108327077 None] Acquiring lock "cinder-f9285e0e-ce15-4b9a-84bb-0f8ee1a37d2b-delete_snapshot" by "delete_snapshot" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:57:58 devstack cinder-volume[87515]: DEBUG cinder.coordination [req-52e7c151-666a-4963-92d9-beb62ab99bdb req-1ceef3ab-ff3a-4c35-a692-9f0d583f64fd tempest-VolumesSnapshotsTestJSON-108327077 None] Lock "cinder-f9285e0e-ce15-4b9a-84bb-0f8ee1a37d2b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.044s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:57:58 devstack cinder-volume[87515]: DEBUG cinder.coordination [req-52e7c151-666a-4963-92d9-beb62ab99bdb req-1ceef3ab-ff3a-4c35-a692-9f0d583f64fd tempest-VolumesSnapshotsTestJSON-108327077 None] Acquiring lock "cinder-quobyte-0a6283cb-3a47-40e3-9f13-2a0b619b106f" by "delete_snapshot" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:57:59 devstack cinder-volume[87515]: DEBUG cinder.coordination [req-52e7c151-666a-4963-92d9-beb62ab99bdb req-1ceef3ab-ff3a-4c35-a692-9f0d583f64fd tempest-VolumesSnapshotsTestJSON-108327077 None] Lock "cinder-quobyte-0a6283cb-3a47-40e3-9f13-2a0b619b106f" acquired by "delete_snapshot" :: waited 0.076s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:57:59 devstack cinder-volume[87515]: DEBUG cinder.coordination [req-52e7c151-666a-4963-92d9-beb62ab99bdb req-1ceef3ab-ff3a-4c35-a692-9f0d583f64fd tempest-VolumesSnapshotsTestJSON-108327077 None] Acquiring lock "cinder-quobyte-f9285e0e-ce15-4b9a-84bb-0f8ee1a37d2b" by "_delete_snapshot" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:57:59 devstack cinder-volume[87515]: DEBUG cinder.coordination [req-52e7c151-666a-4963-92d9-beb62ab99bdb req-1ceef3ab-ff3a-4c35-a692-9f0d583f64fd tempest-VolumesSnapshotsTestJSON-108327077 None] Lock "cinder-quobyte-f9285e0e-ce15-4b9a-84bb-0f8ee1a37d2b" acquired by "_delete_snapshot" :: waited 0.076s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:57:59 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [req-52e7c151-666a-4963-92d9-beb62ab99bdb req-1ceef3ab-ff3a-4c35-a692-9f0d583f64fd tempest-VolumesSnapshotsTestJSON-108327077 None] Deleting offline snapshot f9285e0e-ce15-4b9a-84bb-0f8ee1a37d2b of volume 0a6283cb-3a47-40e3-9f13-2a0b619b106f {{(pid=87515) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 09:57:59 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [req-52e7c151-666a-4963-92d9-beb62ab99bdb req-1ceef3ab-ff3a-4c35-a692-9f0d583f64fd tempest-VolumesSnapshotsTestJSON-108327077 None] snapshot_file for this snap is: volume-0a6283cb-3a47-40e3-9f13-2a0b619b106f.f9285e0e-ce15-4b9a-84bb-0f8ee1a37d2b {{(pid=87515) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 09:57:59 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[005886d1-1669-4109-834e-5f9b36dc606e]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 09:57:59 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [req-52e7c151-666a-4963-92d9-beb62ab99bdb req-1ceef3ab-ff3a-4c35-a692-9f0d583f64fd tempest-VolumesSnapshotsTestJSON-108327077 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-0a6283cb-3a47-40e3-9f13-2a0b619b106f.f9285e0e-ce15-4b9a-84bb-0f8ee1a37d2b {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:57:59 devstack sudo[88409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-0a6283cb-3a47-40e3-9f13-2a0b619b106f.f9285e0e-ce15-4b9a-84bb-0f8ee1a37d2b Sep 07 09:57:59 devstack sudo[88409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:58:00 devstack sudo[88409]: pam_unix(sudo:session): session closed for user root Sep 07 09:58:00 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [req-52e7c151-666a-4963-92d9-beb62ab99bdb req-1ceef3ab-ff3a-4c35-a692-9f0d583f64fd tempest-VolumesSnapshotsTestJSON-108327077 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-0a6283cb-3a47-40e3-9f13-2a0b619b106f.f9285e0e-ce15-4b9a-84bb-0f8ee1a37d2b" returned: 0 in 0.954s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:58:00 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [req-52e7c151-666a-4963-92d9-beb62ab99bdb req-1ceef3ab-ff3a-4c35-a692-9f0d583f64fd tempest-VolumesSnapshotsTestJSON-108327077 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0a6283cb-3a47-40e3-9f13-2a0b619b106f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87515) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 09:58:00 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[c357e146-c6a9-45f5-9514-63a7731a3cb3]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 09:58:00 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [req-52e7c151-666a-4963-92d9-beb62ab99bdb req-1ceef3ab-ff3a-4c35-a692-9f0d583f64fd tempest-VolumesSnapshotsTestJSON-108327077 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-0a6283cb-3a47-40e3-9f13-2a0b619b106f {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:58:00 devstack sudo[88449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-0a6283cb-3a47-40e3-9f13-2a0b619b106f Sep 07 09:58:00 devstack sudo[88449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:58:01 devstack sudo[88449]: pam_unix(sudo:session): session closed for user root Sep 07 09:58:01 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [req-52e7c151-666a-4963-92d9-beb62ab99bdb req-1ceef3ab-ff3a-4c35-a692-9f0d583f64fd tempest-VolumesSnapshotsTestJSON-108327077 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-0a6283cb-3a47-40e3-9f13-2a0b619b106f" returned: 0 in 0.885s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:58:01 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [req-52e7c151-666a-4963-92d9-beb62ab99bdb req-1ceef3ab-ff3a-4c35-a692-9f0d583f64fd tempest-VolumesSnapshotsTestJSON-108327077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-0a6283cb-3a47-40e3-9f13-2a0b619b106f.f9285e0e-ce15-4b9a-84bb-0f8ee1a37d2b {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:58:01 devstack sudo[88456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-0a6283cb-3a47-40e3-9f13-2a0b619b106f.f9285e0e-ce15-4b9a-84bb-0f8ee1a37d2b Sep 07 09:58:01 devstack sudo[88456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:58:02 devstack sudo[88456]: pam_unix(sudo:session): session closed for user root Sep 07 09:58:02 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [req-52e7c151-666a-4963-92d9-beb62ab99bdb req-1ceef3ab-ff3a-4c35-a692-9f0d583f64fd tempest-VolumesSnapshotsTestJSON-108327077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-0a6283cb-3a47-40e3-9f13-2a0b619b106f.f9285e0e-ce15-4b9a-84bb-0f8ee1a37d2b" returned: 0 in 1.494s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:58:02 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [req-52e7c151-666a-4963-92d9-beb62ab99bdb req-1ceef3ab-ff3a-4c35-a692-9f0d583f64fd tempest-VolumesSnapshotsTestJSON-108327077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-0a6283cb-3a47-40e3-9f13-2a0b619b106f.f9285e0e-ce15-4b9a-84bb-0f8ee1a37d2b {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:58:02 devstack sudo[88477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-0a6283cb-3a47-40e3-9f13-2a0b619b106f.f9285e0e-ce15-4b9a-84bb-0f8ee1a37d2b Sep 07 09:58:02 devstack sudo[88477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:58:03 devstack sudo[88477]: pam_unix(sudo:session): session closed for user root Sep 07 09:58:03 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [req-52e7c151-666a-4963-92d9-beb62ab99bdb req-1ceef3ab-ff3a-4c35-a692-9f0d583f64fd tempest-VolumesSnapshotsTestJSON-108327077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-0a6283cb-3a47-40e3-9f13-2a0b619b106f.f9285e0e-ce15-4b9a-84bb-0f8ee1a37d2b" returned: 0 in 0.814s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:58:03 devstack cinder-volume[87515]: DEBUG cinder.coordination [req-52e7c151-666a-4963-92d9-beb62ab99bdb req-1ceef3ab-ff3a-4c35-a692-9f0d583f64fd tempest-VolumesSnapshotsTestJSON-108327077 None] Lock "cinder-quobyte-f9285e0e-ce15-4b9a-84bb-0f8ee1a37d2b" released by "_delete_snapshot" :: held 4.396s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:58:03 devstack cinder-volume[87515]: DEBUG cinder.coordination [req-52e7c151-666a-4963-92d9-beb62ab99bdb req-1ceef3ab-ff3a-4c35-a692-9f0d583f64fd tempest-VolumesSnapshotsTestJSON-108327077 None] Lock "cinder-quobyte-0a6283cb-3a47-40e3-9f13-2a0b619b106f" released by "delete_snapshot" :: held 4.495s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:58:03 devstack cinder-volume[87515]: WARNING cinder.quota [req-52e7c151-666a-4963-92d9-beb62ab99bdb req-1ceef3ab-ff3a-4c35-a692-9f0d583f64fd tempest-VolumesSnapshotsTestJSON-108327077 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 07 09:58:03 devstack cinder-volume[87515]: WARNING cinder.quota [req-52e7c151-666a-4963-92d9-beb62ab99bdb req-1ceef3ab-ff3a-4c35-a692-9f0d583f64fd tempest-VolumesSnapshotsTestJSON-108327077 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 07 09:58:03 devstack cinder-volume[87515]: DEBUG cinder.quota [req-52e7c151-666a-4963-92d9-beb62ab99bdb req-1ceef3ab-ff3a-4c35-a692-9f0d583f64fd tempest-VolumesSnapshotsTestJSON-108327077 None] Created reservations ['39bbd162-2e4e-4109-b4ca-270949a709e5', '83b81873-0a84-43f9-a00e-386d8be28b7e', '9142eeb7-c97a-4855-92f9-025623c49fb6', '6eb962a4-ac5b-48f8-bc8e-82dca4106db8'] {{(pid=87515) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 09:58:03 devstack cinder-volume[87515]: INFO cinder.volume.manager [req-52e7c151-666a-4963-92d9-beb62ab99bdb req-1ceef3ab-ff3a-4c35-a692-9f0d583f64fd tempest-VolumesSnapshotsTestJSON-108327077 None] Delete snapshot completed successfully. Sep 07 09:58:03 devstack cinder-volume[87515]: DEBUG cinder.coordination [req-52e7c151-666a-4963-92d9-beb62ab99bdb req-1ceef3ab-ff3a-4c35-a692-9f0d583f64fd tempest-VolumesSnapshotsTestJSON-108327077 None] Lock "cinder-f9285e0e-ce15-4b9a-84bb-0f8ee1a37d2b-delete_snapshot" released by "delete_snapshot" :: held 4.965s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:58:04 devstack cinder-volume[87515]: DEBUG cinder.coordination [req-1c21d1ad-3615-44f5-a5c8-7f197b53bfb2 req-75571c0b-7062-438c-9d83-d97678fd5b9d tempest-VolumesSnapshotsTestJSON-108327077 None] Acquiring lock "cinder-0a6283cb-3a47-40e3-9f13-2a0b619b106f-delete_volume" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:58:04 devstack cinder-volume[87515]: DEBUG cinder.coordination [req-1c21d1ad-3615-44f5-a5c8-7f197b53bfb2 req-75571c0b-7062-438c-9d83-d97678fd5b9d tempest-VolumesSnapshotsTestJSON-108327077 None] Lock "cinder-0a6283cb-3a47-40e3-9f13-2a0b619b106f-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:58:04 devstack cinder-volume[87515]: DEBUG cinder.coordination [req-1c21d1ad-3615-44f5-a5c8-7f197b53bfb2 req-75571c0b-7062-438c-9d83-d97678fd5b9d tempest-VolumesSnapshotsTestJSON-108327077 None] Acquiring lock "cinder-quobyte-0a6283cb-3a47-40e3-9f13-2a0b619b106f" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:58:04 devstack cinder-volume[87515]: DEBUG cinder.coordination [req-1c21d1ad-3615-44f5-a5c8-7f197b53bfb2 req-75571c0b-7062-438c-9d83-d97678fd5b9d tempest-VolumesSnapshotsTestJSON-108327077 None] Lock "cinder-quobyte-0a6283cb-3a47-40e3-9f13-2a0b619b106f" acquired by "delete_volume" :: waited 0.055s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:58:04 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[5114da4a-7f97-4688-b99e-8d79af754350]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 09:58:04 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [req-1c21d1ad-3615-44f5-a5c8-7f197b53bfb2 req-75571c0b-7062-438c-9d83-d97678fd5b9d tempest-VolumesSnapshotsTestJSON-108327077 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-0a6283cb-3a47-40e3-9f13-2a0b619b106f {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:58:04 devstack sudo[88529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-0a6283cb-3a47-40e3-9f13-2a0b619b106f Sep 07 09:58:04 devstack sudo[88529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:58:05 devstack sudo[88529]: pam_unix(sudo:session): session closed for user root Sep 07 09:58:05 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [req-1c21d1ad-3615-44f5-a5c8-7f197b53bfb2 req-75571c0b-7062-438c-9d83-d97678fd5b9d tempest-VolumesSnapshotsTestJSON-108327077 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-0a6283cb-3a47-40e3-9f13-2a0b619b106f" returned: 0 in 0.774s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:58:05 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [req-1c21d1ad-3615-44f5-a5c8-7f197b53bfb2 req-75571c0b-7062-438c-9d83-d97678fd5b9d tempest-VolumesSnapshotsTestJSON-108327077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-0a6283cb-3a47-40e3-9f13-2a0b619b106f {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:58:05 devstack sudo[88552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-0a6283cb-3a47-40e3-9f13-2a0b619b106f Sep 07 09:58:05 devstack sudo[88552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:58:06 devstack sudo[88552]: pam_unix(sudo:session): session closed for user root Sep 07 09:58:06 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [req-1c21d1ad-3615-44f5-a5c8-7f197b53bfb2 req-75571c0b-7062-438c-9d83-d97678fd5b9d tempest-VolumesSnapshotsTestJSON-108327077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-0a6283cb-3a47-40e3-9f13-2a0b619b106f" returned: 0 in 0.784s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:58:06 devstack cinder-volume[87515]: DEBUG cinder.coordination [req-1c21d1ad-3615-44f5-a5c8-7f197b53bfb2 req-75571c0b-7062-438c-9d83-d97678fd5b9d tempest-VolumesSnapshotsTestJSON-108327077 None] Lock "cinder-quobyte-0a6283cb-3a47-40e3-9f13-2a0b619b106f" released by "delete_volume" :: held 1.691s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:58:06 devstack cinder-volume[87515]: WARNING cinder.quota [req-1c21d1ad-3615-44f5-a5c8-7f197b53bfb2 req-75571c0b-7062-438c-9d83-d97678fd5b9d tempest-VolumesSnapshotsTestJSON-108327077 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 07 09:58:06 devstack cinder-volume[87515]: DEBUG cinder.quota [req-1c21d1ad-3615-44f5-a5c8-7f197b53bfb2 req-75571c0b-7062-438c-9d83-d97678fd5b9d tempest-VolumesSnapshotsTestJSON-108327077 None] Created reservations ['462fdbbb-f322-4c9d-9592-30d507f31e45', '59d1817e-6dcd-42ee-a560-d57191974618', 'e902d5a8-6029-4abf-a722-2792e005e897', '18d51769-0057-487a-8647-b9b3604ea90d'] {{(pid=87515) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 09:58:06 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [req-1c21d1ad-3615-44f5-a5c8-7f197b53bfb2 req-75571c0b-7062-438c-9d83-d97678fd5b9d tempest-VolumesSnapshotsTestJSON-108327077 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:58:06 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [req-1c21d1ad-3615-44f5-a5c8-7f197b53bfb2 req-75571c0b-7062-438c-9d83-d97678fd5b9d tempest-VolumesSnapshotsTestJSON-108327077 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:58:06 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [req-1c21d1ad-3615-44f5-a5c8-7f197b53bfb2 req-75571c0b-7062-438c-9d83-d97678fd5b9d tempest-VolumesSnapshotsTestJSON-108327077 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 09:58:06 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [req-1c21d1ad-3615-44f5-a5c8-7f197b53bfb2 req-75571c0b-7062-438c-9d83-d97678fd5b9d tempest-VolumesSnapshotsTestJSON-108327077 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 09:58:06 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [req-1c21d1ad-3615-44f5-a5c8-7f197b53bfb2 req-75571c0b-7062-438c-9d83-d97678fd5b9d tempest-VolumesSnapshotsTestJSON-108327077 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:58:06 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [req-1c21d1ad-3615-44f5-a5c8-7f197b53bfb2 req-75571c0b-7062-438c-9d83-d97678fd5b9d tempest-VolumesSnapshotsTestJSON-108327077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:58:06 devstack sudo[88574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a Sep 07 09:58:06 devstack sudo[88574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:58:06 devstack sudo[88574]: pam_unix(sudo:session): session closed for user root Sep 07 09:58:06 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [req-1c21d1ad-3615-44f5-a5c8-7f197b53bfb2 req-75571c0b-7062-438c-9d83-d97678fd5b9d tempest-VolumesSnapshotsTestJSON-108327077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a" returned: 0 in 0.302s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:58:06 devstack cinder-volume[87515]: DEBUG cinder.manager [req-1c21d1ad-3615-44f5-a5c8-7f197b53bfb2 req-75571c0b-7062-438c-9d83-d97678fd5b9d tempest-VolumesSnapshotsTestJSON-108327077 None] Notifying Schedulers of capabilities ... {{(pid=87515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 09:58:06 devstack cinder-volume[87515]: INFO cinder.volume.manager [req-1c21d1ad-3615-44f5-a5c8-7f197b53bfb2 req-75571c0b-7062-438c-9d83-d97678fd5b9d tempest-VolumesSnapshotsTestJSON-108327077 None] Deleted volume successfully. Sep 07 09:58:06 devstack cinder-volume[87515]: DEBUG cinder.coordination [req-1c21d1ad-3615-44f5-a5c8-7f197b53bfb2 req-75571c0b-7062-438c-9d83-d97678fd5b9d tempest-VolumesSnapshotsTestJSON-108327077 None] Lock "cinder-0a6283cb-3a47-40e3-9f13-2a0b619b106f-delete_volume" released by "delete_volume" :: held 2.581s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:58:09 devstack cinder-volume[87515]: DEBUG cinder.volume.flows.manager.create_volume [None req-4de64a82-b6c7-4099-a70a-d41c92e6327b tempest-VolumesAdminNegativeTest-577749579 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 09:58:09 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-4de64a82-b6c7-4099-a70a-d41c92e6327b tempest-VolumesAdminNegativeTest-577749579 None] Flow 'volume_create_manager' (40fa5356-b8a2-43b2-8454-520b305ab84c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 09:58:09 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-4de64a82-b6c7-4099-a70a-d41c92e6327b tempest-VolumesAdminNegativeTest-577749579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e36210ab-2612-4437-ab66-d2ef766f553b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:58:09 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-4de64a82-b6c7-4099-a70a-d41c92e6327b tempest-VolumesAdminNegativeTest-577749579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e36210ab-2612-4437-ab66-d2ef766f553b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T07:58:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-532193167',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c204148-1259-4998-a3be-5528f18cadca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3bd47ee85e6a40d4b7a7f5f24145b3b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T07:58:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T07:58:09Z,use_quota=True,user_id='7abd204d1c284288b33a9ac8ca5c20a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3a092cd-7947-4cbf-abff-4ba9567becf0),volume_type_id=f3a092cd-7947-4cbf-abff-4ba9567becf0)' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:58:09 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-4de64a82-b6c7-4099-a70a-d41c92e6327b tempest-VolumesAdminNegativeTest-577749579 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c491b7f5-988a-471f-8730-ee1a93f59855) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:58:09 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-4de64a82-b6c7-4099-a70a-d41c92e6327b tempest-VolumesAdminNegativeTest-577749579 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c491b7f5-988a-471f-8730-ee1a93f59855) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:58:09 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-4de64a82-b6c7-4099-a70a-d41c92e6327b tempest-VolumesAdminNegativeTest-577749579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c5b33e3-ff79-44ac-80f5-533229e71575) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:58:09 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-4de64a82-b6c7-4099-a70a-d41c92e6327b tempest-VolumesAdminNegativeTest-577749579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c5b33e3-ff79-44ac-80f5-533229e71575) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6c204148-1259-4998-a3be-5528f18cadca', 'volume_name': 'volume-6c204148-1259-4998-a3be-5528f18cadca', 'volume_size': 1}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:58:09 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-4de64a82-b6c7-4099-a70a-d41c92e6327b tempest-VolumesAdminNegativeTest-577749579 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (afd169b4-95e4-48d6-b403-f737f487a6cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:58:09 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-4de64a82-b6c7-4099-a70a-d41c92e6327b tempest-VolumesAdminNegativeTest-577749579 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (afd169b4-95e4-48d6-b403-f737f487a6cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:58:09 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-4de64a82-b6c7-4099-a70a-d41c92e6327b tempest-VolumesAdminNegativeTest-577749579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62152669-08d3-4aec-8ac5-08c492d5102e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:58:09 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-4de64a82-b6c7-4099-a70a-d41c92e6327b tempest-VolumesAdminNegativeTest-577749579 None] Volume 6c204148-1259-4998-a3be-5528f18cadca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6c204148-1259-4998-a3be-5528f18cadca', 'volume_size': 1} Sep 07 09:58:09 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-4de64a82-b6c7-4099-a70a-d41c92e6327b tempest-VolumesAdminNegativeTest-577749579 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:58:09 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-4de64a82-b6c7-4099-a70a-d41c92e6327b tempest-VolumesAdminNegativeTest-577749579 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:58:09 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-4de64a82-b6c7-4099-a70a-d41c92e6327b tempest-VolumesAdminNegativeTest-577749579 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T07:58:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-532193167',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c204148-1259-4998-a3be-5528f18cadca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3bd47ee85e6a40d4b7a7f5f24145b3b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T07:58:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T07:58:09Z,use_quota=True,user_id='7abd204d1c284288b33a9ac8ca5c20a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3a092cd-7947-4cbf-abff-4ba9567becf0),volume_type_id=f3a092cd-7947-4cbf-abff-4ba9567becf0)}" {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 09:58:09 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-4de64a82-b6c7-4099-a70a-d41c92e6327b tempest-VolumesAdminNegativeTest-577749579 None] Creating volume 6c204148-1259-4998-a3be-5528f18cadca {{(pid=87515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 09:58:09 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-4de64a82-b6c7-4099-a70a-d41c92e6327b tempest-VolumesAdminNegativeTest-577749579 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:58:09 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-4de64a82-b6c7-4099-a70a-d41c92e6327b tempest-VolumesAdminNegativeTest-577749579 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:58:09 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-4de64a82-b6c7-4099-a70a-d41c92e6327b tempest-VolumesAdminNegativeTest-577749579 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 09:58:09 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-4de64a82-b6c7-4099-a70a-d41c92e6327b tempest-VolumesAdminNegativeTest-577749579 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 09:58:09 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-4de64a82-b6c7-4099-a70a-d41c92e6327b tempest-VolumesAdminNegativeTest-577749579 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:58:09 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-4de64a82-b6c7-4099-a70a-d41c92e6327b tempest-VolumesAdminNegativeTest-577749579 None] Selected osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c as target Quobyte volume. {{(pid=87515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 09:58:09 devstack cinder-volume[87515]: INFO cinder.volume.drivers.remotefs [None req-4de64a82-b6c7-4099-a70a-d41c92e6327b tempest-VolumesAdminNegativeTest-577749579 None] casted to osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c Sep 07 09:58:09 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-4de64a82-b6c7-4099-a70a-d41c92e6327b tempest-VolumesAdminNegativeTest-577749579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-6c204148-1259-4998-a3be-5528f18cadca 1073741824 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:58:09 devstack sudo[88618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-6c204148-1259-4998-a3be-5528f18cadca 1073741824 Sep 07 09:58:09 devstack sudo[88618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:58:10 devstack sudo[88618]: pam_unix(sudo:session): session closed for user root Sep 07 09:58:10 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-4de64a82-b6c7-4099-a70a-d41c92e6327b tempest-VolumesAdminNegativeTest-577749579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-6c204148-1259-4998-a3be-5528f18cadca 1073741824" returned: 0 in 0.729s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:58:10 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-4de64a82-b6c7-4099-a70a-d41c92e6327b tempest-VolumesAdminNegativeTest-577749579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-6c204148-1259-4998-a3be-5528f18cadca {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:58:10 devstack sudo[88625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-6c204148-1259-4998-a3be-5528f18cadca Sep 07 09:58:10 devstack sudo[88625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:58:10 devstack sudo[88625]: pam_unix(sudo:session): session closed for user root Sep 07 09:58:10 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-4de64a82-b6c7-4099-a70a-d41c92e6327b tempest-VolumesAdminNegativeTest-577749579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-6c204148-1259-4998-a3be-5528f18cadca" returned: 0 in 0.457s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:58:10 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-4de64a82-b6c7-4099-a70a-d41c92e6327b tempest-VolumesAdminNegativeTest-577749579 None] <== create_volume: return (1289ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'} {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 09:58:10 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-4de64a82-b6c7-4099-a70a-d41c92e6327b tempest-VolumesAdminNegativeTest-577749579 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.292s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:58:10 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-4de64a82-b6c7-4099-a70a-d41c92e6327b tempest-VolumesAdminNegativeTest-577749579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62152669-08d3-4aec-8ac5-08c492d5102e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6c204148-1259-4998-a3be-5528f18cadca', 'volume_size': 1}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:58:10 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-4de64a82-b6c7-4099-a70a-d41c92e6327b tempest-VolumesAdminNegativeTest-577749579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c28072db-18b2-4882-9e5e-5fc85f69cfbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:58:10 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-4de64a82-b6c7-4099-a70a-d41c92e6327b tempest-VolumesAdminNegativeTest-577749579 None] Volume volume-6c204148-1259-4998-a3be-5528f18cadca (6c204148-1259-4998-a3be-5528f18cadca): created successfully Sep 07 09:58:10 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-4de64a82-b6c7-4099-a70a-d41c92e6327b tempest-VolumesAdminNegativeTest-577749579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c28072db-18b2-4882-9e5e-5fc85f69cfbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:58:10 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-4de64a82-b6c7-4099-a70a-d41c92e6327b tempest-VolumesAdminNegativeTest-577749579 None] Flow 'volume_create_manager' (40fa5356-b8a2-43b2-8454-520b305ab84c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 09:58:10 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-4de64a82-b6c7-4099-a70a-d41c92e6327b tempest-VolumesAdminNegativeTest-577749579 None] Created volume successfully. Sep 07 09:58:11 devstack cinder-volume[87515]: DEBUG oslo_service.periodic_task [None req-cebd6a9d-3073-42a1-b65a-b38d444d85ed None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87515) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 09:58:11 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-cebd6a9d-3073-42a1-b65a-b38d444d85ed None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:58:11 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-cebd6a9d-3073-42a1-b65a-b38d444d85ed None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:58:11 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-cebd6a9d-3073-42a1-b65a-b38d444d85ed None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 09:58:11 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-cebd6a9d-3073-42a1-b65a-b38d444d85ed None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 09:58:11 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-cebd6a9d-3073-42a1-b65a-b38d444d85ed None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:58:11 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-cebd6a9d-3073-42a1-b65a-b38d444d85ed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:58:11 devstack sudo[88628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a Sep 07 09:58:11 devstack sudo[88628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:58:11 devstack sudo[88628]: pam_unix(sudo:session): session closed for user root Sep 07 09:58:11 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-cebd6a9d-3073-42a1-b65a-b38d444d85ed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a" returned: 0 in 0.338s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:58:11 devstack cinder-volume[87515]: DEBUG cinder.manager [None req-cebd6a9d-3073-42a1-b65a-b38d444d85ed None None] Notifying Schedulers of capabilities ... {{(pid=87515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 09:58:11 devstack cinder-volume[87515]: DEBUG oslo_service.periodic_task [None req-cebd6a9d-3073-42a1-b65a-b38d444d85ed None None] Running periodic task VolumeManager._thread_info {{(pid=87515) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 09:58:11 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-cebd6a9d-3073-42a1-b65a-b38d444d85ed None None] thread count: 8 {{(pid=87515) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 07 09:58:11 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-cebd6a9d-3073-42a1-b65a-b38d444d85ed None None] thread info: [<_MainThread(MainThread, started 131647121809536)>, , , , , , , ] {{(pid=87515) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 07 09:58:12 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-0676b3b4-cd12-4aa0-9f45-d19900ff3178 tempest-VolumesAdminNegativeTest-577749579 None] Acquiring lock "cinder-6c204148-1259-4998-a3be-5528f18cadca-delete_volume" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:58:12 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-0676b3b4-cd12-4aa0-9f45-d19900ff3178 tempest-VolumesAdminNegativeTest-577749579 None] Lock "cinder-6c204148-1259-4998-a3be-5528f18cadca-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:58:12 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-0676b3b4-cd12-4aa0-9f45-d19900ff3178 tempest-VolumesAdminNegativeTest-577749579 None] Acquiring lock "cinder-quobyte-6c204148-1259-4998-a3be-5528f18cadca" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:58:12 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-0676b3b4-cd12-4aa0-9f45-d19900ff3178 tempest-VolumesAdminNegativeTest-577749579 None] Lock "cinder-quobyte-6c204148-1259-4998-a3be-5528f18cadca" acquired by "delete_volume" :: waited 0.043s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:58:12 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bec0abb-06e6-4249-b0cd-318dc19c8fc6]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 09:58:12 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-0676b3b4-cd12-4aa0-9f45-d19900ff3178 tempest-VolumesAdminNegativeTest-577749579 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-6c204148-1259-4998-a3be-5528f18cadca {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:58:12 devstack sudo[88631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-6c204148-1259-4998-a3be-5528f18cadca Sep 07 09:58:12 devstack sudo[88631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:58:13 devstack sudo[88631]: pam_unix(sudo:session): session closed for user root Sep 07 09:58:13 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-0676b3b4-cd12-4aa0-9f45-d19900ff3178 tempest-VolumesAdminNegativeTest-577749579 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-6c204148-1259-4998-a3be-5528f18cadca" returned: 0 in 0.735s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:58:13 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-0676b3b4-cd12-4aa0-9f45-d19900ff3178 tempest-VolumesAdminNegativeTest-577749579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-6c204148-1259-4998-a3be-5528f18cadca {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:58:13 devstack sudo[88636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-6c204148-1259-4998-a3be-5528f18cadca Sep 07 09:58:13 devstack sudo[88636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:58:13 devstack sudo[88636]: pam_unix(sudo:session): session closed for user root Sep 07 09:58:13 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-0676b3b4-cd12-4aa0-9f45-d19900ff3178 tempest-VolumesAdminNegativeTest-577749579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-6c204148-1259-4998-a3be-5528f18cadca" returned: 0 in 0.429s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:58:13 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-0676b3b4-cd12-4aa0-9f45-d19900ff3178 tempest-VolumesAdminNegativeTest-577749579 None] Lock "cinder-quobyte-6c204148-1259-4998-a3be-5528f18cadca" released by "delete_volume" :: held 1.232s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:58:13 devstack cinder-volume[87515]: DEBUG cinder.quota [None req-0676b3b4-cd12-4aa0-9f45-d19900ff3178 tempest-VolumesAdminNegativeTest-577749579 None] Created reservations ['be88907e-9eac-4df9-9879-24bd2ebe64e1', '76162476-47f5-4707-8cb1-4b30daecaf53', '53fd6308-9d69-4a4b-967c-0ef15027121b', '74a03de1-18d8-447f-9baa-e9e6598c4789'] {{(pid=87515) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 09:58:13 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-0676b3b4-cd12-4aa0-9f45-d19900ff3178 tempest-VolumesAdminNegativeTest-577749579 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:58:13 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-0676b3b4-cd12-4aa0-9f45-d19900ff3178 tempest-VolumesAdminNegativeTest-577749579 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:58:13 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-0676b3b4-cd12-4aa0-9f45-d19900ff3178 tempest-VolumesAdminNegativeTest-577749579 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 09:58:13 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-0676b3b4-cd12-4aa0-9f45-d19900ff3178 tempest-VolumesAdminNegativeTest-577749579 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 09:58:13 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-0676b3b4-cd12-4aa0-9f45-d19900ff3178 tempest-VolumesAdminNegativeTest-577749579 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:58:13 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-0676b3b4-cd12-4aa0-9f45-d19900ff3178 tempest-VolumesAdminNegativeTest-577749579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:58:13 devstack sudo[88678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a Sep 07 09:58:13 devstack sudo[88678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:58:14 devstack sudo[88678]: pam_unix(sudo:session): session closed for user root Sep 07 09:58:14 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-0676b3b4-cd12-4aa0-9f45-d19900ff3178 tempest-VolumesAdminNegativeTest-577749579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a" returned: 0 in 0.442s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:58:14 devstack cinder-volume[87515]: DEBUG cinder.manager [None req-0676b3b4-cd12-4aa0-9f45-d19900ff3178 tempest-VolumesAdminNegativeTest-577749579 None] Notifying Schedulers of capabilities ... {{(pid=87515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 09:58:14 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-0676b3b4-cd12-4aa0-9f45-d19900ff3178 tempest-VolumesAdminNegativeTest-577749579 None] Deleted volume successfully. Sep 07 09:58:14 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-0676b3b4-cd12-4aa0-9f45-d19900ff3178 tempest-VolumesAdminNegativeTest-577749579 None] Lock "cinder-6c204148-1259-4998-a3be-5528f18cadca-delete_volume" released by "delete_volume" :: held 2.130s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:58:20 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-a5e65b30-a602-4529-8f95-20b61e4ff1d9 tempest-GroupSnapshotsTest-1849189312 None] Group tempest-GroupSnapshotsTest-Group-317955635: creating Sep 07 09:58:20 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-a5e65b30-a602-4529-8f95-20b61e4ff1d9 tempest-GroupSnapshotsTest-1849189312 None] Group tempest-GroupSnapshotsTest-Group-317955635: created successfully Sep 07 09:58:20 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-a5e65b30-a602-4529-8f95-20b61e4ff1d9 tempest-GroupSnapshotsTest-1849189312 None] Create group completed successfully. Sep 07 09:58:22 devstack cinder-volume[87515]: DEBUG cinder.volume.flows.manager.create_volume [None req-832a5016-7aeb-4c32-b497-989796d7ae1f tempest-GroupSnapshotsTest-1849189312 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 09:58:22 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-832a5016-7aeb-4c32-b497-989796d7ae1f tempest-GroupSnapshotsTest-1849189312 None] Flow 'volume_create_manager' (fc3f355d-7deb-4e26-84a2-e6853a525cf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 09:58:22 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-832a5016-7aeb-4c32-b497-989796d7ae1f tempest-GroupSnapshotsTest-1849189312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8bac3392-d7d7-4ad7-851e-ec0ff95c38e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:58:22 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-832a5016-7aeb-4c32-b497-989796d7ae1f tempest-GroupSnapshotsTest-1849189312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8bac3392-d7d7-4ad7-851e-ec0ff95c38e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T07:58:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1286956897',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3330a5ae-3bf7-4516-8714-3d3f218d44f6,host='devstack@QuobyteHD#QuobyteHD',id=de0b0d11-bd68-4e98-bab2-f4a6a97d1f41,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0bdaa19ad94c41a98e26982980d686bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T07:58:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T07:58:22Z,use_quota=True,user_id='0a729d1b14204872b787704d5e4d6602',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f40ef2d7-8086-489b-b397-832023c827b4),volume_type_id=f40ef2d7-8086-489b-b397-832023c827b4)' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:58:22 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-832a5016-7aeb-4c32-b497-989796d7ae1f tempest-GroupSnapshotsTest-1849189312 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25834880-7ced-4182-8c24-f8a547e19abe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:58:22 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-832a5016-7aeb-4c32-b497-989796d7ae1f tempest-GroupSnapshotsTest-1849189312 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25834880-7ced-4182-8c24-f8a547e19abe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:58:22 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-832a5016-7aeb-4c32-b497-989796d7ae1f tempest-GroupSnapshotsTest-1849189312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2932ca3d-8c6b-4a61-8443-7c94df2d6c00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:58:22 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-832a5016-7aeb-4c32-b497-989796d7ae1f tempest-GroupSnapshotsTest-1849189312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2932ca3d-8c6b-4a61-8443-7c94df2d6c00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'de0b0d11-bd68-4e98-bab2-f4a6a97d1f41', 'volume_name': 'volume-de0b0d11-bd68-4e98-bab2-f4a6a97d1f41', 'volume_size': 1}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:58:22 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-832a5016-7aeb-4c32-b497-989796d7ae1f tempest-GroupSnapshotsTest-1849189312 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb4be643-0a04-49af-a50e-d7359d0f323a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:58:22 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-832a5016-7aeb-4c32-b497-989796d7ae1f tempest-GroupSnapshotsTest-1849189312 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb4be643-0a04-49af-a50e-d7359d0f323a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:58:22 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-832a5016-7aeb-4c32-b497-989796d7ae1f tempest-GroupSnapshotsTest-1849189312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fcdbd54f-5d44-4ccd-848f-bcfcf774e744) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:58:22 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-832a5016-7aeb-4c32-b497-989796d7ae1f tempest-GroupSnapshotsTest-1849189312 None] Volume de0b0d11-bd68-4e98-bab2-f4a6a97d1f41: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-de0b0d11-bd68-4e98-bab2-f4a6a97d1f41', 'volume_size': 1} Sep 07 09:58:22 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-832a5016-7aeb-4c32-b497-989796d7ae1f tempest-GroupSnapshotsTest-1849189312 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:58:22 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-832a5016-7aeb-4c32-b497-989796d7ae1f tempest-GroupSnapshotsTest-1849189312 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:58:22 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-832a5016-7aeb-4c32-b497-989796d7ae1f tempest-GroupSnapshotsTest-1849189312 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=3330a5ae-3bf7-4516-8714-3d3f218d44f6,created_at=2026-09-07T07:58:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1286956897',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3330a5ae-3bf7-4516-8714-3d3f218d44f6,host='devstack@QuobyteHD#QuobyteHD',id=de0b0d11-bd68-4e98-bab2-f4a6a97d1f41,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0bdaa19ad94c41a98e26982980d686bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T07:58:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T07:58:22Z,use_quota=True,user_id='0a729d1b14204872b787704d5e4d6602',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f40ef2d7-8086-489b-b397-832023c827b4),volume_type_id=f40ef2d7-8086-489b-b397-832023c827b4)}" {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 09:58:22 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-832a5016-7aeb-4c32-b497-989796d7ae1f tempest-GroupSnapshotsTest-1849189312 None] Creating volume de0b0d11-bd68-4e98-bab2-f4a6a97d1f41 {{(pid=87515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 09:58:22 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-832a5016-7aeb-4c32-b497-989796d7ae1f tempest-GroupSnapshotsTest-1849189312 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:58:22 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-832a5016-7aeb-4c32-b497-989796d7ae1f tempest-GroupSnapshotsTest-1849189312 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:58:22 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-832a5016-7aeb-4c32-b497-989796d7ae1f tempest-GroupSnapshotsTest-1849189312 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 09:58:22 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-832a5016-7aeb-4c32-b497-989796d7ae1f tempest-GroupSnapshotsTest-1849189312 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 09:58:22 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-832a5016-7aeb-4c32-b497-989796d7ae1f tempest-GroupSnapshotsTest-1849189312 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:58:22 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-832a5016-7aeb-4c32-b497-989796d7ae1f tempest-GroupSnapshotsTest-1849189312 None] Selected osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c as target Quobyte volume. {{(pid=87515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 09:58:22 devstack cinder-volume[87515]: INFO cinder.volume.drivers.remotefs [None req-832a5016-7aeb-4c32-b497-989796d7ae1f tempest-GroupSnapshotsTest-1849189312 None] casted to osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c Sep 07 09:58:22 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-832a5016-7aeb-4c32-b497-989796d7ae1f tempest-GroupSnapshotsTest-1849189312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-de0b0d11-bd68-4e98-bab2-f4a6a97d1f41 1073741824 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:58:22 devstack sudo[88713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-de0b0d11-bd68-4e98-bab2-f4a6a97d1f41 1073741824 Sep 07 09:58:22 devstack sudo[88713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:58:22 devstack sudo[88713]: pam_unix(sudo:session): session closed for user root Sep 07 09:58:22 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-832a5016-7aeb-4c32-b497-989796d7ae1f tempest-GroupSnapshotsTest-1849189312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-de0b0d11-bd68-4e98-bab2-f4a6a97d1f41 1073741824" returned: 0 in 0.588s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:58:22 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-832a5016-7aeb-4c32-b497-989796d7ae1f tempest-GroupSnapshotsTest-1849189312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-de0b0d11-bd68-4e98-bab2-f4a6a97d1f41 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:58:22 devstack sudo[88720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-de0b0d11-bd68-4e98-bab2-f4a6a97d1f41 Sep 07 09:58:22 devstack sudo[88720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:58:23 devstack sudo[88720]: pam_unix(sudo:session): session closed for user root Sep 07 09:58:23 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-832a5016-7aeb-4c32-b497-989796d7ae1f tempest-GroupSnapshotsTest-1849189312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-de0b0d11-bd68-4e98-bab2-f4a6a97d1f41" returned: 0 in 0.421s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:58:23 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-832a5016-7aeb-4c32-b497-989796d7ae1f tempest-GroupSnapshotsTest-1849189312 None] <== create_volume: return (1071ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'} {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 09:58:23 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-832a5016-7aeb-4c32-b497-989796d7ae1f tempest-GroupSnapshotsTest-1849189312 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.077s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:58:23 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-832a5016-7aeb-4c32-b497-989796d7ae1f tempest-GroupSnapshotsTest-1849189312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fcdbd54f-5d44-4ccd-848f-bcfcf774e744) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-de0b0d11-bd68-4e98-bab2-f4a6a97d1f41', 'volume_size': 1}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:58:23 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-832a5016-7aeb-4c32-b497-989796d7ae1f tempest-GroupSnapshotsTest-1849189312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (944c2866-80c7-4750-a7eb-2e2064adfb7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:58:23 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-832a5016-7aeb-4c32-b497-989796d7ae1f tempest-GroupSnapshotsTest-1849189312 None] Volume volume-de0b0d11-bd68-4e98-bab2-f4a6a97d1f41 (de0b0d11-bd68-4e98-bab2-f4a6a97d1f41): created successfully Sep 07 09:58:23 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-832a5016-7aeb-4c32-b497-989796d7ae1f tempest-GroupSnapshotsTest-1849189312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (944c2866-80c7-4750-a7eb-2e2064adfb7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:58:23 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-832a5016-7aeb-4c32-b497-989796d7ae1f tempest-GroupSnapshotsTest-1849189312 None] Flow 'volume_create_manager' (fc3f355d-7deb-4e26-84a2-e6853a525cf6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 09:58:23 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-832a5016-7aeb-4c32-b497-989796d7ae1f tempest-GroupSnapshotsTest-1849189312 None] Created volume successfully. Sep 07 09:58:24 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-7cada7e0-b1c4-401e-bf1b-e09e84aed7f8 tempest-GroupSnapshotsTest-1849189312 None] GroupSnapshot f3fbe70e-840c-4e58-88c5-e1d27c0bebe5: creating. Sep 07 09:58:25 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-7cada7e0-b1c4-401e-bf1b-e09e84aed7f8 tempest-GroupSnapshotsTest-1849189312 None] Group snapshot f3fbe70e-840c-4e58-88c5-e1d27c0bebe5: creating. {{(pid=87515) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 07 09:58:25 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-7cada7e0-b1c4-401e-bf1b-e09e84aed7f8 tempest-GroupSnapshotsTest-1849189312 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:58:25 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-7cada7e0-b1c4-401e-bf1b-e09e84aed7f8 tempest-GroupSnapshotsTest-1849189312 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:58:25 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-7cada7e0-b1c4-401e-bf1b-e09e84aed7f8 tempest-GroupSnapshotsTest-1849189312 None] Creating offline snapshot 3bf6508d-4266-4e38-b81d-91f06d42044d of volume de0b0d11-bd68-4e98-bab2-f4a6a97d1f41 {{(pid=87515) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 09:58:25 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[2986ab2d-5441-4896-b9e2-437d034f429a]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 09:58:25 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-7cada7e0-b1c4-401e-bf1b-e09e84aed7f8 tempest-GroupSnapshotsTest-1849189312 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-de0b0d11-bd68-4e98-bab2-f4a6a97d1f41 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:58:25 devstack sudo[88724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-de0b0d11-bd68-4e98-bab2-f4a6a97d1f41 Sep 07 09:58:25 devstack sudo[88724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:58:25 devstack sudo[88724]: pam_unix(sudo:session): session closed for user root Sep 07 09:58:25 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-7cada7e0-b1c4-401e-bf1b-e09e84aed7f8 tempest-GroupSnapshotsTest-1849189312 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-de0b0d11-bd68-4e98-bab2-f4a6a97d1f41" returned: 0 in 0.411s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:58:25 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-7cada7e0-b1c4-401e-bf1b-e09e84aed7f8 tempest-GroupSnapshotsTest-1849189312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-de0b0d11-bd68-4e98-bab2-f4a6a97d1f41,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-de0b0d11-bd68-4e98-bab2-f4a6a97d1f41.3bf6508d-4266-4e38-b81d-91f06d42044d 1G {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:58:25 devstack sudo[88730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-de0b0d11-bd68-4e98-bab2-f4a6a97d1f41,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-de0b0d11-bd68-4e98-bab2-f4a6a97d1f41.3bf6508d-4266-4e38-b81d-91f06d42044d 1G Sep 07 09:58:25 devstack sudo[88730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:58:26 devstack sudo[88730]: pam_unix(sudo:session): session closed for user root Sep 07 09:58:26 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-7cada7e0-b1c4-401e-bf1b-e09e84aed7f8 tempest-GroupSnapshotsTest-1849189312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-de0b0d11-bd68-4e98-bab2-f4a6a97d1f41,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-de0b0d11-bd68-4e98-bab2-f4a6a97d1f41.3bf6508d-4266-4e38-b81d-91f06d42044d 1G" returned: 0 in 0.598s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:58:26 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-7cada7e0-b1c4-401e-bf1b-e09e84aed7f8 tempest-GroupSnapshotsTest-1849189312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-de0b0d11-bd68-4e98-bab2-f4a6a97d1f41 -F qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-de0b0d11-bd68-4e98-bab2-f4a6a97d1f41.3bf6508d-4266-4e38-b81d-91f06d42044d {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:58:26 devstack sudo[88736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-de0b0d11-bd68-4e98-bab2-f4a6a97d1f41 -F qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-de0b0d11-bd68-4e98-bab2-f4a6a97d1f41.3bf6508d-4266-4e38-b81d-91f06d42044d Sep 07 09:58:26 devstack sudo[88736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:58:26 devstack sudo[88736]: pam_unix(sudo:session): session closed for user root Sep 07 09:58:26 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-7cada7e0-b1c4-401e-bf1b-e09e84aed7f8 tempest-GroupSnapshotsTest-1849189312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-de0b0d11-bd68-4e98-bab2-f4a6a97d1f41 -F qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-de0b0d11-bd68-4e98-bab2-f4a6a97d1f41.3bf6508d-4266-4e38-b81d-91f06d42044d" returned: 0 in 0.435s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:58:26 devstack cinder-volume[87515]: WARNING cinder.volume.drivers.remotefs [None req-7cada7e0-b1c4-401e-bf1b-e09e84aed7f8 tempest-GroupSnapshotsTest-1849189312 None] /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-de0b0d11-bd68-4e98-bab2-f4a6a97d1f41.3bf6508d-4266-4e38-b81d-91f06d42044d is being set with open permissions: ugo+rw: NotImplementedError Sep 07 09:58:26 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-7cada7e0-b1c4-401e-bf1b-e09e84aed7f8 tempest-GroupSnapshotsTest-1849189312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-de0b0d11-bd68-4e98-bab2-f4a6a97d1f41.3bf6508d-4266-4e38-b81d-91f06d42044d {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:58:26 devstack sudo[88741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-de0b0d11-bd68-4e98-bab2-f4a6a97d1f41.3bf6508d-4266-4e38-b81d-91f06d42044d Sep 07 09:58:26 devstack sudo[88741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:58:26 devstack sudo[88741]: pam_unix(sudo:session): session closed for user root Sep 07 09:58:26 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-7cada7e0-b1c4-401e-bf1b-e09e84aed7f8 tempest-GroupSnapshotsTest-1849189312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-de0b0d11-bd68-4e98-bab2-f4a6a97d1f41.3bf6508d-4266-4e38-b81d-91f06d42044d" returned: 0 in 0.345s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:58:26 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-7cada7e0-b1c4-401e-bf1b-e09e84aed7f8 tempest-GroupSnapshotsTest-1849189312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-de0b0d11-bd68-4e98-bab2-f4a6a97d1f41.info {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:58:26 devstack sudo[88744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-de0b0d11-bd68-4e98-bab2-f4a6a97d1f41.info Sep 07 09:58:27 devstack sudo[88744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:58:27 devstack sudo[88744]: pam_unix(sudo:session): session closed for user root Sep 07 09:58:27 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-7cada7e0-b1c4-401e-bf1b-e09e84aed7f8 tempest-GroupSnapshotsTest-1849189312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-de0b0d11-bd68-4e98-bab2-f4a6a97d1f41.info" returned: 0 in 0.308s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:58:27 devstack cinder-volume[87515]: WARNING cinder.volume.drivers.remotefs [None req-7cada7e0-b1c4-401e-bf1b-e09e84aed7f8 tempest-GroupSnapshotsTest-1849189312 None] /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-de0b0d11-bd68-4e98-bab2-f4a6a97d1f41.info is being set with open permissions: ugo+rw: NotImplementedError Sep 07 09:58:27 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-7cada7e0-b1c4-401e-bf1b-e09e84aed7f8 tempest-GroupSnapshotsTest-1849189312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-de0b0d11-bd68-4e98-bab2-f4a6a97d1f41.info {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:58:27 devstack sudo[88747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-de0b0d11-bd68-4e98-bab2-f4a6a97d1f41.info Sep 07 09:58:27 devstack sudo[88747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:58:27 devstack sudo[88747]: pam_unix(sudo:session): session closed for user root Sep 07 09:58:27 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-7cada7e0-b1c4-401e-bf1b-e09e84aed7f8 tempest-GroupSnapshotsTest-1849189312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-de0b0d11-bd68-4e98-bab2-f4a6a97d1f41.info" returned: 0 in 0.354s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:58:27 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-7cada7e0-b1c4-401e-bf1b-e09e84aed7f8 tempest-GroupSnapshotsTest-1849189312 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.572s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:58:27 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-7cada7e0-b1c4-401e-bf1b-e09e84aed7f8 tempest-GroupSnapshotsTest-1849189312 None] group_snapshot f3fbe70e-840c-4e58-88c5-e1d27c0bebe5: created successfully Sep 07 09:58:29 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-61297e9f-33aa-4ef4-80e1-09c16c11939f tempest-GroupSnapshotsTest-1849189312 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:58:29 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-61297e9f-33aa-4ef4-80e1-09c16c11939f tempest-GroupSnapshotsTest-1849189312 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:58:29 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-61297e9f-33aa-4ef4-80e1-09c16c11939f tempest-GroupSnapshotsTest-1849189312 None] Acquiring lock "cinder-quobyte-3bf6508d-4266-4e38-b81d-91f06d42044d-e95b8cbf-d201-4b1c-9a53-d8e11c314e1c" by "_create_volume_from_snapshot" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:58:29 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-61297e9f-33aa-4ef4-80e1-09c16c11939f tempest-GroupSnapshotsTest-1849189312 None] Lock "cinder-quobyte-3bf6508d-4266-4e38-b81d-91f06d42044d-e95b8cbf-d201-4b1c-9a53-d8e11c314e1c" acquired by "_create_volume_from_snapshot" :: waited 0.020s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:58:29 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-61297e9f-33aa-4ef4-80e1-09c16c11939f tempest-GroupSnapshotsTest-1849189312 None] Creating volume e95b8cbf-d201-4b1c-9a53-d8e11c314e1c from snapshot 3bf6508d-4266-4e38-b81d-91f06d42044d {{(pid=87515) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 07 09:58:29 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-61297e9f-33aa-4ef4-80e1-09c16c11939f tempest-GroupSnapshotsTest-1849189312 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:58:29 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-61297e9f-33aa-4ef4-80e1-09c16c11939f tempest-GroupSnapshotsTest-1849189312 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:58:29 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-61297e9f-33aa-4ef4-80e1-09c16c11939f tempest-GroupSnapshotsTest-1849189312 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 09:58:29 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-61297e9f-33aa-4ef4-80e1-09c16c11939f tempest-GroupSnapshotsTest-1849189312 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 09:58:29 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-61297e9f-33aa-4ef4-80e1-09c16c11939f tempest-GroupSnapshotsTest-1849189312 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:58:29 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-61297e9f-33aa-4ef4-80e1-09c16c11939f tempest-GroupSnapshotsTest-1849189312 None] Selected osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c as target Quobyte volume. {{(pid=87515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 09:58:29 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-61297e9f-33aa-4ef4-80e1-09c16c11939f tempest-GroupSnapshotsTest-1849189312 None] Acquiring lock "cinder-quobyte-e95b8cbf-d201-4b1c-9a53-d8e11c314e1c" by "_copy_volume_from_snapshot" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:58:29 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-61297e9f-33aa-4ef4-80e1-09c16c11939f tempest-GroupSnapshotsTest-1849189312 None] Lock "cinder-quobyte-e95b8cbf-d201-4b1c-9a53-d8e11c314e1c" acquired by "_copy_volume_from_snapshot" :: waited 0.035s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:58:29 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-61297e9f-33aa-4ef4-80e1-09c16c11939f tempest-GroupSnapshotsTest-1849189312 None] snapshot: 3bf6508d-4266-4e38-b81d-91f06d42044d, volume: e95b8cbf-d201-4b1c-9a53-d8e11c314e1c, {{(pid=87515) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 07 09:58:29 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-61297e9f-33aa-4ef4-80e1-09c16c11939f tempest-GroupSnapshotsTest-1849189312 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:58:29 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-61297e9f-33aa-4ef4-80e1-09c16c11939f tempest-GroupSnapshotsTest-1849189312 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:58:29 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-61297e9f-33aa-4ef4-80e1-09c16c11939f tempest-GroupSnapshotsTest-1849189312 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 09:58:29 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-61297e9f-33aa-4ef4-80e1-09c16c11939f tempest-GroupSnapshotsTest-1849189312 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 09:58:29 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-61297e9f-33aa-4ef4-80e1-09c16c11939f tempest-GroupSnapshotsTest-1849189312 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:58:29 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbeabb87-f57c-4f70-abb1-d2023eee9989]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 09:58:29 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-61297e9f-33aa-4ef4-80e1-09c16c11939f tempest-GroupSnapshotsTest-1849189312 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-de0b0d11-bd68-4e98-bab2-f4a6a97d1f41.3bf6508d-4266-4e38-b81d-91f06d42044d {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:58:29 devstack sudo[88755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-de0b0d11-bd68-4e98-bab2-f4a6a97d1f41.3bf6508d-4266-4e38-b81d-91f06d42044d Sep 07 09:58:29 devstack sudo[88755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:58:29 devstack sudo[88755]: pam_unix(sudo:session): session closed for user root Sep 07 09:58:29 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-61297e9f-33aa-4ef4-80e1-09c16c11939f tempest-GroupSnapshotsTest-1849189312 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-de0b0d11-bd68-4e98-bab2-f4a6a97d1f41.3bf6508d-4266-4e38-b81d-91f06d42044d" returned: 0 in 0.504s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:58:29 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-61297e9f-33aa-4ef4-80e1-09c16c11939f tempest-GroupSnapshotsTest-1849189312 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-de0b0d11-bd68-4e98-bab2-f4a6a97d1f41(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87515) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 09:58:29 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[1156f7db-5f44-4155-9d33-15594bfb33aa]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 09:58:29 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-61297e9f-33aa-4ef4-80e1-09c16c11939f tempest-GroupSnapshotsTest-1849189312 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-de0b0d11-bd68-4e98-bab2-f4a6a97d1f41 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:58:30 devstack sudo[88760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-de0b0d11-bd68-4e98-bab2-f4a6a97d1f41 Sep 07 09:58:30 devstack sudo[88760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:58:30 devstack sudo[88760]: pam_unix(sudo:session): session closed for user root Sep 07 09:58:30 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-61297e9f-33aa-4ef4-80e1-09c16c11939f tempest-GroupSnapshotsTest-1849189312 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-de0b0d11-bd68-4e98-bab2-f4a6a97d1f41" returned: 0 in 0.466s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:58:30 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-61297e9f-33aa-4ef4-80e1-09c16c11939f tempest-GroupSnapshotsTest-1849189312 None] will copy from snapshot at /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-de0b0d11-bd68-4e98-bab2-f4a6a97d1f41 {{(pid=87515) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 07 09:58:30 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-61297e9f-33aa-4ef4-80e1-09c16c11939f tempest-GroupSnapshotsTest-1849189312 None] Creating direct copy from snapshot {{(pid=87515) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 07 09:58:30 devstack cinder-volume[87515]: DEBUG cinder.utils [None req-61297e9f-33aa-4ef4-80e1-09c16c11939f tempest-GroupSnapshotsTest-1849189312 None] Path /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-e95b8cbf-d201-4b1c-9a53-d8e11c314e1c not found in is_blk_device check {{(pid=87515) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 07 09:58:30 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-61297e9f-33aa-4ef4-80e1-09c16c11939f tempest-GroupSnapshotsTest-1849189312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-de0b0d11-bd68-4e98-bab2-f4a6a97d1f41 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-e95b8cbf-d201-4b1c-9a53-d8e11c314e1c {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:58:30 devstack sudo[88767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-de0b0d11-bd68-4e98-bab2-f4a6a97d1f41 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-e95b8cbf-d201-4b1c-9a53-d8e11c314e1c Sep 07 09:58:30 devstack sudo[88767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:58:35 devstack cinder-volume[87515]: DEBUG cinder.volume.flows.manager.create_volume [None req-f2954072-02e5-4e77-8418-bbfef5623009 tempest-ServerActionsTestOtherA-1577109295 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 09:58:35 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-f2954072-02e5-4e77-8418-bbfef5623009 tempest-ServerActionsTestOtherA-1577109295 None] Flow 'volume_create_manager' (fc8bdd71-bb38-4538-a581-96fcd4c7b096) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 09:58:35 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-f2954072-02e5-4e77-8418-bbfef5623009 tempest-ServerActionsTestOtherA-1577109295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58bdec1c-88b5-4da1-ac5f-6837747821ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:58:35 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-f2954072-02e5-4e77-8418-bbfef5623009 tempest-ServerActionsTestOtherA-1577109295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58bdec1c-88b5-4da1-ac5f-6837747821ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T07:58:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-667206532',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15e4fccc-b0e8-488e-8c3e-d0261bf8472c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0805f131487d4bf6907414c10b172704',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T07:58:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T07:58:35Z,use_quota=True,user_id='1918b665bf3a468e837ffc0cefcbf767',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3a092cd-7947-4cbf-abff-4ba9567becf0),volume_type_id=f3a092cd-7947-4cbf-abff-4ba9567becf0)' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:58:35 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-f2954072-02e5-4e77-8418-bbfef5623009 tempest-ServerActionsTestOtherA-1577109295 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34fbcd9c-e4b2-4fee-a182-7e8dbbfe4135) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:58:35 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-f2954072-02e5-4e77-8418-bbfef5623009 tempest-ServerActionsTestOtherA-1577109295 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34fbcd9c-e4b2-4fee-a182-7e8dbbfe4135) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:58:35 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-f2954072-02e5-4e77-8418-bbfef5623009 tempest-ServerActionsTestOtherA-1577109295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b55aa54-8f8d-4b58-ab71-2c0d587062ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:58:35 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-f2954072-02e5-4e77-8418-bbfef5623009 tempest-ServerActionsTestOtherA-1577109295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b55aa54-8f8d-4b58-ab71-2c0d587062ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '15e4fccc-b0e8-488e-8c3e-d0261bf8472c', 'volume_name': 'volume-15e4fccc-b0e8-488e-8c3e-d0261bf8472c', 'volume_size': 1}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:58:35 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-f2954072-02e5-4e77-8418-bbfef5623009 tempest-ServerActionsTestOtherA-1577109295 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79eff41e-6329-41a9-82f0-c1de1154960b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:58:35 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-f2954072-02e5-4e77-8418-bbfef5623009 tempest-ServerActionsTestOtherA-1577109295 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79eff41e-6329-41a9-82f0-c1de1154960b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:58:35 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-f2954072-02e5-4e77-8418-bbfef5623009 tempest-ServerActionsTestOtherA-1577109295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6eeccbd8-f20f-499b-9a8d-bd2094d04b96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:58:35 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-f2954072-02e5-4e77-8418-bbfef5623009 tempest-ServerActionsTestOtherA-1577109295 None] Volume 15e4fccc-b0e8-488e-8c3e-d0261bf8472c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-15e4fccc-b0e8-488e-8c3e-d0261bf8472c', 'volume_size': 1} Sep 07 09:58:35 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-f2954072-02e5-4e77-8418-bbfef5623009 tempest-ServerActionsTestOtherA-1577109295 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:58:36 devstack sudo[88767]: pam_unix(sudo:session): session closed for user root Sep 07 09:58:36 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-61297e9f-33aa-4ef4-80e1-09c16c11939f tempest-GroupSnapshotsTest-1849189312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-de0b0d11-bd68-4e98-bab2-f4a6a97d1f41 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-e95b8cbf-d201-4b1c-9a53-d8e11c314e1c" returned: 0 in 6.449s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:58:36 devstack cinder-volume[87515]: DEBUG cinder.image.image_utils [None req-61297e9f-33aa-4ef4-80e1-09c16c11939f tempest-GroupSnapshotsTest-1849189312 None] Image conversion details: src /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-de0b0d11-bd68-4e98-bab2-f4a6a97d1f41, size 1024.00 MB, duration 6.45 sec, destination /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-e95b8cbf-d201-4b1c-9a53-d8e11c314e1c {{(pid=87515) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 07 09:58:36 devstack cinder-volume[87515]: INFO cinder.image.image_utils [None req-61297e9f-33aa-4ef4-80e1-09c16c11939f tempest-GroupSnapshotsTest-1849189312 None] Converted 1024.00 MB image at 158.73 MB/s Sep 07 09:58:36 devstack cinder-volume[87515]: WARNING cinder.volume.drivers.remotefs [None req-61297e9f-33aa-4ef4-80e1-09c16c11939f tempest-GroupSnapshotsTest-1849189312 None] /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-e95b8cbf-d201-4b1c-9a53-d8e11c314e1c is being set with open permissions: ugo+rw: NotImplementedError Sep 07 09:58:36 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-61297e9f-33aa-4ef4-80e1-09c16c11939f tempest-GroupSnapshotsTest-1849189312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-e95b8cbf-d201-4b1c-9a53-d8e11c314e1c {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:58:36 devstack sudo[88800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-e95b8cbf-d201-4b1c-9a53-d8e11c314e1c Sep 07 09:58:36 devstack sudo[88800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:58:37 devstack sudo[88800]: pam_unix(sudo:session): session closed for user root Sep 07 09:58:37 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-61297e9f-33aa-4ef4-80e1-09c16c11939f tempest-GroupSnapshotsTest-1849189312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-e95b8cbf-d201-4b1c-9a53-d8e11c314e1c" returned: 0 in 0.355s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:58:37 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-61297e9f-33aa-4ef4-80e1-09c16c11939f tempest-GroupSnapshotsTest-1849189312 None] Lock "cinder-quobyte-e95b8cbf-d201-4b1c-9a53-d8e11c314e1c" released by "_copy_volume_from_snapshot" :: held 7.911s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:58:37 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-61297e9f-33aa-4ef4-80e1-09c16c11939f tempest-GroupSnapshotsTest-1849189312 None] Lock "cinder-quobyte-3bf6508d-4266-4e38-b81d-91f06d42044d-e95b8cbf-d201-4b1c-9a53-d8e11c314e1c" released by "_create_volume_from_snapshot" :: held 8.014s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:58:37 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-61297e9f-33aa-4ef4-80e1-09c16c11939f tempest-GroupSnapshotsTest-1849189312 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.036s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:58:37 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-f2954072-02e5-4e77-8418-bbfef5623009 tempest-ServerActionsTestOtherA-1577109295 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.686s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:58:37 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-f2954072-02e5-4e77-8418-bbfef5623009 tempest-ServerActionsTestOtherA-1577109295 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T07:58:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-667206532',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15e4fccc-b0e8-488e-8c3e-d0261bf8472c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0805f131487d4bf6907414c10b172704',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T07:58:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T07:58:35Z,use_quota=True,user_id='1918b665bf3a468e837ffc0cefcbf767',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3a092cd-7947-4cbf-abff-4ba9567becf0),volume_type_id=f3a092cd-7947-4cbf-abff-4ba9567becf0)}" {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 09:58:37 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-f2954072-02e5-4e77-8418-bbfef5623009 tempest-ServerActionsTestOtherA-1577109295 None] Creating volume 15e4fccc-b0e8-488e-8c3e-d0261bf8472c {{(pid=87515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 09:58:37 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-f2954072-02e5-4e77-8418-bbfef5623009 tempest-ServerActionsTestOtherA-1577109295 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:58:37 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-f2954072-02e5-4e77-8418-bbfef5623009 tempest-ServerActionsTestOtherA-1577109295 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:58:37 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-f2954072-02e5-4e77-8418-bbfef5623009 tempest-ServerActionsTestOtherA-1577109295 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 09:58:37 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-f2954072-02e5-4e77-8418-bbfef5623009 tempest-ServerActionsTestOtherA-1577109295 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 09:58:37 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-f2954072-02e5-4e77-8418-bbfef5623009 tempest-ServerActionsTestOtherA-1577109295 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:58:37 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-f2954072-02e5-4e77-8418-bbfef5623009 tempest-ServerActionsTestOtherA-1577109295 None] Selected osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c as target Quobyte volume. {{(pid=87515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 09:58:37 devstack cinder-volume[87515]: INFO cinder.volume.drivers.remotefs [None req-f2954072-02e5-4e77-8418-bbfef5623009 tempest-ServerActionsTestOtherA-1577109295 None] casted to osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c Sep 07 09:58:37 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-f2954072-02e5-4e77-8418-bbfef5623009 tempest-ServerActionsTestOtherA-1577109295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-15e4fccc-b0e8-488e-8c3e-d0261bf8472c 1073741824 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:58:37 devstack sudo[88803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-15e4fccc-b0e8-488e-8c3e-d0261bf8472c 1073741824 Sep 07 09:58:37 devstack sudo[88803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:58:37 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-61297e9f-33aa-4ef4-80e1-09c16c11939f tempest-GroupSnapshotsTest-1849189312 None] Create group from source-snapshot-f3fbe70e-840c-4e58-88c5-e1d27c0bebe5 completed successfully. Sep 07 09:58:37 devstack sudo[88803]: pam_unix(sudo:session): session closed for user root Sep 07 09:58:37 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-f2954072-02e5-4e77-8418-bbfef5623009 tempest-ServerActionsTestOtherA-1577109295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-15e4fccc-b0e8-488e-8c3e-d0261bf8472c 1073741824" returned: 0 in 0.617s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:58:38 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-f2954072-02e5-4e77-8418-bbfef5623009 tempest-ServerActionsTestOtherA-1577109295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-15e4fccc-b0e8-488e-8c3e-d0261bf8472c {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:58:38 devstack sudo[88809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-15e4fccc-b0e8-488e-8c3e-d0261bf8472c Sep 07 09:58:38 devstack sudo[88809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:58:38 devstack sudo[88809]: pam_unix(sudo:session): session closed for user root Sep 07 09:58:38 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-f2954072-02e5-4e77-8418-bbfef5623009 tempest-ServerActionsTestOtherA-1577109295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-15e4fccc-b0e8-488e-8c3e-d0261bf8472c" returned: 0 in 0.296s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:58:38 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-f2954072-02e5-4e77-8418-bbfef5623009 tempest-ServerActionsTestOtherA-1577109295 None] <== create_volume: return (982ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'} {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 09:58:38 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-f2954072-02e5-4e77-8418-bbfef5623009 tempest-ServerActionsTestOtherA-1577109295 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.989s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:58:38 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-f2954072-02e5-4e77-8418-bbfef5623009 tempest-ServerActionsTestOtherA-1577109295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6eeccbd8-f20f-499b-9a8d-bd2094d04b96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-15e4fccc-b0e8-488e-8c3e-d0261bf8472c', 'volume_size': 1}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:58:38 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-f2954072-02e5-4e77-8418-bbfef5623009 tempest-ServerActionsTestOtherA-1577109295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (095b4320-04da-46cc-ae0a-38cde96b5dee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:58:38 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-f2954072-02e5-4e77-8418-bbfef5623009 tempest-ServerActionsTestOtherA-1577109295 None] Volume volume-15e4fccc-b0e8-488e-8c3e-d0261bf8472c (15e4fccc-b0e8-488e-8c3e-d0261bf8472c): created successfully Sep 07 09:58:38 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-f2954072-02e5-4e77-8418-bbfef5623009 tempest-ServerActionsTestOtherA-1577109295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (095b4320-04da-46cc-ae0a-38cde96b5dee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:58:38 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-f2954072-02e5-4e77-8418-bbfef5623009 tempest-ServerActionsTestOtherA-1577109295 None] Flow 'volume_create_manager' (fc8bdd71-bb38-4538-a581-96fcd4c7b096) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 09:58:38 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-f2954072-02e5-4e77-8418-bbfef5623009 tempest-ServerActionsTestOtherA-1577109295 None] Created volume successfully. Sep 07 09:58:38 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-4e0b6f6f-adb1-4a5c-8012-960ea57bb4f1 tempest-GroupSnapshotsTest-1849189312 None] Acquiring lock "cinder-quobyte-e95b8cbf-d201-4b1c-9a53-d8e11c314e1c" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:58:38 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-4e0b6f6f-adb1-4a5c-8012-960ea57bb4f1 tempest-GroupSnapshotsTest-1849189312 None] Lock "cinder-quobyte-e95b8cbf-d201-4b1c-9a53-d8e11c314e1c" acquired by "delete_volume" :: waited 0.018s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:58:38 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[a183cdb2-7042-4471-8225-9a822216c982]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 09:58:38 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-4e0b6f6f-adb1-4a5c-8012-960ea57bb4f1 tempest-GroupSnapshotsTest-1849189312 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-e95b8cbf-d201-4b1c-9a53-d8e11c314e1c {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:58:38 devstack sudo[88813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-e95b8cbf-d201-4b1c-9a53-d8e11c314e1c Sep 07 09:58:38 devstack sudo[88813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:58:39 devstack sudo[88813]: pam_unix(sudo:session): session closed for user root Sep 07 09:58:39 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-4e0b6f6f-adb1-4a5c-8012-960ea57bb4f1 tempest-GroupSnapshotsTest-1849189312 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-e95b8cbf-d201-4b1c-9a53-d8e11c314e1c" returned: 0 in 0.562s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:58:39 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-4e0b6f6f-adb1-4a5c-8012-960ea57bb4f1 tempest-GroupSnapshotsTest-1849189312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-e95b8cbf-d201-4b1c-9a53-d8e11c314e1c {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:58:39 devstack sudo[88818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-e95b8cbf-d201-4b1c-9a53-d8e11c314e1c Sep 07 09:58:39 devstack sudo[88818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:58:39 devstack sudo[88818]: pam_unix(sudo:session): session closed for user root Sep 07 09:58:39 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-4e0b6f6f-adb1-4a5c-8012-960ea57bb4f1 tempest-GroupSnapshotsTest-1849189312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-e95b8cbf-d201-4b1c-9a53-d8e11c314e1c" returned: 0 in 0.302s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:58:39 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-4e0b6f6f-adb1-4a5c-8012-960ea57bb4f1 tempest-GroupSnapshotsTest-1849189312 None] Lock "cinder-quobyte-e95b8cbf-d201-4b1c-9a53-d8e11c314e1c" released by "delete_volume" :: held 0.929s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:58:39 devstack cinder-volume[87515]: DEBUG cinder.quota [None req-4e0b6f6f-adb1-4a5c-8012-960ea57bb4f1 tempest-GroupSnapshotsTest-1849189312 None] Created reservations ['136c0660-15e9-4abc-953b-098af5de5f46'] {{(pid=87515) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 09:58:39 devstack cinder-volume[87515]: WARNING cinder.quota [None req-4e0b6f6f-adb1-4a5c-8012-960ea57bb4f1 tempest-GroupSnapshotsTest-1849189312 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1036916727 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1036916727, it is now deprecated. Please use the default quota class for default quota. Sep 07 09:58:39 devstack cinder-volume[87515]: WARNING cinder.quota [None req-4e0b6f6f-adb1-4a5c-8012-960ea57bb4f1 tempest-GroupSnapshotsTest-1849189312 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1036916727 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1036916727, it is now deprecated. Please use the default quota class for default quota. Sep 07 09:58:39 devstack cinder-volume[87515]: DEBUG cinder.quota [None req-4e0b6f6f-adb1-4a5c-8012-960ea57bb4f1 tempest-GroupSnapshotsTest-1849189312 None] Created reservations ['f5814150-f0cb-4beb-b29a-0643b232b0b7', 'e974ab45-64de-43b4-9107-cc31b85de031', '9cd13f6f-196e-4401-96ef-328ece875037', 'fda06e4b-d482-4121-98c6-c6945d2c0c42'] {{(pid=87515) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 09:58:39 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-4e0b6f6f-adb1-4a5c-8012-960ea57bb4f1 tempest-GroupSnapshotsTest-1849189312 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:58:39 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-4e0b6f6f-adb1-4a5c-8012-960ea57bb4f1 tempest-GroupSnapshotsTest-1849189312 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:58:39 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-4e0b6f6f-adb1-4a5c-8012-960ea57bb4f1 tempest-GroupSnapshotsTest-1849189312 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 09:58:39 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-4e0b6f6f-adb1-4a5c-8012-960ea57bb4f1 tempest-GroupSnapshotsTest-1849189312 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 09:58:39 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-4e0b6f6f-adb1-4a5c-8012-960ea57bb4f1 tempest-GroupSnapshotsTest-1849189312 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:58:39 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-4e0b6f6f-adb1-4a5c-8012-960ea57bb4f1 tempest-GroupSnapshotsTest-1849189312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:58:39 devstack sudo[88826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a Sep 07 09:58:39 devstack sudo[88826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:58:40 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-664e5ceb-6b3b-4b54-b6d6-9ffd2465541d tempest-GroupSnapshotsTest-1849189312 None] group_snapshot f3fbe70e-840c-4e58-88c5-e1d27c0bebe5: deleting Sep 07 09:58:40 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-664e5ceb-6b3b-4b54-b6d6-9ffd2465541d tempest-GroupSnapshotsTest-1849189312 None] group_snapshot f3fbe70e-840c-4e58-88c5-e1d27c0bebe5: deleting {{(pid=87515) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 07 09:58:40 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-664e5ceb-6b3b-4b54-b6d6-9ffd2465541d tempest-GroupSnapshotsTest-1849189312 None] Acquiring lock "cinder-quobyte-de0b0d11-bd68-4e98-bab2-f4a6a97d1f41" by "delete_snapshot" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:58:40 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-664e5ceb-6b3b-4b54-b6d6-9ffd2465541d tempest-GroupSnapshotsTest-1849189312 None] Lock "cinder-quobyte-de0b0d11-bd68-4e98-bab2-f4a6a97d1f41" acquired by "delete_snapshot" :: waited 0.039s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:58:40 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-664e5ceb-6b3b-4b54-b6d6-9ffd2465541d tempest-GroupSnapshotsTest-1849189312 None] Acquiring lock "cinder-quobyte-3bf6508d-4266-4e38-b81d-91f06d42044d" by "_delete_snapshot" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:58:40 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-664e5ceb-6b3b-4b54-b6d6-9ffd2465541d tempest-GroupSnapshotsTest-1849189312 None] Lock "cinder-quobyte-3bf6508d-4266-4e38-b81d-91f06d42044d" acquired by "_delete_snapshot" :: waited 0.058s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:58:40 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-664e5ceb-6b3b-4b54-b6d6-9ffd2465541d tempest-GroupSnapshotsTest-1849189312 None] Deleting offline snapshot 3bf6508d-4266-4e38-b81d-91f06d42044d of volume de0b0d11-bd68-4e98-bab2-f4a6a97d1f41 {{(pid=87515) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 09:58:40 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-664e5ceb-6b3b-4b54-b6d6-9ffd2465541d tempest-GroupSnapshotsTest-1849189312 None] snapshot_file for this snap is: volume-de0b0d11-bd68-4e98-bab2-f4a6a97d1f41.3bf6508d-4266-4e38-b81d-91f06d42044d {{(pid=87515) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 09:58:40 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8668234-43c3-41a3-b667-5d9b0b00c2a2]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 09:58:40 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-664e5ceb-6b3b-4b54-b6d6-9ffd2465541d tempest-GroupSnapshotsTest-1849189312 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-de0b0d11-bd68-4e98-bab2-f4a6a97d1f41.3bf6508d-4266-4e38-b81d-91f06d42044d {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:58:40 devstack sudo[88835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-de0b0d11-bd68-4e98-bab2-f4a6a97d1f41.3bf6508d-4266-4e38-b81d-91f06d42044d Sep 07 09:58:40 devstack sudo[88835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:58:40 devstack sudo[88826]: pam_unix(sudo:session): session closed for user root Sep 07 09:58:40 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-4e0b6f6f-adb1-4a5c-8012-960ea57bb4f1 tempest-GroupSnapshotsTest-1849189312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a" returned: 0 in 0.655s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:58:40 devstack cinder-volume[87515]: DEBUG cinder.manager [None req-4e0b6f6f-adb1-4a5c-8012-960ea57bb4f1 tempest-GroupSnapshotsTest-1849189312 None] Notifying Schedulers of capabilities ... {{(pid=87515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 09:58:40 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-4e0b6f6f-adb1-4a5c-8012-960ea57bb4f1 tempest-GroupSnapshotsTest-1849189312 None] Delete group completed successfully. Sep 07 09:58:40 devstack sudo[88835]: pam_unix(sudo:session): session closed for user root Sep 07 09:58:40 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-664e5ceb-6b3b-4b54-b6d6-9ffd2465541d tempest-GroupSnapshotsTest-1849189312 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-de0b0d11-bd68-4e98-bab2-f4a6a97d1f41.3bf6508d-4266-4e38-b81d-91f06d42044d" returned: 0 in 0.541s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:58:40 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-664e5ceb-6b3b-4b54-b6d6-9ffd2465541d tempest-GroupSnapshotsTest-1849189312 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-de0b0d11-bd68-4e98-bab2-f4a6a97d1f41(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87515) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 09:58:41 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[46b93d92-58d6-4642-bf2d-ac9ec19d75a0]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 09:58:41 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-664e5ceb-6b3b-4b54-b6d6-9ffd2465541d tempest-GroupSnapshotsTest-1849189312 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-de0b0d11-bd68-4e98-bab2-f4a6a97d1f41 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:58:41 devstack sudo[88846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-de0b0d11-bd68-4e98-bab2-f4a6a97d1f41 Sep 07 09:58:41 devstack sudo[88846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:58:41 devstack sudo[88846]: pam_unix(sudo:session): session closed for user root Sep 07 09:58:41 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-664e5ceb-6b3b-4b54-b6d6-9ffd2465541d tempest-GroupSnapshotsTest-1849189312 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-de0b0d11-bd68-4e98-bab2-f4a6a97d1f41" returned: 0 in 0.692s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:58:41 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-664e5ceb-6b3b-4b54-b6d6-9ffd2465541d tempest-GroupSnapshotsTest-1849189312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-de0b0d11-bd68-4e98-bab2-f4a6a97d1f41.3bf6508d-4266-4e38-b81d-91f06d42044d {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:58:41 devstack sudo[88854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-de0b0d11-bd68-4e98-bab2-f4a6a97d1f41.3bf6508d-4266-4e38-b81d-91f06d42044d Sep 07 09:58:41 devstack sudo[88854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:58:42 devstack sudo[88854]: pam_unix(sudo:session): session closed for user root Sep 07 09:58:42 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-664e5ceb-6b3b-4b54-b6d6-9ffd2465541d tempest-GroupSnapshotsTest-1849189312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-de0b0d11-bd68-4e98-bab2-f4a6a97d1f41.3bf6508d-4266-4e38-b81d-91f06d42044d" returned: 0 in 0.624s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:58:42 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-664e5ceb-6b3b-4b54-b6d6-9ffd2465541d tempest-GroupSnapshotsTest-1849189312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-de0b0d11-bd68-4e98-bab2-f4a6a97d1f41.3bf6508d-4266-4e38-b81d-91f06d42044d {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:58:42 devstack sudo[88863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-de0b0d11-bd68-4e98-bab2-f4a6a97d1f41.3bf6508d-4266-4e38-b81d-91f06d42044d Sep 07 09:58:42 devstack sudo[88863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:58:42 devstack sudo[88863]: pam_unix(sudo:session): session closed for user root Sep 07 09:58:42 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-664e5ceb-6b3b-4b54-b6d6-9ffd2465541d tempest-GroupSnapshotsTest-1849189312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-de0b0d11-bd68-4e98-bab2-f4a6a97d1f41.3bf6508d-4266-4e38-b81d-91f06d42044d" returned: 0 in 0.411s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:58:42 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-664e5ceb-6b3b-4b54-b6d6-9ffd2465541d tempest-GroupSnapshotsTest-1849189312 None] Lock "cinder-quobyte-3bf6508d-4266-4e38-b81d-91f06d42044d" released by "_delete_snapshot" :: held 2.456s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:58:42 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-664e5ceb-6b3b-4b54-b6d6-9ffd2465541d tempest-GroupSnapshotsTest-1849189312 None] Lock "cinder-quobyte-de0b0d11-bd68-4e98-bab2-f4a6a97d1f41" released by "delete_snapshot" :: held 2.526s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:58:42 devstack cinder-volume[87515]: WARNING cinder.quota [None req-664e5ceb-6b3b-4b54-b6d6-9ffd2465541d tempest-GroupSnapshotsTest-1849189312 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1036916727 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1036916727, it is now deprecated. Please use the default quota class for default quota. Sep 07 09:58:43 devstack cinder-volume[87515]: DEBUG cinder.quota [None req-664e5ceb-6b3b-4b54-b6d6-9ffd2465541d tempest-GroupSnapshotsTest-1849189312 None] Created reservations ['bf19c7ab-e9dc-4547-b760-01984ee90743', 'f8cfc138-3852-48ff-b462-4ebd501857c7', 'e4ac2760-3d53-44b6-8456-bf4c2a5a496c', '5a489176-de66-4fd3-99ac-fae469ef36f8'] {{(pid=87515) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 09:58:43 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-664e5ceb-6b3b-4b54-b6d6-9ffd2465541d tempest-GroupSnapshotsTest-1849189312 None] group_snapshot f3fbe70e-840c-4e58-88c5-e1d27c0bebe5: deleted successfully Sep 07 09:58:44 devstack cinder-volume[87515]: DEBUG dbcounter [-] [87515] Writing DB stats cinder:SELECT=56,cinder:UPDATE=62,cinder:INSERT=10,cinder:DELETE=4 {{(pid=87515) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 09:58:44 devstack cinder-volume[87515]: DEBUG dbcounter [-] [87515] Writing DB stats cinder:UPDATE=54,cinder:SELECT=56,cinder:INSERT=18,cinder:DELETE=3 {{(pid=87515) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 09:58:44 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-0496817b-a6a6-49bf-980a-a76c758e3a15 tempest-GroupSnapshotsTest-1849189312 None] Acquiring lock "cinder-quobyte-de0b0d11-bd68-4e98-bab2-f4a6a97d1f41" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:58:44 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-0496817b-a6a6-49bf-980a-a76c758e3a15 tempest-GroupSnapshotsTest-1849189312 None] Lock "cinder-quobyte-de0b0d11-bd68-4e98-bab2-f4a6a97d1f41" acquired by "delete_volume" :: waited 0.037s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:58:44 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[48d9d831-1b31-441d-81d4-64a31a182b78]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 09:58:44 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-0496817b-a6a6-49bf-980a-a76c758e3a15 tempest-GroupSnapshotsTest-1849189312 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-de0b0d11-bd68-4e98-bab2-f4a6a97d1f41 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:58:44 devstack sudo[88898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-de0b0d11-bd68-4e98-bab2-f4a6a97d1f41 Sep 07 09:58:44 devstack sudo[88898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:58:44 devstack sudo[88898]: pam_unix(sudo:session): session closed for user root Sep 07 09:58:44 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-0496817b-a6a6-49bf-980a-a76c758e3a15 tempest-GroupSnapshotsTest-1849189312 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-de0b0d11-bd68-4e98-bab2-f4a6a97d1f41" returned: 0 in 0.460s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:58:44 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-0496817b-a6a6-49bf-980a-a76c758e3a15 tempest-GroupSnapshotsTest-1849189312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-de0b0d11-bd68-4e98-bab2-f4a6a97d1f41 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:58:44 devstack sudo[88904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-de0b0d11-bd68-4e98-bab2-f4a6a97d1f41 Sep 07 09:58:44 devstack sudo[88904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:58:45 devstack sudo[88904]: pam_unix(sudo:session): session closed for user root Sep 07 09:58:45 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-0496817b-a6a6-49bf-980a-a76c758e3a15 tempest-GroupSnapshotsTest-1849189312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-de0b0d11-bd68-4e98-bab2-f4a6a97d1f41" returned: 0 in 0.445s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:58:45 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-0496817b-a6a6-49bf-980a-a76c758e3a15 tempest-GroupSnapshotsTest-1849189312 None] Lock "cinder-quobyte-de0b0d11-bd68-4e98-bab2-f4a6a97d1f41" released by "delete_volume" :: held 1.010s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:58:45 devstack cinder-volume[87515]: DEBUG cinder.quota [None req-0496817b-a6a6-49bf-980a-a76c758e3a15 tempest-GroupSnapshotsTest-1849189312 None] Created reservations ['ee334b98-3da4-4435-9e9f-faf5e5de0e8d'] {{(pid=87515) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 09:58:45 devstack cinder-volume[87515]: WARNING cinder.db.api [None req-0496817b-a6a6-49bf-980a-a76c758e3a15 tempest-GroupSnapshotsTest-1849189312 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1036916727'] Sep 07 09:58:45 devstack cinder-volume[87515]: DEBUG cinder.quota [None req-0496817b-a6a6-49bf-980a-a76c758e3a15 tempest-GroupSnapshotsTest-1849189312 None] Created reservations ['66bcfa93-502d-4019-9930-18e7e9fb6b60', '5041a3e8-9149-4e3f-bbca-5083e6a9abe3', '30d798a3-e4d3-4036-810c-041fa1ce4779', '106ba966-4c11-4871-90f7-8f149d0e82a3'] {{(pid=87515) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 09:58:45 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-0496817b-a6a6-49bf-980a-a76c758e3a15 tempest-GroupSnapshotsTest-1849189312 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:58:45 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-0496817b-a6a6-49bf-980a-a76c758e3a15 tempest-GroupSnapshotsTest-1849189312 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:58:45 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-0496817b-a6a6-49bf-980a-a76c758e3a15 tempest-GroupSnapshotsTest-1849189312 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 09:58:45 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-0496817b-a6a6-49bf-980a-a76c758e3a15 tempest-GroupSnapshotsTest-1849189312 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 09:58:45 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-0496817b-a6a6-49bf-980a-a76c758e3a15 tempest-GroupSnapshotsTest-1849189312 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:58:45 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-0496817b-a6a6-49bf-980a-a76c758e3a15 tempest-GroupSnapshotsTest-1849189312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:58:45 devstack sudo[88908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a Sep 07 09:58:45 devstack sudo[88908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:58:45 devstack sudo[88908]: pam_unix(sudo:session): session closed for user root Sep 07 09:58:45 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-0496817b-a6a6-49bf-980a-a76c758e3a15 tempest-GroupSnapshotsTest-1849189312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a" returned: 0 in 0.353s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:58:46 devstack cinder-volume[87515]: DEBUG cinder.manager [None req-0496817b-a6a6-49bf-980a-a76c758e3a15 tempest-GroupSnapshotsTest-1849189312 None] Notifying Schedulers of capabilities ... {{(pid=87515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 09:58:46 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-0496817b-a6a6-49bf-980a-a76c758e3a15 tempest-GroupSnapshotsTest-1849189312 None] Delete group completed successfully. Sep 07 09:58:47 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-f1a4df8d-d6fd-411e-91e3-fdf6b53b83e5 tempest-GroupSnapshotsTest-1849189312 None] Group tempest-GroupSnapshotsTest-Group-791595964: creating Sep 07 09:58:47 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-f1a4df8d-d6fd-411e-91e3-fdf6b53b83e5 tempest-GroupSnapshotsTest-1849189312 None] Group tempest-GroupSnapshotsTest-Group-791595964: created successfully Sep 07 09:58:47 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-f1a4df8d-d6fd-411e-91e3-fdf6b53b83e5 tempest-GroupSnapshotsTest-1849189312 None] Create group completed successfully. Sep 07 09:58:50 devstack cinder-volume[87515]: DEBUG cinder.volume.flows.manager.create_volume [None req-014b9e55-6f2c-4171-a3b8-679f9a8f468e tempest-GroupSnapshotsTest-1849189312 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 09:58:50 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-014b9e55-6f2c-4171-a3b8-679f9a8f468e tempest-GroupSnapshotsTest-1849189312 None] Flow 'volume_create_manager' (8caeb062-2541-4dfb-be3e-e1bcc616a2fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 09:58:50 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-014b9e55-6f2c-4171-a3b8-679f9a8f468e tempest-GroupSnapshotsTest-1849189312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e27f5e38-aa76-4b05-b717-bcec2bd94e98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:58:50 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-014b9e55-6f2c-4171-a3b8-679f9a8f468e tempest-GroupSnapshotsTest-1849189312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e27f5e38-aa76-4b05-b717-bcec2bd94e98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T07:58:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-420902364',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=9c5213ec-7ed6-42e3-b58e-4e4395303307,host='devstack@QuobyteHD#QuobyteHD',id=ee12dea4-5bb5-4d90-aeb1-73da8103f717,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0bdaa19ad94c41a98e26982980d686bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T07:58:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T07:58:50Z,use_quota=True,user_id='0a729d1b14204872b787704d5e4d6602',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c4d73488-7655-4a9e-803a-ef5f43bc778f),volume_type_id=c4d73488-7655-4a9e-803a-ef5f43bc778f)' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:58:50 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-014b9e55-6f2c-4171-a3b8-679f9a8f468e tempest-GroupSnapshotsTest-1849189312 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (823e6b2a-cbb3-4bcf-ac10-44453852830f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:58:50 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-014b9e55-6f2c-4171-a3b8-679f9a8f468e tempest-GroupSnapshotsTest-1849189312 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (823e6b2a-cbb3-4bcf-ac10-44453852830f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:58:50 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-014b9e55-6f2c-4171-a3b8-679f9a8f468e tempest-GroupSnapshotsTest-1849189312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e90c1ed-a28a-4fb6-872e-791c643d8a1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:58:50 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-014b9e55-6f2c-4171-a3b8-679f9a8f468e tempest-GroupSnapshotsTest-1849189312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e90c1ed-a28a-4fb6-872e-791c643d8a1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ee12dea4-5bb5-4d90-aeb1-73da8103f717', 'volume_name': 'volume-ee12dea4-5bb5-4d90-aeb1-73da8103f717', 'volume_size': 1}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:58:50 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-014b9e55-6f2c-4171-a3b8-679f9a8f468e tempest-GroupSnapshotsTest-1849189312 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4d111ad-c3ec-4078-8c87-d6f1efb35257) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:58:50 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-014b9e55-6f2c-4171-a3b8-679f9a8f468e tempest-GroupSnapshotsTest-1849189312 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4d111ad-c3ec-4078-8c87-d6f1efb35257) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:58:50 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-014b9e55-6f2c-4171-a3b8-679f9a8f468e tempest-GroupSnapshotsTest-1849189312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e844fd6-5367-4439-afb0-70afdd3b141d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:58:50 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-014b9e55-6f2c-4171-a3b8-679f9a8f468e tempest-GroupSnapshotsTest-1849189312 None] Volume ee12dea4-5bb5-4d90-aeb1-73da8103f717: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ee12dea4-5bb5-4d90-aeb1-73da8103f717', 'volume_size': 1} Sep 07 09:58:50 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-014b9e55-6f2c-4171-a3b8-679f9a8f468e tempest-GroupSnapshotsTest-1849189312 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:58:50 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-014b9e55-6f2c-4171-a3b8-679f9a8f468e tempest-GroupSnapshotsTest-1849189312 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:58:50 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-014b9e55-6f2c-4171-a3b8-679f9a8f468e tempest-GroupSnapshotsTest-1849189312 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=9c5213ec-7ed6-42e3-b58e-4e4395303307,created_at=2026-09-07T07:58:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-420902364',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=9c5213ec-7ed6-42e3-b58e-4e4395303307,host='devstack@QuobyteHD#QuobyteHD',id=ee12dea4-5bb5-4d90-aeb1-73da8103f717,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0bdaa19ad94c41a98e26982980d686bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T07:58:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T07:58:50Z,use_quota=True,user_id='0a729d1b14204872b787704d5e4d6602',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c4d73488-7655-4a9e-803a-ef5f43bc778f),volume_type_id=c4d73488-7655-4a9e-803a-ef5f43bc778f)}" {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 09:58:50 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-014b9e55-6f2c-4171-a3b8-679f9a8f468e tempest-GroupSnapshotsTest-1849189312 None] Creating volume ee12dea4-5bb5-4d90-aeb1-73da8103f717 {{(pid=87515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 09:58:50 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-014b9e55-6f2c-4171-a3b8-679f9a8f468e tempest-GroupSnapshotsTest-1849189312 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:58:50 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-014b9e55-6f2c-4171-a3b8-679f9a8f468e tempest-GroupSnapshotsTest-1849189312 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:58:50 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-014b9e55-6f2c-4171-a3b8-679f9a8f468e tempest-GroupSnapshotsTest-1849189312 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 09:58:50 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-014b9e55-6f2c-4171-a3b8-679f9a8f468e tempest-GroupSnapshotsTest-1849189312 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 09:58:50 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-014b9e55-6f2c-4171-a3b8-679f9a8f468e tempest-GroupSnapshotsTest-1849189312 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:58:50 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-014b9e55-6f2c-4171-a3b8-679f9a8f468e tempest-GroupSnapshotsTest-1849189312 None] Selected osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c as target Quobyte volume. {{(pid=87515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 09:58:50 devstack cinder-volume[87515]: INFO cinder.volume.drivers.remotefs [None req-014b9e55-6f2c-4171-a3b8-679f9a8f468e tempest-GroupSnapshotsTest-1849189312 None] casted to osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c Sep 07 09:58:50 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-014b9e55-6f2c-4171-a3b8-679f9a8f468e tempest-GroupSnapshotsTest-1849189312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-ee12dea4-5bb5-4d90-aeb1-73da8103f717 1073741824 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:58:51 devstack sudo[89043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-ee12dea4-5bb5-4d90-aeb1-73da8103f717 1073741824 Sep 07 09:58:51 devstack sudo[89043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:58:52 devstack sudo[89043]: pam_unix(sudo:session): session closed for user root Sep 07 09:58:52 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-014b9e55-6f2c-4171-a3b8-679f9a8f468e tempest-GroupSnapshotsTest-1849189312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-ee12dea4-5bb5-4d90-aeb1-73da8103f717 1073741824" returned: 0 in 1.226s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:58:52 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-014b9e55-6f2c-4171-a3b8-679f9a8f468e tempest-GroupSnapshotsTest-1849189312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-ee12dea4-5bb5-4d90-aeb1-73da8103f717 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:58:52 devstack sudo[89054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-ee12dea4-5bb5-4d90-aeb1-73da8103f717 Sep 07 09:58:52 devstack sudo[89054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:58:52 devstack sudo[89054]: pam_unix(sudo:session): session closed for user root Sep 07 09:58:52 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-014b9e55-6f2c-4171-a3b8-679f9a8f468e tempest-GroupSnapshotsTest-1849189312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-ee12dea4-5bb5-4d90-aeb1-73da8103f717" returned: 0 in 0.311s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:58:52 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-014b9e55-6f2c-4171-a3b8-679f9a8f468e tempest-GroupSnapshotsTest-1849189312 None] <== create_volume: return (1602ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'} {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 09:58:52 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-014b9e55-6f2c-4171-a3b8-679f9a8f468e tempest-GroupSnapshotsTest-1849189312 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.608s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:58:52 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-014b9e55-6f2c-4171-a3b8-679f9a8f468e tempest-GroupSnapshotsTest-1849189312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e844fd6-5367-4439-afb0-70afdd3b141d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ee12dea4-5bb5-4d90-aeb1-73da8103f717', 'volume_size': 1}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:58:52 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-014b9e55-6f2c-4171-a3b8-679f9a8f468e tempest-GroupSnapshotsTest-1849189312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d66f933f-462f-454a-924f-4a49b544d20c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:58:52 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-014b9e55-6f2c-4171-a3b8-679f9a8f468e tempest-GroupSnapshotsTest-1849189312 None] Volume volume-ee12dea4-5bb5-4d90-aeb1-73da8103f717 (ee12dea4-5bb5-4d90-aeb1-73da8103f717): created successfully Sep 07 09:58:52 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-014b9e55-6f2c-4171-a3b8-679f9a8f468e tempest-GroupSnapshotsTest-1849189312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d66f933f-462f-454a-924f-4a49b544d20c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:58:52 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-014b9e55-6f2c-4171-a3b8-679f9a8f468e tempest-GroupSnapshotsTest-1849189312 None] Flow 'volume_create_manager' (8caeb062-2541-4dfb-be3e-e1bcc616a2fa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 09:58:52 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-014b9e55-6f2c-4171-a3b8-679f9a8f468e tempest-GroupSnapshotsTest-1849189312 None] Created volume successfully. Sep 07 09:58:54 devstack cinder-volume[87515]: DEBUG cinder.volume.flows.manager.create_volume [None req-446ca8be-3fa6-4cc9-82d7-6b11c7f80cad tempest-GroupSnapshotsTest-1849189312 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 09:58:54 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-446ca8be-3fa6-4cc9-82d7-6b11c7f80cad tempest-GroupSnapshotsTest-1849189312 None] Flow 'volume_create_manager' (96c123d7-0bc2-4ea4-a12a-967fe472c286) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 09:58:54 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-446ca8be-3fa6-4cc9-82d7-6b11c7f80cad tempest-GroupSnapshotsTest-1849189312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (339b6c0d-a223-42cd-84fa-c061fd221f90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:58:54 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-446ca8be-3fa6-4cc9-82d7-6b11c7f80cad tempest-GroupSnapshotsTest-1849189312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (339b6c0d-a223-42cd-84fa-c061fd221f90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T07:58:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1723298580',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=9c5213ec-7ed6-42e3-b58e-4e4395303307,host='devstack@QuobyteHD#QuobyteHD',id=a2f0862c-6027-48ba-8d7e-7098f4928a59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0bdaa19ad94c41a98e26982980d686bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T07:58:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T07:58:54Z,use_quota=True,user_id='0a729d1b14204872b787704d5e4d6602',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c4d73488-7655-4a9e-803a-ef5f43bc778f),volume_type_id=c4d73488-7655-4a9e-803a-ef5f43bc778f)' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:58:54 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-446ca8be-3fa6-4cc9-82d7-6b11c7f80cad tempest-GroupSnapshotsTest-1849189312 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30ce9f66-fea8-48a4-9a7e-493521c05175) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:58:54 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-446ca8be-3fa6-4cc9-82d7-6b11c7f80cad tempest-GroupSnapshotsTest-1849189312 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30ce9f66-fea8-48a4-9a7e-493521c05175) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:58:54 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-446ca8be-3fa6-4cc9-82d7-6b11c7f80cad tempest-GroupSnapshotsTest-1849189312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cec293e1-0024-4db8-a356-7ecb48a7202f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:58:54 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-446ca8be-3fa6-4cc9-82d7-6b11c7f80cad tempest-GroupSnapshotsTest-1849189312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cec293e1-0024-4db8-a356-7ecb48a7202f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a2f0862c-6027-48ba-8d7e-7098f4928a59', 'volume_name': 'volume-a2f0862c-6027-48ba-8d7e-7098f4928a59', 'volume_size': 1}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:58:54 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-446ca8be-3fa6-4cc9-82d7-6b11c7f80cad tempest-GroupSnapshotsTest-1849189312 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5f5a63b-c7ba-4555-920e-e3674c1859e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:58:54 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-446ca8be-3fa6-4cc9-82d7-6b11c7f80cad tempest-GroupSnapshotsTest-1849189312 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5f5a63b-c7ba-4555-920e-e3674c1859e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:58:54 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-446ca8be-3fa6-4cc9-82d7-6b11c7f80cad tempest-GroupSnapshotsTest-1849189312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c3d7417-899e-4802-a2f6-d26c3ace7b6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:58:54 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-446ca8be-3fa6-4cc9-82d7-6b11c7f80cad tempest-GroupSnapshotsTest-1849189312 None] Volume a2f0862c-6027-48ba-8d7e-7098f4928a59: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a2f0862c-6027-48ba-8d7e-7098f4928a59', 'volume_size': 1} Sep 07 09:58:54 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-446ca8be-3fa6-4cc9-82d7-6b11c7f80cad tempest-GroupSnapshotsTest-1849189312 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:58:54 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-446ca8be-3fa6-4cc9-82d7-6b11c7f80cad tempest-GroupSnapshotsTest-1849189312 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:58:54 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-446ca8be-3fa6-4cc9-82d7-6b11c7f80cad tempest-GroupSnapshotsTest-1849189312 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=9c5213ec-7ed6-42e3-b58e-4e4395303307,created_at=2026-09-07T07:58:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1723298580',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=9c5213ec-7ed6-42e3-b58e-4e4395303307,host='devstack@QuobyteHD#QuobyteHD',id=a2f0862c-6027-48ba-8d7e-7098f4928a59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0bdaa19ad94c41a98e26982980d686bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T07:58:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T07:58:54Z,use_quota=True,user_id='0a729d1b14204872b787704d5e4d6602',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c4d73488-7655-4a9e-803a-ef5f43bc778f),volume_type_id=c4d73488-7655-4a9e-803a-ef5f43bc778f)}" {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 09:58:54 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-446ca8be-3fa6-4cc9-82d7-6b11c7f80cad tempest-GroupSnapshotsTest-1849189312 None] Creating volume a2f0862c-6027-48ba-8d7e-7098f4928a59 {{(pid=87515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 09:58:54 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-446ca8be-3fa6-4cc9-82d7-6b11c7f80cad tempest-GroupSnapshotsTest-1849189312 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:58:54 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-446ca8be-3fa6-4cc9-82d7-6b11c7f80cad tempest-GroupSnapshotsTest-1849189312 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:58:54 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-446ca8be-3fa6-4cc9-82d7-6b11c7f80cad tempest-GroupSnapshotsTest-1849189312 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 09:58:54 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-446ca8be-3fa6-4cc9-82d7-6b11c7f80cad tempest-GroupSnapshotsTest-1849189312 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 09:58:54 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-446ca8be-3fa6-4cc9-82d7-6b11c7f80cad tempest-GroupSnapshotsTest-1849189312 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:58:54 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-446ca8be-3fa6-4cc9-82d7-6b11c7f80cad tempest-GroupSnapshotsTest-1849189312 None] Selected osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c as target Quobyte volume. {{(pid=87515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 09:58:54 devstack cinder-volume[87515]: INFO cinder.volume.drivers.remotefs [None req-446ca8be-3fa6-4cc9-82d7-6b11c7f80cad tempest-GroupSnapshotsTest-1849189312 None] casted to osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c Sep 07 09:58:54 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-446ca8be-3fa6-4cc9-82d7-6b11c7f80cad tempest-GroupSnapshotsTest-1849189312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-a2f0862c-6027-48ba-8d7e-7098f4928a59 1073741824 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:58:54 devstack sudo[89057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-a2f0862c-6027-48ba-8d7e-7098f4928a59 1073741824 Sep 07 09:58:54 devstack sudo[89057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:58:55 devstack sudo[89057]: pam_unix(sudo:session): session closed for user root Sep 07 09:58:55 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-446ca8be-3fa6-4cc9-82d7-6b11c7f80cad tempest-GroupSnapshotsTest-1849189312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-a2f0862c-6027-48ba-8d7e-7098f4928a59 1073741824" returned: 0 in 0.913s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:58:55 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-446ca8be-3fa6-4cc9-82d7-6b11c7f80cad tempest-GroupSnapshotsTest-1849189312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-a2f0862c-6027-48ba-8d7e-7098f4928a59 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:58:55 devstack sudo[89063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-a2f0862c-6027-48ba-8d7e-7098f4928a59 Sep 07 09:58:55 devstack sudo[89063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:58:56 devstack sudo[89063]: pam_unix(sudo:session): session closed for user root Sep 07 09:58:56 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-446ca8be-3fa6-4cc9-82d7-6b11c7f80cad tempest-GroupSnapshotsTest-1849189312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-a2f0862c-6027-48ba-8d7e-7098f4928a59" returned: 0 in 0.475s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:58:56 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-446ca8be-3fa6-4cc9-82d7-6b11c7f80cad tempest-GroupSnapshotsTest-1849189312 None] <== create_volume: return (1467ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'} {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 09:58:56 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-446ca8be-3fa6-4cc9-82d7-6b11c7f80cad tempest-GroupSnapshotsTest-1849189312 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.474s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:58:56 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-446ca8be-3fa6-4cc9-82d7-6b11c7f80cad tempest-GroupSnapshotsTest-1849189312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c3d7417-899e-4802-a2f6-d26c3ace7b6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a2f0862c-6027-48ba-8d7e-7098f4928a59', 'volume_size': 1}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:58:56 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-446ca8be-3fa6-4cc9-82d7-6b11c7f80cad tempest-GroupSnapshotsTest-1849189312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af7b0710-1d67-47ce-bf26-0185a7e53030) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:58:56 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-446ca8be-3fa6-4cc9-82d7-6b11c7f80cad tempest-GroupSnapshotsTest-1849189312 None] Volume volume-a2f0862c-6027-48ba-8d7e-7098f4928a59 (a2f0862c-6027-48ba-8d7e-7098f4928a59): created successfully Sep 07 09:58:56 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-446ca8be-3fa6-4cc9-82d7-6b11c7f80cad tempest-GroupSnapshotsTest-1849189312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af7b0710-1d67-47ce-bf26-0185a7e53030) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:58:56 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-446ca8be-3fa6-4cc9-82d7-6b11c7f80cad tempest-GroupSnapshotsTest-1849189312 None] Flow 'volume_create_manager' (96c123d7-0bc2-4ea4-a12a-967fe472c286) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 09:58:56 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-446ca8be-3fa6-4cc9-82d7-6b11c7f80cad tempest-GroupSnapshotsTest-1849189312 None] Created volume successfully. Sep 07 09:58:57 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-cc2fdbb7-88e8-4061-800a-8bd7c479bb93 tempest-GroupSnapshotsTest-1849189312 None] Update group completed successfully. Sep 07 09:58:59 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-3283f313-8e29-4c60-bfd0-e8b2a3d88200 tempest-GroupSnapshotsTest-1849189312 None] Update group completed successfully. Sep 07 09:59:00 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-a2c6548f-1fff-490e-8568-798edb2098a1 tempest-GroupSnapshotsTest-1849189312 None] Update group completed successfully. Sep 07 09:59:01 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-ab7b0fec-c709-4de0-90f4-e0117af99bfe tempest-GroupSnapshotsTest-1849189312 None] Update group completed successfully. Sep 07 09:59:03 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-df9edc03-a7af-4524-95d1-67d463ba26d1 tempest-GroupSnapshotsTest-1849189312 None] GroupSnapshot 5cd116be-b787-458e-9c2f-fb2f4af4ca75: creating. Sep 07 09:59:03 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-df9edc03-a7af-4524-95d1-67d463ba26d1 tempest-GroupSnapshotsTest-1849189312 None] Group snapshot 5cd116be-b787-458e-9c2f-fb2f4af4ca75: creating. {{(pid=87515) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 07 09:59:03 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-df9edc03-a7af-4524-95d1-67d463ba26d1 tempest-GroupSnapshotsTest-1849189312 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:59:03 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-df9edc03-a7af-4524-95d1-67d463ba26d1 tempest-GroupSnapshotsTest-1849189312 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:59:03 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-df9edc03-a7af-4524-95d1-67d463ba26d1 tempest-GroupSnapshotsTest-1849189312 None] Creating offline snapshot 3af6520e-e70b-4a27-84ed-463bce6539f5 of volume ee12dea4-5bb5-4d90-aeb1-73da8103f717 {{(pid=87515) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 09:59:03 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bbf4d2d-440e-4fe5-9f4c-a47ee4d8a08d]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 09:59:03 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-df9edc03-a7af-4524-95d1-67d463ba26d1 tempest-GroupSnapshotsTest-1849189312 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-ee12dea4-5bb5-4d90-aeb1-73da8103f717 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:59:03 devstack sudo[89092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-ee12dea4-5bb5-4d90-aeb1-73da8103f717 Sep 07 09:59:03 devstack sudo[89092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:59:03 devstack sudo[89092]: pam_unix(sudo:session): session closed for user root Sep 07 09:59:04 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-df9edc03-a7af-4524-95d1-67d463ba26d1 tempest-GroupSnapshotsTest-1849189312 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-ee12dea4-5bb5-4d90-aeb1-73da8103f717" returned: 0 in 0.763s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:59:04 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-df9edc03-a7af-4524-95d1-67d463ba26d1 tempest-GroupSnapshotsTest-1849189312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-ee12dea4-5bb5-4d90-aeb1-73da8103f717,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-ee12dea4-5bb5-4d90-aeb1-73da8103f717.3af6520e-e70b-4a27-84ed-463bce6539f5 1G {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:59:04 devstack sudo[89098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-ee12dea4-5bb5-4d90-aeb1-73da8103f717,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-ee12dea4-5bb5-4d90-aeb1-73da8103f717.3af6520e-e70b-4a27-84ed-463bce6539f5 1G Sep 07 09:59:04 devstack sudo[89098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:59:04 devstack sudo[89098]: pam_unix(sudo:session): session closed for user root Sep 07 09:59:04 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-df9edc03-a7af-4524-95d1-67d463ba26d1 tempest-GroupSnapshotsTest-1849189312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-ee12dea4-5bb5-4d90-aeb1-73da8103f717,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-ee12dea4-5bb5-4d90-aeb1-73da8103f717.3af6520e-e70b-4a27-84ed-463bce6539f5 1G" returned: 0 in 0.881s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:59:04 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-df9edc03-a7af-4524-95d1-67d463ba26d1 tempest-GroupSnapshotsTest-1849189312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ee12dea4-5bb5-4d90-aeb1-73da8103f717 -F qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-ee12dea4-5bb5-4d90-aeb1-73da8103f717.3af6520e-e70b-4a27-84ed-463bce6539f5 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:59:04 devstack sudo[89104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ee12dea4-5bb5-4d90-aeb1-73da8103f717 -F qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-ee12dea4-5bb5-4d90-aeb1-73da8103f717.3af6520e-e70b-4a27-84ed-463bce6539f5 Sep 07 09:59:04 devstack sudo[89104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:59:05 devstack sudo[89104]: pam_unix(sudo:session): session closed for user root Sep 07 09:59:05 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-df9edc03-a7af-4524-95d1-67d463ba26d1 tempest-GroupSnapshotsTest-1849189312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ee12dea4-5bb5-4d90-aeb1-73da8103f717 -F qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-ee12dea4-5bb5-4d90-aeb1-73da8103f717.3af6520e-e70b-4a27-84ed-463bce6539f5" returned: 0 in 0.536s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:59:05 devstack cinder-volume[87515]: WARNING cinder.volume.drivers.remotefs [None req-df9edc03-a7af-4524-95d1-67d463ba26d1 tempest-GroupSnapshotsTest-1849189312 None] /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-ee12dea4-5bb5-4d90-aeb1-73da8103f717.3af6520e-e70b-4a27-84ed-463bce6539f5 is being set with open permissions: ugo+rw: NotImplementedError Sep 07 09:59:05 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-df9edc03-a7af-4524-95d1-67d463ba26d1 tempest-GroupSnapshotsTest-1849189312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-ee12dea4-5bb5-4d90-aeb1-73da8103f717.3af6520e-e70b-4a27-84ed-463bce6539f5 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:59:05 devstack sudo[89117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-ee12dea4-5bb5-4d90-aeb1-73da8103f717.3af6520e-e70b-4a27-84ed-463bce6539f5 Sep 07 09:59:05 devstack sudo[89117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:59:05 devstack sudo[89117]: pam_unix(sudo:session): session closed for user root Sep 07 09:59:05 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-df9edc03-a7af-4524-95d1-67d463ba26d1 tempest-GroupSnapshotsTest-1849189312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-ee12dea4-5bb5-4d90-aeb1-73da8103f717.3af6520e-e70b-4a27-84ed-463bce6539f5" returned: 0 in 0.369s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:59:05 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-df9edc03-a7af-4524-95d1-67d463ba26d1 tempest-GroupSnapshotsTest-1849189312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-ee12dea4-5bb5-4d90-aeb1-73da8103f717.info {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:59:05 devstack sudo[89173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-ee12dea4-5bb5-4d90-aeb1-73da8103f717.info Sep 07 09:59:05 devstack sudo[89173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:59:06 devstack sudo[89173]: pam_unix(sudo:session): session closed for user root Sep 07 09:59:06 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-df9edc03-a7af-4524-95d1-67d463ba26d1 tempest-GroupSnapshotsTest-1849189312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-ee12dea4-5bb5-4d90-aeb1-73da8103f717.info" returned: 0 in 0.539s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:59:06 devstack cinder-volume[87515]: WARNING cinder.volume.drivers.remotefs [None req-df9edc03-a7af-4524-95d1-67d463ba26d1 tempest-GroupSnapshotsTest-1849189312 None] /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-ee12dea4-5bb5-4d90-aeb1-73da8103f717.info is being set with open permissions: ugo+rw: NotImplementedError Sep 07 09:59:06 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-df9edc03-a7af-4524-95d1-67d463ba26d1 tempest-GroupSnapshotsTest-1849189312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-ee12dea4-5bb5-4d90-aeb1-73da8103f717.info {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:59:06 devstack sudo[89176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-ee12dea4-5bb5-4d90-aeb1-73da8103f717.info Sep 07 09:59:06 devstack sudo[89176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:59:06 devstack sudo[89176]: pam_unix(sudo:session): session closed for user root Sep 07 09:59:06 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-df9edc03-a7af-4524-95d1-67d463ba26d1 tempest-GroupSnapshotsTest-1849189312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-ee12dea4-5bb5-4d90-aeb1-73da8103f717.info" returned: 0 in 0.311s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:59:06 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-df9edc03-a7af-4524-95d1-67d463ba26d1 tempest-GroupSnapshotsTest-1849189312 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.588s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:59:06 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-df9edc03-a7af-4524-95d1-67d463ba26d1 tempest-GroupSnapshotsTest-1849189312 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:59:06 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-df9edc03-a7af-4524-95d1-67d463ba26d1 tempest-GroupSnapshotsTest-1849189312 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:59:06 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-df9edc03-a7af-4524-95d1-67d463ba26d1 tempest-GroupSnapshotsTest-1849189312 None] Creating offline snapshot 67cb083b-9bc0-4b14-8546-1c9f68e3e780 of volume a2f0862c-6027-48ba-8d7e-7098f4928a59 {{(pid=87515) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 09:59:06 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8a9b443-869f-479a-981d-1e3f8f6df7f7]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 09:59:06 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-df9edc03-a7af-4524-95d1-67d463ba26d1 tempest-GroupSnapshotsTest-1849189312 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-a2f0862c-6027-48ba-8d7e-7098f4928a59 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:59:06 devstack sudo[89179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-a2f0862c-6027-48ba-8d7e-7098f4928a59 Sep 07 09:59:06 devstack sudo[89179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:59:07 devstack sudo[89179]: pam_unix(sudo:session): session closed for user root Sep 07 09:59:07 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-df9edc03-a7af-4524-95d1-67d463ba26d1 tempest-GroupSnapshotsTest-1849189312 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-a2f0862c-6027-48ba-8d7e-7098f4928a59" returned: 0 in 0.455s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:59:07 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-df9edc03-a7af-4524-95d1-67d463ba26d1 tempest-GroupSnapshotsTest-1849189312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-a2f0862c-6027-48ba-8d7e-7098f4928a59,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-a2f0862c-6027-48ba-8d7e-7098f4928a59.67cb083b-9bc0-4b14-8546-1c9f68e3e780 1G {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:59:07 devstack sudo[89184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-a2f0862c-6027-48ba-8d7e-7098f4928a59,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-a2f0862c-6027-48ba-8d7e-7098f4928a59.67cb083b-9bc0-4b14-8546-1c9f68e3e780 1G Sep 07 09:59:07 devstack sudo[89184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:59:07 devstack sudo[89184]: pam_unix(sudo:session): session closed for user root Sep 07 09:59:07 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-df9edc03-a7af-4524-95d1-67d463ba26d1 tempest-GroupSnapshotsTest-1849189312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-a2f0862c-6027-48ba-8d7e-7098f4928a59,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-a2f0862c-6027-48ba-8d7e-7098f4928a59.67cb083b-9bc0-4b14-8546-1c9f68e3e780 1G" returned: 0 in 0.535s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:59:07 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-df9edc03-a7af-4524-95d1-67d463ba26d1 tempest-GroupSnapshotsTest-1849189312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a2f0862c-6027-48ba-8d7e-7098f4928a59 -F qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-a2f0862c-6027-48ba-8d7e-7098f4928a59.67cb083b-9bc0-4b14-8546-1c9f68e3e780 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:59:07 devstack sudo[89191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a2f0862c-6027-48ba-8d7e-7098f4928a59 -F qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-a2f0862c-6027-48ba-8d7e-7098f4928a59.67cb083b-9bc0-4b14-8546-1c9f68e3e780 Sep 07 09:59:07 devstack sudo[89191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:59:08 devstack sudo[89191]: pam_unix(sudo:session): session closed for user root Sep 07 09:59:08 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-df9edc03-a7af-4524-95d1-67d463ba26d1 tempest-GroupSnapshotsTest-1849189312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a2f0862c-6027-48ba-8d7e-7098f4928a59 -F qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-a2f0862c-6027-48ba-8d7e-7098f4928a59.67cb083b-9bc0-4b14-8546-1c9f68e3e780" returned: 0 in 0.354s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:59:08 devstack cinder-volume[87515]: WARNING cinder.volume.drivers.remotefs [None req-df9edc03-a7af-4524-95d1-67d463ba26d1 tempest-GroupSnapshotsTest-1849189312 None] /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-a2f0862c-6027-48ba-8d7e-7098f4928a59.67cb083b-9bc0-4b14-8546-1c9f68e3e780 is being set with open permissions: ugo+rw: NotImplementedError Sep 07 09:59:08 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-df9edc03-a7af-4524-95d1-67d463ba26d1 tempest-GroupSnapshotsTest-1849189312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-a2f0862c-6027-48ba-8d7e-7098f4928a59.67cb083b-9bc0-4b14-8546-1c9f68e3e780 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:59:08 devstack sudo[89198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-a2f0862c-6027-48ba-8d7e-7098f4928a59.67cb083b-9bc0-4b14-8546-1c9f68e3e780 Sep 07 09:59:08 devstack sudo[89198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:59:08 devstack sudo[89198]: pam_unix(sudo:session): session closed for user root Sep 07 09:59:08 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-df9edc03-a7af-4524-95d1-67d463ba26d1 tempest-GroupSnapshotsTest-1849189312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-a2f0862c-6027-48ba-8d7e-7098f4928a59.67cb083b-9bc0-4b14-8546-1c9f68e3e780" returned: 0 in 0.332s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:59:08 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-df9edc03-a7af-4524-95d1-67d463ba26d1 tempest-GroupSnapshotsTest-1849189312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-a2f0862c-6027-48ba-8d7e-7098f4928a59.info {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:59:08 devstack sudo[89219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-a2f0862c-6027-48ba-8d7e-7098f4928a59.info Sep 07 09:59:08 devstack sudo[89219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:59:09 devstack sudo[89219]: pam_unix(sudo:session): session closed for user root Sep 07 09:59:09 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-df9edc03-a7af-4524-95d1-67d463ba26d1 tempest-GroupSnapshotsTest-1849189312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-a2f0862c-6027-48ba-8d7e-7098f4928a59.info" returned: 0 in 0.477s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:59:09 devstack cinder-volume[87515]: WARNING cinder.volume.drivers.remotefs [None req-df9edc03-a7af-4524-95d1-67d463ba26d1 tempest-GroupSnapshotsTest-1849189312 None] /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-a2f0862c-6027-48ba-8d7e-7098f4928a59.info is being set with open permissions: ugo+rw: NotImplementedError Sep 07 09:59:09 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-df9edc03-a7af-4524-95d1-67d463ba26d1 tempest-GroupSnapshotsTest-1849189312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-a2f0862c-6027-48ba-8d7e-7098f4928a59.info {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:59:09 devstack sudo[89249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-a2f0862c-6027-48ba-8d7e-7098f4928a59.info Sep 07 09:59:09 devstack sudo[89249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:59:09 devstack sudo[89249]: pam_unix(sudo:session): session closed for user root Sep 07 09:59:09 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-df9edc03-a7af-4524-95d1-67d463ba26d1 tempest-GroupSnapshotsTest-1849189312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-a2f0862c-6027-48ba-8d7e-7098f4928a59.info" returned: 0 in 0.452s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:59:09 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-df9edc03-a7af-4524-95d1-67d463ba26d1 tempest-GroupSnapshotsTest-1849189312 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.816s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:59:09 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-df9edc03-a7af-4524-95d1-67d463ba26d1 tempest-GroupSnapshotsTest-1849189312 None] group_snapshot 5cd116be-b787-458e-9c2f-fb2f4af4ca75: created successfully Sep 07 09:59:11 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-ce922b8f-2174-458e-94b5-4659001cabf6 tempest-GroupSnapshotsTest-1849189312 None] group_snapshot 5cd116be-b787-458e-9c2f-fb2f4af4ca75: deleting Sep 07 09:59:11 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-ce922b8f-2174-458e-94b5-4659001cabf6 tempest-GroupSnapshotsTest-1849189312 None] group_snapshot 5cd116be-b787-458e-9c2f-fb2f4af4ca75: deleting {{(pid=87515) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 07 09:59:11 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-ce922b8f-2174-458e-94b5-4659001cabf6 tempest-GroupSnapshotsTest-1849189312 None] Acquiring lock "cinder-quobyte-ee12dea4-5bb5-4d90-aeb1-73da8103f717" by "delete_snapshot" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:59:11 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-ce922b8f-2174-458e-94b5-4659001cabf6 tempest-GroupSnapshotsTest-1849189312 None] Lock "cinder-quobyte-ee12dea4-5bb5-4d90-aeb1-73da8103f717" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:59:11 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-ce922b8f-2174-458e-94b5-4659001cabf6 tempest-GroupSnapshotsTest-1849189312 None] Acquiring lock "cinder-quobyte-3af6520e-e70b-4a27-84ed-463bce6539f5" by "_delete_snapshot" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:59:11 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-ce922b8f-2174-458e-94b5-4659001cabf6 tempest-GroupSnapshotsTest-1849189312 None] Lock "cinder-quobyte-3af6520e-e70b-4a27-84ed-463bce6539f5" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:59:11 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-ce922b8f-2174-458e-94b5-4659001cabf6 tempest-GroupSnapshotsTest-1849189312 None] Deleting offline snapshot 3af6520e-e70b-4a27-84ed-463bce6539f5 of volume ee12dea4-5bb5-4d90-aeb1-73da8103f717 {{(pid=87515) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 09:59:11 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-ce922b8f-2174-458e-94b5-4659001cabf6 tempest-GroupSnapshotsTest-1849189312 None] snapshot_file for this snap is: volume-ee12dea4-5bb5-4d90-aeb1-73da8103f717.3af6520e-e70b-4a27-84ed-463bce6539f5 {{(pid=87515) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 09:59:11 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[73d028e9-1d4e-42a3-86b8-3c902ba0abdc]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 09:59:11 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-ce922b8f-2174-458e-94b5-4659001cabf6 tempest-GroupSnapshotsTest-1849189312 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-ee12dea4-5bb5-4d90-aeb1-73da8103f717.3af6520e-e70b-4a27-84ed-463bce6539f5 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:59:11 devstack cinder-volume[87515]: DEBUG oslo_service.periodic_task [None req-cebd6a9d-3073-42a1-b65a-b38d444d85ed None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87515) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 09:59:11 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-cebd6a9d-3073-42a1-b65a-b38d444d85ed None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:59:11 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-cebd6a9d-3073-42a1-b65a-b38d444d85ed None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:59:11 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-cebd6a9d-3073-42a1-b65a-b38d444d85ed None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 09:59:11 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-cebd6a9d-3073-42a1-b65a-b38d444d85ed None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 09:59:11 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-cebd6a9d-3073-42a1-b65a-b38d444d85ed None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:59:11 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-cebd6a9d-3073-42a1-b65a-b38d444d85ed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:59:11 devstack sudo[89300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a Sep 07 09:59:11 devstack sudo[89300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:59:11 devstack sudo[89296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-ee12dea4-5bb5-4d90-aeb1-73da8103f717.3af6520e-e70b-4a27-84ed-463bce6539f5 Sep 07 09:59:11 devstack sudo[89296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:59:12 devstack sudo[89300]: pam_unix(sudo:session): session closed for user root Sep 07 09:59:12 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-cebd6a9d-3073-42a1-b65a-b38d444d85ed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a" returned: 0 in 0.523s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:59:12 devstack cinder-volume[87515]: DEBUG cinder.manager [None req-cebd6a9d-3073-42a1-b65a-b38d444d85ed None None] Notifying Schedulers of capabilities ... {{(pid=87515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 09:59:12 devstack cinder-volume[87515]: DEBUG oslo_service.periodic_task [None req-cebd6a9d-3073-42a1-b65a-b38d444d85ed None None] Running periodic task VolumeManager._thread_info {{(pid=87515) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 09:59:12 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-cebd6a9d-3073-42a1-b65a-b38d444d85ed None None] thread count: 8 {{(pid=87515) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 07 09:59:12 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-cebd6a9d-3073-42a1-b65a-b38d444d85ed None None] thread info: [<_MainThread(MainThread, started 131647121809536)>, , , , , , , ] {{(pid=87515) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 07 09:59:12 devstack sudo[89296]: pam_unix(sudo:session): session closed for user root Sep 07 09:59:12 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-ce922b8f-2174-458e-94b5-4659001cabf6 tempest-GroupSnapshotsTest-1849189312 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-ee12dea4-5bb5-4d90-aeb1-73da8103f717.3af6520e-e70b-4a27-84ed-463bce6539f5" returned: 0 in 0.839s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:59:12 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-ce922b8f-2174-458e-94b5-4659001cabf6 tempest-GroupSnapshotsTest-1849189312 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ee12dea4-5bb5-4d90-aeb1-73da8103f717(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87515) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 09:59:12 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[0780737d-3ad3-4b44-af50-1ee54991ddc6]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 09:59:12 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-ce922b8f-2174-458e-94b5-4659001cabf6 tempest-GroupSnapshotsTest-1849189312 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-ee12dea4-5bb5-4d90-aeb1-73da8103f717 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:59:12 devstack sudo[89317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-ee12dea4-5bb5-4d90-aeb1-73da8103f717 Sep 07 09:59:12 devstack sudo[89317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:59:13 devstack sudo[89317]: pam_unix(sudo:session): session closed for user root Sep 07 09:59:13 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-ce922b8f-2174-458e-94b5-4659001cabf6 tempest-GroupSnapshotsTest-1849189312 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-ee12dea4-5bb5-4d90-aeb1-73da8103f717" returned: 0 in 0.831s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:59:13 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-ce922b8f-2174-458e-94b5-4659001cabf6 tempest-GroupSnapshotsTest-1849189312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-ee12dea4-5bb5-4d90-aeb1-73da8103f717.3af6520e-e70b-4a27-84ed-463bce6539f5 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:59:13 devstack sudo[89326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-ee12dea4-5bb5-4d90-aeb1-73da8103f717.3af6520e-e70b-4a27-84ed-463bce6539f5 Sep 07 09:59:13 devstack sudo[89326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:59:13 devstack sudo[89326]: pam_unix(sudo:session): session closed for user root Sep 07 09:59:13 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-ce922b8f-2174-458e-94b5-4659001cabf6 tempest-GroupSnapshotsTest-1849189312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-ee12dea4-5bb5-4d90-aeb1-73da8103f717.3af6520e-e70b-4a27-84ed-463bce6539f5" returned: 0 in 0.557s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:59:13 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-ce922b8f-2174-458e-94b5-4659001cabf6 tempest-GroupSnapshotsTest-1849189312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-ee12dea4-5bb5-4d90-aeb1-73da8103f717.3af6520e-e70b-4a27-84ed-463bce6539f5 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:59:13 devstack sudo[89345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-ee12dea4-5bb5-4d90-aeb1-73da8103f717.3af6520e-e70b-4a27-84ed-463bce6539f5 Sep 07 09:59:13 devstack sudo[89345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:59:14 devstack sudo[89345]: pam_unix(sudo:session): session closed for user root Sep 07 09:59:14 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-ce922b8f-2174-458e-94b5-4659001cabf6 tempest-GroupSnapshotsTest-1849189312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-ee12dea4-5bb5-4d90-aeb1-73da8103f717.3af6520e-e70b-4a27-84ed-463bce6539f5" returned: 0 in 0.623s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:59:14 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-ce922b8f-2174-458e-94b5-4659001cabf6 tempest-GroupSnapshotsTest-1849189312 None] Lock "cinder-quobyte-3af6520e-e70b-4a27-84ed-463bce6539f5" released by "_delete_snapshot" :: held 3.097s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:59:14 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-ce922b8f-2174-458e-94b5-4659001cabf6 tempest-GroupSnapshotsTest-1849189312 None] Lock "cinder-quobyte-ee12dea4-5bb5-4d90-aeb1-73da8103f717" released by "delete_snapshot" :: held 3.145s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:59:14 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-ce922b8f-2174-458e-94b5-4659001cabf6 tempest-GroupSnapshotsTest-1849189312 None] Acquiring lock "cinder-quobyte-a2f0862c-6027-48ba-8d7e-7098f4928a59" by "delete_snapshot" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:59:14 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-ce922b8f-2174-458e-94b5-4659001cabf6 tempest-GroupSnapshotsTest-1849189312 None] Lock "cinder-quobyte-a2f0862c-6027-48ba-8d7e-7098f4928a59" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:59:14 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-ce922b8f-2174-458e-94b5-4659001cabf6 tempest-GroupSnapshotsTest-1849189312 None] Acquiring lock "cinder-quobyte-67cb083b-9bc0-4b14-8546-1c9f68e3e780" by "_delete_snapshot" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:59:14 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-ce922b8f-2174-458e-94b5-4659001cabf6 tempest-GroupSnapshotsTest-1849189312 None] Lock "cinder-quobyte-67cb083b-9bc0-4b14-8546-1c9f68e3e780" acquired by "_delete_snapshot" :: waited 0.035s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:59:14 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-ce922b8f-2174-458e-94b5-4659001cabf6 tempest-GroupSnapshotsTest-1849189312 None] Deleting offline snapshot 67cb083b-9bc0-4b14-8546-1c9f68e3e780 of volume a2f0862c-6027-48ba-8d7e-7098f4928a59 {{(pid=87515) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 09:59:14 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-ce922b8f-2174-458e-94b5-4659001cabf6 tempest-GroupSnapshotsTest-1849189312 None] snapshot_file for this snap is: volume-a2f0862c-6027-48ba-8d7e-7098f4928a59.67cb083b-9bc0-4b14-8546-1c9f68e3e780 {{(pid=87515) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 09:59:14 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f55ced5-c850-4cb8-aa11-0a1e4c2884dc]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 09:59:14 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-ce922b8f-2174-458e-94b5-4659001cabf6 tempest-GroupSnapshotsTest-1849189312 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-a2f0862c-6027-48ba-8d7e-7098f4928a59.67cb083b-9bc0-4b14-8546-1c9f68e3e780 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:59:14 devstack sudo[89358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-a2f0862c-6027-48ba-8d7e-7098f4928a59.67cb083b-9bc0-4b14-8546-1c9f68e3e780 Sep 07 09:59:14 devstack sudo[89358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:59:15 devstack sudo[89358]: pam_unix(sudo:session): session closed for user root Sep 07 09:59:15 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-ce922b8f-2174-458e-94b5-4659001cabf6 tempest-GroupSnapshotsTest-1849189312 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-a2f0862c-6027-48ba-8d7e-7098f4928a59.67cb083b-9bc0-4b14-8546-1c9f68e3e780" returned: 0 in 0.501s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:59:15 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-ce922b8f-2174-458e-94b5-4659001cabf6 tempest-GroupSnapshotsTest-1849189312 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a2f0862c-6027-48ba-8d7e-7098f4928a59(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87515) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 09:59:15 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac7cd017-b9bb-417f-b128-960b6a69be4b]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 09:59:15 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-ce922b8f-2174-458e-94b5-4659001cabf6 tempest-GroupSnapshotsTest-1849189312 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-a2f0862c-6027-48ba-8d7e-7098f4928a59 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:59:15 devstack sudo[89365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-a2f0862c-6027-48ba-8d7e-7098f4928a59 Sep 07 09:59:15 devstack sudo[89365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:59:15 devstack sudo[89365]: pam_unix(sudo:session): session closed for user root Sep 07 09:59:15 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-ce922b8f-2174-458e-94b5-4659001cabf6 tempest-GroupSnapshotsTest-1849189312 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-a2f0862c-6027-48ba-8d7e-7098f4928a59" returned: 0 in 0.584s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:59:15 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-ce922b8f-2174-458e-94b5-4659001cabf6 tempest-GroupSnapshotsTest-1849189312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-a2f0862c-6027-48ba-8d7e-7098f4928a59.67cb083b-9bc0-4b14-8546-1c9f68e3e780 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:59:15 devstack sudo[89376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-a2f0862c-6027-48ba-8d7e-7098f4928a59.67cb083b-9bc0-4b14-8546-1c9f68e3e780 Sep 07 09:59:15 devstack sudo[89376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:59:16 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-ce922b8f-2174-458e-94b5-4659001cabf6 tempest-GroupSnapshotsTest-1849189312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-a2f0862c-6027-48ba-8d7e-7098f4928a59.67cb083b-9bc0-4b14-8546-1c9f68e3e780" returned: 0 in 0.611s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:59:16 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-ce922b8f-2174-458e-94b5-4659001cabf6 tempest-GroupSnapshotsTest-1849189312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-a2f0862c-6027-48ba-8d7e-7098f4928a59.67cb083b-9bc0-4b14-8546-1c9f68e3e780 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:59:16 devstack sudo[89376]: pam_unix(sudo:session): session closed for user root Sep 07 09:59:16 devstack sudo[89383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-a2f0862c-6027-48ba-8d7e-7098f4928a59.67cb083b-9bc0-4b14-8546-1c9f68e3e780 Sep 07 09:59:16 devstack sudo[89383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:59:16 devstack sudo[89383]: pam_unix(sudo:session): session closed for user root Sep 07 09:59:16 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-ce922b8f-2174-458e-94b5-4659001cabf6 tempest-GroupSnapshotsTest-1849189312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-a2f0862c-6027-48ba-8d7e-7098f4928a59.67cb083b-9bc0-4b14-8546-1c9f68e3e780" returned: 0 in 0.495s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:59:16 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-ce922b8f-2174-458e-94b5-4659001cabf6 tempest-GroupSnapshotsTest-1849189312 None] Lock "cinder-quobyte-67cb083b-9bc0-4b14-8546-1c9f68e3e780" released by "_delete_snapshot" :: held 2.443s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:59:17 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-ce922b8f-2174-458e-94b5-4659001cabf6 tempest-GroupSnapshotsTest-1849189312 None] Lock "cinder-quobyte-a2f0862c-6027-48ba-8d7e-7098f4928a59" released by "delete_snapshot" :: held 2.500s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:59:17 devstack cinder-volume[87515]: WARNING cinder.quota [None req-ce922b8f-2174-458e-94b5-4659001cabf6 tempest-GroupSnapshotsTest-1849189312 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1470037831 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1470037831, it is now deprecated. Please use the default quota class for default quota. Sep 07 09:59:17 devstack cinder-volume[87515]: WARNING cinder.quota [None req-ce922b8f-2174-458e-94b5-4659001cabf6 tempest-GroupSnapshotsTest-1849189312 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1470037831 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1470037831, it is now deprecated. Please use the default quota class for default quota. Sep 07 09:59:17 devstack cinder-volume[87515]: DEBUG cinder.quota [None req-ce922b8f-2174-458e-94b5-4659001cabf6 tempest-GroupSnapshotsTest-1849189312 None] Created reservations ['ebe93083-8a38-4464-96bd-70acceec3520', 'd9527736-f4eb-49cf-a51e-643bc6132e7f', '4e147e83-558c-47dd-9abb-ab753e23c93a', 'a2f5d579-cac6-448c-bff6-b31eeccbc673'] {{(pid=87515) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 09:59:17 devstack cinder-volume[87515]: DEBUG cinder.quota [None req-ce922b8f-2174-458e-94b5-4659001cabf6 tempest-GroupSnapshotsTest-1849189312 None] Created reservations ['1ea0544e-dd35-4516-9a87-2bcc908bbb69', 'cddf3fd6-d822-4eb4-b26e-2067b9322a3c', '2ecfd7fb-97d8-4b23-b00a-715e879a3685', '490606d7-d917-40fd-9554-4d80a75bc707'] {{(pid=87515) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 09:59:17 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-ce922b8f-2174-458e-94b5-4659001cabf6 tempest-GroupSnapshotsTest-1849189312 None] group_snapshot 5cd116be-b787-458e-9c2f-fb2f4af4ca75: deleted successfully Sep 07 09:59:18 devstack cinder-volume[87515]: DEBUG cinder.volume.flows.manager.create_volume [None req-78715e05-c978-4f8f-8042-fb1033b44b58 tempest-ServersNegativeTestJSON-147044492 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 09:59:18 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-78715e05-c978-4f8f-8042-fb1033b44b58 tempest-ServersNegativeTestJSON-147044492 None] Flow 'volume_create_manager' (9595f59c-441d-430f-ac82-2ff4d422bb0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 09:59:18 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-78715e05-c978-4f8f-8042-fb1033b44b58 tempest-ServersNegativeTestJSON-147044492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4cee134b-f449-41f6-a60d-3e38e771ed94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:59:18 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-78715e05-c978-4f8f-8042-fb1033b44b58 tempest-ServersNegativeTestJSON-147044492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4cee134b-f449-41f6-a60d-3e38e771ed94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T07:59:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1847743653',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26827e68-b1e1-4eda-a782-11d8e7de4f25,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15619559956e4d42b66e36d17a8754bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T07:59:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T07:59:19Z,use_quota=True,user_id='e9e816169a2e43e5976d12f4b290a9fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3a092cd-7947-4cbf-abff-4ba9567becf0),volume_type_id=f3a092cd-7947-4cbf-abff-4ba9567becf0)' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:59:18 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-78715e05-c978-4f8f-8042-fb1033b44b58 tempest-ServersNegativeTestJSON-147044492 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6cd7c4bc-f1b9-4f75-981f-304b23623482) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:59:18 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-78715e05-c978-4f8f-8042-fb1033b44b58 tempest-ServersNegativeTestJSON-147044492 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6cd7c4bc-f1b9-4f75-981f-304b23623482) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:59:18 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-78715e05-c978-4f8f-8042-fb1033b44b58 tempest-ServersNegativeTestJSON-147044492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e5a5191-70c3-4778-ba46-078841f13d40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:59:18 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-78715e05-c978-4f8f-8042-fb1033b44b58 tempest-ServersNegativeTestJSON-147044492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e5a5191-70c3-4778-ba46-078841f13d40) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '26827e68-b1e1-4eda-a782-11d8e7de4f25', 'volume_name': 'volume-26827e68-b1e1-4eda-a782-11d8e7de4f25', 'volume_size': 1}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:59:18 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-78715e05-c978-4f8f-8042-fb1033b44b58 tempest-ServersNegativeTestJSON-147044492 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (766197d0-8e6d-4908-b7a7-d8fbf119fb95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:59:18 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-78715e05-c978-4f8f-8042-fb1033b44b58 tempest-ServersNegativeTestJSON-147044492 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (766197d0-8e6d-4908-b7a7-d8fbf119fb95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:59:18 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-78715e05-c978-4f8f-8042-fb1033b44b58 tempest-ServersNegativeTestJSON-147044492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54b38ead-06a1-4605-aa5b-b2d7af760b6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:59:18 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-78715e05-c978-4f8f-8042-fb1033b44b58 tempest-ServersNegativeTestJSON-147044492 None] Volume 26827e68-b1e1-4eda-a782-11d8e7de4f25: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-26827e68-b1e1-4eda-a782-11d8e7de4f25', 'volume_size': 1} Sep 07 09:59:18 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-78715e05-c978-4f8f-8042-fb1033b44b58 tempest-ServersNegativeTestJSON-147044492 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:59:18 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-78715e05-c978-4f8f-8042-fb1033b44b58 tempest-ServersNegativeTestJSON-147044492 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:59:18 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-78715e05-c978-4f8f-8042-fb1033b44b58 tempest-ServersNegativeTestJSON-147044492 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T07:59:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1847743653',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26827e68-b1e1-4eda-a782-11d8e7de4f25,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15619559956e4d42b66e36d17a8754bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T07:59:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T07:59:19Z,use_quota=True,user_id='e9e816169a2e43e5976d12f4b290a9fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3a092cd-7947-4cbf-abff-4ba9567becf0),volume_type_id=f3a092cd-7947-4cbf-abff-4ba9567becf0)}" {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 09:59:18 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-78715e05-c978-4f8f-8042-fb1033b44b58 tempest-ServersNegativeTestJSON-147044492 None] Creating volume 26827e68-b1e1-4eda-a782-11d8e7de4f25 {{(pid=87515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 09:59:18 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-78715e05-c978-4f8f-8042-fb1033b44b58 tempest-ServersNegativeTestJSON-147044492 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:59:18 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-78715e05-c978-4f8f-8042-fb1033b44b58 tempest-ServersNegativeTestJSON-147044492 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:59:18 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-78715e05-c978-4f8f-8042-fb1033b44b58 tempest-ServersNegativeTestJSON-147044492 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 09:59:18 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-78715e05-c978-4f8f-8042-fb1033b44b58 tempest-ServersNegativeTestJSON-147044492 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 09:59:18 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-78715e05-c978-4f8f-8042-fb1033b44b58 tempest-ServersNegativeTestJSON-147044492 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:59:18 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-78715e05-c978-4f8f-8042-fb1033b44b58 tempest-ServersNegativeTestJSON-147044492 None] Selected osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c as target Quobyte volume. {{(pid=87515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 09:59:18 devstack cinder-volume[87515]: INFO cinder.volume.drivers.remotefs [None req-78715e05-c978-4f8f-8042-fb1033b44b58 tempest-ServersNegativeTestJSON-147044492 None] casted to osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c Sep 07 09:59:18 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-78715e05-c978-4f8f-8042-fb1033b44b58 tempest-ServersNegativeTestJSON-147044492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-26827e68-b1e1-4eda-a782-11d8e7de4f25 1073741824 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:59:18 devstack sudo[89463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-26827e68-b1e1-4eda-a782-11d8e7de4f25 1073741824 Sep 07 09:59:18 devstack sudo[89463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:59:19 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-a3911003-b527-4ba5-8c5d-e75f2508c779 tempest-GroupSnapshotsTest-1849189312 None] Acquiring lock "cinder-quobyte-a2f0862c-6027-48ba-8d7e-7098f4928a59" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:59:19 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-a3911003-b527-4ba5-8c5d-e75f2508c779 tempest-GroupSnapshotsTest-1849189312 None] Lock "cinder-quobyte-a2f0862c-6027-48ba-8d7e-7098f4928a59" acquired by "delete_volume" :: waited 0.033s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:59:19 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[b184750d-1675-403e-8a07-cab023c22d93]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 09:59:19 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-a3911003-b527-4ba5-8c5d-e75f2508c779 tempest-GroupSnapshotsTest-1849189312 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-a2f0862c-6027-48ba-8d7e-7098f4928a59 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:59:19 devstack sudo[89463]: pam_unix(sudo:session): session closed for user root Sep 07 09:59:19 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-78715e05-c978-4f8f-8042-fb1033b44b58 tempest-ServersNegativeTestJSON-147044492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-26827e68-b1e1-4eda-a782-11d8e7de4f25 1073741824" returned: 0 in 0.788s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:59:19 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-78715e05-c978-4f8f-8042-fb1033b44b58 tempest-ServersNegativeTestJSON-147044492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-26827e68-b1e1-4eda-a782-11d8e7de4f25 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:59:19 devstack sudo[89472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-a2f0862c-6027-48ba-8d7e-7098f4928a59 Sep 07 09:59:19 devstack sudo[89472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:59:19 devstack sudo[89473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-26827e68-b1e1-4eda-a782-11d8e7de4f25 Sep 07 09:59:19 devstack sudo[89473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:59:20 devstack sudo[89472]: pam_unix(sudo:session): session closed for user root Sep 07 09:59:20 devstack sudo[89473]: pam_unix(sudo:session): session closed for user root Sep 07 09:59:20 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-a3911003-b527-4ba5-8c5d-e75f2508c779 tempest-GroupSnapshotsTest-1849189312 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-a2f0862c-6027-48ba-8d7e-7098f4928a59" returned: 0 in 0.609s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:59:20 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-a3911003-b527-4ba5-8c5d-e75f2508c779 tempest-GroupSnapshotsTest-1849189312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-a2f0862c-6027-48ba-8d7e-7098f4928a59 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:59:20 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-78715e05-c978-4f8f-8042-fb1033b44b58 tempest-ServersNegativeTestJSON-147044492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-26827e68-b1e1-4eda-a782-11d8e7de4f25" returned: 0 in 0.508s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:59:20 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-78715e05-c978-4f8f-8042-fb1033b44b58 tempest-ServersNegativeTestJSON-147044492 None] <== create_volume: return (1388ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'} {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 09:59:20 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-78715e05-c978-4f8f-8042-fb1033b44b58 tempest-ServersNegativeTestJSON-147044492 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.395s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:59:20 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-78715e05-c978-4f8f-8042-fb1033b44b58 tempest-ServersNegativeTestJSON-147044492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54b38ead-06a1-4605-aa5b-b2d7af760b6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-26827e68-b1e1-4eda-a782-11d8e7de4f25', 'volume_size': 1}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:59:20 devstack sudo[89481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-a2f0862c-6027-48ba-8d7e-7098f4928a59 Sep 07 09:59:20 devstack sudo[89481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:59:20 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-78715e05-c978-4f8f-8042-fb1033b44b58 tempest-ServersNegativeTestJSON-147044492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f6c3470-4d6c-4843-8226-29daf5b5a12a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:59:20 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-78715e05-c978-4f8f-8042-fb1033b44b58 tempest-ServersNegativeTestJSON-147044492 None] Volume volume-26827e68-b1e1-4eda-a782-11d8e7de4f25 (26827e68-b1e1-4eda-a782-11d8e7de4f25): created successfully Sep 07 09:59:20 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-78715e05-c978-4f8f-8042-fb1033b44b58 tempest-ServersNegativeTestJSON-147044492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f6c3470-4d6c-4843-8226-29daf5b5a12a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:59:20 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-78715e05-c978-4f8f-8042-fb1033b44b58 tempest-ServersNegativeTestJSON-147044492 None] Flow 'volume_create_manager' (9595f59c-441d-430f-ac82-2ff4d422bb0c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 09:59:20 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-78715e05-c978-4f8f-8042-fb1033b44b58 tempest-ServersNegativeTestJSON-147044492 None] Created volume successfully. Sep 07 09:59:20 devstack cinder-volume[87515]: DEBUG cinder.volume.flows.manager.create_volume [None req-963c8ee2-35c3-4551-b05d-ba8ade87c959 tempest-DeleteServersTestJSON-2035648071 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 09:59:20 devstack sudo[89481]: pam_unix(sudo:session): session closed for user root Sep 07 09:59:20 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-963c8ee2-35c3-4551-b05d-ba8ade87c959 tempest-DeleteServersTestJSON-2035648071 None] Flow 'volume_create_manager' (24778c3b-f371-4a9f-8460-750d7302dfbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 09:59:20 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-963c8ee2-35c3-4551-b05d-ba8ade87c959 tempest-DeleteServersTestJSON-2035648071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18b58e3e-dc85-49bf-b259-aa13051da672) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:59:20 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-a3911003-b527-4ba5-8c5d-e75f2508c779 tempest-GroupSnapshotsTest-1849189312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-a2f0862c-6027-48ba-8d7e-7098f4928a59" returned: 0 in 0.542s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:59:20 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-963c8ee2-35c3-4551-b05d-ba8ade87c959 tempest-DeleteServersTestJSON-2035648071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18b58e3e-dc85-49bf-b259-aa13051da672) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T07:59:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-821005425',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b2a72c1-2962-4da7-90da-c2983f72b4b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b141d66358d74a5ea86b7e8d58911889',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T07:59:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T07:59:21Z,use_quota=True,user_id='580eb4b67fed4f2d980fe533f68d17e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3a092cd-7947-4cbf-abff-4ba9567becf0),volume_type_id=f3a092cd-7947-4cbf-abff-4ba9567becf0)' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:59:20 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-963c8ee2-35c3-4551-b05d-ba8ade87c959 tempest-DeleteServersTestJSON-2035648071 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7671d9ac-94de-4ce0-842d-f9ba6f8cfbd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:59:20 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-963c8ee2-35c3-4551-b05d-ba8ade87c959 tempest-DeleteServersTestJSON-2035648071 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7671d9ac-94de-4ce0-842d-f9ba6f8cfbd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:59:20 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-963c8ee2-35c3-4551-b05d-ba8ade87c959 tempest-DeleteServersTestJSON-2035648071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4d3f3df-1711-46ed-b442-bbefaa78e496) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:59:20 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-963c8ee2-35c3-4551-b05d-ba8ade87c959 tempest-DeleteServersTestJSON-2035648071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4d3f3df-1711-46ed-b442-bbefaa78e496) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5b2a72c1-2962-4da7-90da-c2983f72b4b7', 'volume_name': 'volume-5b2a72c1-2962-4da7-90da-c2983f72b4b7', 'volume_size': 1}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:59:20 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-963c8ee2-35c3-4551-b05d-ba8ade87c959 tempest-DeleteServersTestJSON-2035648071 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba8ac3cf-46c1-4a33-b573-121ee7cc7f10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:59:20 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-963c8ee2-35c3-4551-b05d-ba8ade87c959 tempest-DeleteServersTestJSON-2035648071 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba8ac3cf-46c1-4a33-b573-121ee7cc7f10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:59:20 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-963c8ee2-35c3-4551-b05d-ba8ade87c959 tempest-DeleteServersTestJSON-2035648071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c75f8792-4f6f-470b-981b-d084423f638d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:59:20 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-963c8ee2-35c3-4551-b05d-ba8ade87c959 tempest-DeleteServersTestJSON-2035648071 None] Volume 5b2a72c1-2962-4da7-90da-c2983f72b4b7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5b2a72c1-2962-4da7-90da-c2983f72b4b7', 'volume_size': 1} Sep 07 09:59:20 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-963c8ee2-35c3-4551-b05d-ba8ade87c959 tempest-DeleteServersTestJSON-2035648071 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:59:20 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-963c8ee2-35c3-4551-b05d-ba8ade87c959 tempest-DeleteServersTestJSON-2035648071 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:59:20 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-963c8ee2-35c3-4551-b05d-ba8ade87c959 tempest-DeleteServersTestJSON-2035648071 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T07:59:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-821005425',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b2a72c1-2962-4da7-90da-c2983f72b4b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b141d66358d74a5ea86b7e8d58911889',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T07:59:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T07:59:21Z,use_quota=True,user_id='580eb4b67fed4f2d980fe533f68d17e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3a092cd-7947-4cbf-abff-4ba9567becf0),volume_type_id=f3a092cd-7947-4cbf-abff-4ba9567becf0)}" {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 09:59:20 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-963c8ee2-35c3-4551-b05d-ba8ade87c959 tempest-DeleteServersTestJSON-2035648071 None] Creating volume 5b2a72c1-2962-4da7-90da-c2983f72b4b7 {{(pid=87515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 09:59:20 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-963c8ee2-35c3-4551-b05d-ba8ade87c959 tempest-DeleteServersTestJSON-2035648071 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:59:20 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-963c8ee2-35c3-4551-b05d-ba8ade87c959 tempest-DeleteServersTestJSON-2035648071 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:59:20 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-963c8ee2-35c3-4551-b05d-ba8ade87c959 tempest-DeleteServersTestJSON-2035648071 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 09:59:20 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-963c8ee2-35c3-4551-b05d-ba8ade87c959 tempest-DeleteServersTestJSON-2035648071 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 09:59:20 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-963c8ee2-35c3-4551-b05d-ba8ade87c959 tempest-DeleteServersTestJSON-2035648071 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:59:20 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-963c8ee2-35c3-4551-b05d-ba8ade87c959 tempest-DeleteServersTestJSON-2035648071 None] Selected osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c as target Quobyte volume. {{(pid=87515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 09:59:20 devstack cinder-volume[87515]: INFO cinder.volume.drivers.remotefs [None req-963c8ee2-35c3-4551-b05d-ba8ade87c959 tempest-DeleteServersTestJSON-2035648071 None] casted to osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c Sep 07 09:59:20 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-963c8ee2-35c3-4551-b05d-ba8ade87c959 tempest-DeleteServersTestJSON-2035648071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-5b2a72c1-2962-4da7-90da-c2983f72b4b7 1073741824 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:59:20 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-a3911003-b527-4ba5-8c5d-e75f2508c779 tempest-GroupSnapshotsTest-1849189312 None] Lock "cinder-quobyte-a2f0862c-6027-48ba-8d7e-7098f4928a59" released by "delete_volume" :: held 1.383s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:59:20 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-a3911003-b527-4ba5-8c5d-e75f2508c779 tempest-GroupSnapshotsTest-1849189312 None] Acquiring lock "cinder-quobyte-ee12dea4-5bb5-4d90-aeb1-73da8103f717" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:59:21 devstack sudo[89484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-5b2a72c1-2962-4da7-90da-c2983f72b4b7 1073741824 Sep 07 09:59:21 devstack sudo[89484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:59:21 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-a3911003-b527-4ba5-8c5d-e75f2508c779 tempest-GroupSnapshotsTest-1849189312 None] Lock "cinder-quobyte-ee12dea4-5bb5-4d90-aeb1-73da8103f717" acquired by "delete_volume" :: waited 0.039s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:59:21 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[27f8dd85-ba26-460b-aae0-b325ae196e88]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 09:59:21 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-a3911003-b527-4ba5-8c5d-e75f2508c779 tempest-GroupSnapshotsTest-1849189312 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-ee12dea4-5bb5-4d90-aeb1-73da8103f717 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:59:21 devstack sudo[89486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-ee12dea4-5bb5-4d90-aeb1-73da8103f717 Sep 07 09:59:21 devstack sudo[89486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:59:21 devstack sudo[89484]: pam_unix(sudo:session): session closed for user root Sep 07 09:59:21 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-963c8ee2-35c3-4551-b05d-ba8ade87c959 tempest-DeleteServersTestJSON-2035648071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-5b2a72c1-2962-4da7-90da-c2983f72b4b7 1073741824" returned: 0 in 0.797s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:59:21 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-963c8ee2-35c3-4551-b05d-ba8ade87c959 tempest-DeleteServersTestJSON-2035648071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-5b2a72c1-2962-4da7-90da-c2983f72b4b7 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:59:21 devstack sudo[89486]: pam_unix(sudo:session): session closed for user root Sep 07 09:59:21 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-a3911003-b527-4ba5-8c5d-e75f2508c779 tempest-GroupSnapshotsTest-1849189312 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-ee12dea4-5bb5-4d90-aeb1-73da8103f717" returned: 0 in 0.708s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:59:21 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-a3911003-b527-4ba5-8c5d-e75f2508c779 tempest-GroupSnapshotsTest-1849189312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-ee12dea4-5bb5-4d90-aeb1-73da8103f717 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:59:21 devstack sudo[89506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-5b2a72c1-2962-4da7-90da-c2983f72b4b7 Sep 07 09:59:21 devstack sudo[89506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:59:21 devstack sudo[89508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-ee12dea4-5bb5-4d90-aeb1-73da8103f717 Sep 07 09:59:21 devstack sudo[89508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:59:22 devstack cinder-volume[87515]: WARNING py.warnings [req-d74d5a53-0354-449f-aa94-3b99f04852b2 req-0c4987fe-1395-4372-97f4-2748d8102083 tempest-ServerActionsTestOtherA-1577109295 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volume_attachment". Apply join condition(s) between each element to resolve. Sep 07 09:59:22 devstack cinder-volume[87515]: .first() Sep 07 09:59:22 devstack cinder-volume[87515]: Sep 07 09:59:22 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [req-d74d5a53-0354-449f-aa94-3b99f04852b2 req-0c4987fe-1395-4372-97f4-2748d8102083 tempest-ServerActionsTestOtherA-1577109295 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:59:22 devstack sudo[89506]: pam_unix(sudo:session): session closed for user root Sep 07 09:59:22 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-963c8ee2-35c3-4551-b05d-ba8ade87c959 tempest-DeleteServersTestJSON-2035648071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-5b2a72c1-2962-4da7-90da-c2983f72b4b7" returned: 0 in 0.391s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:59:22 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-963c8ee2-35c3-4551-b05d-ba8ade87c959 tempest-DeleteServersTestJSON-2035648071 None] <== create_volume: return (1250ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'} {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 09:59:22 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-963c8ee2-35c3-4551-b05d-ba8ade87c959 tempest-DeleteServersTestJSON-2035648071 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.254s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:59:22 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [req-d74d5a53-0354-449f-aa94-3b99f04852b2 req-0c4987fe-1395-4372-97f4-2748d8102083 tempest-ServerActionsTestOtherA-1577109295 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.055s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:59:22 devstack sudo[89508]: pam_unix(sudo:session): session closed for user root Sep 07 09:59:22 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-a3911003-b527-4ba5-8c5d-e75f2508c779 tempest-GroupSnapshotsTest-1849189312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-ee12dea4-5bb5-4d90-aeb1-73da8103f717" returned: 0 in 0.429s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:59:22 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-963c8ee2-35c3-4551-b05d-ba8ade87c959 tempest-DeleteServersTestJSON-2035648071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c75f8792-4f6f-470b-981b-d084423f638d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5b2a72c1-2962-4da7-90da-c2983f72b4b7', 'volume_size': 1}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:59:22 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-963c8ee2-35c3-4551-b05d-ba8ade87c959 tempest-DeleteServersTestJSON-2035648071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e9284a7-1a08-4f22-a532-de2e3f1de4b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:59:22 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-a3911003-b527-4ba5-8c5d-e75f2508c779 tempest-GroupSnapshotsTest-1849189312 None] Lock "cinder-quobyte-ee12dea4-5bb5-4d90-aeb1-73da8103f717" released by "delete_volume" :: held 1.274s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:59:22 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-963c8ee2-35c3-4551-b05d-ba8ade87c959 tempest-DeleteServersTestJSON-2035648071 None] Volume volume-5b2a72c1-2962-4da7-90da-c2983f72b4b7 (5b2a72c1-2962-4da7-90da-c2983f72b4b7): created successfully Sep 07 09:59:22 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-963c8ee2-35c3-4551-b05d-ba8ade87c959 tempest-DeleteServersTestJSON-2035648071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e9284a7-1a08-4f22-a532-de2e3f1de4b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:59:22 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-963c8ee2-35c3-4551-b05d-ba8ade87c959 tempest-DeleteServersTestJSON-2035648071 None] Flow 'volume_create_manager' (24778c3b-f371-4a9f-8460-750d7302dfbf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 09:59:22 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [req-d74d5a53-0354-449f-aa94-3b99f04852b2 req-0c4987fe-1395-4372-97f4-2748d8102083 tempest-ServerActionsTestOtherA-1577109295 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.193s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:59:22 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-963c8ee2-35c3-4551-b05d-ba8ade87c959 tempest-DeleteServersTestJSON-2035648071 None] Created volume successfully. Sep 07 09:59:22 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [req-d74d5a53-0354-449f-aa94-3b99f04852b2 req-0c4987fe-1395-4372-97f4-2748d8102083 tempest-ServerActionsTestOtherA-1577109295 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c', 'name': 'volume-15e4fccc-b0e8-488e-8c3e-d0261bf8472c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5026e0be-eff1-41b4-b668-4779e227865a', 'enforce_multipath': True} {{(pid=87515) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 07 09:59:22 devstack cinder-volume[87515]: DEBUG cinder.quota [None req-a3911003-b527-4ba5-8c5d-e75f2508c779 tempest-GroupSnapshotsTest-1849189312 None] Created reservations ['1bb4fa75-a3d9-442a-891b-1563af73476e'] {{(pid=87515) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 09:59:22 devstack cinder-volume[87515]: INFO cinder.volume.manager [req-d74d5a53-0354-449f-aa94-3b99f04852b2 req-0c4987fe-1395-4372-97f4-2748d8102083 tempest-ServerActionsTestOtherA-1577109295 None] attachment_update completed successfully. Sep 07 09:59:22 devstack cinder-volume[87515]: WARNING cinder.quota [None req-a3911003-b527-4ba5-8c5d-e75f2508c779 tempest-GroupSnapshotsTest-1849189312 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1470037831 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1470037831, it is now deprecated. Please use the default quota class for default quota. Sep 07 09:59:22 devstack cinder-volume[87515]: DEBUG cinder.quota [None req-a3911003-b527-4ba5-8c5d-e75f2508c779 tempest-GroupSnapshotsTest-1849189312 None] Created reservations ['8cd645e4-2595-45f1-8bbb-d4cd55d0987a', 'd817cc82-3131-4eb2-93f6-c0ccaf83b567', '4ccf2612-a9fa-491f-9e99-214b6ca54f49', 'e59e6a8c-7cd7-4ae3-bb47-fec02a4224b9'] {{(pid=87515) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 09:59:22 devstack cinder-volume[87515]: DEBUG cinder.volume.flows.manager.create_volume [None req-f4a2cc4d-180c-4ccb-b94b-bbbc05212309 tempest-ServersNegativeTestJSON-147044492 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 09:59:22 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-f4a2cc4d-180c-4ccb-b94b-bbbc05212309 tempest-ServersNegativeTestJSON-147044492 None] Flow 'volume_create_manager' (f2c42633-60b5-4369-b618-0928031b95f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 09:59:22 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-f4a2cc4d-180c-4ccb-b94b-bbbc05212309 tempest-ServersNegativeTestJSON-147044492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (114f4446-da1b-4ef5-b5a8-1839d2a72498) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:59:23 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-f4a2cc4d-180c-4ccb-b94b-bbbc05212309 tempest-ServersNegativeTestJSON-147044492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (114f4446-da1b-4ef5-b5a8-1839d2a72498) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T07:59:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-2112621883',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68f632f7-28b1-4523-98f1-a6f76b807325,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15619559956e4d42b66e36d17a8754bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T07:59:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T07:59:23Z,use_quota=True,user_id='e9e816169a2e43e5976d12f4b290a9fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3a092cd-7947-4cbf-abff-4ba9567becf0),volume_type_id=f3a092cd-7947-4cbf-abff-4ba9567becf0)' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:59:23 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-f4a2cc4d-180c-4ccb-b94b-bbbc05212309 tempest-ServersNegativeTestJSON-147044492 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0838d6f-f441-4420-b41c-54c3b6ed63ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:59:23 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-f4a2cc4d-180c-4ccb-b94b-bbbc05212309 tempest-ServersNegativeTestJSON-147044492 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0838d6f-f441-4420-b41c-54c3b6ed63ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:59:23 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-f4a2cc4d-180c-4ccb-b94b-bbbc05212309 tempest-ServersNegativeTestJSON-147044492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bed93076-fb41-4f4c-b142-df27af3236e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:59:23 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-f4a2cc4d-180c-4ccb-b94b-bbbc05212309 tempest-ServersNegativeTestJSON-147044492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bed93076-fb41-4f4c-b142-df27af3236e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '68f632f7-28b1-4523-98f1-a6f76b807325', 'volume_name': 'volume-68f632f7-28b1-4523-98f1-a6f76b807325', 'volume_size': 1}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:59:23 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-f4a2cc4d-180c-4ccb-b94b-bbbc05212309 tempest-ServersNegativeTestJSON-147044492 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (461c1ae1-7fd7-46dc-b628-2d68503d05e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:59:23 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-f4a2cc4d-180c-4ccb-b94b-bbbc05212309 tempest-ServersNegativeTestJSON-147044492 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (461c1ae1-7fd7-46dc-b628-2d68503d05e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:59:23 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-f4a2cc4d-180c-4ccb-b94b-bbbc05212309 tempest-ServersNegativeTestJSON-147044492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0f8b237-daa4-4704-a947-ddb2db5d60d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:59:23 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-f4a2cc4d-180c-4ccb-b94b-bbbc05212309 tempest-ServersNegativeTestJSON-147044492 None] Volume 68f632f7-28b1-4523-98f1-a6f76b807325: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-68f632f7-28b1-4523-98f1-a6f76b807325', 'volume_size': 1} Sep 07 09:59:23 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-f4a2cc4d-180c-4ccb-b94b-bbbc05212309 tempest-ServersNegativeTestJSON-147044492 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:59:23 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-f4a2cc4d-180c-4ccb-b94b-bbbc05212309 tempest-ServersNegativeTestJSON-147044492 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:59:23 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-f4a2cc4d-180c-4ccb-b94b-bbbc05212309 tempest-ServersNegativeTestJSON-147044492 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T07:59:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-2112621883',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68f632f7-28b1-4523-98f1-a6f76b807325,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15619559956e4d42b66e36d17a8754bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T07:59:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T07:59:23Z,use_quota=True,user_id='e9e816169a2e43e5976d12f4b290a9fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3a092cd-7947-4cbf-abff-4ba9567becf0),volume_type_id=f3a092cd-7947-4cbf-abff-4ba9567becf0)}" {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 09:59:23 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-f4a2cc4d-180c-4ccb-b94b-bbbc05212309 tempest-ServersNegativeTestJSON-147044492 None] Creating volume 68f632f7-28b1-4523-98f1-a6f76b807325 {{(pid=87515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 09:59:23 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-f4a2cc4d-180c-4ccb-b94b-bbbc05212309 tempest-ServersNegativeTestJSON-147044492 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:59:23 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-f4a2cc4d-180c-4ccb-b94b-bbbc05212309 tempest-ServersNegativeTestJSON-147044492 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:59:23 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-f4a2cc4d-180c-4ccb-b94b-bbbc05212309 tempest-ServersNegativeTestJSON-147044492 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 09:59:23 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-f4a2cc4d-180c-4ccb-b94b-bbbc05212309 tempest-ServersNegativeTestJSON-147044492 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 09:59:23 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-f4a2cc4d-180c-4ccb-b94b-bbbc05212309 tempest-ServersNegativeTestJSON-147044492 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:59:23 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-f4a2cc4d-180c-4ccb-b94b-bbbc05212309 tempest-ServersNegativeTestJSON-147044492 None] Selected osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c as target Quobyte volume. {{(pid=87515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 09:59:23 devstack cinder-volume[87515]: INFO cinder.volume.drivers.remotefs [None req-f4a2cc4d-180c-4ccb-b94b-bbbc05212309 tempest-ServersNegativeTestJSON-147044492 None] casted to osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c Sep 07 09:59:23 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-f4a2cc4d-180c-4ccb-b94b-bbbc05212309 tempest-ServersNegativeTestJSON-147044492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-68f632f7-28b1-4523-98f1-a6f76b807325 1073741824 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:59:23 devstack cinder-volume[87515]: DEBUG cinder.quota [None req-a3911003-b527-4ba5-8c5d-e75f2508c779 tempest-GroupSnapshotsTest-1849189312 None] Created reservations ['8b021e1a-aa10-4257-9c14-e277cc076920', '24ab674c-0d43-4970-b2cc-22f4b909855f', '35d77829-fca6-4c82-997a-d459d91f099e', 'b0626adf-b226-4804-a807-12aa84870448'] {{(pid=87515) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 09:59:23 devstack sudo[89516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-68f632f7-28b1-4523-98f1-a6f76b807325 1073741824 Sep 07 09:59:23 devstack sudo[89516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:59:23 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-a3911003-b527-4ba5-8c5d-e75f2508c779 tempest-GroupSnapshotsTest-1849189312 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:59:23 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-a3911003-b527-4ba5-8c5d-e75f2508c779 tempest-GroupSnapshotsTest-1849189312 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:59:23 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-a3911003-b527-4ba5-8c5d-e75f2508c779 tempest-GroupSnapshotsTest-1849189312 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 09:59:23 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-a3911003-b527-4ba5-8c5d-e75f2508c779 tempest-GroupSnapshotsTest-1849189312 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 09:59:23 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-a3911003-b527-4ba5-8c5d-e75f2508c779 tempest-GroupSnapshotsTest-1849189312 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:59:23 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-a3911003-b527-4ba5-8c5d-e75f2508c779 tempest-GroupSnapshotsTest-1849189312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:59:23 devstack sudo[89563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a Sep 07 09:59:23 devstack sudo[89563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:59:23 devstack sudo[89563]: pam_unix(sudo:session): session closed for user root Sep 07 09:59:23 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-a3911003-b527-4ba5-8c5d-e75f2508c779 tempest-GroupSnapshotsTest-1849189312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a" returned: 0 in 0.390s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:59:23 devstack cinder-volume[87515]: DEBUG cinder.manager [None req-a3911003-b527-4ba5-8c5d-e75f2508c779 tempest-GroupSnapshotsTest-1849189312 None] Notifying Schedulers of capabilities ... {{(pid=87515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 09:59:23 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-a3911003-b527-4ba5-8c5d-e75f2508c779 tempest-GroupSnapshotsTest-1849189312 None] Delete group completed successfully. Sep 07 09:59:23 devstack sudo[89516]: pam_unix(sudo:session): session closed for user root Sep 07 09:59:23 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-f4a2cc4d-180c-4ccb-b94b-bbbc05212309 tempest-ServersNegativeTestJSON-147044492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-68f632f7-28b1-4523-98f1-a6f76b807325 1073741824" returned: 0 in 0.640s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:59:23 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-f4a2cc4d-180c-4ccb-b94b-bbbc05212309 tempest-ServersNegativeTestJSON-147044492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-68f632f7-28b1-4523-98f1-a6f76b807325 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:59:23 devstack sudo[89912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-68f632f7-28b1-4523-98f1-a6f76b807325 Sep 07 09:59:23 devstack sudo[89912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:59:24 devstack sudo[89912]: pam_unix(sudo:session): session closed for user root Sep 07 09:59:24 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-f4a2cc4d-180c-4ccb-b94b-bbbc05212309 tempest-ServersNegativeTestJSON-147044492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-68f632f7-28b1-4523-98f1-a6f76b807325" returned: 0 in 0.343s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:59:24 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-f4a2cc4d-180c-4ccb-b94b-bbbc05212309 tempest-ServersNegativeTestJSON-147044492 None] <== create_volume: return (1059ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'} {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 09:59:24 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-f4a2cc4d-180c-4ccb-b94b-bbbc05212309 tempest-ServersNegativeTestJSON-147044492 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.063s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:59:24 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-f4a2cc4d-180c-4ccb-b94b-bbbc05212309 tempest-ServersNegativeTestJSON-147044492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0f8b237-daa4-4704-a947-ddb2db5d60d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-68f632f7-28b1-4523-98f1-a6f76b807325', 'volume_size': 1}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:59:24 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-f4a2cc4d-180c-4ccb-b94b-bbbc05212309 tempest-ServersNegativeTestJSON-147044492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9758163a-cf75-4f1d-98d2-d8610a69f6b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:59:24 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-f4a2cc4d-180c-4ccb-b94b-bbbc05212309 tempest-ServersNegativeTestJSON-147044492 None] Volume volume-68f632f7-28b1-4523-98f1-a6f76b807325 (68f632f7-28b1-4523-98f1-a6f76b807325): created successfully Sep 07 09:59:24 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-f4a2cc4d-180c-4ccb-b94b-bbbc05212309 tempest-ServersNegativeTestJSON-147044492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9758163a-cf75-4f1d-98d2-d8610a69f6b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:59:24 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-f4a2cc4d-180c-4ccb-b94b-bbbc05212309 tempest-ServersNegativeTestJSON-147044492 None] Flow 'volume_create_manager' (f2c42633-60b5-4369-b618-0928031b95f4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 09:59:24 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-f4a2cc4d-180c-4ccb-b94b-bbbc05212309 tempest-ServersNegativeTestJSON-147044492 None] Created volume successfully. Sep 07 09:59:24 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-37c07479-6b00-4aea-8b09-c87d2bdbf146 tempest-GroupSnapshotsTest-1849189312 None] Group tempest-GroupSnapshotsTest-Group-1607098: creating Sep 07 09:59:24 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-37c07479-6b00-4aea-8b09-c87d2bdbf146 tempest-GroupSnapshotsTest-1849189312 None] Group tempest-GroupSnapshotsTest-Group-1607098: created successfully Sep 07 09:59:24 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-37c07479-6b00-4aea-8b09-c87d2bdbf146 tempest-GroupSnapshotsTest-1849189312 None] Create group completed successfully. Sep 07 09:59:24 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [req-f34591aa-deba-4843-874f-5b88758703d8 req-bee37ae1-e864-496d-b4ae-75aabac54423 tempest-DeleteServersTestJSON-2035648071 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:59:24 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [req-f34591aa-deba-4843-874f-5b88758703d8 req-bee37ae1-e864-496d-b4ae-75aabac54423 tempest-DeleteServersTestJSON-2035648071 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:59:24 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [req-f34591aa-deba-4843-874f-5b88758703d8 req-bee37ae1-e864-496d-b4ae-75aabac54423 tempest-DeleteServersTestJSON-2035648071 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:59:24 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [req-f34591aa-deba-4843-874f-5b88758703d8 req-bee37ae1-e864-496d-b4ae-75aabac54423 tempest-DeleteServersTestJSON-2035648071 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c', 'name': 'volume-5b2a72c1-2962-4da7-90da-c2983f72b4b7', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7f4625f0-4fb8-46de-a091-07134780e8f5', 'enforce_multipath': True} {{(pid=87515) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 07 09:59:24 devstack cinder-volume[87515]: INFO cinder.volume.manager [req-f34591aa-deba-4843-874f-5b88758703d8 req-bee37ae1-e864-496d-b4ae-75aabac54423 tempest-DeleteServersTestJSON-2035648071 None] attachment_update completed successfully. Sep 07 09:59:25 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-9bd19383-6054-44f2-b7f0-502a859291ff tempest-ServersNegativeTestJSON-147044492 None] Acquiring lock "cinder-68f632f7-28b1-4523-98f1-a6f76b807325-delete_volume" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:59:25 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-9bd19383-6054-44f2-b7f0-502a859291ff tempest-ServersNegativeTestJSON-147044492 None] Lock "cinder-68f632f7-28b1-4523-98f1-a6f76b807325-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:59:25 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-9bd19383-6054-44f2-b7f0-502a859291ff tempest-ServersNegativeTestJSON-147044492 None] Acquiring lock "cinder-quobyte-68f632f7-28b1-4523-98f1-a6f76b807325" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:59:25 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-9bd19383-6054-44f2-b7f0-502a859291ff tempest-ServersNegativeTestJSON-147044492 None] Lock "cinder-quobyte-68f632f7-28b1-4523-98f1-a6f76b807325" acquired by "delete_volume" :: waited 0.023s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:59:25 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd2628f2-4b93-40e5-86a6-4657e15e9f3c]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 09:59:25 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-9bd19383-6054-44f2-b7f0-502a859291ff tempest-ServersNegativeTestJSON-147044492 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-68f632f7-28b1-4523-98f1-a6f76b807325 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:59:26 devstack sudo[89927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-68f632f7-28b1-4523-98f1-a6f76b807325 Sep 07 09:59:26 devstack sudo[89927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:59:26 devstack sudo[89927]: pam_unix(sudo:session): session closed for user root Sep 07 09:59:26 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-9bd19383-6054-44f2-b7f0-502a859291ff tempest-ServersNegativeTestJSON-147044492 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-68f632f7-28b1-4523-98f1-a6f76b807325" returned: 0 in 0.530s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:59:26 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-9bd19383-6054-44f2-b7f0-502a859291ff tempest-ServersNegativeTestJSON-147044492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-68f632f7-28b1-4523-98f1-a6f76b807325 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:59:26 devstack sudo[89933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-68f632f7-28b1-4523-98f1-a6f76b807325 Sep 07 09:59:26 devstack sudo[89933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:59:26 devstack cinder-volume[87515]: DEBUG cinder.volume.flows.manager.create_volume [None req-e163cea2-e84a-457d-9755-c2d6bf1d6e67 tempest-GroupSnapshotsTest-1849189312 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 09:59:26 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-e163cea2-e84a-457d-9755-c2d6bf1d6e67 tempest-GroupSnapshotsTest-1849189312 None] Flow 'volume_create_manager' (38de148e-d93b-4dbd-8fb4-e76cf69f4912) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 09:59:26 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-e163cea2-e84a-457d-9755-c2d6bf1d6e67 tempest-GroupSnapshotsTest-1849189312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43e44eeb-074c-478a-992b-bb08afc49bd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:59:26 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-e163cea2-e84a-457d-9755-c2d6bf1d6e67 tempest-GroupSnapshotsTest-1849189312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43e44eeb-074c-478a-992b-bb08afc49bd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T07:59:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-159802355',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=ed513887-13dc-423c-8e91-a5222fb071b1,host='devstack@QuobyteHD#QuobyteHD',id=62e90beb-b056-42e3-94e2-d1fd49e1da3f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0bdaa19ad94c41a98e26982980d686bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T07:59:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T07:59:27Z,use_quota=True,user_id='0a729d1b14204872b787704d5e4d6602',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f5a8ca4-bda5-44e3-8933-2a1cfef513b6),volume_type_id=3f5a8ca4-bda5-44e3-8933-2a1cfef513b6)' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:59:26 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-e163cea2-e84a-457d-9755-c2d6bf1d6e67 tempest-GroupSnapshotsTest-1849189312 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63261cf4-788c-4c50-bf3f-643a4952f6f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:59:26 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-e163cea2-e84a-457d-9755-c2d6bf1d6e67 tempest-GroupSnapshotsTest-1849189312 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63261cf4-788c-4c50-bf3f-643a4952f6f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:59:26 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-e163cea2-e84a-457d-9755-c2d6bf1d6e67 tempest-GroupSnapshotsTest-1849189312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d25a1bf-c832-48ce-9e5d-1614b989fee6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:59:27 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-e163cea2-e84a-457d-9755-c2d6bf1d6e67 tempest-GroupSnapshotsTest-1849189312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d25a1bf-c832-48ce-9e5d-1614b989fee6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '62e90beb-b056-42e3-94e2-d1fd49e1da3f', 'volume_name': 'volume-62e90beb-b056-42e3-94e2-d1fd49e1da3f', 'volume_size': 1}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:59:27 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-e163cea2-e84a-457d-9755-c2d6bf1d6e67 tempest-GroupSnapshotsTest-1849189312 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0086f4d7-7c84-4b17-a411-11e27b18ce7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:59:27 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-e163cea2-e84a-457d-9755-c2d6bf1d6e67 tempest-GroupSnapshotsTest-1849189312 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0086f4d7-7c84-4b17-a411-11e27b18ce7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:59:27 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-e163cea2-e84a-457d-9755-c2d6bf1d6e67 tempest-GroupSnapshotsTest-1849189312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29749d48-d933-43c6-bd9b-8024f710ef80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:59:27 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-e163cea2-e84a-457d-9755-c2d6bf1d6e67 tempest-GroupSnapshotsTest-1849189312 None] Volume 62e90beb-b056-42e3-94e2-d1fd49e1da3f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-62e90beb-b056-42e3-94e2-d1fd49e1da3f', 'volume_size': 1} Sep 07 09:59:27 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-e163cea2-e84a-457d-9755-c2d6bf1d6e67 tempest-GroupSnapshotsTest-1849189312 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:59:27 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-e163cea2-e84a-457d-9755-c2d6bf1d6e67 tempest-GroupSnapshotsTest-1849189312 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:59:27 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-e163cea2-e84a-457d-9755-c2d6bf1d6e67 tempest-GroupSnapshotsTest-1849189312 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=ed513887-13dc-423c-8e91-a5222fb071b1,created_at=2026-09-07T07:59:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-159802355',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=ed513887-13dc-423c-8e91-a5222fb071b1,host='devstack@QuobyteHD#QuobyteHD',id=62e90beb-b056-42e3-94e2-d1fd49e1da3f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0bdaa19ad94c41a98e26982980d686bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T07:59:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T07:59:27Z,use_quota=True,user_id='0a729d1b14204872b787704d5e4d6602',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f5a8ca4-bda5-44e3-8933-2a1cfef513b6),volume_type_id=3f5a8ca4-bda5-44e3-8933-2a1cfef513b6)}" {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 09:59:27 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-e163cea2-e84a-457d-9755-c2d6bf1d6e67 tempest-GroupSnapshotsTest-1849189312 None] Creating volume 62e90beb-b056-42e3-94e2-d1fd49e1da3f {{(pid=87515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 09:59:27 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-e163cea2-e84a-457d-9755-c2d6bf1d6e67 tempest-GroupSnapshotsTest-1849189312 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:59:27 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-e163cea2-e84a-457d-9755-c2d6bf1d6e67 tempest-GroupSnapshotsTest-1849189312 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:59:27 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-e163cea2-e84a-457d-9755-c2d6bf1d6e67 tempest-GroupSnapshotsTest-1849189312 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 09:59:27 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-e163cea2-e84a-457d-9755-c2d6bf1d6e67 tempest-GroupSnapshotsTest-1849189312 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 09:59:27 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-e163cea2-e84a-457d-9755-c2d6bf1d6e67 tempest-GroupSnapshotsTest-1849189312 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:59:27 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-e163cea2-e84a-457d-9755-c2d6bf1d6e67 tempest-GroupSnapshotsTest-1849189312 None] Selected osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c as target Quobyte volume. {{(pid=87515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 09:59:27 devstack cinder-volume[87515]: INFO cinder.volume.drivers.remotefs [None req-e163cea2-e84a-457d-9755-c2d6bf1d6e67 tempest-GroupSnapshotsTest-1849189312 None] casted to osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c Sep 07 09:59:27 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-e163cea2-e84a-457d-9755-c2d6bf1d6e67 tempest-GroupSnapshotsTest-1849189312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-62e90beb-b056-42e3-94e2-d1fd49e1da3f 1073741824 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:59:27 devstack sudo[89937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-62e90beb-b056-42e3-94e2-d1fd49e1da3f 1073741824 Sep 07 09:59:27 devstack sudo[89937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:59:27 devstack sudo[89933]: pam_unix(sudo:session): session closed for user root Sep 07 09:59:27 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-9bd19383-6054-44f2-b7f0-502a859291ff tempest-ServersNegativeTestJSON-147044492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-68f632f7-28b1-4523-98f1-a6f76b807325" returned: 0 in 0.845s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:59:27 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-9bd19383-6054-44f2-b7f0-502a859291ff tempest-ServersNegativeTestJSON-147044492 None] Lock "cinder-quobyte-68f632f7-28b1-4523-98f1-a6f76b807325" released by "delete_volume" :: held 1.428s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:59:27 devstack cinder-volume[87515]: DEBUG cinder.quota [None req-9bd19383-6054-44f2-b7f0-502a859291ff tempest-ServersNegativeTestJSON-147044492 None] Created reservations ['004161ce-346d-42dd-9250-0da0d5a2a8c8', 'de8d14f7-5ac3-4abc-a2ca-cc5f07c9ae66', '48f566b7-a81b-4cfb-bdee-fab3c6f15006', '70e6ef2c-3032-49a5-8015-bd2e2765503a'] {{(pid=87515) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 09:59:27 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-9bd19383-6054-44f2-b7f0-502a859291ff tempest-ServersNegativeTestJSON-147044492 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:59:27 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-9bd19383-6054-44f2-b7f0-502a859291ff tempest-ServersNegativeTestJSON-147044492 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:59:27 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-9bd19383-6054-44f2-b7f0-502a859291ff tempest-ServersNegativeTestJSON-147044492 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 09:59:27 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-9bd19383-6054-44f2-b7f0-502a859291ff tempest-ServersNegativeTestJSON-147044492 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 09:59:27 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-9bd19383-6054-44f2-b7f0-502a859291ff tempest-ServersNegativeTestJSON-147044492 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:59:27 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-9bd19383-6054-44f2-b7f0-502a859291ff tempest-ServersNegativeTestJSON-147044492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:59:27 devstack sudo[89946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a Sep 07 09:59:27 devstack sudo[89946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:59:27 devstack sudo[89937]: pam_unix(sudo:session): session closed for user root Sep 07 09:59:27 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-e163cea2-e84a-457d-9755-c2d6bf1d6e67 tempest-GroupSnapshotsTest-1849189312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-62e90beb-b056-42e3-94e2-d1fd49e1da3f 1073741824" returned: 0 in 0.784s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:59:27 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-e163cea2-e84a-457d-9755-c2d6bf1d6e67 tempest-GroupSnapshotsTest-1849189312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-62e90beb-b056-42e3-94e2-d1fd49e1da3f {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:59:28 devstack sudo[89964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-62e90beb-b056-42e3-94e2-d1fd49e1da3f Sep 07 09:59:28 devstack sudo[89964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:59:28 devstack sudo[89946]: pam_unix(sudo:session): session closed for user root Sep 07 09:59:28 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-9bd19383-6054-44f2-b7f0-502a859291ff tempest-ServersNegativeTestJSON-147044492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a" returned: 0 in 0.523s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:59:28 devstack cinder-volume[87515]: DEBUG cinder.manager [None req-9bd19383-6054-44f2-b7f0-502a859291ff tempest-ServersNegativeTestJSON-147044492 None] Notifying Schedulers of capabilities ... {{(pid=87515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 09:59:28 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-9bd19383-6054-44f2-b7f0-502a859291ff tempest-ServersNegativeTestJSON-147044492 None] Deleted volume successfully. Sep 07 09:59:28 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-9bd19383-6054-44f2-b7f0-502a859291ff tempest-ServersNegativeTestJSON-147044492 None] Lock "cinder-68f632f7-28b1-4523-98f1-a6f76b807325-delete_volume" released by "delete_volume" :: held 2.377s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:59:28 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-58dcea99-f5aa-4d47-84e0-9f39687ce925 tempest-ServersNegativeTestJSON-147044492 None] Acquiring lock "cinder-26827e68-b1e1-4eda-a782-11d8e7de4f25-delete_volume" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:59:28 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-58dcea99-f5aa-4d47-84e0-9f39687ce925 tempest-ServersNegativeTestJSON-147044492 None] Lock "cinder-26827e68-b1e1-4eda-a782-11d8e7de4f25-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:59:28 devstack sudo[89964]: pam_unix(sudo:session): session closed for user root Sep 07 09:59:28 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-e163cea2-e84a-457d-9755-c2d6bf1d6e67 tempest-GroupSnapshotsTest-1849189312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-62e90beb-b056-42e3-94e2-d1fd49e1da3f" returned: 0 in 0.558s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:59:28 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-e163cea2-e84a-457d-9755-c2d6bf1d6e67 tempest-GroupSnapshotsTest-1849189312 None] <== create_volume: return (1456ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'} {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 09:59:28 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-e163cea2-e84a-457d-9755-c2d6bf1d6e67 tempest-GroupSnapshotsTest-1849189312 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.461s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:59:28 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-e163cea2-e84a-457d-9755-c2d6bf1d6e67 tempest-GroupSnapshotsTest-1849189312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29749d48-d933-43c6-bd9b-8024f710ef80) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-62e90beb-b056-42e3-94e2-d1fd49e1da3f', 'volume_size': 1}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:59:28 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-e163cea2-e84a-457d-9755-c2d6bf1d6e67 tempest-GroupSnapshotsTest-1849189312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c67eeadc-74a9-4d79-ad52-1dd3cf7301f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 09:59:28 devstack cinder-volume[87515]: INFO cinder.volume.manager [req-c322e78c-d99b-4f3e-b52e-da9272f02b14 req-1eca5192-b1f3-4fa5-ac73-701cb00e74e4 tempest-ServerActionsTestOtherA-1577109295 None] Terminate volume connection completed successfully. Sep 07 09:59:28 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [req-c322e78c-d99b-4f3e-b52e-da9272f02b14 req-1eca5192-b1f3-4fa5-ac73-701cb00e74e4 tempest-ServerActionsTestOtherA-1577109295 None] Deleting attachment 5026e0be-eff1-41b4-b668-4779e227865a. {{(pid=87515) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 07 09:59:28 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-58dcea99-f5aa-4d47-84e0-9f39687ce925 tempest-ServersNegativeTestJSON-147044492 None] Acquiring lock "cinder-quobyte-26827e68-b1e1-4eda-a782-11d8e7de4f25" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:59:28 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-e163cea2-e84a-457d-9755-c2d6bf1d6e67 tempest-GroupSnapshotsTest-1849189312 None] Volume volume-62e90beb-b056-42e3-94e2-d1fd49e1da3f (62e90beb-b056-42e3-94e2-d1fd49e1da3f): created successfully Sep 07 09:59:28 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-e163cea2-e84a-457d-9755-c2d6bf1d6e67 tempest-GroupSnapshotsTest-1849189312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c67eeadc-74a9-4d79-ad52-1dd3cf7301f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 09:59:28 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-e163cea2-e84a-457d-9755-c2d6bf1d6e67 tempest-GroupSnapshotsTest-1849189312 None] Flow 'volume_create_manager' (38de148e-d93b-4dbd-8fb4-e76cf69f4912) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 09:59:28 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-58dcea99-f5aa-4d47-84e0-9f39687ce925 tempest-ServersNegativeTestJSON-147044492 None] Lock "cinder-quobyte-26827e68-b1e1-4eda-a782-11d8e7de4f25" acquired by "delete_volume" :: waited 0.036s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:59:28 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-e163cea2-e84a-457d-9755-c2d6bf1d6e67 tempest-GroupSnapshotsTest-1849189312 None] Created volume successfully. Sep 07 09:59:28 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9ab6fe5-c34e-4c47-8854-8dbc25d299b3]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 09:59:28 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-58dcea99-f5aa-4d47-84e0-9f39687ce925 tempest-ServersNegativeTestJSON-147044492 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-26827e68-b1e1-4eda-a782-11d8e7de4f25 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:59:28 devstack sudo[90022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-26827e68-b1e1-4eda-a782-11d8e7de4f25 Sep 07 09:59:28 devstack sudo[90022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:59:29 devstack sudo[90022]: pam_unix(sudo:session): session closed for user root Sep 07 09:59:29 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-58dcea99-f5aa-4d47-84e0-9f39687ce925 tempest-ServersNegativeTestJSON-147044492 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-26827e68-b1e1-4eda-a782-11d8e7de4f25" returned: 0 in 0.613s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:59:29 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-58dcea99-f5aa-4d47-84e0-9f39687ce925 tempest-ServersNegativeTestJSON-147044492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-26827e68-b1e1-4eda-a782-11d8e7de4f25 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:59:29 devstack sudo[90046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-26827e68-b1e1-4eda-a782-11d8e7de4f25 Sep 07 09:59:29 devstack sudo[90046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:59:29 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [req-c322e78c-d99b-4f3e-b52e-da9272f02b14 req-440c371f-b06c-4c72-81f8-af09ae3a09dc tempest-ServerActionsTestOtherA-1577109295 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:59:29 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [req-c322e78c-d99b-4f3e-b52e-da9272f02b14 req-440c371f-b06c-4c72-81f8-af09ae3a09dc tempest-ServerActionsTestOtherA-1577109295 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:59:29 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [req-c322e78c-d99b-4f3e-b52e-da9272f02b14 req-440c371f-b06c-4c72-81f8-af09ae3a09dc tempest-ServerActionsTestOtherA-1577109295 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.020s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:59:29 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [req-c322e78c-d99b-4f3e-b52e-da9272f02b14 req-440c371f-b06c-4c72-81f8-af09ae3a09dc tempest-ServerActionsTestOtherA-1577109295 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c', 'name': 'volume-15e4fccc-b0e8-488e-8c3e-d0261bf8472c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f7df04a5-cfe4-422c-92da-dcee9ceb4343', 'enforce_multipath': True} {{(pid=87515) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 07 09:59:29 devstack sudo[90046]: pam_unix(sudo:session): session closed for user root Sep 07 09:59:29 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-58dcea99-f5aa-4d47-84e0-9f39687ce925 tempest-ServersNegativeTestJSON-147044492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-26827e68-b1e1-4eda-a782-11d8e7de4f25" returned: 0 in 0.494s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:59:29 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-58dcea99-f5aa-4d47-84e0-9f39687ce925 tempest-ServersNegativeTestJSON-147044492 None] Lock "cinder-quobyte-26827e68-b1e1-4eda-a782-11d8e7de4f25" released by "delete_volume" :: held 1.168s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:59:29 devstack cinder-volume[87515]: INFO cinder.volume.manager [req-c322e78c-d99b-4f3e-b52e-da9272f02b14 req-440c371f-b06c-4c72-81f8-af09ae3a09dc tempest-ServerActionsTestOtherA-1577109295 None] attachment_update completed successfully. Sep 07 09:59:29 devstack cinder-volume[87515]: DEBUG cinder.quota [None req-58dcea99-f5aa-4d47-84e0-9f39687ce925 tempest-ServersNegativeTestJSON-147044492 None] Created reservations ['4dc53cb0-bbc1-46b7-b54a-931074396d1e', 'ff09636e-99f1-4979-9ccd-a33def76551b', '7d54cd25-372c-4059-9b5c-01ddfb2604f6', '25e46747-787c-470c-a994-9d02adb5efee'] {{(pid=87515) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 09:59:30 devstack cinder-volume[87515]: INFO cinder.volume.manager [req-4932ac40-535c-4b44-9d60-a122576648f4 req-6edbc72e-7bad-49a4-9262-9e41c26855a5 tempest-DeleteServersTestJSON-2035648071 None] Terminate volume connection completed successfully. Sep 07 09:59:30 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [req-4932ac40-535c-4b44-9d60-a122576648f4 req-6edbc72e-7bad-49a4-9262-9e41c26855a5 tempest-DeleteServersTestJSON-2035648071 None] Deleting attachment 7f4625f0-4fb8-46de-a091-07134780e8f5. {{(pid=87515) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 07 09:59:30 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-58dcea99-f5aa-4d47-84e0-9f39687ce925 tempest-ServersNegativeTestJSON-147044492 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:59:30 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-58dcea99-f5aa-4d47-84e0-9f39687ce925 tempest-ServersNegativeTestJSON-147044492 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:59:30 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-58dcea99-f5aa-4d47-84e0-9f39687ce925 tempest-ServersNegativeTestJSON-147044492 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 09:59:30 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-58dcea99-f5aa-4d47-84e0-9f39687ce925 tempest-ServersNegativeTestJSON-147044492 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 09:59:30 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-58dcea99-f5aa-4d47-84e0-9f39687ce925 tempest-ServersNegativeTestJSON-147044492 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:59:30 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-58dcea99-f5aa-4d47-84e0-9f39687ce925 tempest-ServersNegativeTestJSON-147044492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:59:30 devstack sudo[90059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a Sep 07 09:59:30 devstack sudo[90059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:59:30 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-273c849d-3317-43a5-a83f-cdd83f73ab8b tempest-GroupSnapshotsTest-1849189312 None] GroupSnapshot 0671e36a-3e5d-4ee9-b0ad-94cab8fecb9c: creating. Sep 07 09:59:30 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-273c849d-3317-43a5-a83f-cdd83f73ab8b tempest-GroupSnapshotsTest-1849189312 None] Group snapshot 0671e36a-3e5d-4ee9-b0ad-94cab8fecb9c: creating. {{(pid=87515) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 07 09:59:30 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-273c849d-3317-43a5-a83f-cdd83f73ab8b tempest-GroupSnapshotsTest-1849189312 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:59:30 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-273c849d-3317-43a5-a83f-cdd83f73ab8b tempest-GroupSnapshotsTest-1849189312 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:59:30 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-273c849d-3317-43a5-a83f-cdd83f73ab8b tempest-GroupSnapshotsTest-1849189312 None] Creating offline snapshot 0abf28dd-781d-4ee5-8605-23c125d9fa3c of volume 62e90beb-b056-42e3-94e2-d1fd49e1da3f {{(pid=87515) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 09:59:30 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3621d20-e4df-4ea3-a353-e3437622d5fe]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 09:59:30 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-273c849d-3317-43a5-a83f-cdd83f73ab8b tempest-GroupSnapshotsTest-1849189312 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-62e90beb-b056-42e3-94e2-d1fd49e1da3f {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:59:30 devstack sudo[90061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-62e90beb-b056-42e3-94e2-d1fd49e1da3f Sep 07 09:59:30 devstack sudo[90061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:59:30 devstack sudo[90059]: pam_unix(sudo:session): session closed for user root Sep 07 09:59:30 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-58dcea99-f5aa-4d47-84e0-9f39687ce925 tempest-ServersNegativeTestJSON-147044492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a" returned: 0 in 0.394s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:59:30 devstack cinder-volume[87515]: DEBUG cinder.manager [None req-58dcea99-f5aa-4d47-84e0-9f39687ce925 tempest-ServersNegativeTestJSON-147044492 None] Notifying Schedulers of capabilities ... {{(pid=87515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 09:59:30 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-58dcea99-f5aa-4d47-84e0-9f39687ce925 tempest-ServersNegativeTestJSON-147044492 None] Deleted volume successfully. Sep 07 09:59:30 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-58dcea99-f5aa-4d47-84e0-9f39687ce925 tempest-ServersNegativeTestJSON-147044492 None] Lock "cinder-26827e68-b1e1-4eda-a782-11d8e7de4f25-delete_volume" released by "delete_volume" :: held 2.075s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:59:30 devstack sudo[90061]: pam_unix(sudo:session): session closed for user root Sep 07 09:59:30 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-273c849d-3317-43a5-a83f-cdd83f73ab8b tempest-GroupSnapshotsTest-1849189312 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-62e90beb-b056-42e3-94e2-d1fd49e1da3f" returned: 0 in 0.506s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:59:30 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-273c849d-3317-43a5-a83f-cdd83f73ab8b tempest-GroupSnapshotsTest-1849189312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-62e90beb-b056-42e3-94e2-d1fd49e1da3f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-62e90beb-b056-42e3-94e2-d1fd49e1da3f.0abf28dd-781d-4ee5-8605-23c125d9fa3c 1G {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:59:30 devstack sudo[90079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-62e90beb-b056-42e3-94e2-d1fd49e1da3f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-62e90beb-b056-42e3-94e2-d1fd49e1da3f.0abf28dd-781d-4ee5-8605-23c125d9fa3c 1G Sep 07 09:59:30 devstack sudo[90079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:59:31 devstack sudo[90079]: pam_unix(sudo:session): session closed for user root Sep 07 09:59:31 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-273c849d-3317-43a5-a83f-cdd83f73ab8b tempest-GroupSnapshotsTest-1849189312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-62e90beb-b056-42e3-94e2-d1fd49e1da3f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-62e90beb-b056-42e3-94e2-d1fd49e1da3f.0abf28dd-781d-4ee5-8605-23c125d9fa3c 1G" returned: 0 in 0.574s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:59:31 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-273c849d-3317-43a5-a83f-cdd83f73ab8b tempest-GroupSnapshotsTest-1849189312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-62e90beb-b056-42e3-94e2-d1fd49e1da3f -F qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-62e90beb-b056-42e3-94e2-d1fd49e1da3f.0abf28dd-781d-4ee5-8605-23c125d9fa3c {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:59:31 devstack sudo[90113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-62e90beb-b056-42e3-94e2-d1fd49e1da3f -F qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-62e90beb-b056-42e3-94e2-d1fd49e1da3f.0abf28dd-781d-4ee5-8605-23c125d9fa3c Sep 07 09:59:31 devstack sudo[90113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:59:32 devstack sudo[90113]: pam_unix(sudo:session): session closed for user root Sep 07 09:59:32 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-273c849d-3317-43a5-a83f-cdd83f73ab8b tempest-GroupSnapshotsTest-1849189312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-62e90beb-b056-42e3-94e2-d1fd49e1da3f -F qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-62e90beb-b056-42e3-94e2-d1fd49e1da3f.0abf28dd-781d-4ee5-8605-23c125d9fa3c" returned: 0 in 0.576s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:59:32 devstack cinder-volume[87515]: WARNING cinder.volume.drivers.remotefs [None req-273c849d-3317-43a5-a83f-cdd83f73ab8b tempest-GroupSnapshotsTest-1849189312 None] /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-62e90beb-b056-42e3-94e2-d1fd49e1da3f.0abf28dd-781d-4ee5-8605-23c125d9fa3c is being set with open permissions: ugo+rw: NotImplementedError Sep 07 09:59:32 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-273c849d-3317-43a5-a83f-cdd83f73ab8b tempest-GroupSnapshotsTest-1849189312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-62e90beb-b056-42e3-94e2-d1fd49e1da3f.0abf28dd-781d-4ee5-8605-23c125d9fa3c {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:59:32 devstack sudo[90191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-62e90beb-b056-42e3-94e2-d1fd49e1da3f.0abf28dd-781d-4ee5-8605-23c125d9fa3c Sep 07 09:59:32 devstack sudo[90191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:59:32 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-6cd9edba-8028-4ecf-88de-111577395bd7 tempest-DeleteServersTestJSON-2035648071 None] Acquiring lock "cinder-5b2a72c1-2962-4da7-90da-c2983f72b4b7-delete_volume" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:59:32 devstack sudo[90191]: pam_unix(sudo:session): session closed for user root Sep 07 09:59:32 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-273c849d-3317-43a5-a83f-cdd83f73ab8b tempest-GroupSnapshotsTest-1849189312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-62e90beb-b056-42e3-94e2-d1fd49e1da3f.0abf28dd-781d-4ee5-8605-23c125d9fa3c" returned: 0 in 0.494s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:59:32 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-6cd9edba-8028-4ecf-88de-111577395bd7 tempest-DeleteServersTestJSON-2035648071 None] Lock "cinder-5b2a72c1-2962-4da7-90da-c2983f72b4b7-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:59:32 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-273c849d-3317-43a5-a83f-cdd83f73ab8b tempest-GroupSnapshotsTest-1849189312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-62e90beb-b056-42e3-94e2-d1fd49e1da3f.info {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:59:32 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-6cd9edba-8028-4ecf-88de-111577395bd7 tempest-DeleteServersTestJSON-2035648071 None] Acquiring lock "cinder-quobyte-5b2a72c1-2962-4da7-90da-c2983f72b4b7" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:59:32 devstack sudo[90529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-62e90beb-b056-42e3-94e2-d1fd49e1da3f.info Sep 07 09:59:32 devstack sudo[90529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:59:32 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-6cd9edba-8028-4ecf-88de-111577395bd7 tempest-DeleteServersTestJSON-2035648071 None] Lock "cinder-quobyte-5b2a72c1-2962-4da7-90da-c2983f72b4b7" acquired by "delete_volume" :: waited 0.041s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:59:32 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9a172a1-bef6-48c4-b24f-4d70da80e13c]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 09:59:32 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-6cd9edba-8028-4ecf-88de-111577395bd7 tempest-DeleteServersTestJSON-2035648071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-5b2a72c1-2962-4da7-90da-c2983f72b4b7 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:59:32 devstack sudo[90535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-5b2a72c1-2962-4da7-90da-c2983f72b4b7 Sep 07 09:59:32 devstack sudo[90535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:59:33 devstack sudo[90529]: pam_unix(sudo:session): session closed for user root Sep 07 09:59:33 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-273c849d-3317-43a5-a83f-cdd83f73ab8b tempest-GroupSnapshotsTest-1849189312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-62e90beb-b056-42e3-94e2-d1fd49e1da3f.info" returned: 0 in 0.461s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:59:33 devstack cinder-volume[87515]: WARNING cinder.volume.drivers.remotefs [None req-273c849d-3317-43a5-a83f-cdd83f73ab8b tempest-GroupSnapshotsTest-1849189312 None] /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-62e90beb-b056-42e3-94e2-d1fd49e1da3f.info is being set with open permissions: ugo+rw: NotImplementedError Sep 07 09:59:33 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-273c849d-3317-43a5-a83f-cdd83f73ab8b tempest-GroupSnapshotsTest-1849189312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-62e90beb-b056-42e3-94e2-d1fd49e1da3f.info {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:59:33 devstack sudo[90543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-62e90beb-b056-42e3-94e2-d1fd49e1da3f.info Sep 07 09:59:33 devstack sudo[90543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:59:33 devstack sudo[90543]: pam_unix(sudo:session): session closed for user root Sep 07 09:59:33 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-273c849d-3317-43a5-a83f-cdd83f73ab8b tempest-GroupSnapshotsTest-1849189312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-62e90beb-b056-42e3-94e2-d1fd49e1da3f.info" returned: 0 in 0.359s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:59:33 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-273c849d-3317-43a5-a83f-cdd83f73ab8b tempest-GroupSnapshotsTest-1849189312 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.139s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:59:33 devstack sudo[90535]: pam_unix(sudo:session): session closed for user root Sep 07 09:59:33 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-6cd9edba-8028-4ecf-88de-111577395bd7 tempest-DeleteServersTestJSON-2035648071 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-5b2a72c1-2962-4da7-90da-c2983f72b4b7" returned: 0 in 0.896s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:59:33 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-6cd9edba-8028-4ecf-88de-111577395bd7 tempest-DeleteServersTestJSON-2035648071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-5b2a72c1-2962-4da7-90da-c2983f72b4b7 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:59:33 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-273c849d-3317-43a5-a83f-cdd83f73ab8b tempest-GroupSnapshotsTest-1849189312 None] group_snapshot 0671e36a-3e5d-4ee9-b0ad-94cab8fecb9c: created successfully Sep 07 09:59:33 devstack sudo[90551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-5b2a72c1-2962-4da7-90da-c2983f72b4b7 Sep 07 09:59:33 devstack sudo[90551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:59:34 devstack sudo[90551]: pam_unix(sudo:session): session closed for user root Sep 07 09:59:34 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-6cd9edba-8028-4ecf-88de-111577395bd7 tempest-DeleteServersTestJSON-2035648071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-5b2a72c1-2962-4da7-90da-c2983f72b4b7" returned: 0 in 0.424s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:59:34 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-6cd9edba-8028-4ecf-88de-111577395bd7 tempest-DeleteServersTestJSON-2035648071 None] Lock "cinder-quobyte-5b2a72c1-2962-4da7-90da-c2983f72b4b7" released by "delete_volume" :: held 1.402s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:59:34 devstack cinder-volume[87515]: DEBUG cinder.quota [None req-6cd9edba-8028-4ecf-88de-111577395bd7 tempest-DeleteServersTestJSON-2035648071 None] Created reservations ['def0794f-225c-4b75-b35d-a145f3460ca5', 'b9aab320-d676-4ad7-b67b-eacda134abc9', 'effd7029-a370-4a67-8b89-0b528fdd6572', '4caa93b4-0223-4b62-918a-6ddf0d57596d'] {{(pid=87515) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 09:59:34 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-6cd9edba-8028-4ecf-88de-111577395bd7 tempest-DeleteServersTestJSON-2035648071 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:59:34 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-6cd9edba-8028-4ecf-88de-111577395bd7 tempest-DeleteServersTestJSON-2035648071 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:59:34 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-6cd9edba-8028-4ecf-88de-111577395bd7 tempest-DeleteServersTestJSON-2035648071 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 09:59:34 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-6cd9edba-8028-4ecf-88de-111577395bd7 tempest-DeleteServersTestJSON-2035648071 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 09:59:34 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-6cd9edba-8028-4ecf-88de-111577395bd7 tempest-DeleteServersTestJSON-2035648071 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:59:34 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-6cd9edba-8028-4ecf-88de-111577395bd7 tempest-DeleteServersTestJSON-2035648071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:59:34 devstack sudo[90560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a Sep 07 09:59:34 devstack sudo[90560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:59:34 devstack sudo[90560]: pam_unix(sudo:session): session closed for user root Sep 07 09:59:34 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-6cd9edba-8028-4ecf-88de-111577395bd7 tempest-DeleteServersTestJSON-2035648071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a" returned: 0 in 0.354s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:59:34 devstack cinder-volume[87515]: DEBUG cinder.manager [None req-6cd9edba-8028-4ecf-88de-111577395bd7 tempest-DeleteServersTestJSON-2035648071 None] Notifying Schedulers of capabilities ... {{(pid=87515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 09:59:34 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-6cd9edba-8028-4ecf-88de-111577395bd7 tempest-DeleteServersTestJSON-2035648071 None] Deleted volume successfully. Sep 07 09:59:34 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-6cd9edba-8028-4ecf-88de-111577395bd7 tempest-DeleteServersTestJSON-2035648071 None] Lock "cinder-5b2a72c1-2962-4da7-90da-c2983f72b4b7-delete_volume" released by "delete_volume" :: held 2.185s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:59:35 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-a84fe9c6-68b2-4e5d-9506-0e121b7a38a8 tempest-GroupSnapshotsTest-1849189312 None] group_snapshot 0671e36a-3e5d-4ee9-b0ad-94cab8fecb9c: deleting Sep 07 09:59:35 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-a84fe9c6-68b2-4e5d-9506-0e121b7a38a8 tempest-GroupSnapshotsTest-1849189312 None] group_snapshot 0671e36a-3e5d-4ee9-b0ad-94cab8fecb9c: deleting {{(pid=87515) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 07 09:59:35 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-a84fe9c6-68b2-4e5d-9506-0e121b7a38a8 tempest-GroupSnapshotsTest-1849189312 None] Acquiring lock "cinder-quobyte-62e90beb-b056-42e3-94e2-d1fd49e1da3f" by "delete_snapshot" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:59:35 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-a84fe9c6-68b2-4e5d-9506-0e121b7a38a8 tempest-GroupSnapshotsTest-1849189312 None] Lock "cinder-quobyte-62e90beb-b056-42e3-94e2-d1fd49e1da3f" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:59:35 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-a84fe9c6-68b2-4e5d-9506-0e121b7a38a8 tempest-GroupSnapshotsTest-1849189312 None] Acquiring lock "cinder-quobyte-0abf28dd-781d-4ee5-8605-23c125d9fa3c" by "_delete_snapshot" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:59:35 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-a84fe9c6-68b2-4e5d-9506-0e121b7a38a8 tempest-GroupSnapshotsTest-1849189312 None] Lock "cinder-quobyte-0abf28dd-781d-4ee5-8605-23c125d9fa3c" acquired by "_delete_snapshot" :: waited 0.038s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:59:35 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-a84fe9c6-68b2-4e5d-9506-0e121b7a38a8 tempest-GroupSnapshotsTest-1849189312 None] Deleting offline snapshot 0abf28dd-781d-4ee5-8605-23c125d9fa3c of volume 62e90beb-b056-42e3-94e2-d1fd49e1da3f {{(pid=87515) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 09:59:35 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-a84fe9c6-68b2-4e5d-9506-0e121b7a38a8 tempest-GroupSnapshotsTest-1849189312 None] snapshot_file for this snap is: volume-62e90beb-b056-42e3-94e2-d1fd49e1da3f.0abf28dd-781d-4ee5-8605-23c125d9fa3c {{(pid=87515) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 09:59:35 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a13c3be-02e9-4d6e-bc6b-90f7c06826cb]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 09:59:35 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-a84fe9c6-68b2-4e5d-9506-0e121b7a38a8 tempest-GroupSnapshotsTest-1849189312 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-62e90beb-b056-42e3-94e2-d1fd49e1da3f.0abf28dd-781d-4ee5-8605-23c125d9fa3c {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:59:35 devstack sudo[90566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-62e90beb-b056-42e3-94e2-d1fd49e1da3f.0abf28dd-781d-4ee5-8605-23c125d9fa3c Sep 07 09:59:35 devstack sudo[90566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:59:35 devstack sudo[90566]: pam_unix(sudo:session): session closed for user root Sep 07 09:59:35 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-a84fe9c6-68b2-4e5d-9506-0e121b7a38a8 tempest-GroupSnapshotsTest-1849189312 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-62e90beb-b056-42e3-94e2-d1fd49e1da3f.0abf28dd-781d-4ee5-8605-23c125d9fa3c" returned: 0 in 0.456s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:59:35 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-a84fe9c6-68b2-4e5d-9506-0e121b7a38a8 tempest-GroupSnapshotsTest-1849189312 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-62e90beb-b056-42e3-94e2-d1fd49e1da3f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87515) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 09:59:35 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e433dd2-1883-4ed0-8cd1-ded53f0e64b3]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 09:59:35 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-a84fe9c6-68b2-4e5d-9506-0e121b7a38a8 tempest-GroupSnapshotsTest-1849189312 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-62e90beb-b056-42e3-94e2-d1fd49e1da3f {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:59:36 devstack sudo[90575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-62e90beb-b056-42e3-94e2-d1fd49e1da3f Sep 07 09:59:36 devstack sudo[90575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:59:36 devstack sudo[90575]: pam_unix(sudo:session): session closed for user root Sep 07 09:59:36 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-a84fe9c6-68b2-4e5d-9506-0e121b7a38a8 tempest-GroupSnapshotsTest-1849189312 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-62e90beb-b056-42e3-94e2-d1fd49e1da3f" returned: 0 in 0.519s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:59:36 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-a84fe9c6-68b2-4e5d-9506-0e121b7a38a8 tempest-GroupSnapshotsTest-1849189312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-62e90beb-b056-42e3-94e2-d1fd49e1da3f.0abf28dd-781d-4ee5-8605-23c125d9fa3c {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:59:36 devstack sudo[90581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-62e90beb-b056-42e3-94e2-d1fd49e1da3f.0abf28dd-781d-4ee5-8605-23c125d9fa3c Sep 07 09:59:36 devstack sudo[90581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:59:36 devstack sudo[90581]: pam_unix(sudo:session): session closed for user root Sep 07 09:59:36 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-a84fe9c6-68b2-4e5d-9506-0e121b7a38a8 tempest-GroupSnapshotsTest-1849189312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-62e90beb-b056-42e3-94e2-d1fd49e1da3f.0abf28dd-781d-4ee5-8605-23c125d9fa3c" returned: 0 in 0.452s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:59:36 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-a84fe9c6-68b2-4e5d-9506-0e121b7a38a8 tempest-GroupSnapshotsTest-1849189312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-62e90beb-b056-42e3-94e2-d1fd49e1da3f.0abf28dd-781d-4ee5-8605-23c125d9fa3c {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:59:36 devstack sudo[90587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-62e90beb-b056-42e3-94e2-d1fd49e1da3f.0abf28dd-781d-4ee5-8605-23c125d9fa3c Sep 07 09:59:36 devstack sudo[90587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:59:37 devstack sudo[90587]: pam_unix(sudo:session): session closed for user root Sep 07 09:59:37 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-a84fe9c6-68b2-4e5d-9506-0e121b7a38a8 tempest-GroupSnapshotsTest-1849189312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-62e90beb-b056-42e3-94e2-d1fd49e1da3f.0abf28dd-781d-4ee5-8605-23c125d9fa3c" returned: 0 in 0.427s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:59:37 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-a84fe9c6-68b2-4e5d-9506-0e121b7a38a8 tempest-GroupSnapshotsTest-1849189312 None] Lock "cinder-quobyte-0abf28dd-781d-4ee5-8605-23c125d9fa3c" released by "_delete_snapshot" :: held 2.023s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:59:37 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-a84fe9c6-68b2-4e5d-9506-0e121b7a38a8 tempest-GroupSnapshotsTest-1849189312 None] Lock "cinder-quobyte-62e90beb-b056-42e3-94e2-d1fd49e1da3f" released by "delete_snapshot" :: held 2.071s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:59:37 devstack cinder-volume[87515]: WARNING cinder.quota [None req-a84fe9c6-68b2-4e5d-9506-0e121b7a38a8 tempest-GroupSnapshotsTest-1849189312 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-677229399 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-677229399, it is now deprecated. Please use the default quota class for default quota. Sep 07 09:59:37 devstack cinder-volume[87515]: WARNING cinder.quota [None req-a84fe9c6-68b2-4e5d-9506-0e121b7a38a8 tempest-GroupSnapshotsTest-1849189312 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-677229399 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-677229399, it is now deprecated. Please use the default quota class for default quota. Sep 07 09:59:37 devstack cinder-volume[87515]: DEBUG cinder.quota [None req-a84fe9c6-68b2-4e5d-9506-0e121b7a38a8 tempest-GroupSnapshotsTest-1849189312 None] Created reservations ['ca5fd607-e448-450e-8753-c28da8501890', '2557e538-7496-465c-a240-a0beb73e0e41', 'd5830275-a9a6-459a-a476-2c0660eadf71', 'ceac66e7-d4ee-4a2f-97ac-f8c42510b8d8'] {{(pid=87515) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 09:59:37 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-a84fe9c6-68b2-4e5d-9506-0e121b7a38a8 tempest-GroupSnapshotsTest-1849189312 None] group_snapshot 0671e36a-3e5d-4ee9-b0ad-94cab8fecb9c: deleted successfully Sep 07 09:59:38 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-4ea14ef1-6b52-4660-86bd-977b063d1644 tempest-GroupSnapshotsTest-1849189312 None] Acquiring lock "cinder-quobyte-62e90beb-b056-42e3-94e2-d1fd49e1da3f" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 09:59:38 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-4ea14ef1-6b52-4660-86bd-977b063d1644 tempest-GroupSnapshotsTest-1849189312 None] Lock "cinder-quobyte-62e90beb-b056-42e3-94e2-d1fd49e1da3f" acquired by "delete_volume" :: waited 0.030s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 09:59:38 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd6e8c0f-0025-46aa-a7ed-70bc97cda93c]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 09:59:38 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-4ea14ef1-6b52-4660-86bd-977b063d1644 tempest-GroupSnapshotsTest-1849189312 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-62e90beb-b056-42e3-94e2-d1fd49e1da3f {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:59:38 devstack sudo[90593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-62e90beb-b056-42e3-94e2-d1fd49e1da3f Sep 07 09:59:38 devstack sudo[90593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:59:38 devstack sudo[90593]: pam_unix(sudo:session): session closed for user root Sep 07 09:59:38 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-4ea14ef1-6b52-4660-86bd-977b063d1644 tempest-GroupSnapshotsTest-1849189312 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-62e90beb-b056-42e3-94e2-d1fd49e1da3f" returned: 0 in 0.462s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:59:38 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-4ea14ef1-6b52-4660-86bd-977b063d1644 tempest-GroupSnapshotsTest-1849189312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-62e90beb-b056-42e3-94e2-d1fd49e1da3f {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:59:38 devstack sudo[90598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-62e90beb-b056-42e3-94e2-d1fd49e1da3f Sep 07 09:59:38 devstack sudo[90598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:59:39 devstack sudo[90598]: pam_unix(sudo:session): session closed for user root Sep 07 09:59:39 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-4ea14ef1-6b52-4660-86bd-977b063d1644 tempest-GroupSnapshotsTest-1849189312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-62e90beb-b056-42e3-94e2-d1fd49e1da3f" returned: 0 in 0.393s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:59:39 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-4ea14ef1-6b52-4660-86bd-977b063d1644 tempest-GroupSnapshotsTest-1849189312 None] Lock "cinder-quobyte-62e90beb-b056-42e3-94e2-d1fd49e1da3f" released by "delete_volume" :: held 0.951s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 09:59:39 devstack cinder-volume[87515]: DEBUG cinder.quota [None req-4ea14ef1-6b52-4660-86bd-977b063d1644 tempest-GroupSnapshotsTest-1849189312 None] Created reservations ['c57b0bb7-88d0-4d24-95d2-db39359a4bf6'] {{(pid=87515) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 09:59:39 devstack cinder-volume[87515]: WARNING cinder.quota [None req-4ea14ef1-6b52-4660-86bd-977b063d1644 tempest-GroupSnapshotsTest-1849189312 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-677229399 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-677229399, it is now deprecated. Please use the default quota class for default quota. Sep 07 09:59:39 devstack cinder-volume[87515]: DEBUG cinder.quota [None req-4ea14ef1-6b52-4660-86bd-977b063d1644 tempest-GroupSnapshotsTest-1849189312 None] Created reservations ['d83fec46-8a9e-494f-997a-b5850bd34a1b', '4d508962-5f03-4b91-abc6-2b5a38ae2cf1', 'deea05fc-bed7-4c6b-b161-6ac74dbc34cc', '5c3604fd-ec9e-4fed-b999-efa6573493b0'] {{(pid=87515) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 09:59:39 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-4ea14ef1-6b52-4660-86bd-977b063d1644 tempest-GroupSnapshotsTest-1849189312 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 09:59:39 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-4ea14ef1-6b52-4660-86bd-977b063d1644 tempest-GroupSnapshotsTest-1849189312 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 09:59:39 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-4ea14ef1-6b52-4660-86bd-977b063d1644 tempest-GroupSnapshotsTest-1849189312 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 09:59:39 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-4ea14ef1-6b52-4660-86bd-977b063d1644 tempest-GroupSnapshotsTest-1849189312 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 09:59:39 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-4ea14ef1-6b52-4660-86bd-977b063d1644 tempest-GroupSnapshotsTest-1849189312 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 09:59:39 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-4ea14ef1-6b52-4660-86bd-977b063d1644 tempest-GroupSnapshotsTest-1849189312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 09:59:39 devstack sudo[90601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a Sep 07 09:59:39 devstack sudo[90601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 09:59:39 devstack sudo[90601]: pam_unix(sudo:session): session closed for user root Sep 07 09:59:39 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-4ea14ef1-6b52-4660-86bd-977b063d1644 tempest-GroupSnapshotsTest-1849189312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a" returned: 0 in 0.391s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 09:59:39 devstack cinder-volume[87515]: DEBUG cinder.manager [None req-4ea14ef1-6b52-4660-86bd-977b063d1644 tempest-GroupSnapshotsTest-1849189312 None] Notifying Schedulers of capabilities ... {{(pid=87515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 09:59:39 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-4ea14ef1-6b52-4660-86bd-977b063d1644 tempest-GroupSnapshotsTest-1849189312 None] Delete group completed successfully. Sep 07 09:59:49 devstack cinder-volume[87515]: DEBUG dbcounter [-] [87515] Writing DB stats cinder:UPDATE=111,cinder:SELECT=124,cinder:INSERT=24,cinder:DELETE=6 {{(pid=87515) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 09:59:49 devstack cinder-volume[87515]: DEBUG dbcounter [-] [87515] Writing DB stats cinder:SELECT=119,cinder:INSERT=28,cinder:UPDATE=121,cinder:DELETE=3 {{(pid=87515) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 10:00:00 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-b14fc1f6-255d-4542-ae4f-3a12131fb84c tempest-GroupsV314Test-1269514990 None] Group tempest-GroupsV314Test-Group-1608955028: creating Sep 07 10:00:00 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-b14fc1f6-255d-4542-ae4f-3a12131fb84c tempest-GroupsV314Test-1269514990 None] Group tempest-GroupsV314Test-Group-1608955028: created successfully Sep 07 10:00:00 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-b14fc1f6-255d-4542-ae4f-3a12131fb84c tempest-GroupsV314Test-1269514990 None] Create group completed successfully. Sep 07 10:00:02 devstack cinder-volume[87515]: DEBUG cinder.volume.flows.manager.create_volume [None req-7a727f05-7e8f-482d-b00b-67220c1c723c tempest-GroupsV314Test-1269514990 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 10:00:02 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-7a727f05-7e8f-482d-b00b-67220c1c723c tempest-GroupsV314Test-1269514990 None] Flow 'volume_create_manager' (cf7881dd-173a-44ff-88f1-ef658d590900) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:00:02 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-7a727f05-7e8f-482d-b00b-67220c1c723c tempest-GroupsV314Test-1269514990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8bdc1ac8-1881-43ff-82d2-ae9d073b5f92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:00:02 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-7a727f05-7e8f-482d-b00b-67220c1c723c tempest-GroupsV314Test-1269514990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8bdc1ac8-1881-43ff-82d2-ae9d073b5f92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:00:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1210516327',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a0706ed5-a4b8-4639-982f-805e2f094444,host='devstack@QuobyteHD#QuobyteHD',id=c3817023-e52a-4ba0-b29f-b2377e4aa977,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1d0f5d7a3784a53b288d7a2698d8853',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:00:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:00:02Z,use_quota=True,user_id='f4b888888eb5461688d45b4677cb63ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1650c68c-deb3-42d9-b420-07a72b78930c),volume_type_id=1650c68c-deb3-42d9-b420-07a72b78930c)' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:00:02 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-7a727f05-7e8f-482d-b00b-67220c1c723c tempest-GroupsV314Test-1269514990 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd9cd46e-8cb8-445d-99a6-c15a351bfdeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:00:02 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-7a727f05-7e8f-482d-b00b-67220c1c723c tempest-GroupsV314Test-1269514990 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd9cd46e-8cb8-445d-99a6-c15a351bfdeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:00:02 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-7a727f05-7e8f-482d-b00b-67220c1c723c tempest-GroupsV314Test-1269514990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f1ba1af-4c6e-4bc1-968a-71e47e88e6ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:00:02 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-7a727f05-7e8f-482d-b00b-67220c1c723c tempest-GroupsV314Test-1269514990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f1ba1af-4c6e-4bc1-968a-71e47e88e6ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c3817023-e52a-4ba0-b29f-b2377e4aa977', 'volume_name': 'volume-c3817023-e52a-4ba0-b29f-b2377e4aa977', 'volume_size': 1}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:00:02 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-7a727f05-7e8f-482d-b00b-67220c1c723c tempest-GroupsV314Test-1269514990 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a324a00-97f1-4215-891e-768cd602efb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:00:02 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-7a727f05-7e8f-482d-b00b-67220c1c723c tempest-GroupsV314Test-1269514990 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a324a00-97f1-4215-891e-768cd602efb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:00:02 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-7a727f05-7e8f-482d-b00b-67220c1c723c tempest-GroupsV314Test-1269514990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4bd28788-01ed-4ec2-b27f-f865d2315290) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:00:02 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-7a727f05-7e8f-482d-b00b-67220c1c723c tempest-GroupsV314Test-1269514990 None] Volume c3817023-e52a-4ba0-b29f-b2377e4aa977: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c3817023-e52a-4ba0-b29f-b2377e4aa977', 'volume_size': 1} Sep 07 10:00:02 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-7a727f05-7e8f-482d-b00b-67220c1c723c tempest-GroupsV314Test-1269514990 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:00:02 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-7a727f05-7e8f-482d-b00b-67220c1c723c tempest-GroupsV314Test-1269514990 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:00:02 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-7a727f05-7e8f-482d-b00b-67220c1c723c tempest-GroupsV314Test-1269514990 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=a0706ed5-a4b8-4639-982f-805e2f094444,created_at=2026-09-07T08:00:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1210516327',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a0706ed5-a4b8-4639-982f-805e2f094444,host='devstack@QuobyteHD#QuobyteHD',id=c3817023-e52a-4ba0-b29f-b2377e4aa977,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1d0f5d7a3784a53b288d7a2698d8853',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:00:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:00:02Z,use_quota=True,user_id='f4b888888eb5461688d45b4677cb63ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1650c68c-deb3-42d9-b420-07a72b78930c),volume_type_id=1650c68c-deb3-42d9-b420-07a72b78930c)}" {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 10:00:02 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-7a727f05-7e8f-482d-b00b-67220c1c723c tempest-GroupsV314Test-1269514990 None] Creating volume c3817023-e52a-4ba0-b29f-b2377e4aa977 {{(pid=87515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 10:00:02 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-7a727f05-7e8f-482d-b00b-67220c1c723c tempest-GroupsV314Test-1269514990 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:00:02 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-7a727f05-7e8f-482d-b00b-67220c1c723c tempest-GroupsV314Test-1269514990 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:00:02 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-7a727f05-7e8f-482d-b00b-67220c1c723c tempest-GroupsV314Test-1269514990 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:00:02 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-7a727f05-7e8f-482d-b00b-67220c1c723c tempest-GroupsV314Test-1269514990 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:00:02 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-7a727f05-7e8f-482d-b00b-67220c1c723c tempest-GroupsV314Test-1269514990 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:00:02 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-7a727f05-7e8f-482d-b00b-67220c1c723c tempest-GroupsV314Test-1269514990 None] Selected osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c as target Quobyte volume. {{(pid=87515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 10:00:02 devstack cinder-volume[87515]: INFO cinder.volume.drivers.remotefs [None req-7a727f05-7e8f-482d-b00b-67220c1c723c tempest-GroupsV314Test-1269514990 None] casted to osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c Sep 07 10:00:02 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-7a727f05-7e8f-482d-b00b-67220c1c723c tempest-GroupsV314Test-1269514990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-c3817023-e52a-4ba0-b29f-b2377e4aa977 1073741824 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:00:02 devstack sudo[90688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-c3817023-e52a-4ba0-b29f-b2377e4aa977 1073741824 Sep 07 10:00:02 devstack sudo[90688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:00:02 devstack cinder-volume[87515]: INFO cinder.volume.manager [req-99300b5e-2222-4855-ba5b-1c4e475764f6 req-38feb0bf-221e-4e0d-ab68-b1b94f672e82 tempest-ServerActionsTestOtherA-1577109295 None] Terminate volume connection completed successfully. Sep 07 10:00:02 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [req-99300b5e-2222-4855-ba5b-1c4e475764f6 req-38feb0bf-221e-4e0d-ab68-b1b94f672e82 tempest-ServerActionsTestOtherA-1577109295 None] Deleting attachment f7df04a5-cfe4-422c-92da-dcee9ceb4343. {{(pid=87515) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 07 10:00:03 devstack sudo[90688]: pam_unix(sudo:session): session closed for user root Sep 07 10:00:03 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-7a727f05-7e8f-482d-b00b-67220c1c723c tempest-GroupsV314Test-1269514990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-c3817023-e52a-4ba0-b29f-b2377e4aa977 1073741824" returned: 0 in 0.683s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:00:03 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-7a727f05-7e8f-482d-b00b-67220c1c723c tempest-GroupsV314Test-1269514990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-c3817023-e52a-4ba0-b29f-b2377e4aa977 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:00:03 devstack sudo[90695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-c3817023-e52a-4ba0-b29f-b2377e4aa977 Sep 07 10:00:03 devstack sudo[90695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:00:03 devstack sudo[90695]: pam_unix(sudo:session): session closed for user root Sep 07 10:00:03 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-7a727f05-7e8f-482d-b00b-67220c1c723c tempest-GroupsV314Test-1269514990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-c3817023-e52a-4ba0-b29f-b2377e4aa977" returned: 0 in 0.394s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:00:03 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-7a727f05-7e8f-482d-b00b-67220c1c723c tempest-GroupsV314Test-1269514990 None] <== create_volume: return (1169ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'} {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 10:00:03 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-7a727f05-7e8f-482d-b00b-67220c1c723c tempest-GroupsV314Test-1269514990 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.175s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:00:03 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-7a727f05-7e8f-482d-b00b-67220c1c723c tempest-GroupsV314Test-1269514990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4bd28788-01ed-4ec2-b27f-f865d2315290) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c3817023-e52a-4ba0-b29f-b2377e4aa977', 'volume_size': 1}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:00:03 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-7a727f05-7e8f-482d-b00b-67220c1c723c tempest-GroupsV314Test-1269514990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (faeb8a49-08cf-48a7-aef6-4809d3b3d6f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:00:03 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-7a727f05-7e8f-482d-b00b-67220c1c723c tempest-GroupsV314Test-1269514990 None] Volume volume-c3817023-e52a-4ba0-b29f-b2377e4aa977 (c3817023-e52a-4ba0-b29f-b2377e4aa977): created successfully Sep 07 10:00:03 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-7a727f05-7e8f-482d-b00b-67220c1c723c tempest-GroupsV314Test-1269514990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (faeb8a49-08cf-48a7-aef6-4809d3b3d6f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:00:03 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-7a727f05-7e8f-482d-b00b-67220c1c723c tempest-GroupsV314Test-1269514990 None] Flow 'volume_create_manager' (cf7881dd-173a-44ff-88f1-ef658d590900) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:00:03 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-7a727f05-7e8f-482d-b00b-67220c1c723c tempest-GroupsV314Test-1269514990 None] Created volume successfully. Sep 07 10:00:06 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-4627e56d-ae20-4a2a-855b-cbd5530dae79 tempest-GroupsV314Test-1269514990 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:00:06 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-4627e56d-ae20-4a2a-855b-cbd5530dae79 tempest-GroupsV314Test-1269514990 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:00:06 devstack cinder-volume[87515]: INFO cinder.volume.drivers.remotefs [None req-4627e56d-ae20-4a2a-855b-cbd5530dae79 tempest-GroupsV314Test-1269514990 None] Cloning volume c3817023-e52a-4ba0-b29f-b2377e4aa977 to volume b9b6617c-2fc3-4073-8108-642296217967 Sep 07 10:00:06 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-4627e56d-ae20-4a2a-855b-cbd5530dae79 tempest-GroupsV314Test-1269514990 None] Creating offline snapshot 183fe0c9-a4c6-464c-a046-2611eb400657 of volume c3817023-e52a-4ba0-b29f-b2377e4aa977 {{(pid=87515) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 10:00:06 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfc20a04-0f73-4626-8d06-c5213ebc90df]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:00:06 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-4627e56d-ae20-4a2a-855b-cbd5530dae79 tempest-GroupsV314Test-1269514990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-c3817023-e52a-4ba0-b29f-b2377e4aa977 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:00:06 devstack sudo[90725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-c3817023-e52a-4ba0-b29f-b2377e4aa977 Sep 07 10:00:06 devstack sudo[90725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:00:06 devstack sudo[90725]: pam_unix(sudo:session): session closed for user root Sep 07 10:00:06 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-4627e56d-ae20-4a2a-855b-cbd5530dae79 tempest-GroupsV314Test-1269514990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-c3817023-e52a-4ba0-b29f-b2377e4aa977" returned: 0 in 0.493s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:00:06 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-4627e56d-ae20-4a2a-855b-cbd5530dae79 tempest-GroupsV314Test-1269514990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-c3817023-e52a-4ba0-b29f-b2377e4aa977,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-c3817023-e52a-4ba0-b29f-b2377e4aa977.183fe0c9-a4c6-464c-a046-2611eb400657 1G {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:00:06 devstack sudo[90730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-c3817023-e52a-4ba0-b29f-b2377e4aa977,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-c3817023-e52a-4ba0-b29f-b2377e4aa977.183fe0c9-a4c6-464c-a046-2611eb400657 1G Sep 07 10:00:06 devstack sudo[90730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:00:07 devstack sudo[90730]: pam_unix(sudo:session): session closed for user root Sep 07 10:00:07 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-4627e56d-ae20-4a2a-855b-cbd5530dae79 tempest-GroupsV314Test-1269514990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-c3817023-e52a-4ba0-b29f-b2377e4aa977,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-c3817023-e52a-4ba0-b29f-b2377e4aa977.183fe0c9-a4c6-464c-a046-2611eb400657 1G" returned: 0 in 0.506s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:00:07 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-4627e56d-ae20-4a2a-855b-cbd5530dae79 tempest-GroupsV314Test-1269514990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c3817023-e52a-4ba0-b29f-b2377e4aa977 -F qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-c3817023-e52a-4ba0-b29f-b2377e4aa977.183fe0c9-a4c6-464c-a046-2611eb400657 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:00:07 devstack sudo[90737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c3817023-e52a-4ba0-b29f-b2377e4aa977 -F qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-c3817023-e52a-4ba0-b29f-b2377e4aa977.183fe0c9-a4c6-464c-a046-2611eb400657 Sep 07 10:00:07 devstack sudo[90737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:00:07 devstack sudo[90737]: pam_unix(sudo:session): session closed for user root Sep 07 10:00:07 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-4627e56d-ae20-4a2a-855b-cbd5530dae79 tempest-GroupsV314Test-1269514990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c3817023-e52a-4ba0-b29f-b2377e4aa977 -F qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-c3817023-e52a-4ba0-b29f-b2377e4aa977.183fe0c9-a4c6-464c-a046-2611eb400657" returned: 0 in 0.368s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:00:07 devstack cinder-volume[87515]: WARNING cinder.volume.drivers.remotefs [None req-4627e56d-ae20-4a2a-855b-cbd5530dae79 tempest-GroupsV314Test-1269514990 None] /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-c3817023-e52a-4ba0-b29f-b2377e4aa977.183fe0c9-a4c6-464c-a046-2611eb400657 is being set with open permissions: ugo+rw: NotImplementedError Sep 07 10:00:07 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-4627e56d-ae20-4a2a-855b-cbd5530dae79 tempest-GroupsV314Test-1269514990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-c3817023-e52a-4ba0-b29f-b2377e4aa977.183fe0c9-a4c6-464c-a046-2611eb400657 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:00:07 devstack sudo[90743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-c3817023-e52a-4ba0-b29f-b2377e4aa977.183fe0c9-a4c6-464c-a046-2611eb400657 Sep 07 10:00:07 devstack sudo[90743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:00:07 devstack sudo[90743]: pam_unix(sudo:session): session closed for user root Sep 07 10:00:07 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-4627e56d-ae20-4a2a-855b-cbd5530dae79 tempest-GroupsV314Test-1269514990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-c3817023-e52a-4ba0-b29f-b2377e4aa977.183fe0c9-a4c6-464c-a046-2611eb400657" returned: 0 in 0.283s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:00:07 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-4627e56d-ae20-4a2a-855b-cbd5530dae79 tempest-GroupsV314Test-1269514990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-c3817023-e52a-4ba0-b29f-b2377e4aa977.info {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:00:07 devstack sudo[90747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-c3817023-e52a-4ba0-b29f-b2377e4aa977.info Sep 07 10:00:07 devstack sudo[90747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:00:08 devstack sudo[90747]: pam_unix(sudo:session): session closed for user root Sep 07 10:00:08 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-4627e56d-ae20-4a2a-855b-cbd5530dae79 tempest-GroupsV314Test-1269514990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-c3817023-e52a-4ba0-b29f-b2377e4aa977.info" returned: 0 in 0.477s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:00:08 devstack cinder-volume[87515]: WARNING cinder.volume.drivers.remotefs [None req-4627e56d-ae20-4a2a-855b-cbd5530dae79 tempest-GroupsV314Test-1269514990 None] /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-c3817023-e52a-4ba0-b29f-b2377e4aa977.info is being set with open permissions: ugo+rw: NotImplementedError Sep 07 10:00:08 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-4627e56d-ae20-4a2a-855b-cbd5530dae79 tempest-GroupsV314Test-1269514990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-c3817023-e52a-4ba0-b29f-b2377e4aa977.info {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:00:08 devstack sudo[90752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-c3817023-e52a-4ba0-b29f-b2377e4aa977.info Sep 07 10:00:08 devstack sudo[90752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:00:08 devstack sudo[90752]: pam_unix(sudo:session): session closed for user root Sep 07 10:00:08 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-4627e56d-ae20-4a2a-855b-cbd5530dae79 tempest-GroupsV314Test-1269514990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-c3817023-e52a-4ba0-b29f-b2377e4aa977.info" returned: 0 in 0.383s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:00:08 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-4627e56d-ae20-4a2a-855b-cbd5530dae79 tempest-GroupsV314Test-1269514990 None] Acquiring lock "cinder-quobyte-b9b6617c-2fc3-4073-8108-642296217967" by "_copy_volume_from_snapshot" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:00:08 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-4627e56d-ae20-4a2a-855b-cbd5530dae79 tempest-GroupsV314Test-1269514990 None] Lock "cinder-quobyte-b9b6617c-2fc3-4073-8108-642296217967" acquired by "_copy_volume_from_snapshot" :: waited 0.030s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:00:08 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-4627e56d-ae20-4a2a-855b-cbd5530dae79 tempest-GroupsV314Test-1269514990 None] snapshot: 183fe0c9-a4c6-464c-a046-2611eb400657, volume: b9b6617c-2fc3-4073-8108-642296217967, {{(pid=87515) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 07 10:00:08 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-4627e56d-ae20-4a2a-855b-cbd5530dae79 tempest-GroupsV314Test-1269514990 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:00:08 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-4627e56d-ae20-4a2a-855b-cbd5530dae79 tempest-GroupsV314Test-1269514990 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:00:08 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-4627e56d-ae20-4a2a-855b-cbd5530dae79 tempest-GroupsV314Test-1269514990 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:00:08 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-4627e56d-ae20-4a2a-855b-cbd5530dae79 tempest-GroupsV314Test-1269514990 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:00:08 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-4627e56d-ae20-4a2a-855b-cbd5530dae79 tempest-GroupsV314Test-1269514990 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:00:08 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9973c8a-0b8b-450a-ac2e-fcc465485bf6]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:00:08 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-4627e56d-ae20-4a2a-855b-cbd5530dae79 tempest-GroupsV314Test-1269514990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-c3817023-e52a-4ba0-b29f-b2377e4aa977.183fe0c9-a4c6-464c-a046-2611eb400657 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:00:09 devstack sudo[90755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-c3817023-e52a-4ba0-b29f-b2377e4aa977.183fe0c9-a4c6-464c-a046-2611eb400657 Sep 07 10:00:09 devstack sudo[90755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:00:09 devstack sudo[90755]: pam_unix(sudo:session): session closed for user root Sep 07 10:00:09 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-4627e56d-ae20-4a2a-855b-cbd5530dae79 tempest-GroupsV314Test-1269514990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-c3817023-e52a-4ba0-b29f-b2377e4aa977.183fe0c9-a4c6-464c-a046-2611eb400657" returned: 0 in 0.489s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:00:09 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-4627e56d-ae20-4a2a-855b-cbd5530dae79 tempest-GroupsV314Test-1269514990 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c3817023-e52a-4ba0-b29f-b2377e4aa977(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87515) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 10:00:09 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee87cb8a-bea9-42b6-9582-2817ef3864fe]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:00:09 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-4627e56d-ae20-4a2a-855b-cbd5530dae79 tempest-GroupsV314Test-1269514990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-c3817023-e52a-4ba0-b29f-b2377e4aa977 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:00:09 devstack sudo[90760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-c3817023-e52a-4ba0-b29f-b2377e4aa977 Sep 07 10:00:09 devstack sudo[90760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:00:09 devstack sudo[90760]: pam_unix(sudo:session): session closed for user root Sep 07 10:00:09 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-4627e56d-ae20-4a2a-855b-cbd5530dae79 tempest-GroupsV314Test-1269514990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-c3817023-e52a-4ba0-b29f-b2377e4aa977" returned: 0 in 0.559s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:00:09 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-4627e56d-ae20-4a2a-855b-cbd5530dae79 tempest-GroupsV314Test-1269514990 None] will copy from snapshot at /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-c3817023-e52a-4ba0-b29f-b2377e4aa977 {{(pid=87515) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 07 10:00:09 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-4627e56d-ae20-4a2a-855b-cbd5530dae79 tempest-GroupsV314Test-1269514990 None] Creating direct copy from snapshot {{(pid=87515) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 07 10:00:09 devstack cinder-volume[87515]: DEBUG cinder.utils [None req-4627e56d-ae20-4a2a-855b-cbd5530dae79 tempest-GroupsV314Test-1269514990 None] Path /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-b9b6617c-2fc3-4073-8108-642296217967 not found in is_blk_device check {{(pid=87515) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 07 10:00:09 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-4627e56d-ae20-4a2a-855b-cbd5530dae79 tempest-GroupsV314Test-1269514990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-c3817023-e52a-4ba0-b29f-b2377e4aa977 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-b9b6617c-2fc3-4073-8108-642296217967 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:00:10 devstack sudo[90768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-c3817023-e52a-4ba0-b29f-b2377e4aa977 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-b9b6617c-2fc3-4073-8108-642296217967 Sep 07 10:00:10 devstack sudo[90768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:00:11 devstack cinder-volume[87515]: DEBUG oslo_service.periodic_task [None req-cebd6a9d-3073-42a1-b65a-b38d444d85ed None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87515) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 10:00:11 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-cebd6a9d-3073-42a1-b65a-b38d444d85ed None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:00:11 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-cebd6a9d-3073-42a1-b65a-b38d444d85ed None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:00:11 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-cebd6a9d-3073-42a1-b65a-b38d444d85ed None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:00:11 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-cebd6a9d-3073-42a1-b65a-b38d444d85ed None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:00:11 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-cebd6a9d-3073-42a1-b65a-b38d444d85ed None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:00:11 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-cebd6a9d-3073-42a1-b65a-b38d444d85ed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:00:11 devstack sudo[90819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a Sep 07 10:00:11 devstack sudo[90819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:00:12 devstack sudo[90819]: pam_unix(sudo:session): session closed for user root Sep 07 10:00:12 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-cebd6a9d-3073-42a1-b65a-b38d444d85ed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a" returned: 0 in 1.012s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:00:12 devstack cinder-volume[87515]: DEBUG cinder.manager [None req-cebd6a9d-3073-42a1-b65a-b38d444d85ed None None] Notifying Schedulers of capabilities ... {{(pid=87515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:00:16 devstack sudo[90768]: pam_unix(sudo:session): session closed for user root Sep 07 10:00:16 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-4627e56d-ae20-4a2a-855b-cbd5530dae79 tempest-GroupsV314Test-1269514990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-c3817023-e52a-4ba0-b29f-b2377e4aa977 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-b9b6617c-2fc3-4073-8108-642296217967" returned: 0 in 6.961s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:00:16 devstack cinder-volume[87515]: DEBUG cinder.image.image_utils [None req-4627e56d-ae20-4a2a-855b-cbd5530dae79 tempest-GroupsV314Test-1269514990 None] Image conversion details: src /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-c3817023-e52a-4ba0-b29f-b2377e4aa977, size 1024.00 MB, duration 6.96 sec, destination /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-b9b6617c-2fc3-4073-8108-642296217967 {{(pid=87515) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 07 10:00:16 devstack cinder-volume[87515]: INFO cinder.image.image_utils [None req-4627e56d-ae20-4a2a-855b-cbd5530dae79 tempest-GroupsV314Test-1269514990 None] Converted 1024.00 MB image at 147.08 MB/s Sep 07 10:00:16 devstack cinder-volume[87515]: WARNING cinder.volume.drivers.remotefs [None req-4627e56d-ae20-4a2a-855b-cbd5530dae79 tempest-GroupsV314Test-1269514990 None] /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-b9b6617c-2fc3-4073-8108-642296217967 is being set with open permissions: ugo+rw: NotImplementedError Sep 07 10:00:16 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-4627e56d-ae20-4a2a-855b-cbd5530dae79 tempest-GroupsV314Test-1269514990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-b9b6617c-2fc3-4073-8108-642296217967 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:00:16 devstack sudo[90841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-b9b6617c-2fc3-4073-8108-642296217967 Sep 07 10:00:16 devstack sudo[90841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:00:17 devstack sudo[90841]: pam_unix(sudo:session): session closed for user root Sep 07 10:00:17 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-4627e56d-ae20-4a2a-855b-cbd5530dae79 tempest-GroupsV314Test-1269514990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-b9b6617c-2fc3-4073-8108-642296217967" returned: 0 in 0.361s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:00:17 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-4627e56d-ae20-4a2a-855b-cbd5530dae79 tempest-GroupsV314Test-1269514990 None] Lock "cinder-quobyte-b9b6617c-2fc3-4073-8108-642296217967" released by "_copy_volume_from_snapshot" :: held 8.491s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:00:17 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-4627e56d-ae20-4a2a-855b-cbd5530dae79 tempest-GroupsV314Test-1269514990 None] Acquiring lock "cinder-quobyte-183fe0c9-a4c6-464c-a046-2611eb400657" by "_delete_snapshot" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:00:17 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-4627e56d-ae20-4a2a-855b-cbd5530dae79 tempest-GroupsV314Test-1269514990 None] Lock "cinder-quobyte-183fe0c9-a4c6-464c-a046-2611eb400657" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:00:17 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-4627e56d-ae20-4a2a-855b-cbd5530dae79 tempest-GroupsV314Test-1269514990 None] Deleting offline snapshot 183fe0c9-a4c6-464c-a046-2611eb400657 of volume c3817023-e52a-4ba0-b29f-b2377e4aa977 {{(pid=87515) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 10:00:17 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-4627e56d-ae20-4a2a-855b-cbd5530dae79 tempest-GroupsV314Test-1269514990 None] snapshot_file for this snap is: volume-c3817023-e52a-4ba0-b29f-b2377e4aa977.183fe0c9-a4c6-464c-a046-2611eb400657 {{(pid=87515) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 10:00:17 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b6d96f3-23e8-44ac-a3ac-d8a1f55cf36f]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:00:17 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-4627e56d-ae20-4a2a-855b-cbd5530dae79 tempest-GroupsV314Test-1269514990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-c3817023-e52a-4ba0-b29f-b2377e4aa977.183fe0c9-a4c6-464c-a046-2611eb400657 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:00:17 devstack sudo[90844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-c3817023-e52a-4ba0-b29f-b2377e4aa977.183fe0c9-a4c6-464c-a046-2611eb400657 Sep 07 10:00:17 devstack sudo[90844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:00:17 devstack cinder-volume[87515]: DEBUG dbcounter [-] [87515] Writing DB stats cinder:SELECT=7,cinder:UPDATE=5,cinder:INSERT=3,cinder:DELETE=1 {{(pid=87515) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 10:00:18 devstack sudo[90844]: pam_unix(sudo:session): session closed for user root Sep 07 10:00:18 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-4627e56d-ae20-4a2a-855b-cbd5530dae79 tempest-GroupsV314Test-1269514990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-c3817023-e52a-4ba0-b29f-b2377e4aa977.183fe0c9-a4c6-464c-a046-2611eb400657" returned: 0 in 0.613s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:00:18 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-4627e56d-ae20-4a2a-855b-cbd5530dae79 tempest-GroupsV314Test-1269514990 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c3817023-e52a-4ba0-b29f-b2377e4aa977(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87515) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 10:00:18 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebb736ab-dbbc-454c-b12e-2e26b8af29d3]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:00:18 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-4627e56d-ae20-4a2a-855b-cbd5530dae79 tempest-GroupsV314Test-1269514990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-c3817023-e52a-4ba0-b29f-b2377e4aa977 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:00:18 devstack sudo[90849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-c3817023-e52a-4ba0-b29f-b2377e4aa977 Sep 07 10:00:18 devstack sudo[90849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:00:18 devstack cinder-volume[87515]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc0cabcd-dd2b-4202-ba77-d09429e061f0 tempest-ServerActionsTestOtherA-1577109295 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 10:00:18 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-cc0cabcd-dd2b-4202-ba77-d09429e061f0 tempest-ServerActionsTestOtherA-1577109295 None] Flow 'volume_create_manager' (49fd4c2f-244e-4374-a487-f4f713af2070) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:00:18 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-cc0cabcd-dd2b-4202-ba77-d09429e061f0 tempest-ServerActionsTestOtherA-1577109295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e6a4232-7639-41d9-89a2-154f9ee577a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:00:18 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-cc0cabcd-dd2b-4202-ba77-d09429e061f0 tempest-ServerActionsTestOtherA-1577109295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e6a4232-7639-41d9-89a2-154f9ee577a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:00:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-244151822',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4bf0a9c-41d0-42cc-a3bf-c195d11e69fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0805f131487d4bf6907414c10b172704',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:00:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:00:19Z,use_quota=True,user_id='1918b665bf3a468e837ffc0cefcbf767',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3a092cd-7947-4cbf-abff-4ba9567becf0),volume_type_id=f3a092cd-7947-4cbf-abff-4ba9567becf0)' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:00:18 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-cc0cabcd-dd2b-4202-ba77-d09429e061f0 tempest-ServerActionsTestOtherA-1577109295 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8942fc0-b1b7-4c2b-86a7-e49e287f752d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:00:18 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-cc0cabcd-dd2b-4202-ba77-d09429e061f0 tempest-ServerActionsTestOtherA-1577109295 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8942fc0-b1b7-4c2b-86a7-e49e287f752d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:00:18 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-cc0cabcd-dd2b-4202-ba77-d09429e061f0 tempest-ServerActionsTestOtherA-1577109295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f9775e6-cefc-4178-b542-b82b3d44fca1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:00:18 devstack cinder-volume[87515]: DEBUG cinder.image.glance [None req-cc0cabcd-dd2b-4202-ba77-d09429e061f0 tempest-ServerActionsTestOtherA-1577109295 None] Creating Keystone auth plugin from conf {{(pid=87515) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 07 10:00:18 devstack sudo[90849]: pam_unix(sudo:session): session closed for user root Sep 07 10:00:18 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-4627e56d-ae20-4a2a-855b-cbd5530dae79 tempest-GroupsV314Test-1269514990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-c3817023-e52a-4ba0-b29f-b2377e4aa977" returned: 0 in 0.694s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:00:18 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-4627e56d-ae20-4a2a-855b-cbd5530dae79 tempest-GroupsV314Test-1269514990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-c3817023-e52a-4ba0-b29f-b2377e4aa977.183fe0c9-a4c6-464c-a046-2611eb400657 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:00:18 devstack sudo[90855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-c3817023-e52a-4ba0-b29f-b2377e4aa977.183fe0c9-a4c6-464c-a046-2611eb400657 Sep 07 10:00:18 devstack sudo[90855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:00:18 devstack cinder-volume[87515]: DEBUG cinder.volume.flows.manager.create_volume [None req-273fc75a-76c5-4948-9ce7-96943d3957bb tempest-TaggedAttachmentsTest-262548527 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 10:00:18 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-273fc75a-76c5-4948-9ce7-96943d3957bb tempest-TaggedAttachmentsTest-262548527 None] Flow 'volume_create_manager' (99703f2b-9431-4241-8ca8-c5ccf382ab7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:00:18 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-273fc75a-76c5-4948-9ce7-96943d3957bb tempest-TaggedAttachmentsTest-262548527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7cb1f70e-c788-4cd7-a6a6-a2d8a9a9ab46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:00:18 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-273fc75a-76c5-4948-9ce7-96943d3957bb tempest-TaggedAttachmentsTest-262548527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7cb1f70e-c788-4cd7-a6a6-a2d8a9a9ab46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:00:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1136371274',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e146ba7-f52f-4ef5-b38f-8bf5a6375fe8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16f364821de44c84a3d9a2e603d67e06',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:00:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:00:19Z,use_quota=True,user_id='d57cabcda2a4460ab2cbda6017fad938',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3a092cd-7947-4cbf-abff-4ba9567becf0),volume_type_id=f3a092cd-7947-4cbf-abff-4ba9567becf0)' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:00:18 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-273fc75a-76c5-4948-9ce7-96943d3957bb tempest-TaggedAttachmentsTest-262548527 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7528c0da-a476-42a3-92c6-1ac49a222218) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:00:18 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-273fc75a-76c5-4948-9ce7-96943d3957bb tempest-TaggedAttachmentsTest-262548527 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7528c0da-a476-42a3-92c6-1ac49a222218) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:00:18 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-273fc75a-76c5-4948-9ce7-96943d3957bb tempest-TaggedAttachmentsTest-262548527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7037835d-3863-4c25-bf76-2b572ab96244) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:00:18 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-273fc75a-76c5-4948-9ce7-96943d3957bb tempest-TaggedAttachmentsTest-262548527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7037835d-3863-4c25-bf76-2b572ab96244) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7e146ba7-f52f-4ef5-b38f-8bf5a6375fe8', 'volume_name': 'volume-7e146ba7-f52f-4ef5-b38f-8bf5a6375fe8', 'volume_size': 1}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:00:18 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-273fc75a-76c5-4948-9ce7-96943d3957bb tempest-TaggedAttachmentsTest-262548527 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3eba4cfa-203b-4af4-be62-4b50fd1fab2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:00:18 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-273fc75a-76c5-4948-9ce7-96943d3957bb tempest-TaggedAttachmentsTest-262548527 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3eba4cfa-203b-4af4-be62-4b50fd1fab2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:00:18 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-273fc75a-76c5-4948-9ce7-96943d3957bb tempest-TaggedAttachmentsTest-262548527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d760056-af38-4c00-a63c-fcfc181c7677) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:00:18 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-273fc75a-76c5-4948-9ce7-96943d3957bb tempest-TaggedAttachmentsTest-262548527 None] Volume 7e146ba7-f52f-4ef5-b38f-8bf5a6375fe8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7e146ba7-f52f-4ef5-b38f-8bf5a6375fe8', 'volume_size': 1} Sep 07 10:00:18 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-273fc75a-76c5-4948-9ce7-96943d3957bb tempest-TaggedAttachmentsTest-262548527 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:00:19 devstack sudo[90855]: pam_unix(sudo:session): session closed for user root Sep 07 10:00:19 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-4627e56d-ae20-4a2a-855b-cbd5530dae79 tempest-GroupsV314Test-1269514990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-c3817023-e52a-4ba0-b29f-b2377e4aa977.183fe0c9-a4c6-464c-a046-2611eb400657" returned: 0 in 0.454s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:00:19 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-4627e56d-ae20-4a2a-855b-cbd5530dae79 tempest-GroupsV314Test-1269514990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-c3817023-e52a-4ba0-b29f-b2377e4aa977.183fe0c9-a4c6-464c-a046-2611eb400657 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:00:19 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-cc0cabcd-dd2b-4202-ba77-d09429e061f0 tempest-ServerActionsTestOtherA-1577109295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f9775e6-cefc-4178-b542-b82b3d44fca1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'a4bf0a9c-41d0-42cc-a3bf-c195d11e69fe', 'volume_name': 'volume-a4bf0a9c-41d0-42cc-a3bf-c195d11e69fe', 'volume_size': 1, 'image_id': '26019e10-1e1f-4514-b191-397ccf1d59e6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/26019e10-1e1f-4514-b191-397ccf1d59e6', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4765956d565c46c2a4a703c5a550ca58', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '26019e10-1e1f-4514-b191-397ccf1d59e6', 'created_at': datetime.datetime(2026, 9, 7, 7, 52, 21, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 7, 7, 52, 22, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/26019e10-1e1f-4514-b191-397ccf1d59e6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:00:19 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-cc0cabcd-dd2b-4202-ba77-d09429e061f0 tempest-ServerActionsTestOtherA-1577109295 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76896f03-ddbd-4565-bd8b-bd04076a1044) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:00:19 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-cc0cabcd-dd2b-4202-ba77-d09429e061f0 tempest-ServerActionsTestOtherA-1577109295 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76896f03-ddbd-4565-bd8b-bd04076a1044) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:00:19 devstack sudo[90860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-c3817023-e52a-4ba0-b29f-b2377e4aa977.183fe0c9-a4c6-464c-a046-2611eb400657 Sep 07 10:00:19 devstack sudo[90860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:00:19 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-cc0cabcd-dd2b-4202-ba77-d09429e061f0 tempest-ServerActionsTestOtherA-1577109295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b57c6465-b13c-40b8-a70e-1fab9de3928c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:00:19 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-cc0cabcd-dd2b-4202-ba77-d09429e061f0 tempest-ServerActionsTestOtherA-1577109295 None] Volume a4bf0a9c-41d0-42cc-a3bf-c195d11e69fe: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-a4bf0a9c-41d0-42cc-a3bf-c195d11e69fe', 'volume_size': 1, 'image_id': '26019e10-1e1f-4514-b191-397ccf1d59e6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/26019e10-1e1f-4514-b191-397ccf1d59e6', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4765956d565c46c2a4a703c5a550ca58', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '26019e10-1e1f-4514-b191-397ccf1d59e6', 'created_at': datetime.datetime(2026, 9, 7, 7, 52, 21, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 7, 7, 52, 22, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/26019e10-1e1f-4514-b191-397ccf1d59e6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 07 10:00:19 devstack cinder-volume[87515]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc0cabcd-dd2b-4202-ba77-d09429e061f0 tempest-ServerActionsTestOtherA-1577109295 None] Trying to clone a4bf0a9c-41d0-42cc-a3bf-c195d11e69fe from image 26019e10-1e1f-4514-b191-397ccf1d59e6 at location (None, [{'url': 'file:///opt/stack/data/glance/images/26019e10-1e1f-4514-b191-397ccf1d59e6', 'metadata': {}}]). {{(pid=87515) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 07 10:00:19 devstack sudo[90860]: pam_unix(sudo:session): session closed for user root Sep 07 10:00:19 devstack cinder-volume[87515]: DEBUG cinder.image.image_utils [None req-cc0cabcd-dd2b-4202-ba77-d09429e061f0 tempest-ServerActionsTestOtherA-1577109295 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_26019e10-1e1f-4514-b191-397ccf1d59e6_vt87i8l7devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87515) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 07 10:00:19 devstack cinder-volume[87515]: INFO cinder.image.image_utils [None req-cc0cabcd-dd2b-4202-ba77-d09429e061f0 tempest-ServerActionsTestOtherA-1577109295 None] Image download 20.69 MB at 20.69 MB/s Sep 07 10:00:19 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-4627e56d-ae20-4a2a-855b-cbd5530dae79 tempest-GroupsV314Test-1269514990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-c3817023-e52a-4ba0-b29f-b2377e4aa977.183fe0c9-a4c6-464c-a046-2611eb400657" returned: 0 in 0.445s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:00:19 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-4627e56d-ae20-4a2a-855b-cbd5530dae79 tempest-GroupsV314Test-1269514990 None] Lock "cinder-quobyte-183fe0c9-a4c6-464c-a046-2611eb400657" released by "_delete_snapshot" :: held 2.349s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:00:19 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[fea129b7-92cb-404c-b4fd-38b390cd5057]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:00:19 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-cc0cabcd-dd2b-4202-ba77-d09429e061f0 tempest-ServerActionsTestOtherA-1577109295 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_26019e10-1e1f-4514-b191-397ccf1d59e6_vt87i8l7devstack@QuobyteHD {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:00:19 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-4627e56d-ae20-4a2a-855b-cbd5530dae79 tempest-GroupsV314Test-1269514990 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 13.678s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:00:19 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-273fc75a-76c5-4948-9ce7-96943d3957bb tempest-TaggedAttachmentsTest-262548527 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.776s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:00:19 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-273fc75a-76c5-4948-9ce7-96943d3957bb tempest-TaggedAttachmentsTest-262548527 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:00:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1136371274',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e146ba7-f52f-4ef5-b38f-8bf5a6375fe8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16f364821de44c84a3d9a2e603d67e06',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:00:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:00:19Z,use_quota=True,user_id='d57cabcda2a4460ab2cbda6017fad938',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3a092cd-7947-4cbf-abff-4ba9567becf0),volume_type_id=f3a092cd-7947-4cbf-abff-4ba9567becf0)}" {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 10:00:19 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-273fc75a-76c5-4948-9ce7-96943d3957bb tempest-TaggedAttachmentsTest-262548527 None] Creating volume 7e146ba7-f52f-4ef5-b38f-8bf5a6375fe8 {{(pid=87515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 10:00:19 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-273fc75a-76c5-4948-9ce7-96943d3957bb tempest-TaggedAttachmentsTest-262548527 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:00:19 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-273fc75a-76c5-4948-9ce7-96943d3957bb tempest-TaggedAttachmentsTest-262548527 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:00:19 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-273fc75a-76c5-4948-9ce7-96943d3957bb tempest-TaggedAttachmentsTest-262548527 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:00:19 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-273fc75a-76c5-4948-9ce7-96943d3957bb tempest-TaggedAttachmentsTest-262548527 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:00:19 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-273fc75a-76c5-4948-9ce7-96943d3957bb tempest-TaggedAttachmentsTest-262548527 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:00:19 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-273fc75a-76c5-4948-9ce7-96943d3957bb tempest-TaggedAttachmentsTest-262548527 None] Selected osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c as target Quobyte volume. {{(pid=87515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 10:00:19 devstack cinder-volume[87515]: INFO cinder.volume.drivers.remotefs [None req-273fc75a-76c5-4948-9ce7-96943d3957bb tempest-TaggedAttachmentsTest-262548527 None] casted to osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c Sep 07 10:00:19 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-273fc75a-76c5-4948-9ce7-96943d3957bb tempest-TaggedAttachmentsTest-262548527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-7e146ba7-f52f-4ef5-b38f-8bf5a6375fe8 1073741824 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:00:19 devstack sudo[90887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-7e146ba7-f52f-4ef5-b38f-8bf5a6375fe8 1073741824 Sep 07 10:00:19 devstack sudo[90887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:00:19 devstack sudo[90886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_26019e10-1e1f-4514-b191-397ccf1d59e6_vt87i8l7devstack@QuobyteHD Sep 07 10:00:19 devstack sudo[90886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:00:19 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-4627e56d-ae20-4a2a-855b-cbd5530dae79 tempest-GroupsV314Test-1269514990 None] Create group from source-group-a0706ed5-a4b8-4639-982f-805e2f094444 completed successfully. Sep 07 10:00:20 devstack sudo[90886]: pam_unix(sudo:session): session closed for user root Sep 07 10:00:20 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-cc0cabcd-dd2b-4202-ba77-d09429e061f0 tempest-ServerActionsTestOtherA-1577109295 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_26019e10-1e1f-4514-b191-397ccf1d59e6_vt87i8l7devstack@QuobyteHD" returned: 0 in 0.589s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:00:20 devstack cinder-volume[87515]: DEBUG cinder.image.image_utils [None req-cc0cabcd-dd2b-4202-ba77-d09429e061f0 tempest-ServerActionsTestOtherA-1577109295 None] Temporary image 26019e10-1e1f-4514-b191-397ccf1d59e6 is fetched for user 1918b665bf3a468e837ffc0cefcbf767. {{(pid=87515) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 07 10:00:20 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[b226c438-6bd9-483c-8630-eaf915403c33]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:00:20 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-cc0cabcd-dd2b-4202-ba77-d09429e061f0 tempest-ServerActionsTestOtherA-1577109295 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_26019e10-1e1f-4514-b191-397ccf1d59e6_vt87i8l7devstack@QuobyteHD {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:00:20 devstack sudo[90887]: pam_unix(sudo:session): session closed for user root Sep 07 10:00:20 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-273fc75a-76c5-4948-9ce7-96943d3957bb tempest-TaggedAttachmentsTest-262548527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-7e146ba7-f52f-4ef5-b38f-8bf5a6375fe8 1073741824" returned: 0 in 0.933s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:00:20 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-273fc75a-76c5-4948-9ce7-96943d3957bb tempest-TaggedAttachmentsTest-262548527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-7e146ba7-f52f-4ef5-b38f-8bf5a6375fe8 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:00:20 devstack sudo[90935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_26019e10-1e1f-4514-b191-397ccf1d59e6_vt87i8l7devstack@QuobyteHD Sep 07 10:00:20 devstack sudo[90935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:00:20 devstack sudo[90951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-7e146ba7-f52f-4ef5-b38f-8bf5a6375fe8 Sep 07 10:00:20 devstack sudo[90951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:00:21 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-36dac2c7-0f49-4d77-bbf4-3345bc2b7842 tempest-GroupsV314Test-1269514990 None] Acquiring lock "cinder-quobyte-b9b6617c-2fc3-4073-8108-642296217967" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:00:21 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-36dac2c7-0f49-4d77-bbf4-3345bc2b7842 tempest-GroupsV314Test-1269514990 None] Lock "cinder-quobyte-b9b6617c-2fc3-4073-8108-642296217967" acquired by "delete_volume" :: waited 0.041s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:00:21 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[e62646d6-9492-4dcb-a7b7-58e55ffe3e06]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:00:21 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-36dac2c7-0f49-4d77-bbf4-3345bc2b7842 tempest-GroupsV314Test-1269514990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-b9b6617c-2fc3-4073-8108-642296217967 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:00:21 devstack sudo[90951]: pam_unix(sudo:session): session closed for user root Sep 07 10:00:21 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-273fc75a-76c5-4948-9ce7-96943d3957bb tempest-TaggedAttachmentsTest-262548527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-7e146ba7-f52f-4ef5-b38f-8bf5a6375fe8" returned: 0 in 0.572s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:00:21 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-273fc75a-76c5-4948-9ce7-96943d3957bb tempest-TaggedAttachmentsTest-262548527 None] <== create_volume: return (1613ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'} {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 10:00:21 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-273fc75a-76c5-4948-9ce7-96943d3957bb tempest-TaggedAttachmentsTest-262548527 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.618s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:00:21 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-273fc75a-76c5-4948-9ce7-96943d3957bb tempest-TaggedAttachmentsTest-262548527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d760056-af38-4c00-a63c-fcfc181c7677) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7e146ba7-f52f-4ef5-b38f-8bf5a6375fe8', 'volume_size': 1}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:00:21 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-273fc75a-76c5-4948-9ce7-96943d3957bb tempest-TaggedAttachmentsTest-262548527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df19630d-0619-4eae-a245-5c9a16230523) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:00:21 devstack sudo[90958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-b9b6617c-2fc3-4073-8108-642296217967 Sep 07 10:00:21 devstack sudo[90958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:00:21 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-273fc75a-76c5-4948-9ce7-96943d3957bb tempest-TaggedAttachmentsTest-262548527 None] Volume volume-7e146ba7-f52f-4ef5-b38f-8bf5a6375fe8 (7e146ba7-f52f-4ef5-b38f-8bf5a6375fe8): created successfully Sep 07 10:00:21 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-273fc75a-76c5-4948-9ce7-96943d3957bb tempest-TaggedAttachmentsTest-262548527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df19630d-0619-4eae-a245-5c9a16230523) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:00:21 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-273fc75a-76c5-4948-9ce7-96943d3957bb tempest-TaggedAttachmentsTest-262548527 None] Flow 'volume_create_manager' (99703f2b-9431-4241-8ca8-c5ccf382ab7f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:00:21 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-273fc75a-76c5-4948-9ce7-96943d3957bb tempest-TaggedAttachmentsTest-262548527 None] Created volume successfully. Sep 07 10:00:21 devstack sudo[90935]: pam_unix(sudo:session): session closed for user root Sep 07 10:00:21 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-cc0cabcd-dd2b-4202-ba77-d09429e061f0 tempest-ServerActionsTestOtherA-1577109295 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_26019e10-1e1f-4514-b191-397ccf1d59e6_vt87i8l7devstack@QuobyteHD" returned: 0 in 1.060s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:00:21 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-cc0cabcd-dd2b-4202-ba77-d09429e061f0 tempest-ServerActionsTestOtherA-1577109295 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:00:21 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-cc0cabcd-dd2b-4202-ba77-d09429e061f0 tempest-ServerActionsTestOtherA-1577109295 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:00:21 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-cc0cabcd-dd2b-4202-ba77-d09429e061f0 tempest-ServerActionsTestOtherA-1577109295 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:00:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-244151822',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4bf0a9c-41d0-42cc-a3bf-c195d11e69fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0805f131487d4bf6907414c10b172704',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:00:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:00:19Z,use_quota=True,user_id='1918b665bf3a468e837ffc0cefcbf767',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3a092cd-7947-4cbf-abff-4ba9567becf0),volume_type_id=f3a092cd-7947-4cbf-abff-4ba9567becf0)}" {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 10:00:21 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-cc0cabcd-dd2b-4202-ba77-d09429e061f0 tempest-ServerActionsTestOtherA-1577109295 None] Creating volume a4bf0a9c-41d0-42cc-a3bf-c195d11e69fe {{(pid=87515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 10:00:21 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-cc0cabcd-dd2b-4202-ba77-d09429e061f0 tempest-ServerActionsTestOtherA-1577109295 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:00:21 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-cc0cabcd-dd2b-4202-ba77-d09429e061f0 tempest-ServerActionsTestOtherA-1577109295 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:00:21 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-cc0cabcd-dd2b-4202-ba77-d09429e061f0 tempest-ServerActionsTestOtherA-1577109295 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:00:21 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-cc0cabcd-dd2b-4202-ba77-d09429e061f0 tempest-ServerActionsTestOtherA-1577109295 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:00:21 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-cc0cabcd-dd2b-4202-ba77-d09429e061f0 tempest-ServerActionsTestOtherA-1577109295 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:00:21 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-cc0cabcd-dd2b-4202-ba77-d09429e061f0 tempest-ServerActionsTestOtherA-1577109295 None] Selected osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c as target Quobyte volume. {{(pid=87515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 10:00:21 devstack cinder-volume[87515]: INFO cinder.volume.drivers.remotefs [None req-cc0cabcd-dd2b-4202-ba77-d09429e061f0 tempest-ServerActionsTestOtherA-1577109295 None] casted to osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c Sep 07 10:00:21 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-cc0cabcd-dd2b-4202-ba77-d09429e061f0 tempest-ServerActionsTestOtherA-1577109295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-a4bf0a9c-41d0-42cc-a3bf-c195d11e69fe 1073741824 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:00:21 devstack sudo[90971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-a4bf0a9c-41d0-42cc-a3bf-c195d11e69fe 1073741824 Sep 07 10:00:21 devstack sudo[90971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:00:21 devstack sudo[90958]: pam_unix(sudo:session): session closed for user root Sep 07 10:00:21 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-36dac2c7-0f49-4d77-bbf4-3345bc2b7842 tempest-GroupsV314Test-1269514990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-b9b6617c-2fc3-4073-8108-642296217967" returned: 0 in 0.754s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:00:21 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-36dac2c7-0f49-4d77-bbf4-3345bc2b7842 tempest-GroupsV314Test-1269514990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-b9b6617c-2fc3-4073-8108-642296217967 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:00:21 devstack sudo[90983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-b9b6617c-2fc3-4073-8108-642296217967 Sep 07 10:00:21 devstack sudo[90983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:00:22 devstack sudo[90971]: pam_unix(sudo:session): session closed for user root Sep 07 10:00:22 devstack sudo[90983]: pam_unix(sudo:session): session closed for user root Sep 07 10:00:22 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-36dac2c7-0f49-4d77-bbf4-3345bc2b7842 tempest-GroupsV314Test-1269514990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-b9b6617c-2fc3-4073-8108-642296217967" returned: 0 in 0.683s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:00:22 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-cc0cabcd-dd2b-4202-ba77-d09429e061f0 tempest-ServerActionsTestOtherA-1577109295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-a4bf0a9c-41d0-42cc-a3bf-c195d11e69fe 1073741824" returned: 0 in 1.023s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:00:22 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-36dac2c7-0f49-4d77-bbf4-3345bc2b7842 tempest-GroupsV314Test-1269514990 None] Lock "cinder-quobyte-b9b6617c-2fc3-4073-8108-642296217967" released by "delete_volume" :: held 1.559s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:00:22 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-cc0cabcd-dd2b-4202-ba77-d09429e061f0 tempest-ServerActionsTestOtherA-1577109295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-a4bf0a9c-41d0-42cc-a3bf-c195d11e69fe {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:00:22 devstack sudo[90989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-a4bf0a9c-41d0-42cc-a3bf-c195d11e69fe Sep 07 10:00:22 devstack sudo[90989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:00:22 devstack cinder-volume[87515]: DEBUG cinder.quota [None req-36dac2c7-0f49-4d77-bbf4-3345bc2b7842 tempest-GroupsV314Test-1269514990 None] Created reservations ['3ac8db47-d339-4fe0-ad31-dffaa825fdb2'] {{(pid=87515) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:00:22 devstack cinder-volume[87515]: WARNING cinder.quota [None req-36dac2c7-0f49-4d77-bbf4-3345bc2b7842 tempest-GroupsV314Test-1269514990 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-579678378 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-579678378, it is now deprecated. Please use the default quota class for default quota. Sep 07 10:00:22 devstack cinder-volume[87515]: WARNING cinder.quota [None req-36dac2c7-0f49-4d77-bbf4-3345bc2b7842 tempest-GroupsV314Test-1269514990 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-579678378 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-579678378, it is now deprecated. Please use the default quota class for default quota. Sep 07 10:00:22 devstack cinder-volume[87515]: DEBUG cinder.quota [None req-36dac2c7-0f49-4d77-bbf4-3345bc2b7842 tempest-GroupsV314Test-1269514990 None] Created reservations ['ed48f75c-a58e-412f-8e0d-2bd4ba611c09', '6a6f0e8b-9038-42dd-a294-510fb1c517e8', '1102094f-608d-4c58-9fae-00275ef5a51e', '74e6c3d8-6625-467e-8e86-a497ba5b45be'] {{(pid=87515) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:00:23 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-36dac2c7-0f49-4d77-bbf4-3345bc2b7842 tempest-GroupsV314Test-1269514990 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:00:23 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-36dac2c7-0f49-4d77-bbf4-3345bc2b7842 tempest-GroupsV314Test-1269514990 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:00:23 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-36dac2c7-0f49-4d77-bbf4-3345bc2b7842 tempest-GroupsV314Test-1269514990 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:00:23 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-36dac2c7-0f49-4d77-bbf4-3345bc2b7842 tempest-GroupsV314Test-1269514990 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:00:23 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-36dac2c7-0f49-4d77-bbf4-3345bc2b7842 tempest-GroupsV314Test-1269514990 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:00:23 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-36dac2c7-0f49-4d77-bbf4-3345bc2b7842 tempest-GroupsV314Test-1269514990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:00:23 devstack sudo[90993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a Sep 07 10:00:23 devstack sudo[90993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:00:23 devstack sudo[90989]: pam_unix(sudo:session): session closed for user root Sep 07 10:00:23 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-cc0cabcd-dd2b-4202-ba77-d09429e061f0 tempest-ServerActionsTestOtherA-1577109295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-a4bf0a9c-41d0-42cc-a3bf-c195d11e69fe" returned: 0 in 0.510s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:00:23 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-cc0cabcd-dd2b-4202-ba77-d09429e061f0 tempest-ServerActionsTestOtherA-1577109295 None] <== create_volume: return (1650ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'} {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 10:00:23 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-cc0cabcd-dd2b-4202-ba77-d09429e061f0 tempest-ServerActionsTestOtherA-1577109295 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.659s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:00:23 devstack cinder-volume[87515]: DEBUG cinder.volume.volume_utils [None req-cc0cabcd-dd2b-4202-ba77-d09429e061f0 tempest-ServerActionsTestOtherA-1577109295 None] Attempting download of 26019e10-1e1f-4514-b191-397ccf1d59e6 ((None, [{'url': 'file:///opt/stack/data/glance/images/26019e10-1e1f-4514-b191-397ccf1d59e6', 'metadata': {}}])) to volume a4bf0a9c-41d0-42cc-a3bf-c195d11e69fe. {{(pid=87515) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 07 10:00:23 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e764683-92ad-4df9-bc17-3c500020e6a2]: (4, 'raw') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:00:23 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-cc0cabcd-dd2b-4202-ba77-d09429e061f0 tempest-ServerActionsTestOtherA-1577109295 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_26019e10-1e1f-4514-b191-397ccf1d59e6_impes1x4 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:00:23 devstack sudo[90993]: pam_unix(sudo:session): session closed for user root Sep 07 10:00:23 devstack sudo[90995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_26019e10-1e1f-4514-b191-397ccf1d59e6_impes1x4 Sep 07 10:00:23 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-36dac2c7-0f49-4d77-bbf4-3345bc2b7842 tempest-GroupsV314Test-1269514990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a" returned: 0 in 0.396s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:00:23 devstack sudo[90995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:00:23 devstack cinder-volume[87515]: DEBUG cinder.manager [None req-36dac2c7-0f49-4d77-bbf4-3345bc2b7842 tempest-GroupsV314Test-1269514990 None] Notifying Schedulers of capabilities ... {{(pid=87515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:00:23 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-36dac2c7-0f49-4d77-bbf4-3345bc2b7842 tempest-GroupsV314Test-1269514990 None] Delete group completed successfully. Sep 07 10:00:23 devstack sudo[90995]: pam_unix(sudo:session): session closed for user root Sep 07 10:00:23 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-cc0cabcd-dd2b-4202-ba77-d09429e061f0 tempest-ServerActionsTestOtherA-1577109295 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_26019e10-1e1f-4514-b191-397ccf1d59e6_impes1x4" returned: 0 in 0.411s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:00:23 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-cc0cabcd-dd2b-4202-ba77-d09429e061f0 tempest-ServerActionsTestOtherA-1577109295 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_26019e10-1e1f-4514-b191-397ccf1d59e6_impes1x4 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:00:23 devstack sudo[91000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_26019e10-1e1f-4514-b191-397ccf1d59e6_impes1x4 Sep 07 10:00:23 devstack sudo[91000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:00:24 devstack sudo[91000]: pam_unix(sudo:session): session closed for user root Sep 07 10:00:24 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-cc0cabcd-dd2b-4202-ba77-d09429e061f0 tempest-ServerActionsTestOtherA-1577109295 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_26019e10-1e1f-4514-b191-397ccf1d59e6_impes1x4" returned: 1 in 0.560s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:00:24 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-cc0cabcd-dd2b-4202-ba77-d09429e061f0 tempest-ServerActionsTestOtherA-1577109295 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_26019e10-1e1f-4514-b191-397ccf1d59e6_impes1x4' failed. Not Retrying. {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 07 10:00:24 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[88a0aaa0-f975-4a2a-a469-9000b74e66a1]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:00:24 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-cc0cabcd-dd2b-4202-ba77-d09429e061f0 tempest-ServerActionsTestOtherA-1577109295 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_26019e10-1e1f-4514-b191-397ccf1d59e6_vt87i8l7devstack@QuobyteHD {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:00:24 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-3cbd3be8-e206-49eb-8487-67164f810b3b tempest-GroupsV314Test-1269514990 None] Acquiring lock "cinder-quobyte-c3817023-e52a-4ba0-b29f-b2377e4aa977" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:00:24 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-3cbd3be8-e206-49eb-8487-67164f810b3b tempest-GroupsV314Test-1269514990 None] Lock "cinder-quobyte-c3817023-e52a-4ba0-b29f-b2377e4aa977" acquired by "delete_volume" :: waited 0.028s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:00:24 devstack sudo[91005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_26019e10-1e1f-4514-b191-397ccf1d59e6_vt87i8l7devstack@QuobyteHD Sep 07 10:00:24 devstack sudo[91005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:00:24 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[5100bdab-dc4d-4e79-b866-e104d0159cf0]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:00:24 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-3cbd3be8-e206-49eb-8487-67164f810b3b tempest-GroupsV314Test-1269514990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-c3817023-e52a-4ba0-b29f-b2377e4aa977 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:00:24 devstack sudo[91007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-c3817023-e52a-4ba0-b29f-b2377e4aa977 Sep 07 10:00:24 devstack sudo[91007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:00:24 devstack sudo[91005]: pam_unix(sudo:session): session closed for user root Sep 07 10:00:24 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-cc0cabcd-dd2b-4202-ba77-d09429e061f0 tempest-ServerActionsTestOtherA-1577109295 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_26019e10-1e1f-4514-b191-397ccf1d59e6_vt87i8l7devstack@QuobyteHD" returned: 0 in 0.614s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:00:24 devstack cinder-volume[87515]: DEBUG cinder.image.image_utils [None req-cc0cabcd-dd2b-4202-ba77-d09429e061f0 tempest-ServerActionsTestOtherA-1577109295 None] 26019e10-1e1f-4514-b191-397ccf1d59e6 was qcow2, converting to qcow2 {{(pid=87515) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 07 10:00:25 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-cc0cabcd-dd2b-4202-ba77-d09429e061f0 tempest-ServerActionsTestOtherA-1577109295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_26019e10-1e1f-4514-b191-397ccf1d59e6_vt87i8l7devstack@QuobyteHD /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-a4bf0a9c-41d0-42cc-a3bf-c195d11e69fe {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:00:25 devstack sudo[91012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_26019e10-1e1f-4514-b191-397ccf1d59e6_vt87i8l7devstack@QuobyteHD /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-a4bf0a9c-41d0-42cc-a3bf-c195d11e69fe Sep 07 10:00:25 devstack sudo[91012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:00:25 devstack sudo[91007]: pam_unix(sudo:session): session closed for user root Sep 07 10:00:25 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-3cbd3be8-e206-49eb-8487-67164f810b3b tempest-GroupsV314Test-1269514990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-c3817023-e52a-4ba0-b29f-b2377e4aa977" returned: 0 in 0.618s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:00:25 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-3cbd3be8-e206-49eb-8487-67164f810b3b tempest-GroupsV314Test-1269514990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-c3817023-e52a-4ba0-b29f-b2377e4aa977 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:00:25 devstack sudo[91017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-c3817023-e52a-4ba0-b29f-b2377e4aa977 Sep 07 10:00:25 devstack sudo[91017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:00:25 devstack sudo[91017]: pam_unix(sudo:session): session closed for user root Sep 07 10:00:25 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-3cbd3be8-e206-49eb-8487-67164f810b3b tempest-GroupsV314Test-1269514990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-c3817023-e52a-4ba0-b29f-b2377e4aa977" returned: 0 in 0.410s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:00:25 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-3cbd3be8-e206-49eb-8487-67164f810b3b tempest-GroupsV314Test-1269514990 None] Lock "cinder-quobyte-c3817023-e52a-4ba0-b29f-b2377e4aa977" released by "delete_volume" :: held 1.162s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:00:25 devstack cinder-volume[87515]: DEBUG cinder.quota [None req-3cbd3be8-e206-49eb-8487-67164f810b3b tempest-GroupsV314Test-1269514990 None] Created reservations ['5890f764-0fe2-4e42-8c8d-4fa1d9ae7722'] {{(pid=87515) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:00:25 devstack cinder-volume[87515]: DEBUG cinder.quota [None req-3cbd3be8-e206-49eb-8487-67164f810b3b tempest-GroupsV314Test-1269514990 None] Created reservations ['8f3b5f30-cb58-434f-abdb-ec688f8ef71f', '9c06c595-673d-4df4-afbd-a22e0189df4f', '4d8f6878-943b-4691-a61e-df710de44626', '9082eb7f-f35a-40ec-9cf3-295350611a7f'] {{(pid=87515) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:00:26 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-3cbd3be8-e206-49eb-8487-67164f810b3b tempest-GroupsV314Test-1269514990 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:00:26 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-3cbd3be8-e206-49eb-8487-67164f810b3b tempest-GroupsV314Test-1269514990 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:00:26 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-3cbd3be8-e206-49eb-8487-67164f810b3b tempest-GroupsV314Test-1269514990 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:00:26 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-3cbd3be8-e206-49eb-8487-67164f810b3b tempest-GroupsV314Test-1269514990 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:00:26 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-3cbd3be8-e206-49eb-8487-67164f810b3b tempest-GroupsV314Test-1269514990 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:00:26 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-3cbd3be8-e206-49eb-8487-67164f810b3b tempest-GroupsV314Test-1269514990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:00:26 devstack sudo[91024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a Sep 07 10:00:26 devstack sudo[91024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:00:26 devstack sudo[91024]: pam_unix(sudo:session): session closed for user root Sep 07 10:00:26 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-3cbd3be8-e206-49eb-8487-67164f810b3b tempest-GroupsV314Test-1269514990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a" returned: 0 in 0.424s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:00:26 devstack cinder-volume[87515]: DEBUG cinder.manager [None req-3cbd3be8-e206-49eb-8487-67164f810b3b tempest-GroupsV314Test-1269514990 None] Notifying Schedulers of capabilities ... {{(pid=87515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:00:26 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-3cbd3be8-e206-49eb-8487-67164f810b3b tempest-GroupsV314Test-1269514990 None] Delete group completed successfully. Sep 07 10:00:28 devstack sudo[91012]: pam_unix(sudo:session): session closed for user root Sep 07 10:00:28 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-cc0cabcd-dd2b-4202-ba77-d09429e061f0 tempest-ServerActionsTestOtherA-1577109295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_26019e10-1e1f-4514-b191-397ccf1d59e6_vt87i8l7devstack@QuobyteHD /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-a4bf0a9c-41d0-42cc-a3bf-c195d11e69fe" returned: 0 in 3.054s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:00:28 devstack cinder-volume[87515]: DEBUG cinder.image.image_utils [None req-cc0cabcd-dd2b-4202-ba77-d09429e061f0 tempest-ServerActionsTestOtherA-1577109295 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_26019e10-1e1f-4514-b191-397ccf1d59e6_vt87i8l7devstack@QuobyteHD, size 112.00 MB, duration 3.06 sec, destination /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-a4bf0a9c-41d0-42cc-a3bf-c195d11e69fe {{(pid=87515) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 07 10:00:28 devstack cinder-volume[87515]: INFO cinder.image.image_utils [None req-cc0cabcd-dd2b-4202-ba77-d09429e061f0 tempest-ServerActionsTestOtherA-1577109295 None] Converted 112.00 MB image at 36.65 MB/s Sep 07 10:00:28 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-cc0cabcd-dd2b-4202-ba77-d09429e061f0 tempest-ServerActionsTestOtherA-1577109295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-a4bf0a9c-41d0-42cc-a3bf-c195d11e69fe 1G {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:00:28 devstack sudo[91032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-a4bf0a9c-41d0-42cc-a3bf-c195d11e69fe 1G Sep 07 10:00:28 devstack sudo[91032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:00:28 devstack sudo[91032]: pam_unix(sudo:session): session closed for user root Sep 07 10:00:28 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-cc0cabcd-dd2b-4202-ba77-d09429e061f0 tempest-ServerActionsTestOtherA-1577109295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-a4bf0a9c-41d0-42cc-a3bf-c195d11e69fe 1G" returned: 0 in 0.891s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:00:28 devstack cinder-volume[87515]: DEBUG cinder.volume.volume_utils [None req-cc0cabcd-dd2b-4202-ba77-d09429e061f0 tempest-ServerActionsTestOtherA-1577109295 None] Downloaded image 26019e10-1e1f-4514-b191-397ccf1d59e6 ((None, [{'url': 'file:///opt/stack/data/glance/images/26019e10-1e1f-4514-b191-397ccf1d59e6', 'metadata': {}}])) to volume a4bf0a9c-41d0-42cc-a3bf-c195d11e69fe successfully. {{(pid=87515) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 07 10:00:28 devstack cinder-volume[87515]: DEBUG cinder.image.image_utils [None req-cc0cabcd-dd2b-4202-ba77-d09429e061f0 tempest-ServerActionsTestOtherA-1577109295 None] Temporary image 26019e10-1e1f-4514-b191-397ccf1d59e6 for user 1918b665bf3a468e837ffc0cefcbf767 is deleted. {{(pid=87515) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 07 10:00:28 devstack cinder-volume[87515]: DEBUG cinder.volume.volume_utils [None req-cc0cabcd-dd2b-4202-ba77-d09429e061f0 tempest-ServerActionsTestOtherA-1577109295 None] Marking volume a4bf0a9c-41d0-42cc-a3bf-c195d11e69fe as bootable. {{(pid=87515) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 07 10:00:28 devstack cinder-volume[87515]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc0cabcd-dd2b-4202-ba77-d09429e061f0 tempest-ServerActionsTestOtherA-1577109295 None] Copying metadata from image 26019e10-1e1f-4514-b191-397ccf1d59e6 to a4bf0a9c-41d0-42cc-a3bf-c195d11e69fe. {{(pid=87515) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 07 10:00:28 devstack cinder-volume[87515]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc0cabcd-dd2b-4202-ba77-d09429e061f0 tempest-ServerActionsTestOtherA-1577109295 None] Creating volume glance metadata for volume a4bf0a9c-41d0-42cc-a3bf-c195d11e69fe backed by image 26019e10-1e1f-4514-b191-397ccf1d59e6 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '26019e10-1e1f-4514-b191-397ccf1d59e6', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87515) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 07 10:00:29 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-cc0cabcd-dd2b-4202-ba77-d09429e061f0 tempest-ServerActionsTestOtherA-1577109295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b57c6465-b13c-40b8-a70e-1fab9de3928c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a4bf0a9c-41d0-42cc-a3bf-c195d11e69fe', 'volume_size': 1, 'image_id': '26019e10-1e1f-4514-b191-397ccf1d59e6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/26019e10-1e1f-4514-b191-397ccf1d59e6', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4765956d565c46c2a4a703c5a550ca58', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '26019e10-1e1f-4514-b191-397ccf1d59e6', 'created_at': datetime.datetime(2026, 9, 7, 7, 52, 21, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 7, 7, 52, 22, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/26019e10-1e1f-4514-b191-397ccf1d59e6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:00:29 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-cc0cabcd-dd2b-4202-ba77-d09429e061f0 tempest-ServerActionsTestOtherA-1577109295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6dd87ab-feb9-4de1-b281-94dbc3d9d3d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:00:29 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-cc0cabcd-dd2b-4202-ba77-d09429e061f0 tempest-ServerActionsTestOtherA-1577109295 None] Volume volume-a4bf0a9c-41d0-42cc-a3bf-c195d11e69fe (a4bf0a9c-41d0-42cc-a3bf-c195d11e69fe): created successfully Sep 07 10:00:29 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-cc0cabcd-dd2b-4202-ba77-d09429e061f0 tempest-ServerActionsTestOtherA-1577109295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6dd87ab-feb9-4de1-b281-94dbc3d9d3d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:00:29 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-cc0cabcd-dd2b-4202-ba77-d09429e061f0 tempest-ServerActionsTestOtherA-1577109295 None] Flow 'volume_create_manager' (49fd4c2f-244e-4374-a487-f4f713af2070) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:00:29 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-cc0cabcd-dd2b-4202-ba77-d09429e061f0 tempest-ServerActionsTestOtherA-1577109295 None] Created volume successfully. Sep 07 10:00:36 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [req-25a68e1b-7daa-44e0-9504-22157fb9f0d7 req-73eb2dcc-c1ea-445b-8f48-88690b5a1968 tempest-ServerActionsTestOtherA-1577109295 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:00:36 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [req-25a68e1b-7daa-44e0-9504-22157fb9f0d7 req-73eb2dcc-c1ea-445b-8f48-88690b5a1968 tempest-ServerActionsTestOtherA-1577109295 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:00:36 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [req-25a68e1b-7daa-44e0-9504-22157fb9f0d7 req-73eb2dcc-c1ea-445b-8f48-88690b5a1968 tempest-ServerActionsTestOtherA-1577109295 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.027s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:00:36 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [req-25a68e1b-7daa-44e0-9504-22157fb9f0d7 req-73eb2dcc-c1ea-445b-8f48-88690b5a1968 tempest-ServerActionsTestOtherA-1577109295 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c', 'name': 'volume-a4bf0a9c-41d0-42cc-a3bf-c195d11e69fe', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5d03e671-004e-4302-9deb-9ab3bd9ba0fd', 'enforce_multipath': True} {{(pid=87515) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 07 10:00:36 devstack cinder-volume[87515]: INFO cinder.volume.manager [req-25a68e1b-7daa-44e0-9504-22157fb9f0d7 req-73eb2dcc-c1ea-445b-8f48-88690b5a1968 tempest-ServerActionsTestOtherA-1577109295 None] attachment_update completed successfully. Sep 07 10:00:46 devstack cinder-volume[87515]: DEBUG dbcounter [-] [87515] Writing DB stats cinder:UPDATE=37,cinder:SELECT=37,cinder:DELETE=2,cinder:INSERT=10 {{(pid=87515) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 10:00:46 devstack cinder-volume[87515]: DEBUG dbcounter [-] [87515] Writing DB stats cinder:UPDATE=34,cinder:SELECT=48,cinder:INSERT=15 {{(pid=87515) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 10:00:49 devstack cinder-volume[87515]: DEBUG cinder.volume.flows.manager.create_volume [None req-708b55db-0608-4ea2-b2b7-076e7b0d94e4 tempest-AttachVolumeShelveTestJSON-1028195278 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 10:00:49 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-708b55db-0608-4ea2-b2b7-076e7b0d94e4 tempest-AttachVolumeShelveTestJSON-1028195278 None] Flow 'volume_create_manager' (7ac072e2-0550-44f6-95b8-6407af6d9fbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:00:49 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-708b55db-0608-4ea2-b2b7-076e7b0d94e4 tempest-AttachVolumeShelveTestJSON-1028195278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88dacfd3-3d25-4ed7-8287-8c100b659362) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:00:49 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-708b55db-0608-4ea2-b2b7-076e7b0d94e4 tempest-AttachVolumeShelveTestJSON-1028195278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88dacfd3-3d25-4ed7-8287-8c100b659362) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:00:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1018991544',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=449975e4-7227-42c2-a75f-38c5e63462fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3af7bf5cbde74f7b8c4cdf3ca7827cc8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:00:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:00:49Z,use_quota=True,user_id='129760e0fb9844a29c4d4b5a82c5193b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3a092cd-7947-4cbf-abff-4ba9567becf0),volume_type_id=f3a092cd-7947-4cbf-abff-4ba9567becf0)' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:00:49 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-708b55db-0608-4ea2-b2b7-076e7b0d94e4 tempest-AttachVolumeShelveTestJSON-1028195278 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8806c55b-c776-4586-8a6b-cc819ccfbe47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:00:49 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-708b55db-0608-4ea2-b2b7-076e7b0d94e4 tempest-AttachVolumeShelveTestJSON-1028195278 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8806c55b-c776-4586-8a6b-cc819ccfbe47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:00:49 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-708b55db-0608-4ea2-b2b7-076e7b0d94e4 tempest-AttachVolumeShelveTestJSON-1028195278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5ebd74a-a633-427f-9c0e-2b1140d2a081) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:00:49 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-708b55db-0608-4ea2-b2b7-076e7b0d94e4 tempest-AttachVolumeShelveTestJSON-1028195278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5ebd74a-a633-427f-9c0e-2b1140d2a081) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '449975e4-7227-42c2-a75f-38c5e63462fc', 'volume_name': 'volume-449975e4-7227-42c2-a75f-38c5e63462fc', 'volume_size': 1}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:00:49 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-708b55db-0608-4ea2-b2b7-076e7b0d94e4 tempest-AttachVolumeShelveTestJSON-1028195278 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (836e3c04-3ca5-46af-9f4c-f7a00712f618) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:00:49 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-708b55db-0608-4ea2-b2b7-076e7b0d94e4 tempest-AttachVolumeShelveTestJSON-1028195278 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (836e3c04-3ca5-46af-9f4c-f7a00712f618) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:00:49 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-708b55db-0608-4ea2-b2b7-076e7b0d94e4 tempest-AttachVolumeShelveTestJSON-1028195278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f120194c-2c66-4533-9d77-1b2f5bc501fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:00:49 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-708b55db-0608-4ea2-b2b7-076e7b0d94e4 tempest-AttachVolumeShelveTestJSON-1028195278 None] Volume 449975e4-7227-42c2-a75f-38c5e63462fc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-449975e4-7227-42c2-a75f-38c5e63462fc', 'volume_size': 1} Sep 07 10:00:49 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-708b55db-0608-4ea2-b2b7-076e7b0d94e4 tempest-AttachVolumeShelveTestJSON-1028195278 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:00:49 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-708b55db-0608-4ea2-b2b7-076e7b0d94e4 tempest-AttachVolumeShelveTestJSON-1028195278 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:00:49 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-708b55db-0608-4ea2-b2b7-076e7b0d94e4 tempest-AttachVolumeShelveTestJSON-1028195278 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:00:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1018991544',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=449975e4-7227-42c2-a75f-38c5e63462fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3af7bf5cbde74f7b8c4cdf3ca7827cc8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:00:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:00:49Z,use_quota=True,user_id='129760e0fb9844a29c4d4b5a82c5193b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3a092cd-7947-4cbf-abff-4ba9567becf0),volume_type_id=f3a092cd-7947-4cbf-abff-4ba9567becf0)}" {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 10:00:49 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-708b55db-0608-4ea2-b2b7-076e7b0d94e4 tempest-AttachVolumeShelveTestJSON-1028195278 None] Creating volume 449975e4-7227-42c2-a75f-38c5e63462fc {{(pid=87515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 10:00:49 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-708b55db-0608-4ea2-b2b7-076e7b0d94e4 tempest-AttachVolumeShelveTestJSON-1028195278 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:00:49 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-708b55db-0608-4ea2-b2b7-076e7b0d94e4 tempest-AttachVolumeShelveTestJSON-1028195278 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:00:49 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-708b55db-0608-4ea2-b2b7-076e7b0d94e4 tempest-AttachVolumeShelveTestJSON-1028195278 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:00:49 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-708b55db-0608-4ea2-b2b7-076e7b0d94e4 tempest-AttachVolumeShelveTestJSON-1028195278 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:00:49 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-708b55db-0608-4ea2-b2b7-076e7b0d94e4 tempest-AttachVolumeShelveTestJSON-1028195278 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:00:49 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-708b55db-0608-4ea2-b2b7-076e7b0d94e4 tempest-AttachVolumeShelveTestJSON-1028195278 None] Selected osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c as target Quobyte volume. {{(pid=87515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 10:00:49 devstack cinder-volume[87515]: INFO cinder.volume.drivers.remotefs [None req-708b55db-0608-4ea2-b2b7-076e7b0d94e4 tempest-AttachVolumeShelveTestJSON-1028195278 None] casted to osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c Sep 07 10:00:49 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-708b55db-0608-4ea2-b2b7-076e7b0d94e4 tempest-AttachVolumeShelveTestJSON-1028195278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-449975e4-7227-42c2-a75f-38c5e63462fc 1073741824 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:00:49 devstack sudo[91609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-449975e4-7227-42c2-a75f-38c5e63462fc 1073741824 Sep 07 10:00:49 devstack sudo[91609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:00:50 devstack sudo[91609]: pam_unix(sudo:session): session closed for user root Sep 07 10:00:50 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-708b55db-0608-4ea2-b2b7-076e7b0d94e4 tempest-AttachVolumeShelveTestJSON-1028195278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-449975e4-7227-42c2-a75f-38c5e63462fc 1073741824" returned: 0 in 1.379s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:00:51 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-708b55db-0608-4ea2-b2b7-076e7b0d94e4 tempest-AttachVolumeShelveTestJSON-1028195278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-449975e4-7227-42c2-a75f-38c5e63462fc {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:00:51 devstack sudo[91634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-449975e4-7227-42c2-a75f-38c5e63462fc Sep 07 10:00:51 devstack sudo[91634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:00:51 devstack sudo[91634]: pam_unix(sudo:session): session closed for user root Sep 07 10:00:51 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-708b55db-0608-4ea2-b2b7-076e7b0d94e4 tempest-AttachVolumeShelveTestJSON-1028195278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-449975e4-7227-42c2-a75f-38c5e63462fc" returned: 0 in 0.519s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:00:51 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-708b55db-0608-4ea2-b2b7-076e7b0d94e4 tempest-AttachVolumeShelveTestJSON-1028195278 None] <== create_volume: return (2073ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'} {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 10:00:51 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-708b55db-0608-4ea2-b2b7-076e7b0d94e4 tempest-AttachVolumeShelveTestJSON-1028195278 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.079s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:00:51 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-708b55db-0608-4ea2-b2b7-076e7b0d94e4 tempest-AttachVolumeShelveTestJSON-1028195278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f120194c-2c66-4533-9d77-1b2f5bc501fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-449975e4-7227-42c2-a75f-38c5e63462fc', 'volume_size': 1}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:00:51 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-708b55db-0608-4ea2-b2b7-076e7b0d94e4 tempest-AttachVolumeShelveTestJSON-1028195278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c3c9b35-bb3c-4482-ad44-e732918d8833) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:00:51 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-708b55db-0608-4ea2-b2b7-076e7b0d94e4 tempest-AttachVolumeShelveTestJSON-1028195278 None] Volume volume-449975e4-7227-42c2-a75f-38c5e63462fc (449975e4-7227-42c2-a75f-38c5e63462fc): created successfully Sep 07 10:00:51 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-708b55db-0608-4ea2-b2b7-076e7b0d94e4 tempest-AttachVolumeShelveTestJSON-1028195278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c3c9b35-bb3c-4482-ad44-e732918d8833) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:00:51 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-708b55db-0608-4ea2-b2b7-076e7b0d94e4 tempest-AttachVolumeShelveTestJSON-1028195278 None] Flow 'volume_create_manager' (7ac072e2-0550-44f6-95b8-6407af6d9fbf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:00:51 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-708b55db-0608-4ea2-b2b7-076e7b0d94e4 tempest-AttachVolumeShelveTestJSON-1028195278 None] Created volume successfully. Sep 07 10:00:56 devstack cinder-volume[87515]: INFO cinder.volume.manager [req-024070a4-6eb7-4d8d-934c-96e92b4beee0 req-27afa243-744a-4b28-9be4-04df7de8e1c7 tempest-ServerActionsTestOtherA-1577109295 None] Terminate volume connection completed successfully. Sep 07 10:00:56 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [req-024070a4-6eb7-4d8d-934c-96e92b4beee0 req-27afa243-744a-4b28-9be4-04df7de8e1c7 tempest-ServerActionsTestOtherA-1577109295 None] Deleting attachment 5d03e671-004e-4302-9deb-9ab3bd9ba0fd. {{(pid=87515) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 07 10:00:58 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [req-024070a4-6eb7-4d8d-934c-96e92b4beee0 req-4a62bd9e-5adf-4f19-90eb-78c88d88e818 tempest-ServerActionsTestOtherA-1577109295 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:00:58 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [req-024070a4-6eb7-4d8d-934c-96e92b4beee0 req-4a62bd9e-5adf-4f19-90eb-78c88d88e818 tempest-ServerActionsTestOtherA-1577109295 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:00:58 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [req-024070a4-6eb7-4d8d-934c-96e92b4beee0 req-4a62bd9e-5adf-4f19-90eb-78c88d88e818 tempest-ServerActionsTestOtherA-1577109295 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:00:58 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [req-024070a4-6eb7-4d8d-934c-96e92b4beee0 req-4a62bd9e-5adf-4f19-90eb-78c88d88e818 tempest-ServerActionsTestOtherA-1577109295 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c', 'name': 'volume-a4bf0a9c-41d0-42cc-a3bf-c195d11e69fe', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a7b61538-d772-462a-919b-36834a507cc6', 'enforce_multipath': True} {{(pid=87515) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 07 10:00:58 devstack cinder-volume[87515]: INFO cinder.volume.manager [req-024070a4-6eb7-4d8d-934c-96e92b4beee0 req-4a62bd9e-5adf-4f19-90eb-78c88d88e818 tempest-ServerActionsTestOtherA-1577109295 None] attachment_update completed successfully. Sep 07 10:01:08 devstack cinder-volume[87515]: DEBUG dbcounter [-] [87515] Writing DB stats cinder:SELECT=9,cinder:UPDATE=5,cinder:INSERT=1 {{(pid=87515) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 10:01:08 devstack cinder-volume[87515]: DEBUG dbcounter [-] [87515] Writing DB stats cinder:SELECT=11,cinder:UPDATE=5,cinder:DELETE=1 {{(pid=87515) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 10:01:09 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [req-92d99d02-bffb-47d3-8e6d-8bb0cc68fe55 req-01b40528-244a-45f3-a004-538b470f1c4c tempest-AttachVolumeShelveTestJSON-1028195278 None] No connector for attachment 1c19f9d7-6922-44b0-b4f8-ce02a27866cc; skipping storage backend terminate_connection call. {{(pid=87515) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Sep 07 10:01:09 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [req-92d99d02-bffb-47d3-8e6d-8bb0cc68fe55 req-01b40528-244a-45f3-a004-538b470f1c4c tempest-AttachVolumeShelveTestJSON-1028195278 None] Deleting attachment 1c19f9d7-6922-44b0-b4f8-ce02a27866cc. {{(pid=87515) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 07 10:01:11 devstack cinder-volume[87515]: DEBUG oslo_service.periodic_task [None req-cebd6a9d-3073-42a1-b65a-b38d444d85ed None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87515) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 10:01:11 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-cebd6a9d-3073-42a1-b65a-b38d444d85ed None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:01:11 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-cebd6a9d-3073-42a1-b65a-b38d444d85ed None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:01:11 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-cebd6a9d-3073-42a1-b65a-b38d444d85ed None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:01:11 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-cebd6a9d-3073-42a1-b65a-b38d444d85ed None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:01:11 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-cebd6a9d-3073-42a1-b65a-b38d444d85ed None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:01:11 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-cebd6a9d-3073-42a1-b65a-b38d444d85ed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:01:11 devstack sudo[92240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a Sep 07 10:01:11 devstack sudo[92240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:01:12 devstack sudo[92240]: pam_unix(sudo:session): session closed for user root Sep 07 10:01:12 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-cebd6a9d-3073-42a1-b65a-b38d444d85ed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a" returned: 0 in 0.746s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:01:12 devstack cinder-volume[87515]: DEBUG cinder.manager [None req-cebd6a9d-3073-42a1-b65a-b38d444d85ed None None] Notifying Schedulers of capabilities ... {{(pid=87515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:01:12 devstack cinder-volume[87515]: DEBUG oslo_service.periodic_task [None req-cebd6a9d-3073-42a1-b65a-b38d444d85ed None None] Running periodic task VolumeManager._thread_info {{(pid=87515) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 10:01:12 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-cebd6a9d-3073-42a1-b65a-b38d444d85ed None None] thread count: 28 {{(pid=87515) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 07 10:01:12 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-cebd6a9d-3073-42a1-b65a-b38d444d85ed None None] thread info: [<_MainThread(MainThread, started 131647121809536)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87515) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 07 10:01:14 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [req-fc61c05b-9cb8-4e93-bd7f-fdd95a6fbb74 req-ffc52716-298d-4b0c-b62c-9effa03fac23 tempest-TaggedAttachmentsTest-262548527 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:01:14 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [req-fc61c05b-9cb8-4e93-bd7f-fdd95a6fbb74 req-ffc52716-298d-4b0c-b62c-9effa03fac23 tempest-TaggedAttachmentsTest-262548527 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:01:14 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [req-fc61c05b-9cb8-4e93-bd7f-fdd95a6fbb74 req-ffc52716-298d-4b0c-b62c-9effa03fac23 tempest-TaggedAttachmentsTest-262548527 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.027s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:01:14 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [req-fc61c05b-9cb8-4e93-bd7f-fdd95a6fbb74 req-ffc52716-298d-4b0c-b62c-9effa03fac23 tempest-TaggedAttachmentsTest-262548527 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c', 'name': 'volume-7e146ba7-f52f-4ef5-b38f-8bf5a6375fe8', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3a9f00c6-9533-45fb-8e8d-75e43af342bb', 'enforce_multipath': True} {{(pid=87515) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 07 10:01:14 devstack cinder-volume[87515]: INFO cinder.volume.manager [req-fc61c05b-9cb8-4e93-bd7f-fdd95a6fbb74 req-ffc52716-298d-4b0c-b62c-9effa03fac23 tempest-TaggedAttachmentsTest-262548527 None] attachment_update completed successfully. Sep 07 10:01:19 devstack cinder-volume[87515]: INFO cinder.volume.manager [req-d1496e41-aa97-4baf-a331-f27bf11df48b req-aa25b0b0-27d3-4a63-aeb0-00cbea05c9d3 tempest-TaggedAttachmentsTest-262548527 None] Terminate volume connection completed successfully. Sep 07 10:01:19 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [req-d1496e41-aa97-4baf-a331-f27bf11df48b req-aa25b0b0-27d3-4a63-aeb0-00cbea05c9d3 tempest-TaggedAttachmentsTest-262548527 None] Deleting attachment 3a9f00c6-9533-45fb-8e8d-75e43af342bb. {{(pid=87515) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 07 10:01:24 devstack cinder-volume[87515]: DEBUG dbcounter [-] [87515] Writing DB stats cinder:SELECT=7,cinder:UPDATE=2 {{(pid=87515) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 10:01:29 devstack cinder-volume[87515]: DEBUG dbcounter [-] [87515] Writing DB stats cinder:SELECT=10,cinder:UPDATE=1 {{(pid=87515) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 10:01:31 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-262b5ed2-e6c6-4c84-9b16-b976161940cf tempest-TaggedAttachmentsTest-262548527 None] Acquiring lock "cinder-7e146ba7-f52f-4ef5-b38f-8bf5a6375fe8-delete_volume" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:01:31 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-262b5ed2-e6c6-4c84-9b16-b976161940cf tempest-TaggedAttachmentsTest-262548527 None] Lock "cinder-7e146ba7-f52f-4ef5-b38f-8bf5a6375fe8-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:01:31 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-262b5ed2-e6c6-4c84-9b16-b976161940cf tempest-TaggedAttachmentsTest-262548527 None] Acquiring lock "cinder-quobyte-7e146ba7-f52f-4ef5-b38f-8bf5a6375fe8" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:01:31 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-262b5ed2-e6c6-4c84-9b16-b976161940cf tempest-TaggedAttachmentsTest-262548527 None] Lock "cinder-quobyte-7e146ba7-f52f-4ef5-b38f-8bf5a6375fe8" acquired by "delete_volume" :: waited 0.025s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:01:31 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b0e58f6-14d2-464f-a6d4-875decb94d2a]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:01:31 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-262b5ed2-e6c6-4c84-9b16-b976161940cf tempest-TaggedAttachmentsTest-262548527 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-7e146ba7-f52f-4ef5-b38f-8bf5a6375fe8 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:01:31 devstack sudo[92532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-7e146ba7-f52f-4ef5-b38f-8bf5a6375fe8 Sep 07 10:01:31 devstack sudo[92532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:01:31 devstack sudo[92532]: pam_unix(sudo:session): session closed for user root Sep 07 10:01:31 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-262b5ed2-e6c6-4c84-9b16-b976161940cf tempest-TaggedAttachmentsTest-262548527 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-7e146ba7-f52f-4ef5-b38f-8bf5a6375fe8" returned: 0 in 0.488s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:01:31 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-262b5ed2-e6c6-4c84-9b16-b976161940cf tempest-TaggedAttachmentsTest-262548527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-7e146ba7-f52f-4ef5-b38f-8bf5a6375fe8 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:01:31 devstack sudo[92538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-7e146ba7-f52f-4ef5-b38f-8bf5a6375fe8 Sep 07 10:01:31 devstack sudo[92538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:01:32 devstack sudo[92538]: pam_unix(sudo:session): session closed for user root Sep 07 10:01:32 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-262b5ed2-e6c6-4c84-9b16-b976161940cf tempest-TaggedAttachmentsTest-262548527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-7e146ba7-f52f-4ef5-b38f-8bf5a6375fe8" returned: 0 in 0.336s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:01:32 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-262b5ed2-e6c6-4c84-9b16-b976161940cf tempest-TaggedAttachmentsTest-262548527 None] Lock "cinder-quobyte-7e146ba7-f52f-4ef5-b38f-8bf5a6375fe8" released by "delete_volume" :: held 0.893s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:01:32 devstack cinder-volume[87515]: DEBUG cinder.quota [None req-262b5ed2-e6c6-4c84-9b16-b976161940cf tempest-TaggedAttachmentsTest-262548527 None] Created reservations ['ee2a1b19-c074-467a-b11a-ae48326333f2', '50d05943-e2c7-4b34-84a2-ea791b92199b', '9c1e7ef3-b79c-4fc2-ada6-bbecc4a38a6f', '5d9e779c-93d2-4e45-a3b3-a25477220a5e'] {{(pid=87515) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:01:32 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-262b5ed2-e6c6-4c84-9b16-b976161940cf tempest-TaggedAttachmentsTest-262548527 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:01:32 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-262b5ed2-e6c6-4c84-9b16-b976161940cf tempest-TaggedAttachmentsTest-262548527 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:01:32 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-262b5ed2-e6c6-4c84-9b16-b976161940cf tempest-TaggedAttachmentsTest-262548527 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:01:32 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-262b5ed2-e6c6-4c84-9b16-b976161940cf tempest-TaggedAttachmentsTest-262548527 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:01:32 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-262b5ed2-e6c6-4c84-9b16-b976161940cf tempest-TaggedAttachmentsTest-262548527 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:01:32 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-262b5ed2-e6c6-4c84-9b16-b976161940cf tempest-TaggedAttachmentsTest-262548527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:01:32 devstack sudo[92553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a Sep 07 10:01:32 devstack sudo[92553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:01:32 devstack sudo[92553]: pam_unix(sudo:session): session closed for user root Sep 07 10:01:32 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-262b5ed2-e6c6-4c84-9b16-b976161940cf tempest-TaggedAttachmentsTest-262548527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a" returned: 0 in 0.360s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:01:32 devstack cinder-volume[87515]: DEBUG cinder.manager [None req-262b5ed2-e6c6-4c84-9b16-b976161940cf tempest-TaggedAttachmentsTest-262548527 None] Notifying Schedulers of capabilities ... {{(pid=87515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:01:32 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-262b5ed2-e6c6-4c84-9b16-b976161940cf tempest-TaggedAttachmentsTest-262548527 None] Deleted volume successfully. Sep 07 10:01:32 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-262b5ed2-e6c6-4c84-9b16-b976161940cf tempest-TaggedAttachmentsTest-262548527 None] Lock "cinder-7e146ba7-f52f-4ef5-b38f-8bf5a6375fe8-delete_volume" released by "delete_volume" :: held 1.689s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:01:39 devstack cinder-volume[87515]: INFO cinder.volume.manager [req-a22e804b-6f00-4d22-b11a-581bc57e1074 req-703f6434-7268-4643-919c-3e3e907412e6 tempest-ServerActionsTestOtherA-1577109295 None] Terminate volume connection completed successfully. Sep 07 10:01:39 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [req-a22e804b-6f00-4d22-b11a-581bc57e1074 req-703f6434-7268-4643-919c-3e3e907412e6 tempest-ServerActionsTestOtherA-1577109295 None] Deleting attachment a7b61538-d772-462a-919b-36834a507cc6. {{(pid=87515) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 07 10:01:40 devstack cinder-volume[87515]: DEBUG cinder.coordination [req-a22e804b-6f00-4d22-b11a-581bc57e1074 req-d6fcf1dd-ad53-4539-979f-46dc3cb19a39 tempest-ServerActionsTestOtherA-1577109295 None] Acquiring lock "cinder-a4bf0a9c-41d0-42cc-a3bf-c195d11e69fe-delete_volume" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:01:40 devstack cinder-volume[87515]: DEBUG cinder.coordination [req-a22e804b-6f00-4d22-b11a-581bc57e1074 req-d6fcf1dd-ad53-4539-979f-46dc3cb19a39 tempest-ServerActionsTestOtherA-1577109295 None] Lock "cinder-a4bf0a9c-41d0-42cc-a3bf-c195d11e69fe-delete_volume" acquired by "delete_volume" :: waited 0.060s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:01:40 devstack cinder-volume[87515]: DEBUG cinder.coordination [req-a22e804b-6f00-4d22-b11a-581bc57e1074 req-d6fcf1dd-ad53-4539-979f-46dc3cb19a39 tempest-ServerActionsTestOtherA-1577109295 None] Acquiring lock "cinder-quobyte-a4bf0a9c-41d0-42cc-a3bf-c195d11e69fe" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:01:40 devstack cinder-volume[87515]: DEBUG cinder.coordination [req-a22e804b-6f00-4d22-b11a-581bc57e1074 req-d6fcf1dd-ad53-4539-979f-46dc3cb19a39 tempest-ServerActionsTestOtherA-1577109295 None] Lock "cinder-quobyte-a4bf0a9c-41d0-42cc-a3bf-c195d11e69fe" acquired by "delete_volume" :: waited 0.039s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:01:40 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[c57775b8-673d-42d7-8e5f-d6b5a66727cf]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:01:40 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [req-a22e804b-6f00-4d22-b11a-581bc57e1074 req-d6fcf1dd-ad53-4539-979f-46dc3cb19a39 tempest-ServerActionsTestOtherA-1577109295 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-a4bf0a9c-41d0-42cc-a3bf-c195d11e69fe {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:01:40 devstack sudo[92671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-a4bf0a9c-41d0-42cc-a3bf-c195d11e69fe Sep 07 10:01:40 devstack sudo[92671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:01:41 devstack sudo[92671]: pam_unix(sudo:session): session closed for user root Sep 07 10:01:41 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [req-a22e804b-6f00-4d22-b11a-581bc57e1074 req-d6fcf1dd-ad53-4539-979f-46dc3cb19a39 tempest-ServerActionsTestOtherA-1577109295 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-a4bf0a9c-41d0-42cc-a3bf-c195d11e69fe" returned: 0 in 0.836s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:01:41 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [req-a22e804b-6f00-4d22-b11a-581bc57e1074 req-d6fcf1dd-ad53-4539-979f-46dc3cb19a39 tempest-ServerActionsTestOtherA-1577109295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-a4bf0a9c-41d0-42cc-a3bf-c195d11e69fe {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:01:41 devstack sudo[92679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-a4bf0a9c-41d0-42cc-a3bf-c195d11e69fe Sep 07 10:01:41 devstack sudo[92679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:01:41 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-c7f9f1e5-8b81-44b7-814b-3e69e0d846fb tempest-ServerActionsTestOtherA-1577109295 None] Acquiring lock "cinder-15e4fccc-b0e8-488e-8c3e-d0261bf8472c-delete_volume" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:01:41 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-c7f9f1e5-8b81-44b7-814b-3e69e0d846fb tempest-ServerActionsTestOtherA-1577109295 None] Lock "cinder-15e4fccc-b0e8-488e-8c3e-d0261bf8472c-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:01:41 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-c7f9f1e5-8b81-44b7-814b-3e69e0d846fb tempest-ServerActionsTestOtherA-1577109295 None] Acquiring lock "cinder-quobyte-15e4fccc-b0e8-488e-8c3e-d0261bf8472c" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:01:41 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-c7f9f1e5-8b81-44b7-814b-3e69e0d846fb tempest-ServerActionsTestOtherA-1577109295 None] Lock "cinder-quobyte-15e4fccc-b0e8-488e-8c3e-d0261bf8472c" acquired by "delete_volume" :: waited 0.037s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:01:41 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[142a2c72-5830-4e96-be84-2766d60b0f52]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:01:41 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-c7f9f1e5-8b81-44b7-814b-3e69e0d846fb tempest-ServerActionsTestOtherA-1577109295 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-15e4fccc-b0e8-488e-8c3e-d0261bf8472c {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:01:41 devstack sudo[92679]: pam_unix(sudo:session): session closed for user root Sep 07 10:01:41 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [req-a22e804b-6f00-4d22-b11a-581bc57e1074 req-d6fcf1dd-ad53-4539-979f-46dc3cb19a39 tempest-ServerActionsTestOtherA-1577109295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-a4bf0a9c-41d0-42cc-a3bf-c195d11e69fe" returned: 0 in 0.469s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:01:41 devstack cinder-volume[87515]: DEBUG cinder.coordination [req-a22e804b-6f00-4d22-b11a-581bc57e1074 req-d6fcf1dd-ad53-4539-979f-46dc3cb19a39 tempest-ServerActionsTestOtherA-1577109295 None] Lock "cinder-quobyte-a4bf0a9c-41d0-42cc-a3bf-c195d11e69fe" released by "delete_volume" :: held 1.484s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:01:41 devstack sudo[92682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-15e4fccc-b0e8-488e-8c3e-d0261bf8472c Sep 07 10:01:41 devstack sudo[92682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:01:41 devstack cinder-volume[87515]: DEBUG cinder.quota [req-a22e804b-6f00-4d22-b11a-581bc57e1074 req-d6fcf1dd-ad53-4539-979f-46dc3cb19a39 tempest-ServerActionsTestOtherA-1577109295 None] Created reservations ['b5f4a83e-bbe1-4f40-876b-e884b06c75ab', '5846852a-53af-401f-b87c-5e375b5d8527', '45e8595a-1bfa-4f42-befd-829991b8996d', '6b22b927-e42e-4661-b205-04c2a1d38ab3'] {{(pid=87515) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:01:42 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [req-a22e804b-6f00-4d22-b11a-581bc57e1074 req-d6fcf1dd-ad53-4539-979f-46dc3cb19a39 tempest-ServerActionsTestOtherA-1577109295 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:01:42 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [req-a22e804b-6f00-4d22-b11a-581bc57e1074 req-d6fcf1dd-ad53-4539-979f-46dc3cb19a39 tempest-ServerActionsTestOtherA-1577109295 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:01:42 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [req-a22e804b-6f00-4d22-b11a-581bc57e1074 req-d6fcf1dd-ad53-4539-979f-46dc3cb19a39 tempest-ServerActionsTestOtherA-1577109295 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:01:42 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [req-a22e804b-6f00-4d22-b11a-581bc57e1074 req-d6fcf1dd-ad53-4539-979f-46dc3cb19a39 tempest-ServerActionsTestOtherA-1577109295 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:01:42 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [req-a22e804b-6f00-4d22-b11a-581bc57e1074 req-d6fcf1dd-ad53-4539-979f-46dc3cb19a39 tempest-ServerActionsTestOtherA-1577109295 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:01:42 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [req-a22e804b-6f00-4d22-b11a-581bc57e1074 req-d6fcf1dd-ad53-4539-979f-46dc3cb19a39 tempest-ServerActionsTestOtherA-1577109295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:01:42 devstack sudo[92684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a Sep 07 10:01:42 devstack sudo[92684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:01:42 devstack sudo[92682]: pam_unix(sudo:session): session closed for user root Sep 07 10:01:42 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-c7f9f1e5-8b81-44b7-814b-3e69e0d846fb tempest-ServerActionsTestOtherA-1577109295 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-15e4fccc-b0e8-488e-8c3e-d0261bf8472c" returned: 0 in 0.752s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:01:42 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-c7f9f1e5-8b81-44b7-814b-3e69e0d846fb tempest-ServerActionsTestOtherA-1577109295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-15e4fccc-b0e8-488e-8c3e-d0261bf8472c {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:01:42 devstack sudo[92691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-15e4fccc-b0e8-488e-8c3e-d0261bf8472c Sep 07 10:01:42 devstack sudo[92691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:01:42 devstack sudo[92684]: pam_unix(sudo:session): session closed for user root Sep 07 10:01:42 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [req-a22e804b-6f00-4d22-b11a-581bc57e1074 req-d6fcf1dd-ad53-4539-979f-46dc3cb19a39 tempest-ServerActionsTestOtherA-1577109295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a" returned: 0 in 0.668s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:01:42 devstack cinder-volume[87515]: DEBUG cinder.manager [req-a22e804b-6f00-4d22-b11a-581bc57e1074 req-d6fcf1dd-ad53-4539-979f-46dc3cb19a39 tempest-ServerActionsTestOtherA-1577109295 None] Notifying Schedulers of capabilities ... {{(pid=87515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:01:42 devstack cinder-volume[87515]: INFO cinder.volume.manager [req-a22e804b-6f00-4d22-b11a-581bc57e1074 req-d6fcf1dd-ad53-4539-979f-46dc3cb19a39 tempest-ServerActionsTestOtherA-1577109295 None] Deleted volume successfully. Sep 07 10:01:42 devstack cinder-volume[87515]: DEBUG cinder.coordination [req-a22e804b-6f00-4d22-b11a-581bc57e1074 req-d6fcf1dd-ad53-4539-979f-46dc3cb19a39 tempest-ServerActionsTestOtherA-1577109295 None] Lock "cinder-a4bf0a9c-41d0-42cc-a3bf-c195d11e69fe-delete_volume" released by "delete_volume" :: held 2.603s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:01:42 devstack sudo[92691]: pam_unix(sudo:session): session closed for user root Sep 07 10:01:42 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-c7f9f1e5-8b81-44b7-814b-3e69e0d846fb tempest-ServerActionsTestOtherA-1577109295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-15e4fccc-b0e8-488e-8c3e-d0261bf8472c" returned: 0 in 0.435s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:01:42 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-c7f9f1e5-8b81-44b7-814b-3e69e0d846fb tempest-ServerActionsTestOtherA-1577109295 None] Lock "cinder-quobyte-15e4fccc-b0e8-488e-8c3e-d0261bf8472c" released by "delete_volume" :: held 1.248s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:01:43 devstack cinder-volume[87515]: DEBUG cinder.quota [None req-c7f9f1e5-8b81-44b7-814b-3e69e0d846fb tempest-ServerActionsTestOtherA-1577109295 None] Created reservations ['10fa02c2-aceb-4690-9c62-87a32084a563', '67cc8c57-2f71-4ade-9fc8-841a77640f23', '9f5dda39-d34e-4d12-9dd8-fb4198c0b772', 'c9a191d0-f136-4484-b7a6-7c785759b0e5'] {{(pid=87515) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:01:43 devstack cinder-volume[87515]: DEBUG cinder.volume.flows.manager.create_volume [None req-186247c6-db26-49ae-85aa-a722bece4747 tempest-VolumesActionsTest-400496551 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 10:01:43 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-186247c6-db26-49ae-85aa-a722bece4747 tempest-VolumesActionsTest-400496551 None] Flow 'volume_create_manager' (7e71d826-fac3-43b4-afa0-55924c848fea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:01:43 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-186247c6-db26-49ae-85aa-a722bece4747 tempest-VolumesActionsTest-400496551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b576383-5bd5-497e-a636-aa43e5684cb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:01:43 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-186247c6-db26-49ae-85aa-a722bece4747 tempest-VolumesActionsTest-400496551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b576383-5bd5-497e-a636-aa43e5684cb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:01:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-403013466',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=104feccf-aba9-48ea-b0e9-5fb677075dda,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f74cc96e30f349ebaf0b71d69e3b3086',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:01:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:01:43Z,use_quota=True,user_id='ab9545ec0ce2496d990686f23c82184f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3a092cd-7947-4cbf-abff-4ba9567becf0),volume_type_id=f3a092cd-7947-4cbf-abff-4ba9567becf0)' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:01:43 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-186247c6-db26-49ae-85aa-a722bece4747 tempest-VolumesActionsTest-400496551 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1151ccb1-5954-471f-a3cc-664d66b7b624) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:01:43 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-186247c6-db26-49ae-85aa-a722bece4747 tempest-VolumesActionsTest-400496551 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1151ccb1-5954-471f-a3cc-664d66b7b624) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:01:43 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-186247c6-db26-49ae-85aa-a722bece4747 tempest-VolumesActionsTest-400496551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd5af5f6-3970-4c27-832f-881bf2cae370) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:01:43 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-186247c6-db26-49ae-85aa-a722bece4747 tempest-VolumesActionsTest-400496551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd5af5f6-3970-4c27-832f-881bf2cae370) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '104feccf-aba9-48ea-b0e9-5fb677075dda', 'volume_name': 'volume-104feccf-aba9-48ea-b0e9-5fb677075dda', 'volume_size': 1}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:01:43 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-186247c6-db26-49ae-85aa-a722bece4747 tempest-VolumesActionsTest-400496551 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (549820b8-4a0e-41aa-be56-8aaaec8fae47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:01:43 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-186247c6-db26-49ae-85aa-a722bece4747 tempest-VolumesActionsTest-400496551 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (549820b8-4a0e-41aa-be56-8aaaec8fae47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:01:43 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-186247c6-db26-49ae-85aa-a722bece4747 tempest-VolumesActionsTest-400496551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dda97dfa-a839-45a5-b82b-1db13fd3dadb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:01:43 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-186247c6-db26-49ae-85aa-a722bece4747 tempest-VolumesActionsTest-400496551 None] Volume 104feccf-aba9-48ea-b0e9-5fb677075dda: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-104feccf-aba9-48ea-b0e9-5fb677075dda', 'volume_size': 1} Sep 07 10:01:43 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-186247c6-db26-49ae-85aa-a722bece4747 tempest-VolumesActionsTest-400496551 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:01:43 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-186247c6-db26-49ae-85aa-a722bece4747 tempest-VolumesActionsTest-400496551 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:01:43 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-186247c6-db26-49ae-85aa-a722bece4747 tempest-VolumesActionsTest-400496551 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:01:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-403013466',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=104feccf-aba9-48ea-b0e9-5fb677075dda,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f74cc96e30f349ebaf0b71d69e3b3086',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:01:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:01:43Z,use_quota=True,user_id='ab9545ec0ce2496d990686f23c82184f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3a092cd-7947-4cbf-abff-4ba9567becf0),volume_type_id=f3a092cd-7947-4cbf-abff-4ba9567becf0)}" {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 10:01:43 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-186247c6-db26-49ae-85aa-a722bece4747 tempest-VolumesActionsTest-400496551 None] Creating volume 104feccf-aba9-48ea-b0e9-5fb677075dda {{(pid=87515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 10:01:43 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-186247c6-db26-49ae-85aa-a722bece4747 tempest-VolumesActionsTest-400496551 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:01:43 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-186247c6-db26-49ae-85aa-a722bece4747 tempest-VolumesActionsTest-400496551 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:01:43 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-186247c6-db26-49ae-85aa-a722bece4747 tempest-VolumesActionsTest-400496551 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:01:43 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-186247c6-db26-49ae-85aa-a722bece4747 tempest-VolumesActionsTest-400496551 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:01:43 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-186247c6-db26-49ae-85aa-a722bece4747 tempest-VolumesActionsTest-400496551 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:01:43 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-186247c6-db26-49ae-85aa-a722bece4747 tempest-VolumesActionsTest-400496551 None] Selected osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c as target Quobyte volume. {{(pid=87515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 10:01:43 devstack cinder-volume[87515]: INFO cinder.volume.drivers.remotefs [None req-186247c6-db26-49ae-85aa-a722bece4747 tempest-VolumesActionsTest-400496551 None] casted to osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c Sep 07 10:01:43 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-186247c6-db26-49ae-85aa-a722bece4747 tempest-VolumesActionsTest-400496551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-104feccf-aba9-48ea-b0e9-5fb677075dda 1073741824 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:01:43 devstack sudo[92694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-104feccf-aba9-48ea-b0e9-5fb677075dda 1073741824 Sep 07 10:01:43 devstack sudo[92694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:01:43 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-c7f9f1e5-8b81-44b7-814b-3e69e0d846fb tempest-ServerActionsTestOtherA-1577109295 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:01:43 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-c7f9f1e5-8b81-44b7-814b-3e69e0d846fb tempest-ServerActionsTestOtherA-1577109295 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:01:43 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-c7f9f1e5-8b81-44b7-814b-3e69e0d846fb tempest-ServerActionsTestOtherA-1577109295 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:01:43 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-c7f9f1e5-8b81-44b7-814b-3e69e0d846fb tempest-ServerActionsTestOtherA-1577109295 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:01:43 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-c7f9f1e5-8b81-44b7-814b-3e69e0d846fb tempest-ServerActionsTestOtherA-1577109295 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:01:43 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-c7f9f1e5-8b81-44b7-814b-3e69e0d846fb tempest-ServerActionsTestOtherA-1577109295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:01:43 devstack sudo[92696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a Sep 07 10:01:43 devstack sudo[92696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:01:43 devstack sudo[92696]: pam_unix(sudo:session): session closed for user root Sep 07 10:01:43 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-c7f9f1e5-8b81-44b7-814b-3e69e0d846fb tempest-ServerActionsTestOtherA-1577109295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a" returned: 0 in 0.341s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:01:43 devstack cinder-volume[87515]: DEBUG cinder.manager [None req-c7f9f1e5-8b81-44b7-814b-3e69e0d846fb tempest-ServerActionsTestOtherA-1577109295 None] Notifying Schedulers of capabilities ... {{(pid=87515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:01:43 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-c7f9f1e5-8b81-44b7-814b-3e69e0d846fb tempest-ServerActionsTestOtherA-1577109295 None] Deleted volume successfully. Sep 07 10:01:43 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-c7f9f1e5-8b81-44b7-814b-3e69e0d846fb tempest-ServerActionsTestOtherA-1577109295 None] Lock "cinder-15e4fccc-b0e8-488e-8c3e-d0261bf8472c-delete_volume" released by "delete_volume" :: held 2.041s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:01:43 devstack sudo[92694]: pam_unix(sudo:session): session closed for user root Sep 07 10:01:43 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-186247c6-db26-49ae-85aa-a722bece4747 tempest-VolumesActionsTest-400496551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-104feccf-aba9-48ea-b0e9-5fb677075dda 1073741824" returned: 0 in 0.607s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:01:43 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-186247c6-db26-49ae-85aa-a722bece4747 tempest-VolumesActionsTest-400496551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-104feccf-aba9-48ea-b0e9-5fb677075dda {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:01:43 devstack sudo[92703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-104feccf-aba9-48ea-b0e9-5fb677075dda Sep 07 10:01:43 devstack sudo[92703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:01:44 devstack sudo[92703]: pam_unix(sudo:session): session closed for user root Sep 07 10:01:44 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-186247c6-db26-49ae-85aa-a722bece4747 tempest-VolumesActionsTest-400496551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-104feccf-aba9-48ea-b0e9-5fb677075dda" returned: 0 in 0.426s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:01:44 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-186247c6-db26-49ae-85aa-a722bece4747 tempest-VolumesActionsTest-400496551 None] <== create_volume: return (1081ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'} {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 10:01:44 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-186247c6-db26-49ae-85aa-a722bece4747 tempest-VolumesActionsTest-400496551 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.088s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:01:44 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-186247c6-db26-49ae-85aa-a722bece4747 tempest-VolumesActionsTest-400496551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dda97dfa-a839-45a5-b82b-1db13fd3dadb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-104feccf-aba9-48ea-b0e9-5fb677075dda', 'volume_size': 1}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:01:44 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-186247c6-db26-49ae-85aa-a722bece4747 tempest-VolumesActionsTest-400496551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8bc9ed56-00fd-4180-8180-0787591ef7d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:01:44 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-186247c6-db26-49ae-85aa-a722bece4747 tempest-VolumesActionsTest-400496551 None] Volume volume-104feccf-aba9-48ea-b0e9-5fb677075dda (104feccf-aba9-48ea-b0e9-5fb677075dda): created successfully Sep 07 10:01:44 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-186247c6-db26-49ae-85aa-a722bece4747 tempest-VolumesActionsTest-400496551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8bc9ed56-00fd-4180-8180-0787591ef7d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:01:44 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-186247c6-db26-49ae-85aa-a722bece4747 tempest-VolumesActionsTest-400496551 None] Flow 'volume_create_manager' (7e71d826-fac3-43b4-afa0-55924c848fea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:01:44 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-186247c6-db26-49ae-85aa-a722bece4747 tempest-VolumesActionsTest-400496551 None] Created volume successfully. Sep 07 10:01:45 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-5f2468e4-6a78-4754-8a0f-7adda54e7f9b tempest-VolumesActionsTest-400496551 None] Acquiring lock "cinder-104feccf-aba9-48ea-b0e9-5fb677075dda" by "attach_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:01:45 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-5f2468e4-6a78-4754-8a0f-7adda54e7f9b tempest-VolumesActionsTest-400496551 None] Lock "cinder-104feccf-aba9-48ea-b0e9-5fb677075dda" acquired by "attach_volume" :: waited 0.029s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:01:45 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-5f2468e4-6a78-4754-8a0f-7adda54e7f9b tempest-VolumesActionsTest-400496551 None] Attaching volume 104feccf-aba9-48ea-b0e9-5fb677075dda to instance f5c2ee5e-a9f8-44a5-bc81-6260213e2506 at mountpoint /dev/vdb on host None. Sep 07 10:01:45 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-5f2468e4-6a78-4754-8a0f-7adda54e7f9b tempest-VolumesActionsTest-400496551 None] Attach volume completed successfully. Sep 07 10:01:45 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-5f2468e4-6a78-4754-8a0f-7adda54e7f9b tempest-VolumesActionsTest-400496551 None] Lock "cinder-104feccf-aba9-48ea-b0e9-5fb677075dda" released by "attach_volume" :: held 0.155s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:01:46 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-9a8e34a4-2bd9-46a9-a7cb-69bb7680598b tempest-VolumesActionsTest-1226146345 None] Terminate volume connection completed successfully. Sep 07 10:01:46 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-9a8e34a4-2bd9-46a9-a7cb-69bb7680598b tempest-VolumesActionsTest-1226146345 None] Acquiring lock "cinder-104feccf-aba9-48ea-b0e9-5fb677075dda-detach_volume" by "detach_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:01:46 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-9a8e34a4-2bd9-46a9-a7cb-69bb7680598b tempest-VolumesActionsTest-1226146345 None] Lock "cinder-104feccf-aba9-48ea-b0e9-5fb677075dda-detach_volume" acquired by "detach_volume" :: waited 0.090s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:01:46 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-9a8e34a4-2bd9-46a9-a7cb-69bb7680598b tempest-VolumesActionsTest-1226146345 None] Detaching volume 104feccf-aba9-48ea-b0e9-5fb677075dda from instance f5c2ee5e-a9f8-44a5-bc81-6260213e2506. Sep 07 10:01:46 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-9a8e34a4-2bd9-46a9-a7cb-69bb7680598b tempest-VolumesActionsTest-1226146345 None] Detach volume completed successfully. Sep 07 10:01:46 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-9a8e34a4-2bd9-46a9-a7cb-69bb7680598b tempest-VolumesActionsTest-1226146345 None] Lock "cinder-104feccf-aba9-48ea-b0e9-5fb677075dda-detach_volume" released by "detach_volume" :: held 0.095s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:01:47 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-c0cb0e70-c493-4a45-93c4-2f9c41094ef0 tempest-VolumesActionsTest-400496551 None] Acquiring lock "cinder-104feccf-aba9-48ea-b0e9-5fb677075dda-detach_volume" by "detach_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:01:47 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-c0cb0e70-c493-4a45-93c4-2f9c41094ef0 tempest-VolumesActionsTest-400496551 None] Lock "cinder-104feccf-aba9-48ea-b0e9-5fb677075dda-detach_volume" acquired by "detach_volume" :: waited 0.034s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:01:47 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-c0cb0e70-c493-4a45-93c4-2f9c41094ef0 tempest-VolumesActionsTest-400496551 None] Volume detach called, but volume not attached. Sep 07 10:01:47 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-c0cb0e70-c493-4a45-93c4-2f9c41094ef0 tempest-VolumesActionsTest-400496551 None] Lock "cinder-104feccf-aba9-48ea-b0e9-5fb677075dda-detach_volume" released by "detach_volume" :: held 0.041s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:01:47 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-39a36b09-ce11-4f0e-965a-242df7932e19 tempest-VolumesActionsTest-400496551 None] Acquiring lock "cinder-104feccf-aba9-48ea-b0e9-5fb677075dda-delete_volume" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:01:47 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-39a36b09-ce11-4f0e-965a-242df7932e19 tempest-VolumesActionsTest-400496551 None] Lock "cinder-104feccf-aba9-48ea-b0e9-5fb677075dda-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:01:47 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-39a36b09-ce11-4f0e-965a-242df7932e19 tempest-VolumesActionsTest-400496551 None] Acquiring lock "cinder-quobyte-104feccf-aba9-48ea-b0e9-5fb677075dda" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:01:47 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-39a36b09-ce11-4f0e-965a-242df7932e19 tempest-VolumesActionsTest-400496551 None] Lock "cinder-quobyte-104feccf-aba9-48ea-b0e9-5fb677075dda" acquired by "delete_volume" :: waited 0.024s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:01:47 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[5017219b-1b5b-44d5-b796-f37e99da0281]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:01:47 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-39a36b09-ce11-4f0e-965a-242df7932e19 tempest-VolumesActionsTest-400496551 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-104feccf-aba9-48ea-b0e9-5fb677075dda {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:01:47 devstack sudo[92733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-104feccf-aba9-48ea-b0e9-5fb677075dda Sep 07 10:01:47 devstack sudo[92733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:01:48 devstack sudo[92733]: pam_unix(sudo:session): session closed for user root Sep 07 10:01:48 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-39a36b09-ce11-4f0e-965a-242df7932e19 tempest-VolumesActionsTest-400496551 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-104feccf-aba9-48ea-b0e9-5fb677075dda" returned: 0 in 0.507s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:01:48 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-39a36b09-ce11-4f0e-965a-242df7932e19 tempest-VolumesActionsTest-400496551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-104feccf-aba9-48ea-b0e9-5fb677075dda {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:01:48 devstack sudo[92738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-104feccf-aba9-48ea-b0e9-5fb677075dda Sep 07 10:01:48 devstack sudo[92738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:01:48 devstack sudo[92738]: pam_unix(sudo:session): session closed for user root Sep 07 10:01:48 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-39a36b09-ce11-4f0e-965a-242df7932e19 tempest-VolumesActionsTest-400496551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-104feccf-aba9-48ea-b0e9-5fb677075dda" returned: 0 in 0.688s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:01:48 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-39a36b09-ce11-4f0e-965a-242df7932e19 tempest-VolumesActionsTest-400496551 None] Lock "cinder-quobyte-104feccf-aba9-48ea-b0e9-5fb677075dda" released by "delete_volume" :: held 1.265s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:01:48 devstack cinder-volume[87515]: DEBUG cinder.quota [None req-39a36b09-ce11-4f0e-965a-242df7932e19 tempest-VolumesActionsTest-400496551 None] Created reservations ['b8535ea8-c743-475c-9a03-fa1b589af8c9', '7cb552bc-dc01-4277-864f-b7b89f369793', 'eaf73688-8f36-4be6-8d11-07f44755d15b', '514a9320-80d9-4c5a-aa2c-f75fce6b8dba'] {{(pid=87515) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:01:49 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-39a36b09-ce11-4f0e-965a-242df7932e19 tempest-VolumesActionsTest-400496551 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:01:49 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-39a36b09-ce11-4f0e-965a-242df7932e19 tempest-VolumesActionsTest-400496551 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:01:49 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-39a36b09-ce11-4f0e-965a-242df7932e19 tempest-VolumesActionsTest-400496551 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:01:49 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-39a36b09-ce11-4f0e-965a-242df7932e19 tempest-VolumesActionsTest-400496551 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:01:49 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-39a36b09-ce11-4f0e-965a-242df7932e19 tempest-VolumesActionsTest-400496551 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:01:49 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-39a36b09-ce11-4f0e-965a-242df7932e19 tempest-VolumesActionsTest-400496551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:01:49 devstack sudo[92743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a Sep 07 10:01:49 devstack sudo[92743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:01:49 devstack sudo[92743]: pam_unix(sudo:session): session closed for user root Sep 07 10:01:49 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-39a36b09-ce11-4f0e-965a-242df7932e19 tempest-VolumesActionsTest-400496551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a" returned: 0 in 0.507s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:01:49 devstack cinder-volume[87515]: DEBUG cinder.manager [None req-39a36b09-ce11-4f0e-965a-242df7932e19 tempest-VolumesActionsTest-400496551 None] Notifying Schedulers of capabilities ... {{(pid=87515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:01:49 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-39a36b09-ce11-4f0e-965a-242df7932e19 tempest-VolumesActionsTest-400496551 None] Deleted volume successfully. Sep 07 10:01:49 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-39a36b09-ce11-4f0e-965a-242df7932e19 tempest-VolumesActionsTest-400496551 None] Lock "cinder-104feccf-aba9-48ea-b0e9-5fb677075dda-delete_volume" released by "delete_volume" :: held 2.250s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:01:54 devstack cinder-volume[87515]: DEBUG cinder.volume.flows.manager.create_volume [None req-d7c4cff0-1db4-4a84-a5ad-fa5bc7788933 tempest-VolumesActionsTest-400496551 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 10:01:54 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-d7c4cff0-1db4-4a84-a5ad-fa5bc7788933 tempest-VolumesActionsTest-400496551 None] Flow 'volume_create_manager' (3fd72d4f-5a3d-4c96-86f5-b5c30c70cbcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:01:54 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-d7c4cff0-1db4-4a84-a5ad-fa5bc7788933 tempest-VolumesActionsTest-400496551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1fad95cc-f23c-4f9a-8a3a-e71e57bc122f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:01:54 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-d7c4cff0-1db4-4a84-a5ad-fa5bc7788933 tempest-VolumesActionsTest-400496551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1fad95cc-f23c-4f9a-8a3a-e71e57bc122f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:01:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-531590528',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4b6a4ee-08c0-438f-a861-45aad45741d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f74cc96e30f349ebaf0b71d69e3b3086',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:01:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:01:54Z,use_quota=True,user_id='ab9545ec0ce2496d990686f23c82184f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3a092cd-7947-4cbf-abff-4ba9567becf0),volume_type_id=f3a092cd-7947-4cbf-abff-4ba9567becf0)' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:01:54 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-d7c4cff0-1db4-4a84-a5ad-fa5bc7788933 tempest-VolumesActionsTest-400496551 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd4ec042-5f99-458b-9a1f-c376fcc5320c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:01:54 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-d7c4cff0-1db4-4a84-a5ad-fa5bc7788933 tempest-VolumesActionsTest-400496551 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd4ec042-5f99-458b-9a1f-c376fcc5320c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:01:54 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-d7c4cff0-1db4-4a84-a5ad-fa5bc7788933 tempest-VolumesActionsTest-400496551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b00d4896-2354-47a4-a3d5-c024db41964b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:01:54 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-d7c4cff0-1db4-4a84-a5ad-fa5bc7788933 tempest-VolumesActionsTest-400496551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b00d4896-2354-47a4-a3d5-c024db41964b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a4b6a4ee-08c0-438f-a861-45aad45741d3', 'volume_name': 'volume-a4b6a4ee-08c0-438f-a861-45aad45741d3', 'volume_size': 1}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:01:54 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-d7c4cff0-1db4-4a84-a5ad-fa5bc7788933 tempest-VolumesActionsTest-400496551 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5b2d643-4a86-4e0b-b1f6-d6f0cd1e19e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:01:54 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-d7c4cff0-1db4-4a84-a5ad-fa5bc7788933 tempest-VolumesActionsTest-400496551 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5b2d643-4a86-4e0b-b1f6-d6f0cd1e19e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:01:54 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-d7c4cff0-1db4-4a84-a5ad-fa5bc7788933 tempest-VolumesActionsTest-400496551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5bc0046e-df5b-4d67-b403-1c1e97d4e093) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:01:54 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-d7c4cff0-1db4-4a84-a5ad-fa5bc7788933 tempest-VolumesActionsTest-400496551 None] Volume a4b6a4ee-08c0-438f-a861-45aad45741d3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a4b6a4ee-08c0-438f-a861-45aad45741d3', 'volume_size': 1} Sep 07 10:01:54 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-d7c4cff0-1db4-4a84-a5ad-fa5bc7788933 tempest-VolumesActionsTest-400496551 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:01:54 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-d7c4cff0-1db4-4a84-a5ad-fa5bc7788933 tempest-VolumesActionsTest-400496551 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:01:54 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-d7c4cff0-1db4-4a84-a5ad-fa5bc7788933 tempest-VolumesActionsTest-400496551 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:01:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-531590528',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4b6a4ee-08c0-438f-a861-45aad45741d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f74cc96e30f349ebaf0b71d69e3b3086',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:01:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:01:54Z,use_quota=True,user_id='ab9545ec0ce2496d990686f23c82184f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3a092cd-7947-4cbf-abff-4ba9567becf0),volume_type_id=f3a092cd-7947-4cbf-abff-4ba9567becf0)}" {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 10:01:54 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-d7c4cff0-1db4-4a84-a5ad-fa5bc7788933 tempest-VolumesActionsTest-400496551 None] Creating volume a4b6a4ee-08c0-438f-a861-45aad45741d3 {{(pid=87515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 10:01:54 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-d7c4cff0-1db4-4a84-a5ad-fa5bc7788933 tempest-VolumesActionsTest-400496551 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:01:54 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-d7c4cff0-1db4-4a84-a5ad-fa5bc7788933 tempest-VolumesActionsTest-400496551 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:01:54 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-d7c4cff0-1db4-4a84-a5ad-fa5bc7788933 tempest-VolumesActionsTest-400496551 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:01:54 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-d7c4cff0-1db4-4a84-a5ad-fa5bc7788933 tempest-VolumesActionsTest-400496551 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:01:54 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-d7c4cff0-1db4-4a84-a5ad-fa5bc7788933 tempest-VolumesActionsTest-400496551 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:01:54 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-d7c4cff0-1db4-4a84-a5ad-fa5bc7788933 tempest-VolumesActionsTest-400496551 None] Selected osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c as target Quobyte volume. {{(pid=87515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 10:01:54 devstack cinder-volume[87515]: INFO cinder.volume.drivers.remotefs [None req-d7c4cff0-1db4-4a84-a5ad-fa5bc7788933 tempest-VolumesActionsTest-400496551 None] casted to osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c Sep 07 10:01:54 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-d7c4cff0-1db4-4a84-a5ad-fa5bc7788933 tempest-VolumesActionsTest-400496551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-a4b6a4ee-08c0-438f-a861-45aad45741d3 1073741824 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:01:54 devstack sudo[92809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-a4b6a4ee-08c0-438f-a861-45aad45741d3 1073741824 Sep 07 10:01:54 devstack sudo[92809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:01:55 devstack sudo[92809]: pam_unix(sudo:session): session closed for user root Sep 07 10:01:55 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-d7c4cff0-1db4-4a84-a5ad-fa5bc7788933 tempest-VolumesActionsTest-400496551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-a4b6a4ee-08c0-438f-a861-45aad45741d3 1073741824" returned: 0 in 0.547s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:01:55 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-d7c4cff0-1db4-4a84-a5ad-fa5bc7788933 tempest-VolumesActionsTest-400496551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-a4b6a4ee-08c0-438f-a861-45aad45741d3 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:01:55 devstack sudo[92815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-a4b6a4ee-08c0-438f-a861-45aad45741d3 Sep 07 10:01:55 devstack sudo[92815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:01:55 devstack sudo[92815]: pam_unix(sudo:session): session closed for user root Sep 07 10:01:55 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-d7c4cff0-1db4-4a84-a5ad-fa5bc7788933 tempest-VolumesActionsTest-400496551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-a4b6a4ee-08c0-438f-a861-45aad45741d3" returned: 0 in 0.284s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:01:55 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-d7c4cff0-1db4-4a84-a5ad-fa5bc7788933 tempest-VolumesActionsTest-400496551 None] <== create_volume: return (894ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'} {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 10:01:55 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-d7c4cff0-1db4-4a84-a5ad-fa5bc7788933 tempest-VolumesActionsTest-400496551 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.898s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:01:55 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-d7c4cff0-1db4-4a84-a5ad-fa5bc7788933 tempest-VolumesActionsTest-400496551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5bc0046e-df5b-4d67-b403-1c1e97d4e093) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a4b6a4ee-08c0-438f-a861-45aad45741d3', 'volume_size': 1}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:01:55 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-d7c4cff0-1db4-4a84-a5ad-fa5bc7788933 tempest-VolumesActionsTest-400496551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6af68e8a-aeab-4973-b8ac-f9d1682c027b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:01:55 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-d7c4cff0-1db4-4a84-a5ad-fa5bc7788933 tempest-VolumesActionsTest-400496551 None] Volume volume-a4b6a4ee-08c0-438f-a861-45aad45741d3 (a4b6a4ee-08c0-438f-a861-45aad45741d3): created successfully Sep 07 10:01:55 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-d7c4cff0-1db4-4a84-a5ad-fa5bc7788933 tempest-VolumesActionsTest-400496551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6af68e8a-aeab-4973-b8ac-f9d1682c027b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:01:55 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-d7c4cff0-1db4-4a84-a5ad-fa5bc7788933 tempest-VolumesActionsTest-400496551 None] Flow 'volume_create_manager' (3fd72d4f-5a3d-4c96-86f5-b5c30c70cbcd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:01:55 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-d7c4cff0-1db4-4a84-a5ad-fa5bc7788933 tempest-VolumesActionsTest-400496551 None] Created volume successfully. Sep 07 10:01:56 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-f9d71636-63e8-4452-827b-aaf88e8aafa1 tempest-VolumesActionsTest-1226146345 None] Acquiring lock "cinder-a4b6a4ee-08c0-438f-a861-45aad45741d3-delete_volume" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:01:56 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-f9d71636-63e8-4452-827b-aaf88e8aafa1 tempest-VolumesActionsTest-1226146345 None] Lock "cinder-a4b6a4ee-08c0-438f-a861-45aad45741d3-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:01:56 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-f9d71636-63e8-4452-827b-aaf88e8aafa1 tempest-VolumesActionsTest-1226146345 None] Acquiring lock "cinder-quobyte-a4b6a4ee-08c0-438f-a861-45aad45741d3" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:01:56 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-f9d71636-63e8-4452-827b-aaf88e8aafa1 tempest-VolumesActionsTest-1226146345 None] Lock "cinder-quobyte-a4b6a4ee-08c0-438f-a861-45aad45741d3" acquired by "delete_volume" :: waited 0.029s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:01:56 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[16770389-ea64-45ff-9eea-1a5b018265da]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:01:56 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-f9d71636-63e8-4452-827b-aaf88e8aafa1 tempest-VolumesActionsTest-1226146345 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-a4b6a4ee-08c0-438f-a861-45aad45741d3 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:01:57 devstack sudo[92819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-a4b6a4ee-08c0-438f-a861-45aad45741d3 Sep 07 10:01:57 devstack sudo[92819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:01:57 devstack sudo[92819]: pam_unix(sudo:session): session closed for user root Sep 07 10:01:57 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-f9d71636-63e8-4452-827b-aaf88e8aafa1 tempest-VolumesActionsTest-1226146345 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-a4b6a4ee-08c0-438f-a861-45aad45741d3" returned: 0 in 0.495s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:01:57 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-f9d71636-63e8-4452-827b-aaf88e8aafa1 tempest-VolumesActionsTest-1226146345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-a4b6a4ee-08c0-438f-a861-45aad45741d3 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:01:57 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-f405c468-525c-4f52-9134-9aa301f23b07 tempest-AttachVolumeShelveTestJSON-1028195278 None] Acquiring lock "cinder-449975e4-7227-42c2-a75f-38c5e63462fc-delete_volume" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:01:57 devstack sudo[92826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-a4b6a4ee-08c0-438f-a861-45aad45741d3 Sep 07 10:01:57 devstack sudo[92826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:01:57 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-f405c468-525c-4f52-9134-9aa301f23b07 tempest-AttachVolumeShelveTestJSON-1028195278 None] Lock "cinder-449975e4-7227-42c2-a75f-38c5e63462fc-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:01:57 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-f405c468-525c-4f52-9134-9aa301f23b07 tempest-AttachVolumeShelveTestJSON-1028195278 None] Acquiring lock "cinder-quobyte-449975e4-7227-42c2-a75f-38c5e63462fc" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:01:57 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-f405c468-525c-4f52-9134-9aa301f23b07 tempest-AttachVolumeShelveTestJSON-1028195278 None] Lock "cinder-quobyte-449975e4-7227-42c2-a75f-38c5e63462fc" acquired by "delete_volume" :: waited 0.024s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:01:57 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[21c3e8c4-c545-4b79-bea9-d01f8d45e22f]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:01:57 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-f405c468-525c-4f52-9134-9aa301f23b07 tempest-AttachVolumeShelveTestJSON-1028195278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-449975e4-7227-42c2-a75f-38c5e63462fc {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:01:57 devstack sudo[92828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-449975e4-7227-42c2-a75f-38c5e63462fc Sep 07 10:01:57 devstack sudo[92828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:01:57 devstack sudo[92826]: pam_unix(sudo:session): session closed for user root Sep 07 10:01:57 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-f9d71636-63e8-4452-827b-aaf88e8aafa1 tempest-VolumesActionsTest-1226146345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-a4b6a4ee-08c0-438f-a861-45aad45741d3" returned: 0 in 0.399s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:01:57 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-f9d71636-63e8-4452-827b-aaf88e8aafa1 tempest-VolumesActionsTest-1226146345 None] Lock "cinder-quobyte-a4b6a4ee-08c0-438f-a861-45aad45741d3" released by "delete_volume" :: held 0.957s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:01:57 devstack cinder-volume[87515]: DEBUG cinder.quota [None req-f9d71636-63e8-4452-827b-aaf88e8aafa1 tempest-VolumesActionsTest-1226146345 None] Created reservations ['069969d9-3a6e-4044-b4ab-548fabf53c0c', '8cb2a9c1-c92d-48e8-9efe-1538cd61d6cc', '01aaf5bd-38d3-40f1-ad8e-55635607683c', '0337930a-a235-4c8a-a11f-2531f5971f47'] {{(pid=87515) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:01:58 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-f9d71636-63e8-4452-827b-aaf88e8aafa1 tempest-VolumesActionsTest-1226146345 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:01:58 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-f9d71636-63e8-4452-827b-aaf88e8aafa1 tempest-VolumesActionsTest-1226146345 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:01:58 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-f9d71636-63e8-4452-827b-aaf88e8aafa1 tempest-VolumesActionsTest-1226146345 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:01:58 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-f9d71636-63e8-4452-827b-aaf88e8aafa1 tempest-VolumesActionsTest-1226146345 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:01:58 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-f9d71636-63e8-4452-827b-aaf88e8aafa1 tempest-VolumesActionsTest-1226146345 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:01:58 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-f9d71636-63e8-4452-827b-aaf88e8aafa1 tempest-VolumesActionsTest-1226146345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:01:58 devstack sudo[92835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a Sep 07 10:01:58 devstack sudo[92835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:01:58 devstack sudo[92828]: pam_unix(sudo:session): session closed for user root Sep 07 10:01:58 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-f405c468-525c-4f52-9134-9aa301f23b07 tempest-AttachVolumeShelveTestJSON-1028195278 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-449975e4-7227-42c2-a75f-38c5e63462fc" returned: 0 in 0.431s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:01:58 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-f405c468-525c-4f52-9134-9aa301f23b07 tempest-AttachVolumeShelveTestJSON-1028195278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-449975e4-7227-42c2-a75f-38c5e63462fc {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:01:58 devstack sudo[92837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-449975e4-7227-42c2-a75f-38c5e63462fc Sep 07 10:01:58 devstack sudo[92837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:01:58 devstack sudo[92835]: pam_unix(sudo:session): session closed for user root Sep 07 10:01:58 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-f9d71636-63e8-4452-827b-aaf88e8aafa1 tempest-VolumesActionsTest-1226146345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a" returned: 0 in 0.414s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:01:58 devstack cinder-volume[87515]: DEBUG cinder.manager [None req-f9d71636-63e8-4452-827b-aaf88e8aafa1 tempest-VolumesActionsTest-1226146345 None] Notifying Schedulers of capabilities ... {{(pid=87515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:01:58 devstack sudo[92837]: pam_unix(sudo:session): session closed for user root Sep 07 10:01:58 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-f9d71636-63e8-4452-827b-aaf88e8aafa1 tempest-VolumesActionsTest-1226146345 None] Deleted volume successfully. Sep 07 10:01:58 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-f405c468-525c-4f52-9134-9aa301f23b07 tempest-AttachVolumeShelveTestJSON-1028195278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-449975e4-7227-42c2-a75f-38c5e63462fc" returned: 0 in 0.393s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:01:58 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-f405c468-525c-4f52-9134-9aa301f23b07 tempest-AttachVolumeShelveTestJSON-1028195278 None] Lock "cinder-quobyte-449975e4-7227-42c2-a75f-38c5e63462fc" released by "delete_volume" :: held 0.915s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:01:58 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-f9d71636-63e8-4452-827b-aaf88e8aafa1 tempest-VolumesActionsTest-1226146345 None] Lock "cinder-a4b6a4ee-08c0-438f-a861-45aad45741d3-delete_volume" released by "delete_volume" :: held 1.699s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:01:58 devstack cinder-volume[87515]: DEBUG cinder.quota [None req-f405c468-525c-4f52-9134-9aa301f23b07 tempest-AttachVolumeShelveTestJSON-1028195278 None] Created reservations ['665d0221-a797-4dba-bffa-c2fc13e4c8a5', 'cdc30412-9849-442b-8730-e93065376223', '6d19b317-dd12-4089-ac2f-d5f628a16e23', 'de822b47-870f-4564-9df7-b8d0f1cd2263'] {{(pid=87515) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:01:58 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-f405c468-525c-4f52-9134-9aa301f23b07 tempest-AttachVolumeShelveTestJSON-1028195278 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:01:58 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-f405c468-525c-4f52-9134-9aa301f23b07 tempest-AttachVolumeShelveTestJSON-1028195278 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:01:58 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-f405c468-525c-4f52-9134-9aa301f23b07 tempest-AttachVolumeShelveTestJSON-1028195278 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:01:58 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-f405c468-525c-4f52-9134-9aa301f23b07 tempest-AttachVolumeShelveTestJSON-1028195278 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:01:58 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-f405c468-525c-4f52-9134-9aa301f23b07 tempest-AttachVolumeShelveTestJSON-1028195278 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:01:58 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-f405c468-525c-4f52-9134-9aa301f23b07 tempest-AttachVolumeShelveTestJSON-1028195278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:01:58 devstack sudo[92842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a Sep 07 10:01:58 devstack sudo[92842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:01:59 devstack sudo[92842]: pam_unix(sudo:session): session closed for user root Sep 07 10:01:59 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-f405c468-525c-4f52-9134-9aa301f23b07 tempest-AttachVolumeShelveTestJSON-1028195278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a" returned: 0 in 0.343s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:01:59 devstack cinder-volume[87515]: DEBUG cinder.manager [None req-f405c468-525c-4f52-9134-9aa301f23b07 tempest-AttachVolumeShelveTestJSON-1028195278 None] Notifying Schedulers of capabilities ... {{(pid=87515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:01:59 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-f405c468-525c-4f52-9134-9aa301f23b07 tempest-AttachVolumeShelveTestJSON-1028195278 None] Deleted volume successfully. Sep 07 10:01:59 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-f405c468-525c-4f52-9134-9aa301f23b07 tempest-AttachVolumeShelveTestJSON-1028195278 None] Lock "cinder-449975e4-7227-42c2-a75f-38c5e63462fc-delete_volume" released by "delete_volume" :: held 1.578s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:01:59 devstack cinder-volume[87515]: DEBUG cinder.volume.flows.manager.create_volume [None req-90750acd-d80c-4779-87ff-ee7d50711ccd tempest-VolumesActionsTest-400496551 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 10:01:59 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-90750acd-d80c-4779-87ff-ee7d50711ccd tempest-VolumesActionsTest-400496551 None] Flow 'volume_create_manager' (415d0cf3-8023-44d3-8f7d-3b4735524e8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:01:59 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-90750acd-d80c-4779-87ff-ee7d50711ccd tempest-VolumesActionsTest-400496551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4f78541-d0e3-4e58-a808-3936c60741c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:01:59 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-90750acd-d80c-4779-87ff-ee7d50711ccd tempest-VolumesActionsTest-400496551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4f78541-d0e3-4e58-a808-3936c60741c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:01:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-6510067',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c383e0e4-3d69-4cc9-bcbf-478fe1b17725,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f74cc96e30f349ebaf0b71d69e3b3086',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:02:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:02:00Z,use_quota=True,user_id='ab9545ec0ce2496d990686f23c82184f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3a092cd-7947-4cbf-abff-4ba9567becf0),volume_type_id=f3a092cd-7947-4cbf-abff-4ba9567becf0)' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:01:59 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-90750acd-d80c-4779-87ff-ee7d50711ccd tempest-VolumesActionsTest-400496551 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a715bd6d-87db-411d-bf13-2ebeb0a2f3cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:01:59 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-90750acd-d80c-4779-87ff-ee7d50711ccd tempest-VolumesActionsTest-400496551 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a715bd6d-87db-411d-bf13-2ebeb0a2f3cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:01:59 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-90750acd-d80c-4779-87ff-ee7d50711ccd tempest-VolumesActionsTest-400496551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b804353-0b6b-41b1-9bae-816c8623e253) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:01:59 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-90750acd-d80c-4779-87ff-ee7d50711ccd tempest-VolumesActionsTest-400496551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b804353-0b6b-41b1-9bae-816c8623e253) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c383e0e4-3d69-4cc9-bcbf-478fe1b17725', 'volume_name': 'volume-c383e0e4-3d69-4cc9-bcbf-478fe1b17725', 'volume_size': 1}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:01:59 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-90750acd-d80c-4779-87ff-ee7d50711ccd tempest-VolumesActionsTest-400496551 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd5427db-3396-4175-8464-58eaf29f15cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:01:59 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-90750acd-d80c-4779-87ff-ee7d50711ccd tempest-VolumesActionsTest-400496551 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd5427db-3396-4175-8464-58eaf29f15cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:01:59 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-90750acd-d80c-4779-87ff-ee7d50711ccd tempest-VolumesActionsTest-400496551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e0aecfc-af87-4715-9a33-14302662702e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:01:59 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-90750acd-d80c-4779-87ff-ee7d50711ccd tempest-VolumesActionsTest-400496551 None] Volume c383e0e4-3d69-4cc9-bcbf-478fe1b17725: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c383e0e4-3d69-4cc9-bcbf-478fe1b17725', 'volume_size': 1} Sep 07 10:01:59 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-90750acd-d80c-4779-87ff-ee7d50711ccd tempest-VolumesActionsTest-400496551 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:01:59 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-90750acd-d80c-4779-87ff-ee7d50711ccd tempest-VolumesActionsTest-400496551 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:01:59 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-90750acd-d80c-4779-87ff-ee7d50711ccd tempest-VolumesActionsTest-400496551 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:01:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-6510067',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c383e0e4-3d69-4cc9-bcbf-478fe1b17725,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f74cc96e30f349ebaf0b71d69e3b3086',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:02:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:02:00Z,use_quota=True,user_id='ab9545ec0ce2496d990686f23c82184f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3a092cd-7947-4cbf-abff-4ba9567becf0),volume_type_id=f3a092cd-7947-4cbf-abff-4ba9567becf0)}" {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 10:01:59 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-90750acd-d80c-4779-87ff-ee7d50711ccd tempest-VolumesActionsTest-400496551 None] Creating volume c383e0e4-3d69-4cc9-bcbf-478fe1b17725 {{(pid=87515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 10:01:59 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-90750acd-d80c-4779-87ff-ee7d50711ccd tempest-VolumesActionsTest-400496551 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:01:59 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-90750acd-d80c-4779-87ff-ee7d50711ccd tempest-VolumesActionsTest-400496551 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:01:59 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-90750acd-d80c-4779-87ff-ee7d50711ccd tempest-VolumesActionsTest-400496551 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:01:59 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-90750acd-d80c-4779-87ff-ee7d50711ccd tempest-VolumesActionsTest-400496551 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:01:59 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-90750acd-d80c-4779-87ff-ee7d50711ccd tempest-VolumesActionsTest-400496551 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:01:59 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-90750acd-d80c-4779-87ff-ee7d50711ccd tempest-VolumesActionsTest-400496551 None] Selected osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c as target Quobyte volume. {{(pid=87515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 10:01:59 devstack cinder-volume[87515]: INFO cinder.volume.drivers.remotefs [None req-90750acd-d80c-4779-87ff-ee7d50711ccd tempest-VolumesActionsTest-400496551 None] casted to osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c Sep 07 10:01:59 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-90750acd-d80c-4779-87ff-ee7d50711ccd tempest-VolumesActionsTest-400496551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-c383e0e4-3d69-4cc9-bcbf-478fe1b17725 1073741824 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:01:59 devstack sudo[92845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-c383e0e4-3d69-4cc9-bcbf-478fe1b17725 1073741824 Sep 07 10:01:59 devstack sudo[92845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:02:00 devstack sudo[92845]: pam_unix(sudo:session): session closed for user root Sep 07 10:02:00 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-90750acd-d80c-4779-87ff-ee7d50711ccd tempest-VolumesActionsTest-400496551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-c383e0e4-3d69-4cc9-bcbf-478fe1b17725 1073741824" returned: 0 in 0.567s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:02:00 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-90750acd-d80c-4779-87ff-ee7d50711ccd tempest-VolumesActionsTest-400496551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-c383e0e4-3d69-4cc9-bcbf-478fe1b17725 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:02:00 devstack sudo[92850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-c383e0e4-3d69-4cc9-bcbf-478fe1b17725 Sep 07 10:02:00 devstack sudo[92850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:02:00 devstack sudo[92850]: pam_unix(sudo:session): session closed for user root Sep 07 10:02:00 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-90750acd-d80c-4779-87ff-ee7d50711ccd tempest-VolumesActionsTest-400496551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-c383e0e4-3d69-4cc9-bcbf-478fe1b17725" returned: 0 in 0.307s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:02:00 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-90750acd-d80c-4779-87ff-ee7d50711ccd tempest-VolumesActionsTest-400496551 None] <== create_volume: return (921ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'} {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 10:02:00 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-90750acd-d80c-4779-87ff-ee7d50711ccd tempest-VolumesActionsTest-400496551 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.925s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:02:00 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-90750acd-d80c-4779-87ff-ee7d50711ccd tempest-VolumesActionsTest-400496551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e0aecfc-af87-4715-9a33-14302662702e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c383e0e4-3d69-4cc9-bcbf-478fe1b17725', 'volume_size': 1}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:02:00 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-90750acd-d80c-4779-87ff-ee7d50711ccd tempest-VolumesActionsTest-400496551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16549df5-2ee4-461e-b620-7b4ea9960a26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:02:00 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-90750acd-d80c-4779-87ff-ee7d50711ccd tempest-VolumesActionsTest-400496551 None] Volume volume-c383e0e4-3d69-4cc9-bcbf-478fe1b17725 (c383e0e4-3d69-4cc9-bcbf-478fe1b17725): created successfully Sep 07 10:02:00 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-90750acd-d80c-4779-87ff-ee7d50711ccd tempest-VolumesActionsTest-400496551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16549df5-2ee4-461e-b620-7b4ea9960a26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:02:00 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-90750acd-d80c-4779-87ff-ee7d50711ccd tempest-VolumesActionsTest-400496551 None] Flow 'volume_create_manager' (415d0cf3-8023-44d3-8f7d-3b4735524e8d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:02:00 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-90750acd-d80c-4779-87ff-ee7d50711ccd tempest-VolumesActionsTest-400496551 None] Created volume successfully. Sep 07 10:02:02 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-4960b0ca-d43a-45f4-8db8-2bc35eff4ed2 tempest-VolumesActionsTest-1226146345 None] Acquiring lock "cinder-c383e0e4-3d69-4cc9-bcbf-478fe1b17725-delete_volume" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:02:02 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-4960b0ca-d43a-45f4-8db8-2bc35eff4ed2 tempest-VolumesActionsTest-1226146345 None] Lock "cinder-c383e0e4-3d69-4cc9-bcbf-478fe1b17725-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:02:02 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-4960b0ca-d43a-45f4-8db8-2bc35eff4ed2 tempest-VolumesActionsTest-1226146345 None] Acquiring lock "cinder-quobyte-c383e0e4-3d69-4cc9-bcbf-478fe1b17725" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:02:02 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-4960b0ca-d43a-45f4-8db8-2bc35eff4ed2 tempest-VolumesActionsTest-1226146345 None] Lock "cinder-quobyte-c383e0e4-3d69-4cc9-bcbf-478fe1b17725" acquired by "delete_volume" :: waited 0.025s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:02:02 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[95d851a2-e8db-4fb9-a1eb-848b7ed00056]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:02:02 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-4960b0ca-d43a-45f4-8db8-2bc35eff4ed2 tempest-VolumesActionsTest-1226146345 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-c383e0e4-3d69-4cc9-bcbf-478fe1b17725 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:02:02 devstack sudo[92854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-c383e0e4-3d69-4cc9-bcbf-478fe1b17725 Sep 07 10:02:02 devstack sudo[92854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:02:02 devstack sudo[92854]: pam_unix(sudo:session): session closed for user root Sep 07 10:02:02 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-4960b0ca-d43a-45f4-8db8-2bc35eff4ed2 tempest-VolumesActionsTest-1226146345 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-c383e0e4-3d69-4cc9-bcbf-478fe1b17725" returned: 0 in 0.415s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:02:02 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-4960b0ca-d43a-45f4-8db8-2bc35eff4ed2 tempest-VolumesActionsTest-1226146345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-c383e0e4-3d69-4cc9-bcbf-478fe1b17725 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:02:02 devstack sudo[92859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-c383e0e4-3d69-4cc9-bcbf-478fe1b17725 Sep 07 10:02:02 devstack sudo[92859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:02:02 devstack sudo[92859]: pam_unix(sudo:session): session closed for user root Sep 07 10:02:02 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-4960b0ca-d43a-45f4-8db8-2bc35eff4ed2 tempest-VolumesActionsTest-1226146345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-c383e0e4-3d69-4cc9-bcbf-478fe1b17725" returned: 0 in 0.262s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:02:02 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-4960b0ca-d43a-45f4-8db8-2bc35eff4ed2 tempest-VolumesActionsTest-1226146345 None] Lock "cinder-quobyte-c383e0e4-3d69-4cc9-bcbf-478fe1b17725" released by "delete_volume" :: held 0.728s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:02:03 devstack cinder-volume[87515]: DEBUG cinder.quota [None req-4960b0ca-d43a-45f4-8db8-2bc35eff4ed2 tempest-VolumesActionsTest-1226146345 None] Created reservations ['81b749b5-06cb-41cb-98e1-adb4d16999c3', '2941b44b-7f3d-4cde-934c-4f895b90ee6b', '84e99965-e922-4ece-9261-3f8aa743e488', 'cab8d250-bb5d-4626-8087-49ce6bcf4ecc'] {{(pid=87515) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:02:03 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-4960b0ca-d43a-45f4-8db8-2bc35eff4ed2 tempest-VolumesActionsTest-1226146345 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:02:03 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-4960b0ca-d43a-45f4-8db8-2bc35eff4ed2 tempest-VolumesActionsTest-1226146345 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:02:03 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-4960b0ca-d43a-45f4-8db8-2bc35eff4ed2 tempest-VolumesActionsTest-1226146345 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:02:03 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-4960b0ca-d43a-45f4-8db8-2bc35eff4ed2 tempest-VolumesActionsTest-1226146345 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:02:03 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-4960b0ca-d43a-45f4-8db8-2bc35eff4ed2 tempest-VolumesActionsTest-1226146345 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:02:03 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-4960b0ca-d43a-45f4-8db8-2bc35eff4ed2 tempest-VolumesActionsTest-1226146345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:02:03 devstack sudo[92862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a Sep 07 10:02:03 devstack sudo[92862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:02:03 devstack sudo[92862]: pam_unix(sudo:session): session closed for user root Sep 07 10:02:03 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-4960b0ca-d43a-45f4-8db8-2bc35eff4ed2 tempest-VolumesActionsTest-1226146345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a" returned: 0 in 0.317s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:02:03 devstack cinder-volume[87515]: DEBUG cinder.manager [None req-4960b0ca-d43a-45f4-8db8-2bc35eff4ed2 tempest-VolumesActionsTest-1226146345 None] Notifying Schedulers of capabilities ... {{(pid=87515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:02:03 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-4960b0ca-d43a-45f4-8db8-2bc35eff4ed2 tempest-VolumesActionsTest-1226146345 None] Deleted volume successfully. Sep 07 10:02:03 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-4960b0ca-d43a-45f4-8db8-2bc35eff4ed2 tempest-VolumesActionsTest-1226146345 None] Lock "cinder-c383e0e4-3d69-4cc9-bcbf-478fe1b17725-delete_volume" released by "delete_volume" :: held 1.313s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:02:04 devstack cinder-volume[87515]: DEBUG cinder.volume.flows.manager.create_volume [None req-4561c5ab-5a9f-4973-b9a2-68e2c756fefd tempest-VolumesActionsTest-400496551 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 10:02:04 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-4561c5ab-5a9f-4973-b9a2-68e2c756fefd tempest-VolumesActionsTest-400496551 None] Flow 'volume_create_manager' (620c8844-8ec5-44f2-b0bf-048141b05cdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:02:04 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-4561c5ab-5a9f-4973-b9a2-68e2c756fefd tempest-VolumesActionsTest-400496551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8439373-18df-442b-bc4a-4ca257ede806) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:02:04 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-4561c5ab-5a9f-4973-b9a2-68e2c756fefd tempest-VolumesActionsTest-400496551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8439373-18df-442b-bc4a-4ca257ede806) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:02:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1345125',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a81e4c0-5126-473f-84ca-631b9798e308,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f74cc96e30f349ebaf0b71d69e3b3086',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:02:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:02:04Z,use_quota=True,user_id='ab9545ec0ce2496d990686f23c82184f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3a092cd-7947-4cbf-abff-4ba9567becf0),volume_type_id=f3a092cd-7947-4cbf-abff-4ba9567becf0)' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:02:04 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-4561c5ab-5a9f-4973-b9a2-68e2c756fefd tempest-VolumesActionsTest-400496551 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f2dc33b-7792-4622-b911-76d94ae790fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:02:04 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-4561c5ab-5a9f-4973-b9a2-68e2c756fefd tempest-VolumesActionsTest-400496551 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f2dc33b-7792-4622-b911-76d94ae790fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:02:04 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-4561c5ab-5a9f-4973-b9a2-68e2c756fefd tempest-VolumesActionsTest-400496551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ec837f8-d250-45f6-a786-46069fdeb332) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:02:04 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-4561c5ab-5a9f-4973-b9a2-68e2c756fefd tempest-VolumesActionsTest-400496551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ec837f8-d250-45f6-a786-46069fdeb332) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5a81e4c0-5126-473f-84ca-631b9798e308', 'volume_name': 'volume-5a81e4c0-5126-473f-84ca-631b9798e308', 'volume_size': 1}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:02:04 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-4561c5ab-5a9f-4973-b9a2-68e2c756fefd tempest-VolumesActionsTest-400496551 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bbb22a07-4895-4f3a-af81-45dcc6b10bc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:02:04 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-4561c5ab-5a9f-4973-b9a2-68e2c756fefd tempest-VolumesActionsTest-400496551 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bbb22a07-4895-4f3a-af81-45dcc6b10bc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:02:04 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-4561c5ab-5a9f-4973-b9a2-68e2c756fefd tempest-VolumesActionsTest-400496551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81b4b90b-4efd-4fa8-934c-77cc01ea5c9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:02:04 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-4561c5ab-5a9f-4973-b9a2-68e2c756fefd tempest-VolumesActionsTest-400496551 None] Volume 5a81e4c0-5126-473f-84ca-631b9798e308: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5a81e4c0-5126-473f-84ca-631b9798e308', 'volume_size': 1} Sep 07 10:02:04 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-4561c5ab-5a9f-4973-b9a2-68e2c756fefd tempest-VolumesActionsTest-400496551 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:02:04 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-4561c5ab-5a9f-4973-b9a2-68e2c756fefd tempest-VolumesActionsTest-400496551 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:02:04 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-4561c5ab-5a9f-4973-b9a2-68e2c756fefd tempest-VolumesActionsTest-400496551 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:02:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1345125',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a81e4c0-5126-473f-84ca-631b9798e308,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f74cc96e30f349ebaf0b71d69e3b3086',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:02:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:02:04Z,use_quota=True,user_id='ab9545ec0ce2496d990686f23c82184f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3a092cd-7947-4cbf-abff-4ba9567becf0),volume_type_id=f3a092cd-7947-4cbf-abff-4ba9567becf0)}" {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 10:02:04 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-4561c5ab-5a9f-4973-b9a2-68e2c756fefd tempest-VolumesActionsTest-400496551 None] Creating volume 5a81e4c0-5126-473f-84ca-631b9798e308 {{(pid=87515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 10:02:04 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-4561c5ab-5a9f-4973-b9a2-68e2c756fefd tempest-VolumesActionsTest-400496551 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:02:04 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-4561c5ab-5a9f-4973-b9a2-68e2c756fefd tempest-VolumesActionsTest-400496551 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:02:04 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-4561c5ab-5a9f-4973-b9a2-68e2c756fefd tempest-VolumesActionsTest-400496551 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:02:04 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-4561c5ab-5a9f-4973-b9a2-68e2c756fefd tempest-VolumesActionsTest-400496551 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:02:04 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-4561c5ab-5a9f-4973-b9a2-68e2c756fefd tempest-VolumesActionsTest-400496551 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:02:04 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-4561c5ab-5a9f-4973-b9a2-68e2c756fefd tempest-VolumesActionsTest-400496551 None] Selected osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c as target Quobyte volume. {{(pid=87515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 10:02:04 devstack cinder-volume[87515]: INFO cinder.volume.drivers.remotefs [None req-4561c5ab-5a9f-4973-b9a2-68e2c756fefd tempest-VolumesActionsTest-400496551 None] casted to osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c Sep 07 10:02:04 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-4561c5ab-5a9f-4973-b9a2-68e2c756fefd tempest-VolumesActionsTest-400496551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-5a81e4c0-5126-473f-84ca-631b9798e308 1073741824 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:02:04 devstack sudo[92865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-5a81e4c0-5126-473f-84ca-631b9798e308 1073741824 Sep 07 10:02:04 devstack sudo[92865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:02:04 devstack sudo[92865]: pam_unix(sudo:session): session closed for user root Sep 07 10:02:04 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-4561c5ab-5a9f-4973-b9a2-68e2c756fefd tempest-VolumesActionsTest-400496551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-5a81e4c0-5126-473f-84ca-631b9798e308 1073741824" returned: 0 in 0.570s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:02:04 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-4561c5ab-5a9f-4973-b9a2-68e2c756fefd tempest-VolumesActionsTest-400496551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-5a81e4c0-5126-473f-84ca-631b9798e308 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:02:04 devstack sudo[92871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-5a81e4c0-5126-473f-84ca-631b9798e308 Sep 07 10:02:04 devstack sudo[92871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:02:05 devstack sudo[92871]: pam_unix(sudo:session): session closed for user root Sep 07 10:02:05 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-4561c5ab-5a9f-4973-b9a2-68e2c756fefd tempest-VolumesActionsTest-400496551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-5a81e4c0-5126-473f-84ca-631b9798e308" returned: 0 in 0.333s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:02:05 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-4561c5ab-5a9f-4973-b9a2-68e2c756fefd tempest-VolumesActionsTest-400496551 None] <== create_volume: return (949ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'} {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 10:02:05 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-4561c5ab-5a9f-4973-b9a2-68e2c756fefd tempest-VolumesActionsTest-400496551 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.952s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:02:05 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-4561c5ab-5a9f-4973-b9a2-68e2c756fefd tempest-VolumesActionsTest-400496551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81b4b90b-4efd-4fa8-934c-77cc01ea5c9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5a81e4c0-5126-473f-84ca-631b9798e308', 'volume_size': 1}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:02:05 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-4561c5ab-5a9f-4973-b9a2-68e2c756fefd tempest-VolumesActionsTest-400496551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43325035-960a-4d46-805b-1662094fc70e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:02:05 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-4561c5ab-5a9f-4973-b9a2-68e2c756fefd tempest-VolumesActionsTest-400496551 None] Volume volume-5a81e4c0-5126-473f-84ca-631b9798e308 (5a81e4c0-5126-473f-84ca-631b9798e308): created successfully Sep 07 10:02:05 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-4561c5ab-5a9f-4973-b9a2-68e2c756fefd tempest-VolumesActionsTest-400496551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43325035-960a-4d46-805b-1662094fc70e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:02:05 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-4561c5ab-5a9f-4973-b9a2-68e2c756fefd tempest-VolumesActionsTest-400496551 None] Flow 'volume_create_manager' (620c8844-8ec5-44f2-b0bf-048141b05cdb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:02:05 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-4561c5ab-5a9f-4973-b9a2-68e2c756fefd tempest-VolumesActionsTest-400496551 None] Created volume successfully. Sep 07 10:02:06 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-41b6e7bf-4aa6-4f80-91d9-3a8637d82162 tempest-VolumesActionsTest-1226146345 None] Acquiring lock "cinder-5a81e4c0-5126-473f-84ca-631b9798e308-delete_volume" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:02:06 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-41b6e7bf-4aa6-4f80-91d9-3a8637d82162 tempest-VolumesActionsTest-1226146345 None] Lock "cinder-5a81e4c0-5126-473f-84ca-631b9798e308-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:02:06 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-41b6e7bf-4aa6-4f80-91d9-3a8637d82162 tempest-VolumesActionsTest-1226146345 None] Acquiring lock "cinder-quobyte-5a81e4c0-5126-473f-84ca-631b9798e308" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:02:06 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-41b6e7bf-4aa6-4f80-91d9-3a8637d82162 tempest-VolumesActionsTest-1226146345 None] Lock "cinder-quobyte-5a81e4c0-5126-473f-84ca-631b9798e308" acquired by "delete_volume" :: waited 0.022s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:02:06 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[409e239c-b715-4824-a6c9-d2fff67d350d]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:02:06 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-41b6e7bf-4aa6-4f80-91d9-3a8637d82162 tempest-VolumesActionsTest-1226146345 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-5a81e4c0-5126-473f-84ca-631b9798e308 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:02:06 devstack sudo[92875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-5a81e4c0-5126-473f-84ca-631b9798e308 Sep 07 10:02:06 devstack sudo[92875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:02:06 devstack sudo[92875]: pam_unix(sudo:session): session closed for user root Sep 07 10:02:06 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-41b6e7bf-4aa6-4f80-91d9-3a8637d82162 tempest-VolumesActionsTest-1226146345 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-5a81e4c0-5126-473f-84ca-631b9798e308" returned: 0 in 0.469s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:02:06 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-41b6e7bf-4aa6-4f80-91d9-3a8637d82162 tempest-VolumesActionsTest-1226146345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-5a81e4c0-5126-473f-84ca-631b9798e308 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:02:06 devstack sudo[92882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-5a81e4c0-5126-473f-84ca-631b9798e308 Sep 07 10:02:06 devstack sudo[92882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:02:07 devstack sudo[92882]: pam_unix(sudo:session): session closed for user root Sep 07 10:02:07 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-41b6e7bf-4aa6-4f80-91d9-3a8637d82162 tempest-VolumesActionsTest-1226146345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-5a81e4c0-5126-473f-84ca-631b9798e308" returned: 0 in 0.333s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:02:07 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-41b6e7bf-4aa6-4f80-91d9-3a8637d82162 tempest-VolumesActionsTest-1226146345 None] Lock "cinder-quobyte-5a81e4c0-5126-473f-84ca-631b9798e308" released by "delete_volume" :: held 0.862s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:02:07 devstack cinder-volume[87515]: DEBUG cinder.quota [None req-41b6e7bf-4aa6-4f80-91d9-3a8637d82162 tempest-VolumesActionsTest-1226146345 None] Created reservations ['be9aba01-639e-4841-8d56-fc0bb392d936', 'deae9d13-2011-43a0-bf68-d7dc5589318a', '8f23b97f-a433-432c-98cf-da9e0e9f8ab2', 'ac0dfbc5-af60-4348-89f5-22e6cda5e3bd'] {{(pid=87515) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:02:07 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-41b6e7bf-4aa6-4f80-91d9-3a8637d82162 tempest-VolumesActionsTest-1226146345 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:02:07 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-41b6e7bf-4aa6-4f80-91d9-3a8637d82162 tempest-VolumesActionsTest-1226146345 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:02:07 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-41b6e7bf-4aa6-4f80-91d9-3a8637d82162 tempest-VolumesActionsTest-1226146345 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:02:07 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-41b6e7bf-4aa6-4f80-91d9-3a8637d82162 tempest-VolumesActionsTest-1226146345 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:02:07 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-41b6e7bf-4aa6-4f80-91d9-3a8637d82162 tempest-VolumesActionsTest-1226146345 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:02:07 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-41b6e7bf-4aa6-4f80-91d9-3a8637d82162 tempest-VolumesActionsTest-1226146345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:02:07 devstack sudo[92885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a Sep 07 10:02:07 devstack sudo[92885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:02:07 devstack sudo[92885]: pam_unix(sudo:session): session closed for user root Sep 07 10:02:07 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-41b6e7bf-4aa6-4f80-91d9-3a8637d82162 tempest-VolumesActionsTest-1226146345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a" returned: 0 in 0.303s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:02:07 devstack cinder-volume[87515]: DEBUG cinder.manager [None req-41b6e7bf-4aa6-4f80-91d9-3a8637d82162 tempest-VolumesActionsTest-1226146345 None] Notifying Schedulers of capabilities ... {{(pid=87515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:02:07 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-41b6e7bf-4aa6-4f80-91d9-3a8637d82162 tempest-VolumesActionsTest-1226146345 None] Deleted volume successfully. Sep 07 10:02:07 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-41b6e7bf-4aa6-4f80-91d9-3a8637d82162 tempest-VolumesActionsTest-1226146345 None] Lock "cinder-5a81e4c0-5126-473f-84ca-631b9798e308-delete_volume" released by "delete_volume" :: held 1.530s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:02:08 devstack cinder-volume[87515]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad6aa4c3-ab07-4412-bfd2-629a926ff649 tempest-VolumesActionsTest-400496551 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 10:02:08 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-ad6aa4c3-ab07-4412-bfd2-629a926ff649 tempest-VolumesActionsTest-400496551 None] Flow 'volume_create_manager' (14bd8878-8730-4157-ad99-2de51b5d2b9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:02:08 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-ad6aa4c3-ab07-4412-bfd2-629a926ff649 tempest-VolumesActionsTest-400496551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1b4129f-1f56-4303-b6c7-7051edf7ab4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:02:08 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-ad6aa4c3-ab07-4412-bfd2-629a926ff649 tempest-VolumesActionsTest-400496551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1b4129f-1f56-4303-b6c7-7051edf7ab4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:02:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-907552058',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9323dcc1-d5f9-43c2-baac-839385a67004,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f74cc96e30f349ebaf0b71d69e3b3086',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:02:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:02:08Z,use_quota=True,user_id='ab9545ec0ce2496d990686f23c82184f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3a092cd-7947-4cbf-abff-4ba9567becf0),volume_type_id=f3a092cd-7947-4cbf-abff-4ba9567becf0)' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:02:08 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-ad6aa4c3-ab07-4412-bfd2-629a926ff649 tempest-VolumesActionsTest-400496551 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6247cce-f1ce-4ae6-abfb-e86ffee8e2ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:02:08 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-ad6aa4c3-ab07-4412-bfd2-629a926ff649 tempest-VolumesActionsTest-400496551 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6247cce-f1ce-4ae6-abfb-e86ffee8e2ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:02:08 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-ad6aa4c3-ab07-4412-bfd2-629a926ff649 tempest-VolumesActionsTest-400496551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f8507db-17a4-4dd8-809f-30d23ad03848) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:02:08 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-ad6aa4c3-ab07-4412-bfd2-629a926ff649 tempest-VolumesActionsTest-400496551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f8507db-17a4-4dd8-809f-30d23ad03848) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9323dcc1-d5f9-43c2-baac-839385a67004', 'volume_name': 'volume-9323dcc1-d5f9-43c2-baac-839385a67004', 'volume_size': 1}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:02:08 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-ad6aa4c3-ab07-4412-bfd2-629a926ff649 tempest-VolumesActionsTest-400496551 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d6f7789-a189-472e-ac74-d2271494baab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:02:08 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-ad6aa4c3-ab07-4412-bfd2-629a926ff649 tempest-VolumesActionsTest-400496551 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d6f7789-a189-472e-ac74-d2271494baab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:02:08 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-ad6aa4c3-ab07-4412-bfd2-629a926ff649 tempest-VolumesActionsTest-400496551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bcac662e-29f8-4389-8a32-4522fcc20e16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:02:08 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-ad6aa4c3-ab07-4412-bfd2-629a926ff649 tempest-VolumesActionsTest-400496551 None] Volume 9323dcc1-d5f9-43c2-baac-839385a67004: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9323dcc1-d5f9-43c2-baac-839385a67004', 'volume_size': 1} Sep 07 10:02:08 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-ad6aa4c3-ab07-4412-bfd2-629a926ff649 tempest-VolumesActionsTest-400496551 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:02:08 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-ad6aa4c3-ab07-4412-bfd2-629a926ff649 tempest-VolumesActionsTest-400496551 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:02:08 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-ad6aa4c3-ab07-4412-bfd2-629a926ff649 tempest-VolumesActionsTest-400496551 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:02:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-907552058',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9323dcc1-d5f9-43c2-baac-839385a67004,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f74cc96e30f349ebaf0b71d69e3b3086',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:02:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:02:08Z,use_quota=True,user_id='ab9545ec0ce2496d990686f23c82184f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3a092cd-7947-4cbf-abff-4ba9567becf0),volume_type_id=f3a092cd-7947-4cbf-abff-4ba9567becf0)}" {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 10:02:08 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-ad6aa4c3-ab07-4412-bfd2-629a926ff649 tempest-VolumesActionsTest-400496551 None] Creating volume 9323dcc1-d5f9-43c2-baac-839385a67004 {{(pid=87515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 10:02:08 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-ad6aa4c3-ab07-4412-bfd2-629a926ff649 tempest-VolumesActionsTest-400496551 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:02:08 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-ad6aa4c3-ab07-4412-bfd2-629a926ff649 tempest-VolumesActionsTest-400496551 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:02:08 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-ad6aa4c3-ab07-4412-bfd2-629a926ff649 tempest-VolumesActionsTest-400496551 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:02:08 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-ad6aa4c3-ab07-4412-bfd2-629a926ff649 tempest-VolumesActionsTest-400496551 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:02:08 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-ad6aa4c3-ab07-4412-bfd2-629a926ff649 tempest-VolumesActionsTest-400496551 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:02:08 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-ad6aa4c3-ab07-4412-bfd2-629a926ff649 tempest-VolumesActionsTest-400496551 None] Selected osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c as target Quobyte volume. {{(pid=87515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 10:02:08 devstack cinder-volume[87515]: INFO cinder.volume.drivers.remotefs [None req-ad6aa4c3-ab07-4412-bfd2-629a926ff649 tempest-VolumesActionsTest-400496551 None] casted to osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c Sep 07 10:02:08 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-ad6aa4c3-ab07-4412-bfd2-629a926ff649 tempest-VolumesActionsTest-400496551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-9323dcc1-d5f9-43c2-baac-839385a67004 1073741824 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:02:08 devstack sudo[92888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-9323dcc1-d5f9-43c2-baac-839385a67004 1073741824 Sep 07 10:02:08 devstack sudo[92888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:02:08 devstack sudo[92888]: pam_unix(sudo:session): session closed for user root Sep 07 10:02:08 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-ad6aa4c3-ab07-4412-bfd2-629a926ff649 tempest-VolumesActionsTest-400496551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-9323dcc1-d5f9-43c2-baac-839385a67004 1073741824" returned: 0 in 0.530s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:02:08 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-ad6aa4c3-ab07-4412-bfd2-629a926ff649 tempest-VolumesActionsTest-400496551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-9323dcc1-d5f9-43c2-baac-839385a67004 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:02:08 devstack sudo[92895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-9323dcc1-d5f9-43c2-baac-839385a67004 Sep 07 10:02:08 devstack sudo[92895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:02:09 devstack sudo[92895]: pam_unix(sudo:session): session closed for user root Sep 07 10:02:09 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-ad6aa4c3-ab07-4412-bfd2-629a926ff649 tempest-VolumesActionsTest-400496551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-9323dcc1-d5f9-43c2-baac-839385a67004" returned: 0 in 0.318s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:02:09 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-ad6aa4c3-ab07-4412-bfd2-629a926ff649 tempest-VolumesActionsTest-400496551 None] <== create_volume: return (902ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'} {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 10:02:09 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-ad6aa4c3-ab07-4412-bfd2-629a926ff649 tempest-VolumesActionsTest-400496551 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.906s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:02:09 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-ad6aa4c3-ab07-4412-bfd2-629a926ff649 tempest-VolumesActionsTest-400496551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bcac662e-29f8-4389-8a32-4522fcc20e16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9323dcc1-d5f9-43c2-baac-839385a67004', 'volume_size': 1}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:02:09 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-ad6aa4c3-ab07-4412-bfd2-629a926ff649 tempest-VolumesActionsTest-400496551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3fc8a069-fa7b-4fde-a883-06f745247a7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:02:09 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-ad6aa4c3-ab07-4412-bfd2-629a926ff649 tempest-VolumesActionsTest-400496551 None] Volume volume-9323dcc1-d5f9-43c2-baac-839385a67004 (9323dcc1-d5f9-43c2-baac-839385a67004): created successfully Sep 07 10:02:09 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-ad6aa4c3-ab07-4412-bfd2-629a926ff649 tempest-VolumesActionsTest-400496551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3fc8a069-fa7b-4fde-a883-06f745247a7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:02:09 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-ad6aa4c3-ab07-4412-bfd2-629a926ff649 tempest-VolumesActionsTest-400496551 None] Flow 'volume_create_manager' (14bd8878-8730-4157-ad99-2de51b5d2b9b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:02:09 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-ad6aa4c3-ab07-4412-bfd2-629a926ff649 tempest-VolumesActionsTest-400496551 None] Created volume successfully. Sep 07 10:02:10 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-f6cf3e78-f5ed-479c-ab3b-18dfb54fd7b2 tempest-VolumesActionsTest-1226146345 None] Acquiring lock "cinder-9323dcc1-d5f9-43c2-baac-839385a67004-delete_volume" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:02:10 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-f6cf3e78-f5ed-479c-ab3b-18dfb54fd7b2 tempest-VolumesActionsTest-1226146345 None] Lock "cinder-9323dcc1-d5f9-43c2-baac-839385a67004-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:02:10 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-f6cf3e78-f5ed-479c-ab3b-18dfb54fd7b2 tempest-VolumesActionsTest-1226146345 None] Acquiring lock "cinder-quobyte-9323dcc1-d5f9-43c2-baac-839385a67004" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:02:10 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-f6cf3e78-f5ed-479c-ab3b-18dfb54fd7b2 tempest-VolumesActionsTest-1226146345 None] Lock "cinder-quobyte-9323dcc1-d5f9-43c2-baac-839385a67004" acquired by "delete_volume" :: waited 0.023s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:02:10 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[63480176-d73d-4e74-b0ab-50e04b1eb6c5]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:02:10 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-f6cf3e78-f5ed-479c-ab3b-18dfb54fd7b2 tempest-VolumesActionsTest-1226146345 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-9323dcc1-d5f9-43c2-baac-839385a67004 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:02:10 devstack sudo[92898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-9323dcc1-d5f9-43c2-baac-839385a67004 Sep 07 10:02:10 devstack sudo[92898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:02:11 devstack sudo[92898]: pam_unix(sudo:session): session closed for user root Sep 07 10:02:11 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-f6cf3e78-f5ed-479c-ab3b-18dfb54fd7b2 tempest-VolumesActionsTest-1226146345 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-9323dcc1-d5f9-43c2-baac-839385a67004" returned: 0 in 0.504s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:02:11 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-f6cf3e78-f5ed-479c-ab3b-18dfb54fd7b2 tempest-VolumesActionsTest-1226146345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-9323dcc1-d5f9-43c2-baac-839385a67004 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:02:11 devstack sudo[92903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-9323dcc1-d5f9-43c2-baac-839385a67004 Sep 07 10:02:11 devstack sudo[92903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:02:11 devstack cinder-volume[87515]: DEBUG oslo_service.periodic_task [None req-cebd6a9d-3073-42a1-b65a-b38d444d85ed None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87515) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 10:02:11 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-cebd6a9d-3073-42a1-b65a-b38d444d85ed None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:02:11 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-cebd6a9d-3073-42a1-b65a-b38d444d85ed None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:02:11 devstack sudo[92903]: pam_unix(sudo:session): session closed for user root Sep 07 10:02:11 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-cebd6a9d-3073-42a1-b65a-b38d444d85ed None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:02:11 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-cebd6a9d-3073-42a1-b65a-b38d444d85ed None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:02:11 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-cebd6a9d-3073-42a1-b65a-b38d444d85ed None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:02:11 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-cebd6a9d-3073-42a1-b65a-b38d444d85ed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:02:11 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-f6cf3e78-f5ed-479c-ab3b-18dfb54fd7b2 tempest-VolumesActionsTest-1226146345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-9323dcc1-d5f9-43c2-baac-839385a67004" returned: 0 in 0.495s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:02:11 devstack sudo[92906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a Sep 07 10:02:11 devstack sudo[92906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:02:11 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-f6cf3e78-f5ed-479c-ab3b-18dfb54fd7b2 tempest-VolumesActionsTest-1226146345 None] Lock "cinder-quobyte-9323dcc1-d5f9-43c2-baac-839385a67004" released by "delete_volume" :: held 1.104s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:02:11 devstack cinder-volume[87515]: DEBUG cinder.quota [None req-f6cf3e78-f5ed-479c-ab3b-18dfb54fd7b2 tempest-VolumesActionsTest-1226146345 None] Created reservations ['b698d599-3b4d-4c4f-9b25-50e89d7171ec', '4ab22f84-ebf5-4588-98f5-b727d42c9301', '459910be-2d40-4438-836c-a257ca79399a', '1f35f691-42f1-487b-88fc-19e64efaa303'] {{(pid=87515) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:02:11 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-f6cf3e78-f5ed-479c-ab3b-18dfb54fd7b2 tempest-VolumesActionsTest-1226146345 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:02:11 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-f6cf3e78-f5ed-479c-ab3b-18dfb54fd7b2 tempest-VolumesActionsTest-1226146345 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:02:11 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-f6cf3e78-f5ed-479c-ab3b-18dfb54fd7b2 tempest-VolumesActionsTest-1226146345 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:02:11 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-f6cf3e78-f5ed-479c-ab3b-18dfb54fd7b2 tempest-VolumesActionsTest-1226146345 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:02:11 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-f6cf3e78-f5ed-479c-ab3b-18dfb54fd7b2 tempest-VolumesActionsTest-1226146345 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:02:11 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-f6cf3e78-f5ed-479c-ab3b-18dfb54fd7b2 tempest-VolumesActionsTest-1226146345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:02:11 devstack sudo[92908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a Sep 07 10:02:11 devstack sudo[92908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:02:12 devstack sudo[92906]: pam_unix(sudo:session): session closed for user root Sep 07 10:02:12 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-cebd6a9d-3073-42a1-b65a-b38d444d85ed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a" returned: 0 in 0.614s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:02:12 devstack cinder-volume[87515]: DEBUG cinder.manager [None req-cebd6a9d-3073-42a1-b65a-b38d444d85ed None None] Notifying Schedulers of capabilities ... {{(pid=87515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:02:12 devstack cinder-volume[87515]: DEBUG oslo_service.periodic_task [None req-cebd6a9d-3073-42a1-b65a-b38d444d85ed None None] Running periodic task VolumeManager._thread_info {{(pid=87515) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 10:02:12 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-cebd6a9d-3073-42a1-b65a-b38d444d85ed None None] thread count: 28 {{(pid=87515) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 07 10:02:12 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-cebd6a9d-3073-42a1-b65a-b38d444d85ed None None] thread info: [<_MainThread(MainThread, started 131647121809536)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87515) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 07 10:02:12 devstack sudo[92908]: pam_unix(sudo:session): session closed for user root Sep 07 10:02:12 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-f6cf3e78-f5ed-479c-ab3b-18dfb54fd7b2 tempest-VolumesActionsTest-1226146345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a" returned: 0 in 0.329s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:02:12 devstack cinder-volume[87515]: DEBUG cinder.manager [None req-f6cf3e78-f5ed-479c-ab3b-18dfb54fd7b2 tempest-VolumesActionsTest-1226146345 None] Notifying Schedulers of capabilities ... {{(pid=87515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:02:12 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-f6cf3e78-f5ed-479c-ab3b-18dfb54fd7b2 tempest-VolumesActionsTest-1226146345 None] Deleted volume successfully. Sep 07 10:02:12 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-f6cf3e78-f5ed-479c-ab3b-18dfb54fd7b2 tempest-VolumesActionsTest-1226146345 None] Lock "cinder-9323dcc1-d5f9-43c2-baac-839385a67004-delete_volume" released by "delete_volume" :: held 1.809s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:02:13 devstack cinder-volume[87515]: DEBUG cinder.volume.flows.manager.create_volume [None req-426a0f7e-2e6d-4fde-81a4-ac5d7cc9bccc tempest-VolumesActionsTest-400496551 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 10:02:13 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-426a0f7e-2e6d-4fde-81a4-ac5d7cc9bccc tempest-VolumesActionsTest-400496551 None] Flow 'volume_create_manager' (2fcdbdc0-8e28-4cb7-a2c0-a89a267be3e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:02:13 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-426a0f7e-2e6d-4fde-81a4-ac5d7cc9bccc tempest-VolumesActionsTest-400496551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9222f5f-6e84-4f12-bcf5-d0fb8da08f0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:02:13 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-426a0f7e-2e6d-4fde-81a4-ac5d7cc9bccc tempest-VolumesActionsTest-400496551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9222f5f-6e84-4f12-bcf5-d0fb8da08f0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:02:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-27124487',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9138949b-dbbd-493a-964b-a20e2c148d73,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f74cc96e30f349ebaf0b71d69e3b3086',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:02:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:02:14Z,use_quota=True,user_id='ab9545ec0ce2496d990686f23c82184f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3a092cd-7947-4cbf-abff-4ba9567becf0),volume_type_id=f3a092cd-7947-4cbf-abff-4ba9567becf0)' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:02:13 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-426a0f7e-2e6d-4fde-81a4-ac5d7cc9bccc tempest-VolumesActionsTest-400496551 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2225224e-eecf-4046-8aed-d65f7cc1230c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:02:13 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-426a0f7e-2e6d-4fde-81a4-ac5d7cc9bccc tempest-VolumesActionsTest-400496551 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2225224e-eecf-4046-8aed-d65f7cc1230c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:02:13 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-426a0f7e-2e6d-4fde-81a4-ac5d7cc9bccc tempest-VolumesActionsTest-400496551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ccc85fb-7f7c-40a1-86bb-20805a6d8533) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:02:13 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-426a0f7e-2e6d-4fde-81a4-ac5d7cc9bccc tempest-VolumesActionsTest-400496551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ccc85fb-7f7c-40a1-86bb-20805a6d8533) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9138949b-dbbd-493a-964b-a20e2c148d73', 'volume_name': 'volume-9138949b-dbbd-493a-964b-a20e2c148d73', 'volume_size': 1}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:02:13 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-426a0f7e-2e6d-4fde-81a4-ac5d7cc9bccc tempest-VolumesActionsTest-400496551 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d4204c9-c701-431b-98df-83150ed6399e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:02:13 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-426a0f7e-2e6d-4fde-81a4-ac5d7cc9bccc tempest-VolumesActionsTest-400496551 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d4204c9-c701-431b-98df-83150ed6399e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:02:13 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-426a0f7e-2e6d-4fde-81a4-ac5d7cc9bccc tempest-VolumesActionsTest-400496551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8eb8ff6-faea-4ba8-ae33-745643ee37e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:02:13 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-426a0f7e-2e6d-4fde-81a4-ac5d7cc9bccc tempest-VolumesActionsTest-400496551 None] Volume 9138949b-dbbd-493a-964b-a20e2c148d73: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9138949b-dbbd-493a-964b-a20e2c148d73', 'volume_size': 1} Sep 07 10:02:13 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-426a0f7e-2e6d-4fde-81a4-ac5d7cc9bccc tempest-VolumesActionsTest-400496551 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:02:13 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-426a0f7e-2e6d-4fde-81a4-ac5d7cc9bccc tempest-VolumesActionsTest-400496551 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:02:13 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-426a0f7e-2e6d-4fde-81a4-ac5d7cc9bccc tempest-VolumesActionsTest-400496551 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:02:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-27124487',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9138949b-dbbd-493a-964b-a20e2c148d73,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f74cc96e30f349ebaf0b71d69e3b3086',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:02:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:02:14Z,use_quota=True,user_id='ab9545ec0ce2496d990686f23c82184f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3a092cd-7947-4cbf-abff-4ba9567becf0),volume_type_id=f3a092cd-7947-4cbf-abff-4ba9567becf0)}" {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 10:02:13 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-426a0f7e-2e6d-4fde-81a4-ac5d7cc9bccc tempest-VolumesActionsTest-400496551 None] Creating volume 9138949b-dbbd-493a-964b-a20e2c148d73 {{(pid=87515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 10:02:13 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-426a0f7e-2e6d-4fde-81a4-ac5d7cc9bccc tempest-VolumesActionsTest-400496551 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:02:13 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-426a0f7e-2e6d-4fde-81a4-ac5d7cc9bccc tempest-VolumesActionsTest-400496551 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:02:13 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-426a0f7e-2e6d-4fde-81a4-ac5d7cc9bccc tempest-VolumesActionsTest-400496551 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:02:13 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-426a0f7e-2e6d-4fde-81a4-ac5d7cc9bccc tempest-VolumesActionsTest-400496551 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:02:13 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-426a0f7e-2e6d-4fde-81a4-ac5d7cc9bccc tempest-VolumesActionsTest-400496551 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:02:13 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-426a0f7e-2e6d-4fde-81a4-ac5d7cc9bccc tempest-VolumesActionsTest-400496551 None] Selected osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c as target Quobyte volume. {{(pid=87515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 10:02:13 devstack cinder-volume[87515]: INFO cinder.volume.drivers.remotefs [None req-426a0f7e-2e6d-4fde-81a4-ac5d7cc9bccc tempest-VolumesActionsTest-400496551 None] casted to osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c Sep 07 10:02:13 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-426a0f7e-2e6d-4fde-81a4-ac5d7cc9bccc tempest-VolumesActionsTest-400496551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-9138949b-dbbd-493a-964b-a20e2c148d73 1073741824 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:02:13 devstack sudo[92948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-9138949b-dbbd-493a-964b-a20e2c148d73 1073741824 Sep 07 10:02:13 devstack sudo[92948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:02:14 devstack sudo[92948]: pam_unix(sudo:session): session closed for user root Sep 07 10:02:14 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-426a0f7e-2e6d-4fde-81a4-ac5d7cc9bccc tempest-VolumesActionsTest-400496551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-9138949b-dbbd-493a-964b-a20e2c148d73 1073741824" returned: 0 in 0.610s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:02:14 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-426a0f7e-2e6d-4fde-81a4-ac5d7cc9bccc tempest-VolumesActionsTest-400496551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-9138949b-dbbd-493a-964b-a20e2c148d73 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:02:14 devstack sudo[92954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-9138949b-dbbd-493a-964b-a20e2c148d73 Sep 07 10:02:14 devstack sudo[92954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:02:14 devstack sudo[92954]: pam_unix(sudo:session): session closed for user root Sep 07 10:02:14 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-426a0f7e-2e6d-4fde-81a4-ac5d7cc9bccc tempest-VolumesActionsTest-400496551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-9138949b-dbbd-493a-964b-a20e2c148d73" returned: 0 in 0.351s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:02:14 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-426a0f7e-2e6d-4fde-81a4-ac5d7cc9bccc tempest-VolumesActionsTest-400496551 None] <== create_volume: return (1008ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'} {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 10:02:14 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-426a0f7e-2e6d-4fde-81a4-ac5d7cc9bccc tempest-VolumesActionsTest-400496551 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.010s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:02:14 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-426a0f7e-2e6d-4fde-81a4-ac5d7cc9bccc tempest-VolumesActionsTest-400496551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8eb8ff6-faea-4ba8-ae33-745643ee37e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9138949b-dbbd-493a-964b-a20e2c148d73', 'volume_size': 1}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:02:14 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-426a0f7e-2e6d-4fde-81a4-ac5d7cc9bccc tempest-VolumesActionsTest-400496551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0215c4ba-8c23-4dcd-b321-787c7642e921) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:02:14 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-426a0f7e-2e6d-4fde-81a4-ac5d7cc9bccc tempest-VolumesActionsTest-400496551 None] Volume volume-9138949b-dbbd-493a-964b-a20e2c148d73 (9138949b-dbbd-493a-964b-a20e2c148d73): created successfully Sep 07 10:02:14 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-426a0f7e-2e6d-4fde-81a4-ac5d7cc9bccc tempest-VolumesActionsTest-400496551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0215c4ba-8c23-4dcd-b321-787c7642e921) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:02:14 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-426a0f7e-2e6d-4fde-81a4-ac5d7cc9bccc tempest-VolumesActionsTest-400496551 None] Flow 'volume_create_manager' (2fcdbdc0-8e28-4cb7-a2c0-a89a267be3e1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:02:14 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-426a0f7e-2e6d-4fde-81a4-ac5d7cc9bccc tempest-VolumesActionsTest-400496551 None] Created volume successfully. Sep 07 10:02:15 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-55258b4f-1303-4601-8aa0-40bcf65eed77 tempest-GroupsV320Test-1641967027 None] Group tempest-GroupsV320Test-Group-1348801587: creating Sep 07 10:02:15 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-55258b4f-1303-4601-8aa0-40bcf65eed77 tempest-GroupsV320Test-1641967027 None] Group tempest-GroupsV320Test-Group-1348801587: created successfully Sep 07 10:02:15 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-55258b4f-1303-4601-8aa0-40bcf65eed77 tempest-GroupsV320Test-1641967027 None] Create group completed successfully. Sep 07 10:02:16 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-6207a5a3-7d21-4ee1-968d-1e916359a515 tempest-VolumesActionsTest-400496551 None] Acquiring lock "cinder-9138949b-dbbd-493a-964b-a20e2c148d73-delete_volume" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:02:16 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-6207a5a3-7d21-4ee1-968d-1e916359a515 tempest-VolumesActionsTest-400496551 None] Lock "cinder-9138949b-dbbd-493a-964b-a20e2c148d73-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:02:16 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-6207a5a3-7d21-4ee1-968d-1e916359a515 tempest-VolumesActionsTest-400496551 None] Acquiring lock "cinder-quobyte-9138949b-dbbd-493a-964b-a20e2c148d73" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:02:16 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-6207a5a3-7d21-4ee1-968d-1e916359a515 tempest-VolumesActionsTest-400496551 None] Lock "cinder-quobyte-9138949b-dbbd-493a-964b-a20e2c148d73" acquired by "delete_volume" :: waited 0.038s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:02:16 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4be8bbc-c78e-4e67-a74c-3cfc2bf5a86f]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:02:16 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-6207a5a3-7d21-4ee1-968d-1e916359a515 tempest-VolumesActionsTest-400496551 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-9138949b-dbbd-493a-964b-a20e2c148d73 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:02:16 devstack sudo[92958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-9138949b-dbbd-493a-964b-a20e2c148d73 Sep 07 10:02:16 devstack sudo[92958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:02:17 devstack sudo[92958]: pam_unix(sudo:session): session closed for user root Sep 07 10:02:17 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-6207a5a3-7d21-4ee1-968d-1e916359a515 tempest-VolumesActionsTest-400496551 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-9138949b-dbbd-493a-964b-a20e2c148d73" returned: 0 in 0.587s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:02:17 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-6207a5a3-7d21-4ee1-968d-1e916359a515 tempest-VolumesActionsTest-400496551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-9138949b-dbbd-493a-964b-a20e2c148d73 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:02:17 devstack cinder-volume[87515]: DEBUG cinder.quota [None req-fd7824f7-328c-4c6b-909c-3e85dda6d59d tempest-GroupsV320Test-1641967027 None] Created reservations ['88f6b77e-6191-4732-a977-01a75dadca2d'] {{(pid=87515) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:02:17 devstack sudo[92966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-9138949b-dbbd-493a-964b-a20e2c148d73 Sep 07 10:02:17 devstack sudo[92966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:02:17 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-fd7824f7-328c-4c6b-909c-3e85dda6d59d tempest-GroupsV320Test-1641967027 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:02:17 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-fd7824f7-328c-4c6b-909c-3e85dda6d59d tempest-GroupsV320Test-1641967027 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:02:17 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-fd7824f7-328c-4c6b-909c-3e85dda6d59d tempest-GroupsV320Test-1641967027 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:02:17 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-fd7824f7-328c-4c6b-909c-3e85dda6d59d tempest-GroupsV320Test-1641967027 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:02:17 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-fd7824f7-328c-4c6b-909c-3e85dda6d59d tempest-GroupsV320Test-1641967027 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:02:17 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-fd7824f7-328c-4c6b-909c-3e85dda6d59d tempest-GroupsV320Test-1641967027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:02:17 devstack sudo[92968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a Sep 07 10:02:17 devstack sudo[92968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:02:17 devstack sudo[92966]: pam_unix(sudo:session): session closed for user root Sep 07 10:02:17 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-6207a5a3-7d21-4ee1-968d-1e916359a515 tempest-VolumesActionsTest-400496551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-9138949b-dbbd-493a-964b-a20e2c148d73" returned: 0 in 0.318s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:02:17 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-6207a5a3-7d21-4ee1-968d-1e916359a515 tempest-VolumesActionsTest-400496551 None] Lock "cinder-quobyte-9138949b-dbbd-493a-964b-a20e2c148d73" released by "delete_volume" :: held 0.963s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:02:17 devstack cinder-volume[87515]: DEBUG cinder.quota [None req-6207a5a3-7d21-4ee1-968d-1e916359a515 tempest-VolumesActionsTest-400496551 None] Created reservations ['1a6e2b16-fa37-4b02-b0e9-8596fb2362cb', '1cdf5d7e-04b6-46c1-8b8e-bf9cf0c5f738', 'c519f5c4-36a1-4fc8-a949-8151245c3f87', '37eb4b1e-c65c-4e25-9b19-a88c9c607a17'] {{(pid=87515) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:02:17 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-6207a5a3-7d21-4ee1-968d-1e916359a515 tempest-VolumesActionsTest-400496551 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:02:17 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-6207a5a3-7d21-4ee1-968d-1e916359a515 tempest-VolumesActionsTest-400496551 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:02:17 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-6207a5a3-7d21-4ee1-968d-1e916359a515 tempest-VolumesActionsTest-400496551 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:02:17 devstack sudo[92968]: pam_unix(sudo:session): session closed for user root Sep 07 10:02:17 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-6207a5a3-7d21-4ee1-968d-1e916359a515 tempest-VolumesActionsTest-400496551 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:02:17 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-6207a5a3-7d21-4ee1-968d-1e916359a515 tempest-VolumesActionsTest-400496551 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:02:17 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-6207a5a3-7d21-4ee1-968d-1e916359a515 tempest-VolumesActionsTest-400496551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:02:17 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-fd7824f7-328c-4c6b-909c-3e85dda6d59d tempest-GroupsV320Test-1641967027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a" returned: 0 in 0.410s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:02:17 devstack cinder-volume[87515]: DEBUG cinder.manager [None req-fd7824f7-328c-4c6b-909c-3e85dda6d59d tempest-GroupsV320Test-1641967027 None] Notifying Schedulers of capabilities ... {{(pid=87515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:02:17 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-fd7824f7-328c-4c6b-909c-3e85dda6d59d tempest-GroupsV320Test-1641967027 None] Delete group completed successfully. Sep 07 10:02:17 devstack sudo[92973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a Sep 07 10:02:17 devstack sudo[92973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:02:18 devstack sudo[92973]: pam_unix(sudo:session): session closed for user root Sep 07 10:02:18 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-6207a5a3-7d21-4ee1-968d-1e916359a515 tempest-VolumesActionsTest-400496551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a" returned: 0 in 0.285s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:02:18 devstack cinder-volume[87515]: DEBUG cinder.manager [None req-6207a5a3-7d21-4ee1-968d-1e916359a515 tempest-VolumesActionsTest-400496551 None] Notifying Schedulers of capabilities ... {{(pid=87515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:02:18 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-6207a5a3-7d21-4ee1-968d-1e916359a515 tempest-VolumesActionsTest-400496551 None] Deleted volume successfully. Sep 07 10:02:18 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-6207a5a3-7d21-4ee1-968d-1e916359a515 tempest-VolumesActionsTest-400496551 None] Lock "cinder-9138949b-dbbd-493a-964b-a20e2c148d73-delete_volume" released by "delete_volume" :: held 1.557s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:02:27 devstack cinder-volume[87515]: DEBUG dbcounter [-] [87515] Writing DB stats cinder:SELECT=69,cinder:INSERT=28,cinder:UPDATE=96,cinder:DELETE=11 {{(pid=87515) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 10:02:28 devstack cinder-volume[87515]: DEBUG dbcounter [-] [87515] Writing DB stats cinder:UPDATE=114,cinder:SELECT=85,cinder:INSERT=21,cinder:DELETE=5 {{(pid=87515) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 10:02:48 devstack cinder-volume[87515]: DEBUG cinder.volume.flows.manager.create_volume [None req-0481d363-34bd-4c05-9610-d04c483b8472 tempest-ServerRescueNegativeTestJSON-2123327993 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 10:02:48 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-0481d363-34bd-4c05-9610-d04c483b8472 tempest-ServerRescueNegativeTestJSON-2123327993 None] Flow 'volume_create_manager' (5b2712d4-ed9e-416a-a2d1-261561ff612e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:02:48 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-0481d363-34bd-4c05-9610-d04c483b8472 tempest-ServerRescueNegativeTestJSON-2123327993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4aacab8-ae28-4a39-9d3c-8a550ae8026e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:02:48 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-0481d363-34bd-4c05-9610-d04c483b8472 tempest-ServerRescueNegativeTestJSON-2123327993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4aacab8-ae28-4a39-9d3c-8a550ae8026e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:02:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1450689997',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=edc0eb2c-81be-4b59-a68d-d01d02f936a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e7e6330f05546b4aff49048a92d1ed6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:02:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:02:48Z,use_quota=True,user_id='73c49a36138f43fb98eddc521962ae7b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3a092cd-7947-4cbf-abff-4ba9567becf0),volume_type_id=f3a092cd-7947-4cbf-abff-4ba9567becf0)' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:02:48 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-0481d363-34bd-4c05-9610-d04c483b8472 tempest-ServerRescueNegativeTestJSON-2123327993 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25d3adef-5eed-4601-8fe7-87a9d891d8dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:02:48 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-0481d363-34bd-4c05-9610-d04c483b8472 tempest-ServerRescueNegativeTestJSON-2123327993 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25d3adef-5eed-4601-8fe7-87a9d891d8dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:02:48 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-0481d363-34bd-4c05-9610-d04c483b8472 tempest-ServerRescueNegativeTestJSON-2123327993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f428b89e-0267-449c-a804-e7766e1d7a98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:02:48 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-0481d363-34bd-4c05-9610-d04c483b8472 tempest-ServerRescueNegativeTestJSON-2123327993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f428b89e-0267-449c-a804-e7766e1d7a98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'edc0eb2c-81be-4b59-a68d-d01d02f936a7', 'volume_name': 'volume-edc0eb2c-81be-4b59-a68d-d01d02f936a7', 'volume_size': 1}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:02:48 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-0481d363-34bd-4c05-9610-d04c483b8472 tempest-ServerRescueNegativeTestJSON-2123327993 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4de1eb96-cf39-4516-a2c7-9ce353fb301c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:02:48 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-0481d363-34bd-4c05-9610-d04c483b8472 tempest-ServerRescueNegativeTestJSON-2123327993 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4de1eb96-cf39-4516-a2c7-9ce353fb301c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:02:48 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-0481d363-34bd-4c05-9610-d04c483b8472 tempest-ServerRescueNegativeTestJSON-2123327993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac257d8d-9ac0-4754-a9cf-6b7d418796fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:02:48 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-0481d363-34bd-4c05-9610-d04c483b8472 tempest-ServerRescueNegativeTestJSON-2123327993 None] Volume edc0eb2c-81be-4b59-a68d-d01d02f936a7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-edc0eb2c-81be-4b59-a68d-d01d02f936a7', 'volume_size': 1} Sep 07 10:02:48 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-0481d363-34bd-4c05-9610-d04c483b8472 tempest-ServerRescueNegativeTestJSON-2123327993 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:02:48 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-0481d363-34bd-4c05-9610-d04c483b8472 tempest-ServerRescueNegativeTestJSON-2123327993 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:02:48 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-0481d363-34bd-4c05-9610-d04c483b8472 tempest-ServerRescueNegativeTestJSON-2123327993 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:02:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1450689997',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=edc0eb2c-81be-4b59-a68d-d01d02f936a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e7e6330f05546b4aff49048a92d1ed6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:02:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:02:48Z,use_quota=True,user_id='73c49a36138f43fb98eddc521962ae7b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3a092cd-7947-4cbf-abff-4ba9567becf0),volume_type_id=f3a092cd-7947-4cbf-abff-4ba9567becf0)}" {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 10:02:48 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-0481d363-34bd-4c05-9610-d04c483b8472 tempest-ServerRescueNegativeTestJSON-2123327993 None] Creating volume edc0eb2c-81be-4b59-a68d-d01d02f936a7 {{(pid=87515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 10:02:48 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-0481d363-34bd-4c05-9610-d04c483b8472 tempest-ServerRescueNegativeTestJSON-2123327993 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:02:48 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-0481d363-34bd-4c05-9610-d04c483b8472 tempest-ServerRescueNegativeTestJSON-2123327993 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:02:48 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-0481d363-34bd-4c05-9610-d04c483b8472 tempest-ServerRescueNegativeTestJSON-2123327993 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:02:48 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-0481d363-34bd-4c05-9610-d04c483b8472 tempest-ServerRescueNegativeTestJSON-2123327993 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:02:48 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-0481d363-34bd-4c05-9610-d04c483b8472 tempest-ServerRescueNegativeTestJSON-2123327993 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:02:48 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-0481d363-34bd-4c05-9610-d04c483b8472 tempest-ServerRescueNegativeTestJSON-2123327993 None] Selected osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c as target Quobyte volume. {{(pid=87515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 10:02:48 devstack cinder-volume[87515]: INFO cinder.volume.drivers.remotefs [None req-0481d363-34bd-4c05-9610-d04c483b8472 tempest-ServerRescueNegativeTestJSON-2123327993 None] casted to osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c Sep 07 10:02:48 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-0481d363-34bd-4c05-9610-d04c483b8472 tempest-ServerRescueNegativeTestJSON-2123327993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-edc0eb2c-81be-4b59-a68d-d01d02f936a7 1073741824 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:02:48 devstack sudo[93304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-edc0eb2c-81be-4b59-a68d-d01d02f936a7 1073741824 Sep 07 10:02:48 devstack sudo[93304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:02:49 devstack sudo[93304]: pam_unix(sudo:session): session closed for user root Sep 07 10:02:49 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-0481d363-34bd-4c05-9610-d04c483b8472 tempest-ServerRescueNegativeTestJSON-2123327993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-edc0eb2c-81be-4b59-a68d-d01d02f936a7 1073741824" returned: 0 in 0.835s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:02:49 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-0481d363-34bd-4c05-9610-d04c483b8472 tempest-ServerRescueNegativeTestJSON-2123327993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-edc0eb2c-81be-4b59-a68d-d01d02f936a7 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:02:49 devstack sudo[93310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-edc0eb2c-81be-4b59-a68d-d01d02f936a7 Sep 07 10:02:49 devstack sudo[93310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:02:50 devstack sudo[93310]: pam_unix(sudo:session): session closed for user root Sep 07 10:02:50 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-0481d363-34bd-4c05-9610-d04c483b8472 tempest-ServerRescueNegativeTestJSON-2123327993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-edc0eb2c-81be-4b59-a68d-d01d02f936a7" returned: 0 in 0.451s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:02:50 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-0481d363-34bd-4c05-9610-d04c483b8472 tempest-ServerRescueNegativeTestJSON-2123327993 None] <== create_volume: return (1405ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'} {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 10:02:50 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-0481d363-34bd-4c05-9610-d04c483b8472 tempest-ServerRescueNegativeTestJSON-2123327993 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.412s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:02:50 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-0481d363-34bd-4c05-9610-d04c483b8472 tempest-ServerRescueNegativeTestJSON-2123327993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac257d8d-9ac0-4754-a9cf-6b7d418796fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-edc0eb2c-81be-4b59-a68d-d01d02f936a7', 'volume_size': 1}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:02:50 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-0481d363-34bd-4c05-9610-d04c483b8472 tempest-ServerRescueNegativeTestJSON-2123327993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29b56909-de96-458f-bfc2-683589f8db5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:02:50 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-0481d363-34bd-4c05-9610-d04c483b8472 tempest-ServerRescueNegativeTestJSON-2123327993 None] Volume volume-edc0eb2c-81be-4b59-a68d-d01d02f936a7 (edc0eb2c-81be-4b59-a68d-d01d02f936a7): created successfully Sep 07 10:02:50 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-0481d363-34bd-4c05-9610-d04c483b8472 tempest-ServerRescueNegativeTestJSON-2123327993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29b56909-de96-458f-bfc2-683589f8db5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:02:50 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-0481d363-34bd-4c05-9610-d04c483b8472 tempest-ServerRescueNegativeTestJSON-2123327993 None] Flow 'volume_create_manager' (5b2712d4-ed9e-416a-a2d1-261561ff612e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:02:50 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-0481d363-34bd-4c05-9610-d04c483b8472 tempest-ServerRescueNegativeTestJSON-2123327993 None] Created volume successfully. Sep 07 10:02:50 devstack cinder-volume[87515]: DEBUG cinder.volume.flows.manager.create_volume [None req-03158681-15c4-424b-a10b-07363a8a9fcd tempest-VolumesListAdminTestJSON-1662385217 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 10:02:51 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-03158681-15c4-424b-a10b-07363a8a9fcd tempest-VolumesListAdminTestJSON-1662385217 None] Flow 'volume_create_manager' (0fb30ccf-3caf-4c9b-8364-db93564f0f6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:02:51 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-03158681-15c4-424b-a10b-07363a8a9fcd tempest-VolumesListAdminTestJSON-1662385217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (931ac719-7c74-4e2d-ab74-c6650337304d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:02:51 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-03158681-15c4-424b-a10b-07363a8a9fcd tempest-VolumesListAdminTestJSON-1662385217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (931ac719-7c74-4e2d-ab74-c6650337304d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:02:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-301592853',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=667a84b2-d5a1-44d1-b30a-42afa4735e21,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4081771a73484fefbeba51ce9914d2af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:02:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:02:51Z,use_quota=True,user_id='6a64e72bd66e4a3da76918bfa041bdeb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3a092cd-7947-4cbf-abff-4ba9567becf0),volume_type_id=f3a092cd-7947-4cbf-abff-4ba9567becf0)' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:02:51 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-03158681-15c4-424b-a10b-07363a8a9fcd tempest-VolumesListAdminTestJSON-1662385217 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0dcd703-6919-42fc-83b8-e9b86bd97d9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:02:51 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-03158681-15c4-424b-a10b-07363a8a9fcd tempest-VolumesListAdminTestJSON-1662385217 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0dcd703-6919-42fc-83b8-e9b86bd97d9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:02:51 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-03158681-15c4-424b-a10b-07363a8a9fcd tempest-VolumesListAdminTestJSON-1662385217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de21eca5-110b-4cbc-a3d6-6b4bb57d2bf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:02:51 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-03158681-15c4-424b-a10b-07363a8a9fcd tempest-VolumesListAdminTestJSON-1662385217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de21eca5-110b-4cbc-a3d6-6b4bb57d2bf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '667a84b2-d5a1-44d1-b30a-42afa4735e21', 'volume_name': 'volume-667a84b2-d5a1-44d1-b30a-42afa4735e21', 'volume_size': 1}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:02:51 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-03158681-15c4-424b-a10b-07363a8a9fcd tempest-VolumesListAdminTestJSON-1662385217 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b61a78a1-0af1-4cf4-9b9f-016250523262) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:02:51 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-03158681-15c4-424b-a10b-07363a8a9fcd tempest-VolumesListAdminTestJSON-1662385217 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b61a78a1-0af1-4cf4-9b9f-016250523262) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:02:51 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-03158681-15c4-424b-a10b-07363a8a9fcd tempest-VolumesListAdminTestJSON-1662385217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94818d46-4344-4d18-b92a-b77e290ee242) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:02:51 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-03158681-15c4-424b-a10b-07363a8a9fcd tempest-VolumesListAdminTestJSON-1662385217 None] Volume 667a84b2-d5a1-44d1-b30a-42afa4735e21: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-667a84b2-d5a1-44d1-b30a-42afa4735e21', 'volume_size': 1} Sep 07 10:02:51 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-03158681-15c4-424b-a10b-07363a8a9fcd tempest-VolumesListAdminTestJSON-1662385217 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:02:51 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-03158681-15c4-424b-a10b-07363a8a9fcd tempest-VolumesListAdminTestJSON-1662385217 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:02:51 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-03158681-15c4-424b-a10b-07363a8a9fcd tempest-VolumesListAdminTestJSON-1662385217 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:02:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-301592853',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=667a84b2-d5a1-44d1-b30a-42afa4735e21,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4081771a73484fefbeba51ce9914d2af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:02:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:02:51Z,use_quota=True,user_id='6a64e72bd66e4a3da76918bfa041bdeb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3a092cd-7947-4cbf-abff-4ba9567becf0),volume_type_id=f3a092cd-7947-4cbf-abff-4ba9567becf0)}" {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 10:02:51 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-03158681-15c4-424b-a10b-07363a8a9fcd tempest-VolumesListAdminTestJSON-1662385217 None] Creating volume 667a84b2-d5a1-44d1-b30a-42afa4735e21 {{(pid=87515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 10:02:51 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-03158681-15c4-424b-a10b-07363a8a9fcd tempest-VolumesListAdminTestJSON-1662385217 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:02:51 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-03158681-15c4-424b-a10b-07363a8a9fcd tempest-VolumesListAdminTestJSON-1662385217 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:02:51 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-03158681-15c4-424b-a10b-07363a8a9fcd tempest-VolumesListAdminTestJSON-1662385217 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:02:51 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-03158681-15c4-424b-a10b-07363a8a9fcd tempest-VolumesListAdminTestJSON-1662385217 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:02:51 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-03158681-15c4-424b-a10b-07363a8a9fcd tempest-VolumesListAdminTestJSON-1662385217 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:02:51 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-03158681-15c4-424b-a10b-07363a8a9fcd tempest-VolumesListAdminTestJSON-1662385217 None] Selected osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c as target Quobyte volume. {{(pid=87515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 10:02:51 devstack cinder-volume[87515]: INFO cinder.volume.drivers.remotefs [None req-03158681-15c4-424b-a10b-07363a8a9fcd tempest-VolumesListAdminTestJSON-1662385217 None] casted to osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c Sep 07 10:02:51 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-03158681-15c4-424b-a10b-07363a8a9fcd tempest-VolumesListAdminTestJSON-1662385217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-667a84b2-d5a1-44d1-b30a-42afa4735e21 1073741824 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:02:51 devstack sudo[93327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-667a84b2-d5a1-44d1-b30a-42afa4735e21 1073741824 Sep 07 10:02:51 devstack sudo[93327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:02:51 devstack sudo[93327]: pam_unix(sudo:session): session closed for user root Sep 07 10:02:51 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-03158681-15c4-424b-a10b-07363a8a9fcd tempest-VolumesListAdminTestJSON-1662385217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-667a84b2-d5a1-44d1-b30a-42afa4735e21 1073741824" returned: 0 in 0.715s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:02:51 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-03158681-15c4-424b-a10b-07363a8a9fcd tempest-VolumesListAdminTestJSON-1662385217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-667a84b2-d5a1-44d1-b30a-42afa4735e21 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:02:51 devstack sudo[93339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-667a84b2-d5a1-44d1-b30a-42afa4735e21 Sep 07 10:02:51 devstack sudo[93339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:02:52 devstack sudo[93339]: pam_unix(sudo:session): session closed for user root Sep 07 10:02:52 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-03158681-15c4-424b-a10b-07363a8a9fcd tempest-VolumesListAdminTestJSON-1662385217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-667a84b2-d5a1-44d1-b30a-42afa4735e21" returned: 0 in 0.503s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:02:52 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-03158681-15c4-424b-a10b-07363a8a9fcd tempest-VolumesListAdminTestJSON-1662385217 None] <== create_volume: return (1273ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'} {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 10:02:52 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-03158681-15c4-424b-a10b-07363a8a9fcd tempest-VolumesListAdminTestJSON-1662385217 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.276s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:02:52 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-03158681-15c4-424b-a10b-07363a8a9fcd tempest-VolumesListAdminTestJSON-1662385217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94818d46-4344-4d18-b92a-b77e290ee242) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-667a84b2-d5a1-44d1-b30a-42afa4735e21', 'volume_size': 1}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:02:52 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-03158681-15c4-424b-a10b-07363a8a9fcd tempest-VolumesListAdminTestJSON-1662385217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45b86e83-cb3e-499e-a07a-381221e33b2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:02:52 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-03158681-15c4-424b-a10b-07363a8a9fcd tempest-VolumesListAdminTestJSON-1662385217 None] Volume volume-667a84b2-d5a1-44d1-b30a-42afa4735e21 (667a84b2-d5a1-44d1-b30a-42afa4735e21): created successfully Sep 07 10:02:52 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-03158681-15c4-424b-a10b-07363a8a9fcd tempest-VolumesListAdminTestJSON-1662385217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45b86e83-cb3e-499e-a07a-381221e33b2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:02:52 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-03158681-15c4-424b-a10b-07363a8a9fcd tempest-VolumesListAdminTestJSON-1662385217 None] Flow 'volume_create_manager' (0fb30ccf-3caf-4c9b-8364-db93564f0f6c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:02:52 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-03158681-15c4-424b-a10b-07363a8a9fcd tempest-VolumesListAdminTestJSON-1662385217 None] Created volume successfully. Sep 07 10:02:54 devstack cinder-volume[87515]: DEBUG cinder.volume.flows.manager.create_volume [None req-f6068283-d17c-442b-b5c3-7d0a3e032f70 tempest-VolumesListAdminTestJSON-1662385217 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 10:02:54 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-f6068283-d17c-442b-b5c3-7d0a3e032f70 tempest-VolumesListAdminTestJSON-1662385217 None] Flow 'volume_create_manager' (44e19c12-f00f-4bf8-bd7f-d44b289dc317) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:02:54 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-f6068283-d17c-442b-b5c3-7d0a3e032f70 tempest-VolumesListAdminTestJSON-1662385217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb5f144e-0924-4bb7-ba16-23c774c03906) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:02:54 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-f6068283-d17c-442b-b5c3-7d0a3e032f70 tempest-VolumesListAdminTestJSON-1662385217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb5f144e-0924-4bb7-ba16-23c774c03906) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:02:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-756900518',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a713fce-0faf-425f-b408-b4bff5720310,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4081771a73484fefbeba51ce9914d2af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:02:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:02:54Z,use_quota=True,user_id='6a64e72bd66e4a3da76918bfa041bdeb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3a092cd-7947-4cbf-abff-4ba9567becf0),volume_type_id=f3a092cd-7947-4cbf-abff-4ba9567becf0)' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:02:54 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-f6068283-d17c-442b-b5c3-7d0a3e032f70 tempest-VolumesListAdminTestJSON-1662385217 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f30183b4-d8e6-4383-9cb4-d30ae34cfc93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:02:54 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-f6068283-d17c-442b-b5c3-7d0a3e032f70 tempest-VolumesListAdminTestJSON-1662385217 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f30183b4-d8e6-4383-9cb4-d30ae34cfc93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:02:54 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-f6068283-d17c-442b-b5c3-7d0a3e032f70 tempest-VolumesListAdminTestJSON-1662385217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b59cc695-3ef6-41b0-a292-86783c3339e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:02:54 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-f6068283-d17c-442b-b5c3-7d0a3e032f70 tempest-VolumesListAdminTestJSON-1662385217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b59cc695-3ef6-41b0-a292-86783c3339e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0a713fce-0faf-425f-b408-b4bff5720310', 'volume_name': 'volume-0a713fce-0faf-425f-b408-b4bff5720310', 'volume_size': 1}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:02:54 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-f6068283-d17c-442b-b5c3-7d0a3e032f70 tempest-VolumesListAdminTestJSON-1662385217 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36266105-918d-4798-a0ca-f5f4cf9f55b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:02:54 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-f6068283-d17c-442b-b5c3-7d0a3e032f70 tempest-VolumesListAdminTestJSON-1662385217 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36266105-918d-4798-a0ca-f5f4cf9f55b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:02:54 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-f6068283-d17c-442b-b5c3-7d0a3e032f70 tempest-VolumesListAdminTestJSON-1662385217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e5df815-fe27-4296-9f75-3294bb4f698e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:02:54 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-f6068283-d17c-442b-b5c3-7d0a3e032f70 tempest-VolumesListAdminTestJSON-1662385217 None] Volume 0a713fce-0faf-425f-b408-b4bff5720310: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0a713fce-0faf-425f-b408-b4bff5720310', 'volume_size': 1} Sep 07 10:02:54 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-f6068283-d17c-442b-b5c3-7d0a3e032f70 tempest-VolumesListAdminTestJSON-1662385217 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:02:54 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-f6068283-d17c-442b-b5c3-7d0a3e032f70 tempest-VolumesListAdminTestJSON-1662385217 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:02:54 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-f6068283-d17c-442b-b5c3-7d0a3e032f70 tempest-VolumesListAdminTestJSON-1662385217 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:02:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-756900518',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a713fce-0faf-425f-b408-b4bff5720310,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4081771a73484fefbeba51ce9914d2af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:02:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:02:54Z,use_quota=True,user_id='6a64e72bd66e4a3da76918bfa041bdeb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3a092cd-7947-4cbf-abff-4ba9567becf0),volume_type_id=f3a092cd-7947-4cbf-abff-4ba9567becf0)}" {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 10:02:54 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-f6068283-d17c-442b-b5c3-7d0a3e032f70 tempest-VolumesListAdminTestJSON-1662385217 None] Creating volume 0a713fce-0faf-425f-b408-b4bff5720310 {{(pid=87515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 10:02:54 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-f6068283-d17c-442b-b5c3-7d0a3e032f70 tempest-VolumesListAdminTestJSON-1662385217 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:02:54 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-f6068283-d17c-442b-b5c3-7d0a3e032f70 tempest-VolumesListAdminTestJSON-1662385217 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:02:54 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-f6068283-d17c-442b-b5c3-7d0a3e032f70 tempest-VolumesListAdminTestJSON-1662385217 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:02:54 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-f6068283-d17c-442b-b5c3-7d0a3e032f70 tempest-VolumesListAdminTestJSON-1662385217 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:02:54 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-f6068283-d17c-442b-b5c3-7d0a3e032f70 tempest-VolumesListAdminTestJSON-1662385217 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:02:54 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-f6068283-d17c-442b-b5c3-7d0a3e032f70 tempest-VolumesListAdminTestJSON-1662385217 None] Selected osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c as target Quobyte volume. {{(pid=87515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 10:02:54 devstack cinder-volume[87515]: INFO cinder.volume.drivers.remotefs [None req-f6068283-d17c-442b-b5c3-7d0a3e032f70 tempest-VolumesListAdminTestJSON-1662385217 None] casted to osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c Sep 07 10:02:54 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-f6068283-d17c-442b-b5c3-7d0a3e032f70 tempest-VolumesListAdminTestJSON-1662385217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-0a713fce-0faf-425f-b408-b4bff5720310 1073741824 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:02:54 devstack sudo[93386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-0a713fce-0faf-425f-b408-b4bff5720310 1073741824 Sep 07 10:02:54 devstack sudo[93386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:02:55 devstack sudo[93386]: pam_unix(sudo:session): session closed for user root Sep 07 10:02:55 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-f6068283-d17c-442b-b5c3-7d0a3e032f70 tempest-VolumesListAdminTestJSON-1662385217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-0a713fce-0faf-425f-b408-b4bff5720310 1073741824" returned: 0 in 0.938s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:02:55 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-f6068283-d17c-442b-b5c3-7d0a3e032f70 tempest-VolumesListAdminTestJSON-1662385217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-0a713fce-0faf-425f-b408-b4bff5720310 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:02:55 devstack sudo[93414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-0a713fce-0faf-425f-b408-b4bff5720310 Sep 07 10:02:55 devstack sudo[93414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:02:56 devstack sudo[93414]: pam_unix(sudo:session): session closed for user root Sep 07 10:02:56 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-f6068283-d17c-442b-b5c3-7d0a3e032f70 tempest-VolumesListAdminTestJSON-1662385217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-0a713fce-0faf-425f-b408-b4bff5720310" returned: 0 in 0.429s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:02:56 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-f6068283-d17c-442b-b5c3-7d0a3e032f70 tempest-VolumesListAdminTestJSON-1662385217 None] <== create_volume: return (1443ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'} {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 10:02:56 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-f6068283-d17c-442b-b5c3-7d0a3e032f70 tempest-VolumesListAdminTestJSON-1662385217 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.446s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:02:56 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-f6068283-d17c-442b-b5c3-7d0a3e032f70 tempest-VolumesListAdminTestJSON-1662385217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e5df815-fe27-4296-9f75-3294bb4f698e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0a713fce-0faf-425f-b408-b4bff5720310', 'volume_size': 1}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:02:56 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-f6068283-d17c-442b-b5c3-7d0a3e032f70 tempest-VolumesListAdminTestJSON-1662385217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6fb54c4-eff0-4522-b3fe-45be2ef4f788) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:02:56 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-f6068283-d17c-442b-b5c3-7d0a3e032f70 tempest-VolumesListAdminTestJSON-1662385217 None] Volume volume-0a713fce-0faf-425f-b408-b4bff5720310 (0a713fce-0faf-425f-b408-b4bff5720310): created successfully Sep 07 10:02:56 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-f6068283-d17c-442b-b5c3-7d0a3e032f70 tempest-VolumesListAdminTestJSON-1662385217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6fb54c4-eff0-4522-b3fe-45be2ef4f788) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:02:56 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-f6068283-d17c-442b-b5c3-7d0a3e032f70 tempest-VolumesListAdminTestJSON-1662385217 None] Flow 'volume_create_manager' (44e19c12-f00f-4bf8-bd7f-d44b289dc317) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:02:56 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-f6068283-d17c-442b-b5c3-7d0a3e032f70 tempest-VolumesListAdminTestJSON-1662385217 None] Created volume successfully. Sep 07 10:02:57 devstack cinder-volume[87515]: DEBUG cinder.volume.flows.manager.create_volume [None req-e870a91e-bfae-4c41-9458-a57a127017be tempest-VolumesListAdminTestJSON-1662385217 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 10:02:57 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-e870a91e-bfae-4c41-9458-a57a127017be tempest-VolumesListAdminTestJSON-1662385217 None] Flow 'volume_create_manager' (29f632aa-4ffe-48a1-9a0a-ba19f466da30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:02:57 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-e870a91e-bfae-4c41-9458-a57a127017be tempest-VolumesListAdminTestJSON-1662385217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6deb2b8-16b8-46ac-b73b-ffc215748e85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:02:57 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-e870a91e-bfae-4c41-9458-a57a127017be tempest-VolumesListAdminTestJSON-1662385217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6deb2b8-16b8-46ac-b73b-ffc215748e85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:02:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-14318890',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45f0e84e-ad99-4e4b-a581-dbd29c3c6f78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4081771a73484fefbeba51ce9914d2af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:02:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:02:58Z,use_quota=True,user_id='6a64e72bd66e4a3da76918bfa041bdeb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3a092cd-7947-4cbf-abff-4ba9567becf0),volume_type_id=f3a092cd-7947-4cbf-abff-4ba9567becf0)' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:02:57 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-e870a91e-bfae-4c41-9458-a57a127017be tempest-VolumesListAdminTestJSON-1662385217 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8dfced4b-ce9a-45bf-acc3-1f73fb549ade) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:02:57 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-e870a91e-bfae-4c41-9458-a57a127017be tempest-VolumesListAdminTestJSON-1662385217 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8dfced4b-ce9a-45bf-acc3-1f73fb549ade) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:02:57 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-e870a91e-bfae-4c41-9458-a57a127017be tempest-VolumesListAdminTestJSON-1662385217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47feb0a1-58d2-4bd0-bc18-40cd22dd2048) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:02:57 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-e870a91e-bfae-4c41-9458-a57a127017be tempest-VolumesListAdminTestJSON-1662385217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47feb0a1-58d2-4bd0-bc18-40cd22dd2048) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '45f0e84e-ad99-4e4b-a581-dbd29c3c6f78', 'volume_name': 'volume-45f0e84e-ad99-4e4b-a581-dbd29c3c6f78', 'volume_size': 1}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:02:57 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-e870a91e-bfae-4c41-9458-a57a127017be tempest-VolumesListAdminTestJSON-1662385217 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (919f1ebc-215e-4518-a0b5-e520564d0cd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:02:57 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-e870a91e-bfae-4c41-9458-a57a127017be tempest-VolumesListAdminTestJSON-1662385217 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (919f1ebc-215e-4518-a0b5-e520564d0cd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:02:57 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-e870a91e-bfae-4c41-9458-a57a127017be tempest-VolumesListAdminTestJSON-1662385217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (362fac36-c6f7-47e2-9626-a7deccef54dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:02:57 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-e870a91e-bfae-4c41-9458-a57a127017be tempest-VolumesListAdminTestJSON-1662385217 None] Volume 45f0e84e-ad99-4e4b-a581-dbd29c3c6f78: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-45f0e84e-ad99-4e4b-a581-dbd29c3c6f78', 'volume_size': 1} Sep 07 10:02:57 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-e870a91e-bfae-4c41-9458-a57a127017be tempest-VolumesListAdminTestJSON-1662385217 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:02:57 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-e870a91e-bfae-4c41-9458-a57a127017be tempest-VolumesListAdminTestJSON-1662385217 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:02:57 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-e870a91e-bfae-4c41-9458-a57a127017be tempest-VolumesListAdminTestJSON-1662385217 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:02:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-14318890',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45f0e84e-ad99-4e4b-a581-dbd29c3c6f78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4081771a73484fefbeba51ce9914d2af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:02:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:02:58Z,use_quota=True,user_id='6a64e72bd66e4a3da76918bfa041bdeb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3a092cd-7947-4cbf-abff-4ba9567becf0),volume_type_id=f3a092cd-7947-4cbf-abff-4ba9567becf0)}" {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 10:02:57 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-e870a91e-bfae-4c41-9458-a57a127017be tempest-VolumesListAdminTestJSON-1662385217 None] Creating volume 45f0e84e-ad99-4e4b-a581-dbd29c3c6f78 {{(pid=87515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 10:02:57 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-e870a91e-bfae-4c41-9458-a57a127017be tempest-VolumesListAdminTestJSON-1662385217 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:02:57 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-e870a91e-bfae-4c41-9458-a57a127017be tempest-VolumesListAdminTestJSON-1662385217 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:02:57 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-e870a91e-bfae-4c41-9458-a57a127017be tempest-VolumesListAdminTestJSON-1662385217 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:02:57 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-e870a91e-bfae-4c41-9458-a57a127017be tempest-VolumesListAdminTestJSON-1662385217 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:02:57 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-e870a91e-bfae-4c41-9458-a57a127017be tempest-VolumesListAdminTestJSON-1662385217 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:02:57 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-e870a91e-bfae-4c41-9458-a57a127017be tempest-VolumesListAdminTestJSON-1662385217 None] Selected osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c as target Quobyte volume. {{(pid=87515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 10:02:57 devstack cinder-volume[87515]: INFO cinder.volume.drivers.remotefs [None req-e870a91e-bfae-4c41-9458-a57a127017be tempest-VolumesListAdminTestJSON-1662385217 None] casted to osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c Sep 07 10:02:57 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-e870a91e-bfae-4c41-9458-a57a127017be tempest-VolumesListAdminTestJSON-1662385217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-45f0e84e-ad99-4e4b-a581-dbd29c3c6f78 1073741824 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:02:57 devstack sudo[93419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-45f0e84e-ad99-4e4b-a581-dbd29c3c6f78 1073741824 Sep 07 10:02:57 devstack sudo[93419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:02:58 devstack sudo[93419]: pam_unix(sudo:session): session closed for user root Sep 07 10:02:58 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-e870a91e-bfae-4c41-9458-a57a127017be tempest-VolumesListAdminTestJSON-1662385217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-45f0e84e-ad99-4e4b-a581-dbd29c3c6f78 1073741824" returned: 0 in 0.656s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:02:58 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-e870a91e-bfae-4c41-9458-a57a127017be tempest-VolumesListAdminTestJSON-1662385217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-45f0e84e-ad99-4e4b-a581-dbd29c3c6f78 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:02:58 devstack sudo[93426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-45f0e84e-ad99-4e4b-a581-dbd29c3c6f78 Sep 07 10:02:58 devstack sudo[93426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:02:59 devstack sudo[93426]: pam_unix(sudo:session): session closed for user root Sep 07 10:02:59 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-e870a91e-bfae-4c41-9458-a57a127017be tempest-VolumesListAdminTestJSON-1662385217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-45f0e84e-ad99-4e4b-a581-dbd29c3c6f78" returned: 0 in 0.654s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:02:59 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-e870a91e-bfae-4c41-9458-a57a127017be tempest-VolumesListAdminTestJSON-1662385217 None] <== create_volume: return (1402ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'} {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 10:02:59 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-e870a91e-bfae-4c41-9458-a57a127017be tempest-VolumesListAdminTestJSON-1662385217 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.412s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:02:59 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-e870a91e-bfae-4c41-9458-a57a127017be tempest-VolumesListAdminTestJSON-1662385217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (362fac36-c6f7-47e2-9626-a7deccef54dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-45f0e84e-ad99-4e4b-a581-dbd29c3c6f78', 'volume_size': 1}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:02:59 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-e870a91e-bfae-4c41-9458-a57a127017be tempest-VolumesListAdminTestJSON-1662385217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a358835a-71c0-42c7-9ad6-5f44c139c08b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:02:59 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-e870a91e-bfae-4c41-9458-a57a127017be tempest-VolumesListAdminTestJSON-1662385217 None] Volume volume-45f0e84e-ad99-4e4b-a581-dbd29c3c6f78 (45f0e84e-ad99-4e4b-a581-dbd29c3c6f78): created successfully Sep 07 10:02:59 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-e870a91e-bfae-4c41-9458-a57a127017be tempest-VolumesListAdminTestJSON-1662385217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a358835a-71c0-42c7-9ad6-5f44c139c08b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:02:59 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-e870a91e-bfae-4c41-9458-a57a127017be tempest-VolumesListAdminTestJSON-1662385217 None] Flow 'volume_create_manager' (29f632aa-4ffe-48a1-9a0a-ba19f466da30) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:02:59 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-e870a91e-bfae-4c41-9458-a57a127017be tempest-VolumesListAdminTestJSON-1662385217 None] Created volume successfully. Sep 07 10:03:00 devstack cinder-volume[87515]: DEBUG cinder.volume.flows.manager.create_volume [None req-2b52a464-cd02-46c5-ba63-8be0d41afe14 tempest-AttachVolumeNegativeTest-1630918730 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 10:03:00 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-2b52a464-cd02-46c5-ba63-8be0d41afe14 tempest-AttachVolumeNegativeTest-1630918730 None] Flow 'volume_create_manager' (1b08877e-e726-4824-91e5-31a06adce1cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:03:00 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-2b52a464-cd02-46c5-ba63-8be0d41afe14 tempest-AttachVolumeNegativeTest-1630918730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6683fd4d-e227-42e4-b581-a53b169f85d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:03:00 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-2b52a464-cd02-46c5-ba63-8be0d41afe14 tempest-AttachVolumeNegativeTest-1630918730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6683fd4d-e227-42e4-b581-a53b169f85d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:03:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-911817961',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37707359-cff1-471c-af1d-41a5088f00b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ca0169dc2c14d879d1f7bad9cb3ca6f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:03:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:03:00Z,use_quota=True,user_id='5752280db2e54f83a8c72a8f4626a43c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3a092cd-7947-4cbf-abff-4ba9567becf0),volume_type_id=f3a092cd-7947-4cbf-abff-4ba9567becf0)' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:03:00 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-2b52a464-cd02-46c5-ba63-8be0d41afe14 tempest-AttachVolumeNegativeTest-1630918730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61cd139b-8a12-483a-a582-29f12b08d5eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:03:00 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-2b52a464-cd02-46c5-ba63-8be0d41afe14 tempest-AttachVolumeNegativeTest-1630918730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61cd139b-8a12-483a-a582-29f12b08d5eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:03:00 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-2b52a464-cd02-46c5-ba63-8be0d41afe14 tempest-AttachVolumeNegativeTest-1630918730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e08b7ee3-93c2-48ed-8581-2fed814b575e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:03:00 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-2b52a464-cd02-46c5-ba63-8be0d41afe14 tempest-AttachVolumeNegativeTest-1630918730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e08b7ee3-93c2-48ed-8581-2fed814b575e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '37707359-cff1-471c-af1d-41a5088f00b1', 'volume_name': 'volume-37707359-cff1-471c-af1d-41a5088f00b1', 'volume_size': 1}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:03:00 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-2b52a464-cd02-46c5-ba63-8be0d41afe14 tempest-AttachVolumeNegativeTest-1630918730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5e49774-c517-40ef-9694-9dc3784e0415) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:03:00 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-2b52a464-cd02-46c5-ba63-8be0d41afe14 tempest-AttachVolumeNegativeTest-1630918730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5e49774-c517-40ef-9694-9dc3784e0415) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:03:00 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-2b52a464-cd02-46c5-ba63-8be0d41afe14 tempest-AttachVolumeNegativeTest-1630918730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8527a75-38af-437b-a975-774ccf0868a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:03:00 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-2b52a464-cd02-46c5-ba63-8be0d41afe14 tempest-AttachVolumeNegativeTest-1630918730 None] Volume 37707359-cff1-471c-af1d-41a5088f00b1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-37707359-cff1-471c-af1d-41a5088f00b1', 'volume_size': 1} Sep 07 10:03:00 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-2b52a464-cd02-46c5-ba63-8be0d41afe14 tempest-AttachVolumeNegativeTest-1630918730 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:03:00 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-2b52a464-cd02-46c5-ba63-8be0d41afe14 tempest-AttachVolumeNegativeTest-1630918730 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:03:00 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-2b52a464-cd02-46c5-ba63-8be0d41afe14 tempest-AttachVolumeNegativeTest-1630918730 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:03:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-911817961',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37707359-cff1-471c-af1d-41a5088f00b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ca0169dc2c14d879d1f7bad9cb3ca6f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:03:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:03:00Z,use_quota=True,user_id='5752280db2e54f83a8c72a8f4626a43c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3a092cd-7947-4cbf-abff-4ba9567becf0),volume_type_id=f3a092cd-7947-4cbf-abff-4ba9567becf0)}" {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 10:03:00 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-2b52a464-cd02-46c5-ba63-8be0d41afe14 tempest-AttachVolumeNegativeTest-1630918730 None] Creating volume 37707359-cff1-471c-af1d-41a5088f00b1 {{(pid=87515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 10:03:00 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-2b52a464-cd02-46c5-ba63-8be0d41afe14 tempest-AttachVolumeNegativeTest-1630918730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:03:00 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-2b52a464-cd02-46c5-ba63-8be0d41afe14 tempest-AttachVolumeNegativeTest-1630918730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:03:00 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-2b52a464-cd02-46c5-ba63-8be0d41afe14 tempest-AttachVolumeNegativeTest-1630918730 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:03:00 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-2b52a464-cd02-46c5-ba63-8be0d41afe14 tempest-AttachVolumeNegativeTest-1630918730 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:03:00 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-2b52a464-cd02-46c5-ba63-8be0d41afe14 tempest-AttachVolumeNegativeTest-1630918730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:03:00 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-2b52a464-cd02-46c5-ba63-8be0d41afe14 tempest-AttachVolumeNegativeTest-1630918730 None] Selected osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c as target Quobyte volume. {{(pid=87515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 10:03:00 devstack cinder-volume[87515]: INFO cinder.volume.drivers.remotefs [None req-2b52a464-cd02-46c5-ba63-8be0d41afe14 tempest-AttachVolumeNegativeTest-1630918730 None] casted to osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c Sep 07 10:03:00 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-2b52a464-cd02-46c5-ba63-8be0d41afe14 tempest-AttachVolumeNegativeTest-1630918730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-37707359-cff1-471c-af1d-41a5088f00b1 1073741824 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:03:00 devstack sudo[93440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-37707359-cff1-471c-af1d-41a5088f00b1 1073741824 Sep 07 10:03:00 devstack sudo[93440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:03:01 devstack sudo[93440]: pam_unix(sudo:session): session closed for user root Sep 07 10:03:01 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-2b52a464-cd02-46c5-ba63-8be0d41afe14 tempest-AttachVolumeNegativeTest-1630918730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-37707359-cff1-471c-af1d-41a5088f00b1 1073741824" returned: 0 in 0.991s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:03:01 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-2b52a464-cd02-46c5-ba63-8be0d41afe14 tempest-AttachVolumeNegativeTest-1630918730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-37707359-cff1-471c-af1d-41a5088f00b1 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:03:01 devstack cinder-volume[87515]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae58332d-0786-4369-865b-0fb74d54aff3 tempest-VolumesListAdminTestJSON-1244260090 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 10:03:01 devstack sudo[93487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-37707359-cff1-471c-af1d-41a5088f00b1 Sep 07 10:03:01 devstack sudo[93487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:03:01 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-ae58332d-0786-4369-865b-0fb74d54aff3 tempest-VolumesListAdminTestJSON-1244260090 None] Flow 'volume_create_manager' (47ef858b-d0a9-4de4-9049-c31011aea608) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:03:01 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-ae58332d-0786-4369-865b-0fb74d54aff3 tempest-VolumesListAdminTestJSON-1244260090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b985ad6-399c-4ebb-8f59-1e21472b7394) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:03:01 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-ae58332d-0786-4369-865b-0fb74d54aff3 tempest-VolumesListAdminTestJSON-1244260090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b985ad6-399c-4ebb-8f59-1e21472b7394) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:03:01Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=806a855f-a24e-4388-9c5d-eff5951e09c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='772c81cbbe1b47f8a83ac67c52b2eb7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:03:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:03:02Z,use_quota=True,user_id='9f8ab4b599ae449c888a67dfabbb52cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3a092cd-7947-4cbf-abff-4ba9567becf0),volume_type_id=f3a092cd-7947-4cbf-abff-4ba9567becf0)' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:03:01 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-ae58332d-0786-4369-865b-0fb74d54aff3 tempest-VolumesListAdminTestJSON-1244260090 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3ced5ac-dc7d-421f-ab9c-9e2ed6b32b60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:03:01 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-ae58332d-0786-4369-865b-0fb74d54aff3 tempest-VolumesListAdminTestJSON-1244260090 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3ced5ac-dc7d-421f-ab9c-9e2ed6b32b60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:03:01 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-ae58332d-0786-4369-865b-0fb74d54aff3 tempest-VolumesListAdminTestJSON-1244260090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5c3c2df-b593-4f76-9368-31b2c7f276fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:03:01 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-ae58332d-0786-4369-865b-0fb74d54aff3 tempest-VolumesListAdminTestJSON-1244260090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5c3c2df-b593-4f76-9368-31b2c7f276fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '806a855f-a24e-4388-9c5d-eff5951e09c1', 'volume_name': 'volume-806a855f-a24e-4388-9c5d-eff5951e09c1', 'volume_size': 1}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:03:01 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-ae58332d-0786-4369-865b-0fb74d54aff3 tempest-VolumesListAdminTestJSON-1244260090 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a43034e-eb48-4516-aca8-12091da37e06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:03:01 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-ae58332d-0786-4369-865b-0fb74d54aff3 tempest-VolumesListAdminTestJSON-1244260090 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a43034e-eb48-4516-aca8-12091da37e06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:03:01 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-ae58332d-0786-4369-865b-0fb74d54aff3 tempest-VolumesListAdminTestJSON-1244260090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8a8ef0c-aa5e-4160-afb7-0c6576a14bc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:03:01 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-ae58332d-0786-4369-865b-0fb74d54aff3 tempest-VolumesListAdminTestJSON-1244260090 None] Volume 806a855f-a24e-4388-9c5d-eff5951e09c1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-806a855f-a24e-4388-9c5d-eff5951e09c1', 'volume_size': 1} Sep 07 10:03:01 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-ae58332d-0786-4369-865b-0fb74d54aff3 tempest-VolumesListAdminTestJSON-1244260090 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:03:02 devstack sudo[93487]: pam_unix(sudo:session): session closed for user root Sep 07 10:03:02 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-2b52a464-cd02-46c5-ba63-8be0d41afe14 tempest-AttachVolumeNegativeTest-1630918730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-37707359-cff1-471c-af1d-41a5088f00b1" returned: 0 in 0.357s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:03:02 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-2b52a464-cd02-46c5-ba63-8be0d41afe14 tempest-AttachVolumeNegativeTest-1630918730 None] <== create_volume: return (1446ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'} {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 10:03:02 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-2b52a464-cd02-46c5-ba63-8be0d41afe14 tempest-AttachVolumeNegativeTest-1630918730 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.450s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:03:02 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-ae58332d-0786-4369-865b-0fb74d54aff3 tempest-VolumesListAdminTestJSON-1244260090 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.197s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:03:02 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-ae58332d-0786-4369-865b-0fb74d54aff3 tempest-VolumesListAdminTestJSON-1244260090 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:03:01Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=806a855f-a24e-4388-9c5d-eff5951e09c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='772c81cbbe1b47f8a83ac67c52b2eb7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:03:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:03:02Z,use_quota=True,user_id='9f8ab4b599ae449c888a67dfabbb52cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3a092cd-7947-4cbf-abff-4ba9567becf0),volume_type_id=f3a092cd-7947-4cbf-abff-4ba9567becf0)}" {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 10:03:02 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-ae58332d-0786-4369-865b-0fb74d54aff3 tempest-VolumesListAdminTestJSON-1244260090 None] Creating volume 806a855f-a24e-4388-9c5d-eff5951e09c1 {{(pid=87515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 10:03:02 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-ae58332d-0786-4369-865b-0fb74d54aff3 tempest-VolumesListAdminTestJSON-1244260090 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:03:02 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-ae58332d-0786-4369-865b-0fb74d54aff3 tempest-VolumesListAdminTestJSON-1244260090 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:03:02 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-ae58332d-0786-4369-865b-0fb74d54aff3 tempest-VolumesListAdminTestJSON-1244260090 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:03:02 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-ae58332d-0786-4369-865b-0fb74d54aff3 tempest-VolumesListAdminTestJSON-1244260090 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:03:02 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-ae58332d-0786-4369-865b-0fb74d54aff3 tempest-VolumesListAdminTestJSON-1244260090 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:03:02 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-ae58332d-0786-4369-865b-0fb74d54aff3 tempest-VolumesListAdminTestJSON-1244260090 None] Selected osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c as target Quobyte volume. {{(pid=87515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 10:03:02 devstack cinder-volume[87515]: INFO cinder.volume.drivers.remotefs [None req-ae58332d-0786-4369-865b-0fb74d54aff3 tempest-VolumesListAdminTestJSON-1244260090 None] casted to osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c Sep 07 10:03:02 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-ae58332d-0786-4369-865b-0fb74d54aff3 tempest-VolumesListAdminTestJSON-1244260090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-806a855f-a24e-4388-9c5d-eff5951e09c1 1073741824 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:03:02 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-2b52a464-cd02-46c5-ba63-8be0d41afe14 tempest-AttachVolumeNegativeTest-1630918730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8527a75-38af-437b-a975-774ccf0868a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-37707359-cff1-471c-af1d-41a5088f00b1', 'volume_size': 1}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:03:02 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-2b52a464-cd02-46c5-ba63-8be0d41afe14 tempest-AttachVolumeNegativeTest-1630918730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7dac9e70-2cb2-4e22-b6a2-8f51660cc395) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:03:02 devstack sudo[93490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-806a855f-a24e-4388-9c5d-eff5951e09c1 1073741824 Sep 07 10:03:02 devstack sudo[93490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:03:02 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-2b52a464-cd02-46c5-ba63-8be0d41afe14 tempest-AttachVolumeNegativeTest-1630918730 None] Volume volume-37707359-cff1-471c-af1d-41a5088f00b1 (37707359-cff1-471c-af1d-41a5088f00b1): created successfully Sep 07 10:03:02 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-2b52a464-cd02-46c5-ba63-8be0d41afe14 tempest-AttachVolumeNegativeTest-1630918730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7dac9e70-2cb2-4e22-b6a2-8f51660cc395) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:03:02 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-2b52a464-cd02-46c5-ba63-8be0d41afe14 tempest-AttachVolumeNegativeTest-1630918730 None] Flow 'volume_create_manager' (1b08877e-e726-4824-91e5-31a06adce1cf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:03:02 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-2b52a464-cd02-46c5-ba63-8be0d41afe14 tempest-AttachVolumeNegativeTest-1630918730 None] Created volume successfully. Sep 07 10:03:02 devstack cinder-volume[87515]: DEBUG cinder.volume.flows.manager.create_volume [None req-218cf804-64f5-46e1-8474-96292e01173f tempest-VolumeQuotasNegativeTestJSON-1571111674 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 10:03:03 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-218cf804-64f5-46e1-8474-96292e01173f tempest-VolumeQuotasNegativeTestJSON-1571111674 None] Flow 'volume_create_manager' (8ac39166-2e84-4967-b18c-ffec8d1dbce2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:03:03 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-218cf804-64f5-46e1-8474-96292e01173f tempest-VolumeQuotasNegativeTestJSON-1571111674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02cc7c56-c414-4ac6-9e49-2c72d7c4dca0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:03:03 devstack sudo[93490]: pam_unix(sudo:session): session closed for user root Sep 07 10:03:03 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-218cf804-64f5-46e1-8474-96292e01173f tempest-VolumeQuotasNegativeTestJSON-1571111674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02cc7c56-c414-4ac6-9e49-2c72d7c4dca0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:03:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1128461522',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f129f32-78c2-4819-8b39-8fd3b4d439d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb8a4f2da8a945f3a7766b297b8c6ae6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:03:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:03:03Z,use_quota=True,user_id='daa09ef112c7465ead7b62690ad6f531',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3a092cd-7947-4cbf-abff-4ba9567becf0),volume_type_id=f3a092cd-7947-4cbf-abff-4ba9567becf0)' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:03:03 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-218cf804-64f5-46e1-8474-96292e01173f tempest-VolumeQuotasNegativeTestJSON-1571111674 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b202e676-8162-4ea3-84c1-499bacb35b7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:03:03 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-218cf804-64f5-46e1-8474-96292e01173f tempest-VolumeQuotasNegativeTestJSON-1571111674 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b202e676-8162-4ea3-84c1-499bacb35b7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:03:03 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-218cf804-64f5-46e1-8474-96292e01173f tempest-VolumeQuotasNegativeTestJSON-1571111674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d24a1804-25a3-4505-9ac6-c6b536378696) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:03:03 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-218cf804-64f5-46e1-8474-96292e01173f tempest-VolumeQuotasNegativeTestJSON-1571111674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d24a1804-25a3-4505-9ac6-c6b536378696) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1f129f32-78c2-4819-8b39-8fd3b4d439d7', 'volume_name': 'volume-1f129f32-78c2-4819-8b39-8fd3b4d439d7', 'volume_size': 1}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:03:03 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-218cf804-64f5-46e1-8474-96292e01173f tempest-VolumeQuotasNegativeTestJSON-1571111674 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9155d132-49ba-4a78-8153-f1e84b0e930e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:03:03 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-218cf804-64f5-46e1-8474-96292e01173f tempest-VolumeQuotasNegativeTestJSON-1571111674 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9155d132-49ba-4a78-8153-f1e84b0e930e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:03:03 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-218cf804-64f5-46e1-8474-96292e01173f tempest-VolumeQuotasNegativeTestJSON-1571111674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e1221b7-b94c-48ab-92df-bbc74a831d7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:03:03 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-218cf804-64f5-46e1-8474-96292e01173f tempest-VolumeQuotasNegativeTestJSON-1571111674 None] Volume 1f129f32-78c2-4819-8b39-8fd3b4d439d7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1f129f32-78c2-4819-8b39-8fd3b4d439d7', 'volume_size': 1} Sep 07 10:03:03 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-218cf804-64f5-46e1-8474-96292e01173f tempest-VolumeQuotasNegativeTestJSON-1571111674 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:03:03 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-ae58332d-0786-4369-865b-0fb74d54aff3 tempest-VolumesListAdminTestJSON-1244260090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-806a855f-a24e-4388-9c5d-eff5951e09c1 1073741824" returned: 0 in 1.060s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:03:03 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-ae58332d-0786-4369-865b-0fb74d54aff3 tempest-VolumesListAdminTestJSON-1244260090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-806a855f-a24e-4388-9c5d-eff5951e09c1 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:03:03 devstack sudo[93502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-806a855f-a24e-4388-9c5d-eff5951e09c1 Sep 07 10:03:03 devstack sudo[93502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:03:03 devstack sudo[93502]: pam_unix(sudo:session): session closed for user root Sep 07 10:03:03 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-ae58332d-0786-4369-865b-0fb74d54aff3 tempest-VolumesListAdminTestJSON-1244260090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-806a855f-a24e-4388-9c5d-eff5951e09c1" returned: 0 in 0.297s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:03:03 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-ae58332d-0786-4369-865b-0fb74d54aff3 tempest-VolumesListAdminTestJSON-1244260090 None] <== create_volume: return (1410ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'} {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 10:03:03 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-ae58332d-0786-4369-865b-0fb74d54aff3 tempest-VolumesListAdminTestJSON-1244260090 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.413s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:03:03 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-218cf804-64f5-46e1-8474-96292e01173f tempest-VolumeQuotasNegativeTestJSON-1571111674 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.344s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:03:03 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-218cf804-64f5-46e1-8474-96292e01173f tempest-VolumeQuotasNegativeTestJSON-1571111674 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:03:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1128461522',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f129f32-78c2-4819-8b39-8fd3b4d439d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb8a4f2da8a945f3a7766b297b8c6ae6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:03:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:03:03Z,use_quota=True,user_id='daa09ef112c7465ead7b62690ad6f531',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3a092cd-7947-4cbf-abff-4ba9567becf0),volume_type_id=f3a092cd-7947-4cbf-abff-4ba9567becf0)}" {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 10:03:03 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-218cf804-64f5-46e1-8474-96292e01173f tempest-VolumeQuotasNegativeTestJSON-1571111674 None] Creating volume 1f129f32-78c2-4819-8b39-8fd3b4d439d7 {{(pid=87515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 10:03:03 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-218cf804-64f5-46e1-8474-96292e01173f tempest-VolumeQuotasNegativeTestJSON-1571111674 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:03:03 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-218cf804-64f5-46e1-8474-96292e01173f tempest-VolumeQuotasNegativeTestJSON-1571111674 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:03:03 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-218cf804-64f5-46e1-8474-96292e01173f tempest-VolumeQuotasNegativeTestJSON-1571111674 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:03:03 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-218cf804-64f5-46e1-8474-96292e01173f tempest-VolumeQuotasNegativeTestJSON-1571111674 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:03:03 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-218cf804-64f5-46e1-8474-96292e01173f tempest-VolumeQuotasNegativeTestJSON-1571111674 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:03:03 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-218cf804-64f5-46e1-8474-96292e01173f tempest-VolumeQuotasNegativeTestJSON-1571111674 None] Selected osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c as target Quobyte volume. {{(pid=87515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 10:03:03 devstack cinder-volume[87515]: INFO cinder.volume.drivers.remotefs [None req-218cf804-64f5-46e1-8474-96292e01173f tempest-VolumeQuotasNegativeTestJSON-1571111674 None] casted to osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c Sep 07 10:03:03 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-218cf804-64f5-46e1-8474-96292e01173f tempest-VolumeQuotasNegativeTestJSON-1571111674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-1f129f32-78c2-4819-8b39-8fd3b4d439d7 1073741824 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:03:03 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-ae58332d-0786-4369-865b-0fb74d54aff3 tempest-VolumesListAdminTestJSON-1244260090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8a8ef0c-aa5e-4160-afb7-0c6576a14bc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-806a855f-a24e-4388-9c5d-eff5951e09c1', 'volume_size': 1}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:03:03 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-ae58332d-0786-4369-865b-0fb74d54aff3 tempest-VolumesListAdminTestJSON-1244260090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fcd57b5b-6905-4f90-a0c5-fde8b61166ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:03:03 devstack sudo[93513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-1f129f32-78c2-4819-8b39-8fd3b4d439d7 1073741824 Sep 07 10:03:03 devstack sudo[93513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:03:03 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-ae58332d-0786-4369-865b-0fb74d54aff3 tempest-VolumesListAdminTestJSON-1244260090 None] Volume volume-806a855f-a24e-4388-9c5d-eff5951e09c1 (806a855f-a24e-4388-9c5d-eff5951e09c1): created successfully Sep 07 10:03:03 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-ae58332d-0786-4369-865b-0fb74d54aff3 tempest-VolumesListAdminTestJSON-1244260090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fcd57b5b-6905-4f90-a0c5-fde8b61166ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:03:03 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-ae58332d-0786-4369-865b-0fb74d54aff3 tempest-VolumesListAdminTestJSON-1244260090 None] Flow 'volume_create_manager' (47ef858b-d0a9-4de4-9049-c31011aea608) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:03:03 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [req-4f7cb994-4803-4981-b1cb-cf95c4b944a8 req-cb299d93-522d-449c-a649-cd888d06ec0f tempest-AttachVolumeNegativeTest-1630918730 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:03:03 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-ae58332d-0786-4369-865b-0fb74d54aff3 tempest-VolumesListAdminTestJSON-1244260090 None] Created volume successfully. Sep 07 10:03:03 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-36154005-c3e0-4577-a64a-f1ed174fd9b5 tempest-ServerRescueNegativeTestJSON-2123327993 None] Acquiring lock "cinder-edc0eb2c-81be-4b59-a68d-d01d02f936a7-delete_volume" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:03:04 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-36154005-c3e0-4577-a64a-f1ed174fd9b5 tempest-ServerRescueNegativeTestJSON-2123327993 None] Lock "cinder-edc0eb2c-81be-4b59-a68d-d01d02f936a7-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:03:04 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-36154005-c3e0-4577-a64a-f1ed174fd9b5 tempest-ServerRescueNegativeTestJSON-2123327993 None] Acquiring lock "cinder-quobyte-edc0eb2c-81be-4b59-a68d-d01d02f936a7" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:03:04 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-899bfba2-0467-4df5-8256-60073f8d51ce tempest-VolumesListAdminTestJSON-1244260090 None] Acquiring lock "cinder-806a855f-a24e-4388-9c5d-eff5951e09c1-delete_volume" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:03:04 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-36154005-c3e0-4577-a64a-f1ed174fd9b5 tempest-ServerRescueNegativeTestJSON-2123327993 None] Lock "cinder-quobyte-edc0eb2c-81be-4b59-a68d-d01d02f936a7" acquired by "delete_volume" :: waited 0.026s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:03:04 devstack sudo[93513]: pam_unix(sudo:session): session closed for user root Sep 07 10:03:04 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-899bfba2-0467-4df5-8256-60073f8d51ce tempest-VolumesListAdminTestJSON-1244260090 None] Lock "cinder-806a855f-a24e-4388-9c5d-eff5951e09c1-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:03:04 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-218cf804-64f5-46e1-8474-96292e01173f tempest-VolumeQuotasNegativeTestJSON-1571111674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-1f129f32-78c2-4819-8b39-8fd3b4d439d7 1073741824" returned: 0 in 0.669s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:03:04 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[d195cb51-67d5-4d2e-85b8-37d3de409395]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:03:04 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-36154005-c3e0-4577-a64a-f1ed174fd9b5 tempest-ServerRescueNegativeTestJSON-2123327993 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-edc0eb2c-81be-4b59-a68d-d01d02f936a7 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:03:04 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-899bfba2-0467-4df5-8256-60073f8d51ce tempest-VolumesListAdminTestJSON-1244260090 None] Acquiring lock "cinder-quobyte-806a855f-a24e-4388-9c5d-eff5951e09c1" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:03:04 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-218cf804-64f5-46e1-8474-96292e01173f tempest-VolumeQuotasNegativeTestJSON-1571111674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-1f129f32-78c2-4819-8b39-8fd3b4d439d7 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:03:04 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-899bfba2-0467-4df5-8256-60073f8d51ce tempest-VolumesListAdminTestJSON-1244260090 None] Lock "cinder-quobyte-806a855f-a24e-4388-9c5d-eff5951e09c1" acquired by "delete_volume" :: waited 0.084s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:03:04 devstack sudo[93520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-1f129f32-78c2-4819-8b39-8fd3b4d439d7 Sep 07 10:03:04 devstack sudo[93520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:03:04 devstack sudo[93519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-edc0eb2c-81be-4b59-a68d-d01d02f936a7 Sep 07 10:03:04 devstack sudo[93519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:03:04 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[52cd291b-137f-4868-ae1a-4084118ad03c]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:03:04 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-899bfba2-0467-4df5-8256-60073f8d51ce tempest-VolumesListAdminTestJSON-1244260090 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-806a855f-a24e-4388-9c5d-eff5951e09c1 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:03:04 devstack sudo[93523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-806a855f-a24e-4388-9c5d-eff5951e09c1 Sep 07 10:03:04 devstack sudo[93523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:03:04 devstack sudo[93520]: pam_unix(sudo:session): session closed for user root Sep 07 10:03:04 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-218cf804-64f5-46e1-8474-96292e01173f tempest-VolumeQuotasNegativeTestJSON-1571111674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-1f129f32-78c2-4819-8b39-8fd3b4d439d7" returned: 0 in 0.428s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:03:04 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-218cf804-64f5-46e1-8474-96292e01173f tempest-VolumeQuotasNegativeTestJSON-1571111674 None] <== create_volume: return (1241ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'} {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 10:03:04 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-218cf804-64f5-46e1-8474-96292e01173f tempest-VolumeQuotasNegativeTestJSON-1571111674 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.246s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:03:04 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [req-4f7cb994-4803-4981-b1cb-cf95c4b944a8 req-cb299d93-522d-449c-a649-cd888d06ec0f tempest-AttachVolumeNegativeTest-1630918730 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.165s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:03:04 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [req-4f7cb994-4803-4981-b1cb-cf95c4b944a8 req-cb299d93-522d-449c-a649-cd888d06ec0f tempest-AttachVolumeNegativeTest-1630918730 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.032s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:03:04 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-218cf804-64f5-46e1-8474-96292e01173f tempest-VolumeQuotasNegativeTestJSON-1571111674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e1221b7-b94c-48ab-92df-bbc74a831d7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1f129f32-78c2-4819-8b39-8fd3b4d439d7', 'volume_size': 1}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:03:04 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-218cf804-64f5-46e1-8474-96292e01173f tempest-VolumeQuotasNegativeTestJSON-1571111674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8eaf2082-1ca5-40fa-93b8-470fe14c1a34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:03:04 devstack sudo[93519]: pam_unix(sudo:session): session closed for user root Sep 07 10:03:04 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-36154005-c3e0-4577-a64a-f1ed174fd9b5 tempest-ServerRescueNegativeTestJSON-2123327993 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-edc0eb2c-81be-4b59-a68d-d01d02f936a7" returned: 0 in 0.649s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:03:04 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-36154005-c3e0-4577-a64a-f1ed174fd9b5 tempest-ServerRescueNegativeTestJSON-2123327993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-edc0eb2c-81be-4b59-a68d-d01d02f936a7 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:03:04 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-e03ba056-c5ed-493b-8ccc-6f3c334a0bc9 tempest-VolumesListAdminTestJSON-1662385217 None] Acquiring lock "cinder-45f0e84e-ad99-4e4b-a581-dbd29c3c6f78-delete_volume" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:03:04 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-218cf804-64f5-46e1-8474-96292e01173f tempest-VolumeQuotasNegativeTestJSON-1571111674 None] Volume volume-1f129f32-78c2-4819-8b39-8fd3b4d439d7 (1f129f32-78c2-4819-8b39-8fd3b4d439d7): created successfully Sep 07 10:03:04 devstack sudo[93530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-edc0eb2c-81be-4b59-a68d-d01d02f936a7 Sep 07 10:03:04 devstack sudo[93530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:03:04 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-218cf804-64f5-46e1-8474-96292e01173f tempest-VolumeQuotasNegativeTestJSON-1571111674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8eaf2082-1ca5-40fa-93b8-470fe14c1a34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:03:04 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-218cf804-64f5-46e1-8474-96292e01173f tempest-VolumeQuotasNegativeTestJSON-1571111674 None] Flow 'volume_create_manager' (8ac39166-2e84-4967-b18c-ffec8d1dbce2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:03:04 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-218cf804-64f5-46e1-8474-96292e01173f tempest-VolumeQuotasNegativeTestJSON-1571111674 None] Created volume successfully. Sep 07 10:03:04 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-e03ba056-c5ed-493b-8ccc-6f3c334a0bc9 tempest-VolumesListAdminTestJSON-1662385217 None] Lock "cinder-45f0e84e-ad99-4e4b-a581-dbd29c3c6f78-delete_volume" acquired by "delete_volume" :: waited 0.093s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:03:04 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [req-4f7cb994-4803-4981-b1cb-cf95c4b944a8 req-cb299d93-522d-449c-a649-cd888d06ec0f tempest-AttachVolumeNegativeTest-1630918730 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c', 'name': 'volume-37707359-cff1-471c-af1d-41a5088f00b1', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2e904dac-89dd-4bd0-a45f-0f2873906bba', 'enforce_multipath': True} {{(pid=87515) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 07 10:03:05 devstack sudo[93523]: pam_unix(sudo:session): session closed for user root Sep 07 10:03:05 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-e03ba056-c5ed-493b-8ccc-6f3c334a0bc9 tempest-VolumesListAdminTestJSON-1662385217 None] Acquiring lock "cinder-quobyte-45f0e84e-ad99-4e4b-a581-dbd29c3c6f78" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:03:05 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-899bfba2-0467-4df5-8256-60073f8d51ce tempest-VolumesListAdminTestJSON-1244260090 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-806a855f-a24e-4388-9c5d-eff5951e09c1" returned: 0 in 0.677s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:03:05 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-899bfba2-0467-4df5-8256-60073f8d51ce tempest-VolumesListAdminTestJSON-1244260090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-806a855f-a24e-4388-9c5d-eff5951e09c1 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:03:05 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-e03ba056-c5ed-493b-8ccc-6f3c334a0bc9 tempest-VolumesListAdminTestJSON-1662385217 None] Lock "cinder-quobyte-45f0e84e-ad99-4e4b-a581-dbd29c3c6f78" acquired by "delete_volume" :: waited 0.047s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:03:05 devstack sudo[93535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-806a855f-a24e-4388-9c5d-eff5951e09c1 Sep 07 10:03:05 devstack sudo[93535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:03:05 devstack cinder-volume[87515]: INFO cinder.volume.manager [req-4f7cb994-4803-4981-b1cb-cf95c4b944a8 req-cb299d93-522d-449c-a649-cd888d06ec0f tempest-AttachVolumeNegativeTest-1630918730 None] attachment_update completed successfully. Sep 07 10:03:05 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fe26762-4aeb-427f-a6e0-17f39b616f67]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:03:05 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-e03ba056-c5ed-493b-8ccc-6f3c334a0bc9 tempest-VolumesListAdminTestJSON-1662385217 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-45f0e84e-ad99-4e4b-a581-dbd29c3c6f78 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:03:05 devstack sudo[93530]: pam_unix(sudo:session): session closed for user root Sep 07 10:03:05 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-36154005-c3e0-4577-a64a-f1ed174fd9b5 tempest-ServerRescueNegativeTestJSON-2123327993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-edc0eb2c-81be-4b59-a68d-d01d02f936a7" returned: 0 in 0.596s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:03:05 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-36154005-c3e0-4577-a64a-f1ed174fd9b5 tempest-ServerRescueNegativeTestJSON-2123327993 None] Lock "cinder-quobyte-edc0eb2c-81be-4b59-a68d-d01d02f936a7" released by "delete_volume" :: held 1.357s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:03:05 devstack sudo[93537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-45f0e84e-ad99-4e4b-a581-dbd29c3c6f78 Sep 07 10:03:05 devstack sudo[93537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:03:05 devstack sudo[93535]: pam_unix(sudo:session): session closed for user root Sep 07 10:03:05 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-899bfba2-0467-4df5-8256-60073f8d51ce tempest-VolumesListAdminTestJSON-1244260090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-806a855f-a24e-4388-9c5d-eff5951e09c1" returned: 0 in 0.525s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:03:05 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-899bfba2-0467-4df5-8256-60073f8d51ce tempest-VolumesListAdminTestJSON-1244260090 None] Lock "cinder-quobyte-806a855f-a24e-4388-9c5d-eff5951e09c1" released by "delete_volume" :: held 1.313s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:03:05 devstack cinder-volume[87515]: DEBUG cinder.quota [None req-36154005-c3e0-4577-a64a-f1ed174fd9b5 tempest-ServerRescueNegativeTestJSON-2123327993 None] Created reservations ['9314367e-d7f3-480e-9485-6bbeb7113fe0', 'c7f28ebd-d7c3-4d69-958e-64b919faef07', '97fa5cea-d7d9-462a-b348-e7a12f6ecd05', 'f7455c6a-19c4-47e7-a4b9-13a51e5f2519'] {{(pid=87515) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:03:05 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-36154005-c3e0-4577-a64a-f1ed174fd9b5 tempest-ServerRescueNegativeTestJSON-2123327993 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:03:05 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-36154005-c3e0-4577-a64a-f1ed174fd9b5 tempest-ServerRescueNegativeTestJSON-2123327993 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:03:05 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-36154005-c3e0-4577-a64a-f1ed174fd9b5 tempest-ServerRescueNegativeTestJSON-2123327993 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:03:05 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-36154005-c3e0-4577-a64a-f1ed174fd9b5 tempest-ServerRescueNegativeTestJSON-2123327993 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:03:05 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-36154005-c3e0-4577-a64a-f1ed174fd9b5 tempest-ServerRescueNegativeTestJSON-2123327993 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:03:05 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-36154005-c3e0-4577-a64a-f1ed174fd9b5 tempest-ServerRescueNegativeTestJSON-2123327993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:03:05 devstack cinder-volume[87515]: DEBUG cinder.quota [None req-899bfba2-0467-4df5-8256-60073f8d51ce tempest-VolumesListAdminTestJSON-1244260090 None] Created reservations ['d3f0a908-30b1-4be5-a8e8-d7316f477fff', '2d3a291b-992b-4021-984d-89798b9e5be3', '016d9c5b-fd1c-4083-b52f-0c2683f93bf3', 'df12fbe3-db35-46f0-a606-90b790375683'] {{(pid=87515) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:03:05 devstack sudo[93921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a Sep 07 10:03:05 devstack sudo[93921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:03:06 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-899bfba2-0467-4df5-8256-60073f8d51ce tempest-VolumesListAdminTestJSON-1244260090 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:03:06 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-899bfba2-0467-4df5-8256-60073f8d51ce tempest-VolumesListAdminTestJSON-1244260090 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:03:06 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-899bfba2-0467-4df5-8256-60073f8d51ce tempest-VolumesListAdminTestJSON-1244260090 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:03:06 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-899bfba2-0467-4df5-8256-60073f8d51ce tempest-VolumesListAdminTestJSON-1244260090 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:03:06 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-899bfba2-0467-4df5-8256-60073f8d51ce tempest-VolumesListAdminTestJSON-1244260090 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:03:06 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-899bfba2-0467-4df5-8256-60073f8d51ce tempest-VolumesListAdminTestJSON-1244260090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:03:06 devstack sudo[93537]: pam_unix(sudo:session): session closed for user root Sep 07 10:03:06 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-e03ba056-c5ed-493b-8ccc-6f3c334a0bc9 tempest-VolumesListAdminTestJSON-1662385217 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-45f0e84e-ad99-4e4b-a581-dbd29c3c6f78" returned: 0 in 0.891s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:03:06 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-e03ba056-c5ed-493b-8ccc-6f3c334a0bc9 tempest-VolumesListAdminTestJSON-1662385217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-45f0e84e-ad99-4e4b-a581-dbd29c3c6f78 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:03:06 devstack sudo[93928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a Sep 07 10:03:06 devstack sudo[93928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:03:06 devstack sudo[93929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-45f0e84e-ad99-4e4b-a581-dbd29c3c6f78 Sep 07 10:03:06 devstack sudo[93929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:03:06 devstack sudo[93921]: pam_unix(sudo:session): session closed for user root Sep 07 10:03:06 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-36154005-c3e0-4577-a64a-f1ed174fd9b5 tempest-ServerRescueNegativeTestJSON-2123327993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a" returned: 0 in 0.554s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:03:06 devstack cinder-volume[87515]: DEBUG cinder.manager [None req-36154005-c3e0-4577-a64a-f1ed174fd9b5 tempest-ServerRescueNegativeTestJSON-2123327993 None] Notifying Schedulers of capabilities ... {{(pid=87515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:03:06 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-36154005-c3e0-4577-a64a-f1ed174fd9b5 tempest-ServerRescueNegativeTestJSON-2123327993 None] Deleted volume successfully. Sep 07 10:03:06 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-36154005-c3e0-4577-a64a-f1ed174fd9b5 tempest-ServerRescueNegativeTestJSON-2123327993 None] Lock "cinder-edc0eb2c-81be-4b59-a68d-d01d02f936a7-delete_volume" released by "delete_volume" :: held 2.425s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:03:06 devstack sudo[93929]: pam_unix(sudo:session): session closed for user root Sep 07 10:03:06 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-e03ba056-c5ed-493b-8ccc-6f3c334a0bc9 tempest-VolumesListAdminTestJSON-1662385217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-45f0e84e-ad99-4e4b-a581-dbd29c3c6f78" returned: 0 in 0.548s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:03:06 devstack sudo[93928]: pam_unix(sudo:session): session closed for user root Sep 07 10:03:06 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-899bfba2-0467-4df5-8256-60073f8d51ce tempest-VolumesListAdminTestJSON-1244260090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a" returned: 0 in 0.606s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:03:06 devstack cinder-volume[87515]: DEBUG cinder.manager [None req-899bfba2-0467-4df5-8256-60073f8d51ce tempest-VolumesListAdminTestJSON-1244260090 None] Notifying Schedulers of capabilities ... {{(pid=87515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:03:06 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-e03ba056-c5ed-493b-8ccc-6f3c334a0bc9 tempest-VolumesListAdminTestJSON-1662385217 None] Lock "cinder-quobyte-45f0e84e-ad99-4e4b-a581-dbd29c3c6f78" released by "delete_volume" :: held 1.554s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:03:06 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-899bfba2-0467-4df5-8256-60073f8d51ce tempest-VolumesListAdminTestJSON-1244260090 None] Deleted volume successfully. Sep 07 10:03:06 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-899bfba2-0467-4df5-8256-60073f8d51ce tempest-VolumesListAdminTestJSON-1244260090 None] Lock "cinder-806a855f-a24e-4388-9c5d-eff5951e09c1-delete_volume" released by "delete_volume" :: held 2.568s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:03:06 devstack cinder-volume[87515]: DEBUG cinder.quota [None req-e03ba056-c5ed-493b-8ccc-6f3c334a0bc9 tempest-VolumesListAdminTestJSON-1662385217 None] Created reservations ['4de6524e-f146-4047-a6af-8dea37d7ed26', 'be6cd637-0ca0-4b8f-a9f8-9d36fe03791d', '56cb60d5-7e29-420c-84a4-16b95843677f', '20ef8a8f-8f36-4c40-ad71-6ff627791a8b'] {{(pid=87515) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:03:06 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-e03ba056-c5ed-493b-8ccc-6f3c334a0bc9 tempest-VolumesListAdminTestJSON-1662385217 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:03:06 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-e03ba056-c5ed-493b-8ccc-6f3c334a0bc9 tempest-VolumesListAdminTestJSON-1662385217 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:03:06 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-e03ba056-c5ed-493b-8ccc-6f3c334a0bc9 tempest-VolumesListAdminTestJSON-1662385217 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:03:06 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-e03ba056-c5ed-493b-8ccc-6f3c334a0bc9 tempest-VolumesListAdminTestJSON-1662385217 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:03:06 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-e03ba056-c5ed-493b-8ccc-6f3c334a0bc9 tempest-VolumesListAdminTestJSON-1662385217 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.036s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:03:06 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-e03ba056-c5ed-493b-8ccc-6f3c334a0bc9 tempest-VolumesListAdminTestJSON-1662385217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:03:07 devstack sudo[93936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a Sep 07 10:03:07 devstack sudo[93936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:03:07 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-113e39ab-d774-45f6-a2ad-0a6666d31473 tempest-VolumeQuotasNegativeTestJSON-1571111674 None] Acquiring lock "cinder-1f129f32-78c2-4819-8b39-8fd3b4d439d7-delete_volume" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:03:07 devstack sudo[93936]: pam_unix(sudo:session): session closed for user root Sep 07 10:03:07 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-113e39ab-d774-45f6-a2ad-0a6666d31473 tempest-VolumeQuotasNegativeTestJSON-1571111674 None] Lock "cinder-1f129f32-78c2-4819-8b39-8fd3b4d439d7-delete_volume" acquired by "delete_volume" :: waited 0.086s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:03:07 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-e03ba056-c5ed-493b-8ccc-6f3c334a0bc9 tempest-VolumesListAdminTestJSON-1662385217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a" returned: 0 in 0.470s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:03:07 devstack cinder-volume[87515]: DEBUG cinder.manager [None req-e03ba056-c5ed-493b-8ccc-6f3c334a0bc9 tempest-VolumesListAdminTestJSON-1662385217 None] Notifying Schedulers of capabilities ... {{(pid=87515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:03:07 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-e03ba056-c5ed-493b-8ccc-6f3c334a0bc9 tempest-VolumesListAdminTestJSON-1662385217 None] Deleted volume successfully. Sep 07 10:03:07 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-113e39ab-d774-45f6-a2ad-0a6666d31473 tempest-VolumeQuotasNegativeTestJSON-1571111674 None] Acquiring lock "cinder-quobyte-1f129f32-78c2-4819-8b39-8fd3b4d439d7" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:03:07 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-e03ba056-c5ed-493b-8ccc-6f3c334a0bc9 tempest-VolumesListAdminTestJSON-1662385217 None] Lock "cinder-45f0e84e-ad99-4e4b-a581-dbd29c3c6f78-delete_volume" released by "delete_volume" :: held 2.677s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:03:07 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-113e39ab-d774-45f6-a2ad-0a6666d31473 tempest-VolumeQuotasNegativeTestJSON-1571111674 None] Lock "cinder-quobyte-1f129f32-78c2-4819-8b39-8fd3b4d439d7" acquired by "delete_volume" :: waited 0.100s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:03:07 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[34951441-4a47-4f7b-829f-704de0d12454]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:03:07 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-113e39ab-d774-45f6-a2ad-0a6666d31473 tempest-VolumeQuotasNegativeTestJSON-1571111674 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-1f129f32-78c2-4819-8b39-8fd3b4d439d7 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:03:07 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-cff14640-8d0d-4bf8-b6cd-048f83d275b2 tempest-VolumesListAdminTestJSON-1662385217 None] Acquiring lock "cinder-0a713fce-0faf-425f-b408-b4bff5720310-delete_volume" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:03:07 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-cff14640-8d0d-4bf8-b6cd-048f83d275b2 tempest-VolumesListAdminTestJSON-1662385217 None] Lock "cinder-0a713fce-0faf-425f-b408-b4bff5720310-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:03:07 devstack sudo[93952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-1f129f32-78c2-4819-8b39-8fd3b4d439d7 Sep 07 10:03:07 devstack sudo[93952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:03:07 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-cff14640-8d0d-4bf8-b6cd-048f83d275b2 tempest-VolumesListAdminTestJSON-1662385217 None] Acquiring lock "cinder-quobyte-0a713fce-0faf-425f-b408-b4bff5720310" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:03:08 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-cff14640-8d0d-4bf8-b6cd-048f83d275b2 tempest-VolumesListAdminTestJSON-1662385217 None] Lock "cinder-quobyte-0a713fce-0faf-425f-b408-b4bff5720310" acquired by "delete_volume" :: waited 0.022s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:03:08 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[545f18e9-8e7f-4256-9402-ace1ce9c6714]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:03:08 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-cff14640-8d0d-4bf8-b6cd-048f83d275b2 tempest-VolumesListAdminTestJSON-1662385217 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-0a713fce-0faf-425f-b408-b4bff5720310 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:03:08 devstack sudo[93963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-0a713fce-0faf-425f-b408-b4bff5720310 Sep 07 10:03:08 devstack sudo[93963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:03:08 devstack sudo[93952]: pam_unix(sudo:session): session closed for user root Sep 07 10:03:08 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-113e39ab-d774-45f6-a2ad-0a6666d31473 tempest-VolumeQuotasNegativeTestJSON-1571111674 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-1f129f32-78c2-4819-8b39-8fd3b4d439d7" returned: 0 in 0.694s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:03:08 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-113e39ab-d774-45f6-a2ad-0a6666d31473 tempest-VolumeQuotasNegativeTestJSON-1571111674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-1f129f32-78c2-4819-8b39-8fd3b4d439d7 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:03:08 devstack sudo[93970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-1f129f32-78c2-4819-8b39-8fd3b4d439d7 Sep 07 10:03:08 devstack sudo[93970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:03:08 devstack sudo[93970]: pam_unix(sudo:session): session closed for user root Sep 07 10:03:08 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-113e39ab-d774-45f6-a2ad-0a6666d31473 tempest-VolumeQuotasNegativeTestJSON-1571111674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-1f129f32-78c2-4819-8b39-8fd3b4d439d7" returned: 0 in 0.394s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:03:08 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-113e39ab-d774-45f6-a2ad-0a6666d31473 tempest-VolumeQuotasNegativeTestJSON-1571111674 None] Lock "cinder-quobyte-1f129f32-78c2-4819-8b39-8fd3b4d439d7" released by "delete_volume" :: held 1.179s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:03:08 devstack cinder-volume[87515]: DEBUG cinder.quota [None req-113e39ab-d774-45f6-a2ad-0a6666d31473 tempest-VolumeQuotasNegativeTestJSON-1571111674 None] Created reservations ['575db543-6aa6-4d02-bcb7-f3d37d439872', 'f2768f46-b9b3-488e-ab22-cf6089700071', 'ea1caa9f-df01-4af5-80f5-a994a6a03d56', '05faecb8-5dba-44cc-8dc7-013dedde2dd4'] {{(pid=87515) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:03:09 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-113e39ab-d774-45f6-a2ad-0a6666d31473 tempest-VolumeQuotasNegativeTestJSON-1571111674 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:03:09 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-113e39ab-d774-45f6-a2ad-0a6666d31473 tempest-VolumeQuotasNegativeTestJSON-1571111674 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:03:09 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-113e39ab-d774-45f6-a2ad-0a6666d31473 tempest-VolumeQuotasNegativeTestJSON-1571111674 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:03:09 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-113e39ab-d774-45f6-a2ad-0a6666d31473 tempest-VolumeQuotasNegativeTestJSON-1571111674 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:03:09 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-113e39ab-d774-45f6-a2ad-0a6666d31473 tempest-VolumeQuotasNegativeTestJSON-1571111674 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:03:09 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-113e39ab-d774-45f6-a2ad-0a6666d31473 tempest-VolumeQuotasNegativeTestJSON-1571111674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:03:09 devstack sudo[93978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a Sep 07 10:03:09 devstack sudo[93978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:03:09 devstack sudo[93963]: pam_unix(sudo:session): session closed for user root Sep 07 10:03:09 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-cff14640-8d0d-4bf8-b6cd-048f83d275b2 tempest-VolumesListAdminTestJSON-1662385217 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-0a713fce-0faf-425f-b408-b4bff5720310" returned: 0 in 1.236s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:03:09 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-cff14640-8d0d-4bf8-b6cd-048f83d275b2 tempest-VolumesListAdminTestJSON-1662385217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-0a713fce-0faf-425f-b408-b4bff5720310 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:03:09 devstack sudo[93980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-0a713fce-0faf-425f-b408-b4bff5720310 Sep 07 10:03:09 devstack sudo[93980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:03:09 devstack sudo[93978]: pam_unix(sudo:session): session closed for user root Sep 07 10:03:09 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-113e39ab-d774-45f6-a2ad-0a6666d31473 tempest-VolumeQuotasNegativeTestJSON-1571111674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a" returned: 0 in 0.595s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:03:09 devstack cinder-volume[87515]: DEBUG cinder.manager [None req-113e39ab-d774-45f6-a2ad-0a6666d31473 tempest-VolumeQuotasNegativeTestJSON-1571111674 None] Notifying Schedulers of capabilities ... {{(pid=87515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:03:09 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-113e39ab-d774-45f6-a2ad-0a6666d31473 tempest-VolumeQuotasNegativeTestJSON-1571111674 None] Deleted volume successfully. Sep 07 10:03:09 devstack sudo[93980]: pam_unix(sudo:session): session closed for user root Sep 07 10:03:09 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-cff14640-8d0d-4bf8-b6cd-048f83d275b2 tempest-VolumesListAdminTestJSON-1662385217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-0a713fce-0faf-425f-b408-b4bff5720310" returned: 0 in 0.541s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:03:09 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-cff14640-8d0d-4bf8-b6cd-048f83d275b2 tempest-VolumesListAdminTestJSON-1662385217 None] Lock "cinder-quobyte-0a713fce-0faf-425f-b408-b4bff5720310" released by "delete_volume" :: held 1.877s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:03:09 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-113e39ab-d774-45f6-a2ad-0a6666d31473 tempest-VolumeQuotasNegativeTestJSON-1571111674 None] Lock "cinder-1f129f32-78c2-4819-8b39-8fd3b4d439d7-delete_volume" released by "delete_volume" :: held 2.509s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:03:10 devstack cinder-volume[87515]: DEBUG cinder.quota [None req-cff14640-8d0d-4bf8-b6cd-048f83d275b2 tempest-VolumesListAdminTestJSON-1662385217 None] Created reservations ['35f92f8c-29e7-4075-a7c8-a1468df7400a', '9fab7a42-b640-40c8-b428-b8ded7c95594', '6d32672c-0712-462c-a82d-c73da44f07d7', '7ab2da03-13f9-484d-841d-d1038e16db24'] {{(pid=87515) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:03:10 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-cff14640-8d0d-4bf8-b6cd-048f83d275b2 tempest-VolumesListAdminTestJSON-1662385217 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:03:10 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-cff14640-8d0d-4bf8-b6cd-048f83d275b2 tempest-VolumesListAdminTestJSON-1662385217 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:03:10 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-cff14640-8d0d-4bf8-b6cd-048f83d275b2 tempest-VolumesListAdminTestJSON-1662385217 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:03:10 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-cff14640-8d0d-4bf8-b6cd-048f83d275b2 tempest-VolumesListAdminTestJSON-1662385217 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:03:10 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-cff14640-8d0d-4bf8-b6cd-048f83d275b2 tempest-VolumesListAdminTestJSON-1662385217 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:03:10 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-cff14640-8d0d-4bf8-b6cd-048f83d275b2 tempest-VolumesListAdminTestJSON-1662385217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:03:10 devstack sudo[93987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a Sep 07 10:03:10 devstack sudo[93987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:03:10 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-011d346c-fa57-45d5-bc01-da81e7753c16 tempest-VolumesListAdminTestJSON-1662385217 None] Acquiring lock "cinder-667a84b2-d5a1-44d1-b30a-42afa4735e21-delete_volume" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:03:10 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-011d346c-fa57-45d5-bc01-da81e7753c16 tempest-VolumesListAdminTestJSON-1662385217 None] Lock "cinder-667a84b2-d5a1-44d1-b30a-42afa4735e21-delete_volume" acquired by "delete_volume" :: waited 0.068s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:03:10 devstack sudo[93987]: pam_unix(sudo:session): session closed for user root Sep 07 10:03:10 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-cff14640-8d0d-4bf8-b6cd-048f83d275b2 tempest-VolumesListAdminTestJSON-1662385217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a" returned: 0 in 0.538s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:03:10 devstack cinder-volume[87515]: DEBUG cinder.manager [None req-cff14640-8d0d-4bf8-b6cd-048f83d275b2 tempest-VolumesListAdminTestJSON-1662385217 None] Notifying Schedulers of capabilities ... {{(pid=87515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:03:10 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-cff14640-8d0d-4bf8-b6cd-048f83d275b2 tempest-VolumesListAdminTestJSON-1662385217 None] Deleted volume successfully. Sep 07 10:03:10 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-011d346c-fa57-45d5-bc01-da81e7753c16 tempest-VolumesListAdminTestJSON-1662385217 None] Acquiring lock "cinder-quobyte-667a84b2-d5a1-44d1-b30a-42afa4735e21" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:03:10 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-cff14640-8d0d-4bf8-b6cd-048f83d275b2 tempest-VolumesListAdminTestJSON-1662385217 None] Lock "cinder-0a713fce-0faf-425f-b408-b4bff5720310-delete_volume" released by "delete_volume" :: held 2.968s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:03:10 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-011d346c-fa57-45d5-bc01-da81e7753c16 tempest-VolumesListAdminTestJSON-1662385217 None] Lock "cinder-quobyte-667a84b2-d5a1-44d1-b30a-42afa4735e21" acquired by "delete_volume" :: waited 0.033s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:03:10 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[3752503b-dc57-4bc7-9e8b-7b99d79bb77b]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:03:10 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-011d346c-fa57-45d5-bc01-da81e7753c16 tempest-VolumesListAdminTestJSON-1662385217 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-667a84b2-d5a1-44d1-b30a-42afa4735e21 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:03:11 devstack sudo[93990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-667a84b2-d5a1-44d1-b30a-42afa4735e21 Sep 07 10:03:11 devstack sudo[93990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:03:11 devstack cinder-volume[87515]: DEBUG oslo_service.periodic_task [None req-cebd6a9d-3073-42a1-b65a-b38d444d85ed None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87515) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 10:03:11 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-cebd6a9d-3073-42a1-b65a-b38d444d85ed None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:03:11 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-cebd6a9d-3073-42a1-b65a-b38d444d85ed None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:03:11 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-cebd6a9d-3073-42a1-b65a-b38d444d85ed None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:03:11 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-cebd6a9d-3073-42a1-b65a-b38d444d85ed None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:03:11 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-cebd6a9d-3073-42a1-b65a-b38d444d85ed None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:03:11 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-cebd6a9d-3073-42a1-b65a-b38d444d85ed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:03:11 devstack sudo[93990]: pam_unix(sudo:session): session closed for user root Sep 07 10:03:11 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-011d346c-fa57-45d5-bc01-da81e7753c16 tempest-VolumesListAdminTestJSON-1662385217 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-667a84b2-d5a1-44d1-b30a-42afa4735e21" returned: 0 in 0.648s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:03:11 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-011d346c-fa57-45d5-bc01-da81e7753c16 tempest-VolumesListAdminTestJSON-1662385217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-667a84b2-d5a1-44d1-b30a-42afa4735e21 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:03:11 devstack sudo[93995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a Sep 07 10:03:11 devstack sudo[93995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:03:11 devstack sudo[93996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-667a84b2-d5a1-44d1-b30a-42afa4735e21 Sep 07 10:03:11 devstack sudo[93996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:03:12 devstack sudo[93995]: pam_unix(sudo:session): session closed for user root Sep 07 10:03:12 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-cebd6a9d-3073-42a1-b65a-b38d444d85ed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a" returned: 0 in 0.467s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:03:12 devstack cinder-volume[87515]: DEBUG cinder.manager [None req-cebd6a9d-3073-42a1-b65a-b38d444d85ed None None] Notifying Schedulers of capabilities ... {{(pid=87515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:03:12 devstack cinder-volume[87515]: DEBUG oslo_service.periodic_task [None req-cebd6a9d-3073-42a1-b65a-b38d444d85ed None None] Running periodic task VolumeManager._thread_info {{(pid=87515) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 10:03:12 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-cebd6a9d-3073-42a1-b65a-b38d444d85ed None None] thread count: 28 {{(pid=87515) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 07 10:03:12 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-cebd6a9d-3073-42a1-b65a-b38d444d85ed None None] thread info: [<_MainThread(MainThread, started 131647121809536)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87515) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 07 10:03:12 devstack sudo[93996]: pam_unix(sudo:session): session closed for user root Sep 07 10:03:12 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-011d346c-fa57-45d5-bc01-da81e7753c16 tempest-VolumesListAdminTestJSON-1662385217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-667a84b2-d5a1-44d1-b30a-42afa4735e21" returned: 0 in 0.523s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:03:12 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-011d346c-fa57-45d5-bc01-da81e7753c16 tempest-VolumesListAdminTestJSON-1662385217 None] Lock "cinder-quobyte-667a84b2-d5a1-44d1-b30a-42afa4735e21" released by "delete_volume" :: held 1.254s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:03:12 devstack cinder-volume[87515]: DEBUG cinder.quota [None req-011d346c-fa57-45d5-bc01-da81e7753c16 tempest-VolumesListAdminTestJSON-1662385217 None] Created reservations ['f176d7dc-a847-4c56-bed7-4aaff179f43a', '0ed8ada9-ae63-409c-9233-cc89f55f722d', 'ab64438d-0a33-4be5-a74a-62e43c3ec608', '74a91374-2434-4050-9073-a4b7858f3ac0'] {{(pid=87515) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:03:12 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-011d346c-fa57-45d5-bc01-da81e7753c16 tempest-VolumesListAdminTestJSON-1662385217 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:03:12 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-011d346c-fa57-45d5-bc01-da81e7753c16 tempest-VolumesListAdminTestJSON-1662385217 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:03:12 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-011d346c-fa57-45d5-bc01-da81e7753c16 tempest-VolumesListAdminTestJSON-1662385217 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:03:12 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-011d346c-fa57-45d5-bc01-da81e7753c16 tempest-VolumesListAdminTestJSON-1662385217 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:03:12 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-011d346c-fa57-45d5-bc01-da81e7753c16 tempest-VolumesListAdminTestJSON-1662385217 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:03:12 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-011d346c-fa57-45d5-bc01-da81e7753c16 tempest-VolumesListAdminTestJSON-1662385217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:03:12 devstack sudo[94001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a Sep 07 10:03:12 devstack sudo[94001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:03:12 devstack sudo[94001]: pam_unix(sudo:session): session closed for user root Sep 07 10:03:12 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-011d346c-fa57-45d5-bc01-da81e7753c16 tempest-VolumesListAdminTestJSON-1662385217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a" returned: 0 in 0.425s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:03:12 devstack cinder-volume[87515]: DEBUG cinder.manager [None req-011d346c-fa57-45d5-bc01-da81e7753c16 tempest-VolumesListAdminTestJSON-1662385217 None] Notifying Schedulers of capabilities ... {{(pid=87515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:03:12 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-011d346c-fa57-45d5-bc01-da81e7753c16 tempest-VolumesListAdminTestJSON-1662385217 None] Deleted volume successfully. Sep 07 10:03:12 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-011d346c-fa57-45d5-bc01-da81e7753c16 tempest-VolumesListAdminTestJSON-1662385217 None] Lock "cinder-667a84b2-d5a1-44d1-b30a-42afa4735e21-delete_volume" released by "delete_volume" :: held 2.246s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:03:22 devstack cinder-volume[87515]: DEBUG dbcounter [-] [87515] Writing DB stats cinder:UPDATE=77,cinder:SELECT=47,cinder:INSERT=17,cinder:DELETE=1 {{(pid=87515) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 10:03:22 devstack cinder-volume[87515]: DEBUG dbcounter [-] [87515] Writing DB stats cinder:SELECT=55,cinder:UPDATE=65,cinder:DELETE=12,cinder:INSERT=14 {{(pid=87515) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 10:03:23 devstack cinder-volume[87515]: DEBUG cinder.volume.flows.manager.create_volume [None req-8807d4d0-2f34-4ccb-8939-abf95af75ebf tempest-VolumesTransfersTest-1924607023 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 10:03:23 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-8807d4d0-2f34-4ccb-8939-abf95af75ebf tempest-VolumesTransfersTest-1924607023 None] Flow 'volume_create_manager' (3911f34d-0ee0-4a34-8394-13c898e2763a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:03:23 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-8807d4d0-2f34-4ccb-8939-abf95af75ebf tempest-VolumesTransfersTest-1924607023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e5935dd-5eb1-4cda-854e-3390b9b86887) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:03:23 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-8807d4d0-2f34-4ccb-8939-abf95af75ebf tempest-VolumesTransfersTest-1924607023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e5935dd-5eb1-4cda-854e-3390b9b86887) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:03:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-940683308',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9bf640a5-4fdd-4a06-848b-f6842a3c4535,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bbb0943da3e3463daa0a3e5980742ca9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:03:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:03:24Z,use_quota=True,user_id='f9faa0575a644f0ebd22fc35945293d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3a092cd-7947-4cbf-abff-4ba9567becf0),volume_type_id=f3a092cd-7947-4cbf-abff-4ba9567becf0)' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:03:23 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-8807d4d0-2f34-4ccb-8939-abf95af75ebf tempest-VolumesTransfersTest-1924607023 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1b41e26-5b77-4624-a6e3-c218f274b414) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:03:23 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-8807d4d0-2f34-4ccb-8939-abf95af75ebf tempest-VolumesTransfersTest-1924607023 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1b41e26-5b77-4624-a6e3-c218f274b414) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:03:23 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-8807d4d0-2f34-4ccb-8939-abf95af75ebf tempest-VolumesTransfersTest-1924607023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc17e861-0f46-4707-9a96-c1f82c1ae008) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:03:23 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-8807d4d0-2f34-4ccb-8939-abf95af75ebf tempest-VolumesTransfersTest-1924607023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc17e861-0f46-4707-9a96-c1f82c1ae008) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9bf640a5-4fdd-4a06-848b-f6842a3c4535', 'volume_name': 'volume-9bf640a5-4fdd-4a06-848b-f6842a3c4535', 'volume_size': 1}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:03:23 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-8807d4d0-2f34-4ccb-8939-abf95af75ebf tempest-VolumesTransfersTest-1924607023 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6682128-18bb-414a-9d8f-76128cb6b3b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:03:23 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-8807d4d0-2f34-4ccb-8939-abf95af75ebf tempest-VolumesTransfersTest-1924607023 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6682128-18bb-414a-9d8f-76128cb6b3b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:03:23 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-8807d4d0-2f34-4ccb-8939-abf95af75ebf tempest-VolumesTransfersTest-1924607023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22088163-c446-4ded-9d84-04ecac993801) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:03:23 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-8807d4d0-2f34-4ccb-8939-abf95af75ebf tempest-VolumesTransfersTest-1924607023 None] Volume 9bf640a5-4fdd-4a06-848b-f6842a3c4535: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9bf640a5-4fdd-4a06-848b-f6842a3c4535', 'volume_size': 1} Sep 07 10:03:23 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-8807d4d0-2f34-4ccb-8939-abf95af75ebf tempest-VolumesTransfersTest-1924607023 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:03:23 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-8807d4d0-2f34-4ccb-8939-abf95af75ebf tempest-VolumesTransfersTest-1924607023 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:03:23 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-8807d4d0-2f34-4ccb-8939-abf95af75ebf tempest-VolumesTransfersTest-1924607023 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:03:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-940683308',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9bf640a5-4fdd-4a06-848b-f6842a3c4535,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bbb0943da3e3463daa0a3e5980742ca9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:03:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:03:24Z,use_quota=True,user_id='f9faa0575a644f0ebd22fc35945293d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3a092cd-7947-4cbf-abff-4ba9567becf0),volume_type_id=f3a092cd-7947-4cbf-abff-4ba9567becf0)}" {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 10:03:23 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-8807d4d0-2f34-4ccb-8939-abf95af75ebf tempest-VolumesTransfersTest-1924607023 None] Creating volume 9bf640a5-4fdd-4a06-848b-f6842a3c4535 {{(pid=87515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 10:03:23 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-8807d4d0-2f34-4ccb-8939-abf95af75ebf tempest-VolumesTransfersTest-1924607023 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:03:23 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-8807d4d0-2f34-4ccb-8939-abf95af75ebf tempest-VolumesTransfersTest-1924607023 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:03:23 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-8807d4d0-2f34-4ccb-8939-abf95af75ebf tempest-VolumesTransfersTest-1924607023 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:03:23 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-8807d4d0-2f34-4ccb-8939-abf95af75ebf tempest-VolumesTransfersTest-1924607023 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:03:23 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-8807d4d0-2f34-4ccb-8939-abf95af75ebf tempest-VolumesTransfersTest-1924607023 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:03:23 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-8807d4d0-2f34-4ccb-8939-abf95af75ebf tempest-VolumesTransfersTest-1924607023 None] Selected osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c as target Quobyte volume. {{(pid=87515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 10:03:23 devstack cinder-volume[87515]: INFO cinder.volume.drivers.remotefs [None req-8807d4d0-2f34-4ccb-8939-abf95af75ebf tempest-VolumesTransfersTest-1924607023 None] casted to osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c Sep 07 10:03:23 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-8807d4d0-2f34-4ccb-8939-abf95af75ebf tempest-VolumesTransfersTest-1924607023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-9bf640a5-4fdd-4a06-848b-f6842a3c4535 1073741824 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:03:24 devstack sudo[94131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-9bf640a5-4fdd-4a06-848b-f6842a3c4535 1073741824 Sep 07 10:03:24 devstack sudo[94131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:03:24 devstack sudo[94131]: pam_unix(sudo:session): session closed for user root Sep 07 10:03:24 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-8807d4d0-2f34-4ccb-8939-abf95af75ebf tempest-VolumesTransfersTest-1924607023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-9bf640a5-4fdd-4a06-848b-f6842a3c4535 1073741824" returned: 0 in 0.922s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:03:24 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-8807d4d0-2f34-4ccb-8939-abf95af75ebf tempest-VolumesTransfersTest-1924607023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-9bf640a5-4fdd-4a06-848b-f6842a3c4535 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:03:25 devstack sudo[94137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-9bf640a5-4fdd-4a06-848b-f6842a3c4535 Sep 07 10:03:25 devstack sudo[94137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:03:25 devstack sudo[94137]: pam_unix(sudo:session): session closed for user root Sep 07 10:03:25 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-8807d4d0-2f34-4ccb-8939-abf95af75ebf tempest-VolumesTransfersTest-1924607023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-9bf640a5-4fdd-4a06-848b-f6842a3c4535" returned: 0 in 0.382s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:03:25 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-8807d4d0-2f34-4ccb-8939-abf95af75ebf tempest-VolumesTransfersTest-1924607023 None] <== create_volume: return (1400ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'} {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 10:03:25 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-8807d4d0-2f34-4ccb-8939-abf95af75ebf tempest-VolumesTransfersTest-1924607023 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.406s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:03:25 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-8807d4d0-2f34-4ccb-8939-abf95af75ebf tempest-VolumesTransfersTest-1924607023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22088163-c446-4ded-9d84-04ecac993801) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9bf640a5-4fdd-4a06-848b-f6842a3c4535', 'volume_size': 1}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:03:25 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-8807d4d0-2f34-4ccb-8939-abf95af75ebf tempest-VolumesTransfersTest-1924607023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e248a25-f4a3-4a53-b31e-710c33476f47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:03:25 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-8807d4d0-2f34-4ccb-8939-abf95af75ebf tempest-VolumesTransfersTest-1924607023 None] Volume volume-9bf640a5-4fdd-4a06-848b-f6842a3c4535 (9bf640a5-4fdd-4a06-848b-f6842a3c4535): created successfully Sep 07 10:03:25 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-8807d4d0-2f34-4ccb-8939-abf95af75ebf tempest-VolumesTransfersTest-1924607023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e248a25-f4a3-4a53-b31e-710c33476f47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:03:25 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-8807d4d0-2f34-4ccb-8939-abf95af75ebf tempest-VolumesTransfersTest-1924607023 None] Flow 'volume_create_manager' (3911f34d-0ee0-4a34-8394-13c898e2763a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:03:25 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-8807d4d0-2f34-4ccb-8939-abf95af75ebf tempest-VolumesTransfersTest-1924607023 None] Created volume successfully. Sep 07 10:03:27 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-08e9fd51-32d2-45a7-97a4-db35a66f2565 tempest-VolumesTransfersTest-518431570 None] Transfer volume completed successfully. Sep 07 10:03:28 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-97357b8e-05a4-4727-9ff8-9d9616f8d4c5 tempest-VolumesTransfersTest-162510829 None] Acquiring lock "cinder-9bf640a5-4fdd-4a06-848b-f6842a3c4535-delete_volume" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:03:28 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-97357b8e-05a4-4727-9ff8-9d9616f8d4c5 tempest-VolumesTransfersTest-162510829 None] Lock "cinder-9bf640a5-4fdd-4a06-848b-f6842a3c4535-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:03:28 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-97357b8e-05a4-4727-9ff8-9d9616f8d4c5 tempest-VolumesTransfersTest-162510829 None] Acquiring lock "cinder-quobyte-9bf640a5-4fdd-4a06-848b-f6842a3c4535" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:03:28 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-97357b8e-05a4-4727-9ff8-9d9616f8d4c5 tempest-VolumesTransfersTest-162510829 None] Lock "cinder-quobyte-9bf640a5-4fdd-4a06-848b-f6842a3c4535" acquired by "delete_volume" :: waited 0.026s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:03:29 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[f586097a-0372-4ccd-ad7a-dd03b6b0b813]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:03:29 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-97357b8e-05a4-4727-9ff8-9d9616f8d4c5 tempest-VolumesTransfersTest-162510829 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-9bf640a5-4fdd-4a06-848b-f6842a3c4535 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:03:29 devstack sudo[94167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-9bf640a5-4fdd-4a06-848b-f6842a3c4535 Sep 07 10:03:29 devstack sudo[94167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:03:29 devstack sudo[94167]: pam_unix(sudo:session): session closed for user root Sep 07 10:03:29 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-97357b8e-05a4-4727-9ff8-9d9616f8d4c5 tempest-VolumesTransfersTest-162510829 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-9bf640a5-4fdd-4a06-848b-f6842a3c4535" returned: 0 in 0.704s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:03:29 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-97357b8e-05a4-4727-9ff8-9d9616f8d4c5 tempest-VolumesTransfersTest-162510829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-9bf640a5-4fdd-4a06-848b-f6842a3c4535 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:03:29 devstack sudo[94172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-9bf640a5-4fdd-4a06-848b-f6842a3c4535 Sep 07 10:03:29 devstack sudo[94172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:03:30 devstack sudo[94172]: pam_unix(sudo:session): session closed for user root Sep 07 10:03:30 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-97357b8e-05a4-4727-9ff8-9d9616f8d4c5 tempest-VolumesTransfersTest-162510829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-9bf640a5-4fdd-4a06-848b-f6842a3c4535" returned: 0 in 0.423s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:03:30 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-97357b8e-05a4-4727-9ff8-9d9616f8d4c5 tempest-VolumesTransfersTest-162510829 None] Lock "cinder-quobyte-9bf640a5-4fdd-4a06-848b-f6842a3c4535" released by "delete_volume" :: held 1.219s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:03:30 devstack cinder-volume[87515]: DEBUG cinder.quota [None req-97357b8e-05a4-4727-9ff8-9d9616f8d4c5 tempest-VolumesTransfersTest-162510829 None] Created reservations ['6702d881-92e5-4bd5-8189-f1eaeef9beae', 'd7687cae-2782-4bea-98d8-e12700f63366', '2c41b886-2f4c-4694-abae-a007c4029584', '59373003-67e3-4dfb-82c3-3982d9f0e923'] {{(pid=87515) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:03:30 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-97357b8e-05a4-4727-9ff8-9d9616f8d4c5 tempest-VolumesTransfersTest-162510829 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:03:30 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-97357b8e-05a4-4727-9ff8-9d9616f8d4c5 tempest-VolumesTransfersTest-162510829 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:03:30 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-97357b8e-05a4-4727-9ff8-9d9616f8d4c5 tempest-VolumesTransfersTest-162510829 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:03:30 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-97357b8e-05a4-4727-9ff8-9d9616f8d4c5 tempest-VolumesTransfersTest-162510829 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:03:30 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-97357b8e-05a4-4727-9ff8-9d9616f8d4c5 tempest-VolumesTransfersTest-162510829 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:03:30 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-97357b8e-05a4-4727-9ff8-9d9616f8d4c5 tempest-VolumesTransfersTest-162510829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:03:30 devstack sudo[94175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a Sep 07 10:03:30 devstack sudo[94175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:03:30 devstack sudo[94175]: pam_unix(sudo:session): session closed for user root Sep 07 10:03:30 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-97357b8e-05a4-4727-9ff8-9d9616f8d4c5 tempest-VolumesTransfersTest-162510829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a" returned: 0 in 0.357s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:03:30 devstack cinder-volume[87515]: DEBUG cinder.manager [None req-97357b8e-05a4-4727-9ff8-9d9616f8d4c5 tempest-VolumesTransfersTest-162510829 None] Notifying Schedulers of capabilities ... {{(pid=87515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:03:30 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-97357b8e-05a4-4727-9ff8-9d9616f8d4c5 tempest-VolumesTransfersTest-162510829 None] Deleted volume successfully. Sep 07 10:03:30 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-97357b8e-05a4-4727-9ff8-9d9616f8d4c5 tempest-VolumesTransfersTest-162510829 None] Lock "cinder-9bf640a5-4fdd-4a06-848b-f6842a3c4535-delete_volume" released by "delete_volume" :: held 1.883s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:03:31 devstack cinder-volume[87515]: DEBUG cinder.volume.flows.manager.create_volume [None req-86b4c419-312c-48fd-9c4f-f844c180ccc6 tempest-VolumesTransfersTest-1924607023 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 10:03:32 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-86b4c419-312c-48fd-9c4f-f844c180ccc6 tempest-VolumesTransfersTest-1924607023 None] Flow 'volume_create_manager' (dc1400f9-751b-4a86-8f93-64a932bdbb8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:03:32 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-86b4c419-312c-48fd-9c4f-f844c180ccc6 tempest-VolumesTransfersTest-1924607023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46159685-8376-43fd-aa3b-cbc22cd19bb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:03:32 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-86b4c419-312c-48fd-9c4f-f844c180ccc6 tempest-VolumesTransfersTest-1924607023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46159685-8376-43fd-aa3b-cbc22cd19bb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:03:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-2015500574',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce6717b1-4634-4a79-91b6-e936e47f7c88,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bbb0943da3e3463daa0a3e5980742ca9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:03:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:03:32Z,use_quota=True,user_id='f9faa0575a644f0ebd22fc35945293d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3a092cd-7947-4cbf-abff-4ba9567becf0),volume_type_id=f3a092cd-7947-4cbf-abff-4ba9567becf0)' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:03:32 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-86b4c419-312c-48fd-9c4f-f844c180ccc6 tempest-VolumesTransfersTest-1924607023 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9a3f616-2efa-41ba-8e06-d8ec93542717) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:03:32 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-86b4c419-312c-48fd-9c4f-f844c180ccc6 tempest-VolumesTransfersTest-1924607023 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9a3f616-2efa-41ba-8e06-d8ec93542717) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:03:32 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-86b4c419-312c-48fd-9c4f-f844c180ccc6 tempest-VolumesTransfersTest-1924607023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36109913-f1c2-49d4-ba1b-94d562e36bfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:03:32 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-86b4c419-312c-48fd-9c4f-f844c180ccc6 tempest-VolumesTransfersTest-1924607023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36109913-f1c2-49d4-ba1b-94d562e36bfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ce6717b1-4634-4a79-91b6-e936e47f7c88', 'volume_name': 'volume-ce6717b1-4634-4a79-91b6-e936e47f7c88', 'volume_size': 1}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:03:32 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-86b4c419-312c-48fd-9c4f-f844c180ccc6 tempest-VolumesTransfersTest-1924607023 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3a50734-af3f-40ac-91dc-678b9ebf9f90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:03:32 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-86b4c419-312c-48fd-9c4f-f844c180ccc6 tempest-VolumesTransfersTest-1924607023 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3a50734-af3f-40ac-91dc-678b9ebf9f90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:03:32 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-86b4c419-312c-48fd-9c4f-f844c180ccc6 tempest-VolumesTransfersTest-1924607023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5be3c6f4-1dc7-457e-9c98-02063a20a3c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:03:32 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-86b4c419-312c-48fd-9c4f-f844c180ccc6 tempest-VolumesTransfersTest-1924607023 None] Volume ce6717b1-4634-4a79-91b6-e936e47f7c88: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ce6717b1-4634-4a79-91b6-e936e47f7c88', 'volume_size': 1} Sep 07 10:03:32 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-86b4c419-312c-48fd-9c4f-f844c180ccc6 tempest-VolumesTransfersTest-1924607023 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:03:32 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-86b4c419-312c-48fd-9c4f-f844c180ccc6 tempest-VolumesTransfersTest-1924607023 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:03:32 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-86b4c419-312c-48fd-9c4f-f844c180ccc6 tempest-VolumesTransfersTest-1924607023 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:03:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-2015500574',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce6717b1-4634-4a79-91b6-e936e47f7c88,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bbb0943da3e3463daa0a3e5980742ca9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:03:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:03:32Z,use_quota=True,user_id='f9faa0575a644f0ebd22fc35945293d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3a092cd-7947-4cbf-abff-4ba9567becf0),volume_type_id=f3a092cd-7947-4cbf-abff-4ba9567becf0)}" {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 10:03:32 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-86b4c419-312c-48fd-9c4f-f844c180ccc6 tempest-VolumesTransfersTest-1924607023 None] Creating volume ce6717b1-4634-4a79-91b6-e936e47f7c88 {{(pid=87515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 10:03:32 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-86b4c419-312c-48fd-9c4f-f844c180ccc6 tempest-VolumesTransfersTest-1924607023 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:03:32 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-86b4c419-312c-48fd-9c4f-f844c180ccc6 tempest-VolumesTransfersTest-1924607023 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:03:32 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-86b4c419-312c-48fd-9c4f-f844c180ccc6 tempest-VolumesTransfersTest-1924607023 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:03:32 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-86b4c419-312c-48fd-9c4f-f844c180ccc6 tempest-VolumesTransfersTest-1924607023 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:03:32 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-86b4c419-312c-48fd-9c4f-f844c180ccc6 tempest-VolumesTransfersTest-1924607023 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:03:32 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-86b4c419-312c-48fd-9c4f-f844c180ccc6 tempest-VolumesTransfersTest-1924607023 None] Selected osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c as target Quobyte volume. {{(pid=87515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 10:03:32 devstack cinder-volume[87515]: INFO cinder.volume.drivers.remotefs [None req-86b4c419-312c-48fd-9c4f-f844c180ccc6 tempest-VolumesTransfersTest-1924607023 None] casted to osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c Sep 07 10:03:32 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-86b4c419-312c-48fd-9c4f-f844c180ccc6 tempest-VolumesTransfersTest-1924607023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-ce6717b1-4634-4a79-91b6-e936e47f7c88 1073741824 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:03:32 devstack sudo[94178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-ce6717b1-4634-4a79-91b6-e936e47f7c88 1073741824 Sep 07 10:03:32 devstack sudo[94178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:03:32 devstack sudo[94178]: pam_unix(sudo:session): session closed for user root Sep 07 10:03:32 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-86b4c419-312c-48fd-9c4f-f844c180ccc6 tempest-VolumesTransfersTest-1924607023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-ce6717b1-4634-4a79-91b6-e936e47f7c88 1073741824" returned: 0 in 0.703s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:03:32 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-86b4c419-312c-48fd-9c4f-f844c180ccc6 tempest-VolumesTransfersTest-1924607023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-ce6717b1-4634-4a79-91b6-e936e47f7c88 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:03:32 devstack sudo[94184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-ce6717b1-4634-4a79-91b6-e936e47f7c88 Sep 07 10:03:32 devstack sudo[94184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:03:33 devstack sudo[94184]: pam_unix(sudo:session): session closed for user root Sep 07 10:03:33 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-86b4c419-312c-48fd-9c4f-f844c180ccc6 tempest-VolumesTransfersTest-1924607023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-ce6717b1-4634-4a79-91b6-e936e47f7c88" returned: 0 in 0.295s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:03:33 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-86b4c419-312c-48fd-9c4f-f844c180ccc6 tempest-VolumesTransfersTest-1924607023 None] <== create_volume: return (1061ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'} {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 10:03:33 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-86b4c419-312c-48fd-9c4f-f844c180ccc6 tempest-VolumesTransfersTest-1924607023 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.066s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:03:33 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-86b4c419-312c-48fd-9c4f-f844c180ccc6 tempest-VolumesTransfersTest-1924607023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5be3c6f4-1dc7-457e-9c98-02063a20a3c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ce6717b1-4634-4a79-91b6-e936e47f7c88', 'volume_size': 1}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:03:33 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-86b4c419-312c-48fd-9c4f-f844c180ccc6 tempest-VolumesTransfersTest-1924607023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4936ae19-2892-4ad2-9cbd-9590f5e3218c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:03:33 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-86b4c419-312c-48fd-9c4f-f844c180ccc6 tempest-VolumesTransfersTest-1924607023 None] Volume volume-ce6717b1-4634-4a79-91b6-e936e47f7c88 (ce6717b1-4634-4a79-91b6-e936e47f7c88): created successfully Sep 07 10:03:33 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-86b4c419-312c-48fd-9c4f-f844c180ccc6 tempest-VolumesTransfersTest-1924607023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4936ae19-2892-4ad2-9cbd-9590f5e3218c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:03:33 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-86b4c419-312c-48fd-9c4f-f844c180ccc6 tempest-VolumesTransfersTest-1924607023 None] Flow 'volume_create_manager' (dc1400f9-751b-4a86-8f93-64a932bdbb8f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:03:33 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-86b4c419-312c-48fd-9c4f-f844c180ccc6 tempest-VolumesTransfersTest-1924607023 None] Created volume successfully. Sep 07 10:03:34 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-16f88a22-b259-4cc8-9acd-753975498fbc tempest-VolumesTransfersTest-162510829 None] Acquiring lock "cinder-ce6717b1-4634-4a79-91b6-e936e47f7c88-delete_volume" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:03:34 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-16f88a22-b259-4cc8-9acd-753975498fbc tempest-VolumesTransfersTest-162510829 None] Lock "cinder-ce6717b1-4634-4a79-91b6-e936e47f7c88-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:03:34 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-16f88a22-b259-4cc8-9acd-753975498fbc tempest-VolumesTransfersTest-162510829 None] Acquiring lock "cinder-quobyte-ce6717b1-4634-4a79-91b6-e936e47f7c88" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:03:34 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-16f88a22-b259-4cc8-9acd-753975498fbc tempest-VolumesTransfersTest-162510829 None] Lock "cinder-quobyte-ce6717b1-4634-4a79-91b6-e936e47f7c88" acquired by "delete_volume" :: waited 0.017s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:03:34 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[87429de6-b584-4c98-9951-3eb485bc7bfb]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:03:34 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-16f88a22-b259-4cc8-9acd-753975498fbc tempest-VolumesTransfersTest-162510829 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-ce6717b1-4634-4a79-91b6-e936e47f7c88 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:03:35 devstack sudo[94187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-ce6717b1-4634-4a79-91b6-e936e47f7c88 Sep 07 10:03:35 devstack sudo[94187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:03:35 devstack sudo[94187]: pam_unix(sudo:session): session closed for user root Sep 07 10:03:35 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-16f88a22-b259-4cc8-9acd-753975498fbc tempest-VolumesTransfersTest-162510829 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-ce6717b1-4634-4a79-91b6-e936e47f7c88" returned: 0 in 0.514s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:03:35 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-16f88a22-b259-4cc8-9acd-753975498fbc tempest-VolumesTransfersTest-162510829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-ce6717b1-4634-4a79-91b6-e936e47f7c88 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:03:35 devstack sudo[94192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-ce6717b1-4634-4a79-91b6-e936e47f7c88 Sep 07 10:03:35 devstack sudo[94192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:03:35 devstack sudo[94192]: pam_unix(sudo:session): session closed for user root Sep 07 10:03:35 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-16f88a22-b259-4cc8-9acd-753975498fbc tempest-VolumesTransfersTest-162510829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-ce6717b1-4634-4a79-91b6-e936e47f7c88" returned: 0 in 0.352s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:03:35 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-16f88a22-b259-4cc8-9acd-753975498fbc tempest-VolumesTransfersTest-162510829 None] Lock "cinder-quobyte-ce6717b1-4634-4a79-91b6-e936e47f7c88" released by "delete_volume" :: held 1.015s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:03:36 devstack cinder-volume[87515]: DEBUG cinder.quota [None req-16f88a22-b259-4cc8-9acd-753975498fbc tempest-VolumesTransfersTest-162510829 None] Created reservations ['a1d74563-158c-4ce5-b362-129d51e03119', '1eb6d6d7-18af-4275-922c-21539967e124', '97116c1c-c2e2-4631-af44-95c71f387cf1', '89bac201-8ae3-4fe0-8b3e-089554038868'] {{(pid=87515) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:03:36 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-16f88a22-b259-4cc8-9acd-753975498fbc tempest-VolumesTransfersTest-162510829 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:03:36 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-16f88a22-b259-4cc8-9acd-753975498fbc tempest-VolumesTransfersTest-162510829 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:03:36 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-16f88a22-b259-4cc8-9acd-753975498fbc tempest-VolumesTransfersTest-162510829 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:03:36 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-16f88a22-b259-4cc8-9acd-753975498fbc tempest-VolumesTransfersTest-162510829 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:03:36 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-16f88a22-b259-4cc8-9acd-753975498fbc tempest-VolumesTransfersTest-162510829 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:03:36 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-16f88a22-b259-4cc8-9acd-753975498fbc tempest-VolumesTransfersTest-162510829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:03:36 devstack sudo[94195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a Sep 07 10:03:36 devstack sudo[94195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:03:36 devstack sudo[94195]: pam_unix(sudo:session): session closed for user root Sep 07 10:03:36 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-16f88a22-b259-4cc8-9acd-753975498fbc tempest-VolumesTransfersTest-162510829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a" returned: 0 in 0.375s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:03:36 devstack cinder-volume[87515]: DEBUG cinder.manager [None req-16f88a22-b259-4cc8-9acd-753975498fbc tempest-VolumesTransfersTest-162510829 None] Notifying Schedulers of capabilities ... {{(pid=87515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:03:36 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-16f88a22-b259-4cc8-9acd-753975498fbc tempest-VolumesTransfersTest-162510829 None] Deleted volume successfully. Sep 07 10:03:36 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-16f88a22-b259-4cc8-9acd-753975498fbc tempest-VolumesTransfersTest-162510829 None] Lock "cinder-ce6717b1-4634-4a79-91b6-e936e47f7c88-delete_volume" released by "delete_volume" :: held 1.748s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:03:46 devstack cinder-volume[87515]: DEBUG dbcounter [-] [87515] Writing DB stats cinder:SELECT=12,cinder:UPDATE=26,cinder:INSERT=6,cinder:DELETE=1 {{(pid=87515) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 10:03:46 devstack cinder-volume[87515]: DEBUG dbcounter [-] [87515] Writing DB stats cinder:UPDATE=18,cinder:SELECT=17,cinder:DELETE=3,cinder:INSERT=4 {{(pid=87515) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 10:03:50 devstack cinder-volume[87515]: DEBUG cinder.volume.flows.manager.create_volume [None req-bf224200-1161-46a7-8ea8-e8f1f56c1bb6 tempest-VolumesTransfersV355Test-537106762 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 10:03:50 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-bf224200-1161-46a7-8ea8-e8f1f56c1bb6 tempest-VolumesTransfersV355Test-537106762 None] Flow 'volume_create_manager' (79b1be36-d110-4214-b933-1189dc3cadda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:03:50 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-bf224200-1161-46a7-8ea8-e8f1f56c1bb6 tempest-VolumesTransfersV355Test-537106762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55510f69-b812-44e2-89d2-a7f9eef2fb54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:03:50 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-bf224200-1161-46a7-8ea8-e8f1f56c1bb6 tempest-VolumesTransfersV355Test-537106762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55510f69-b812-44e2-89d2-a7f9eef2fb54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:03:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1489786204',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8407d795-ae33-4f85-a9bc-d84cc7f17967,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a78613a413a44d6871af1f1b3ad0bdf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:03:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:03:51Z,use_quota=True,user_id='8a5f674fe97a490bb08da5e435e20cee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3a092cd-7947-4cbf-abff-4ba9567becf0),volume_type_id=f3a092cd-7947-4cbf-abff-4ba9567becf0)' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:03:50 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-bf224200-1161-46a7-8ea8-e8f1f56c1bb6 tempest-VolumesTransfersV355Test-537106762 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6e4d80d-a9f4-4277-be22-d4f54b2ea787) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:03:50 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-bf224200-1161-46a7-8ea8-e8f1f56c1bb6 tempest-VolumesTransfersV355Test-537106762 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6e4d80d-a9f4-4277-be22-d4f54b2ea787) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:03:50 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-bf224200-1161-46a7-8ea8-e8f1f56c1bb6 tempest-VolumesTransfersV355Test-537106762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49445549-df7d-40b8-858e-519e5b631aca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:03:50 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-bf224200-1161-46a7-8ea8-e8f1f56c1bb6 tempest-VolumesTransfersV355Test-537106762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49445549-df7d-40b8-858e-519e5b631aca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8407d795-ae33-4f85-a9bc-d84cc7f17967', 'volume_name': 'volume-8407d795-ae33-4f85-a9bc-d84cc7f17967', 'volume_size': 1}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:03:50 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-bf224200-1161-46a7-8ea8-e8f1f56c1bb6 tempest-VolumesTransfersV355Test-537106762 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bbdae232-c1d8-4c17-afa1-92d66f2fb4a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:03:50 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-bf224200-1161-46a7-8ea8-e8f1f56c1bb6 tempest-VolumesTransfersV355Test-537106762 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bbdae232-c1d8-4c17-afa1-92d66f2fb4a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:03:50 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-bf224200-1161-46a7-8ea8-e8f1f56c1bb6 tempest-VolumesTransfersV355Test-537106762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (318ebd98-b7a4-409a-9403-ab3a25ed1775) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:03:50 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-bf224200-1161-46a7-8ea8-e8f1f56c1bb6 tempest-VolumesTransfersV355Test-537106762 None] Volume 8407d795-ae33-4f85-a9bc-d84cc7f17967: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8407d795-ae33-4f85-a9bc-d84cc7f17967', 'volume_size': 1} Sep 07 10:03:50 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-bf224200-1161-46a7-8ea8-e8f1f56c1bb6 tempest-VolumesTransfersV355Test-537106762 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:03:50 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-bf224200-1161-46a7-8ea8-e8f1f56c1bb6 tempest-VolumesTransfersV355Test-537106762 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:03:50 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-bf224200-1161-46a7-8ea8-e8f1f56c1bb6 tempest-VolumesTransfersV355Test-537106762 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:03:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1489786204',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8407d795-ae33-4f85-a9bc-d84cc7f17967,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a78613a413a44d6871af1f1b3ad0bdf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:03:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:03:51Z,use_quota=True,user_id='8a5f674fe97a490bb08da5e435e20cee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3a092cd-7947-4cbf-abff-4ba9567becf0),volume_type_id=f3a092cd-7947-4cbf-abff-4ba9567becf0)}" {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 10:03:50 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-bf224200-1161-46a7-8ea8-e8f1f56c1bb6 tempest-VolumesTransfersV355Test-537106762 None] Creating volume 8407d795-ae33-4f85-a9bc-d84cc7f17967 {{(pid=87515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 10:03:50 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-bf224200-1161-46a7-8ea8-e8f1f56c1bb6 tempest-VolumesTransfersV355Test-537106762 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:03:50 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-bf224200-1161-46a7-8ea8-e8f1f56c1bb6 tempest-VolumesTransfersV355Test-537106762 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:03:50 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-bf224200-1161-46a7-8ea8-e8f1f56c1bb6 tempest-VolumesTransfersV355Test-537106762 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:03:50 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-bf224200-1161-46a7-8ea8-e8f1f56c1bb6 tempest-VolumesTransfersV355Test-537106762 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:03:50 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-bf224200-1161-46a7-8ea8-e8f1f56c1bb6 tempest-VolumesTransfersV355Test-537106762 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:03:50 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-bf224200-1161-46a7-8ea8-e8f1f56c1bb6 tempest-VolumesTransfersV355Test-537106762 None] Selected osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c as target Quobyte volume. {{(pid=87515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 10:03:50 devstack cinder-volume[87515]: INFO cinder.volume.drivers.remotefs [None req-bf224200-1161-46a7-8ea8-e8f1f56c1bb6 tempest-VolumesTransfersV355Test-537106762 None] casted to osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c Sep 07 10:03:50 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-bf224200-1161-46a7-8ea8-e8f1f56c1bb6 tempest-VolumesTransfersV355Test-537106762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-8407d795-ae33-4f85-a9bc-d84cc7f17967 1073741824 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:03:50 devstack sudo[94256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-8407d795-ae33-4f85-a9bc-d84cc7f17967 1073741824 Sep 07 10:03:50 devstack sudo[94256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:03:51 devstack sudo[94256]: pam_unix(sudo:session): session closed for user root Sep 07 10:03:51 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-bf224200-1161-46a7-8ea8-e8f1f56c1bb6 tempest-VolumesTransfersV355Test-537106762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-8407d795-ae33-4f85-a9bc-d84cc7f17967 1073741824" returned: 0 in 0.684s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:03:51 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-bf224200-1161-46a7-8ea8-e8f1f56c1bb6 tempest-VolumesTransfersV355Test-537106762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-8407d795-ae33-4f85-a9bc-d84cc7f17967 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:03:51 devstack sudo[94268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-8407d795-ae33-4f85-a9bc-d84cc7f17967 Sep 07 10:03:51 devstack sudo[94268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:03:51 devstack sudo[94268]: pam_unix(sudo:session): session closed for user root Sep 07 10:03:51 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-bf224200-1161-46a7-8ea8-e8f1f56c1bb6 tempest-VolumesTransfersV355Test-537106762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-8407d795-ae33-4f85-a9bc-d84cc7f17967" returned: 0 in 0.455s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:03:51 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-bf224200-1161-46a7-8ea8-e8f1f56c1bb6 tempest-VolumesTransfersV355Test-537106762 None] <== create_volume: return (1200ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'} {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 10:03:51 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-bf224200-1161-46a7-8ea8-e8f1f56c1bb6 tempest-VolumesTransfersV355Test-537106762 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.203s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:03:51 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-bf224200-1161-46a7-8ea8-e8f1f56c1bb6 tempest-VolumesTransfersV355Test-537106762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (318ebd98-b7a4-409a-9403-ab3a25ed1775) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8407d795-ae33-4f85-a9bc-d84cc7f17967', 'volume_size': 1}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:03:51 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-bf224200-1161-46a7-8ea8-e8f1f56c1bb6 tempest-VolumesTransfersV355Test-537106762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b054a7f3-a489-423a-a04b-2435b2431d86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:03:51 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-bf224200-1161-46a7-8ea8-e8f1f56c1bb6 tempest-VolumesTransfersV355Test-537106762 None] Volume volume-8407d795-ae33-4f85-a9bc-d84cc7f17967 (8407d795-ae33-4f85-a9bc-d84cc7f17967): created successfully Sep 07 10:03:51 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-bf224200-1161-46a7-8ea8-e8f1f56c1bb6 tempest-VolumesTransfersV355Test-537106762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b054a7f3-a489-423a-a04b-2435b2431d86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:03:51 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-bf224200-1161-46a7-8ea8-e8f1f56c1bb6 tempest-VolumesTransfersV355Test-537106762 None] Flow 'volume_create_manager' (79b1be36-d110-4214-b933-1189dc3cadda) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:03:51 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-bf224200-1161-46a7-8ea8-e8f1f56c1bb6 tempest-VolumesTransfersV355Test-537106762 None] Created volume successfully. Sep 07 10:03:54 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-9559a1a9-ccf2-4c77-8a05-f87b002125d7 tempest-VolumesTransfersV355Test-1835872615 None] Transfer volume completed successfully. Sep 07 10:03:54 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-2293c887-570d-430e-98d6-10e1d285652e tempest-VolumesTransfersV355Test-729404254 None] Acquiring lock "cinder-8407d795-ae33-4f85-a9bc-d84cc7f17967-delete_volume" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:03:54 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-2293c887-570d-430e-98d6-10e1d285652e tempest-VolumesTransfersV355Test-729404254 None] Lock "cinder-8407d795-ae33-4f85-a9bc-d84cc7f17967-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:03:54 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-2293c887-570d-430e-98d6-10e1d285652e tempest-VolumesTransfersV355Test-729404254 None] Acquiring lock "cinder-quobyte-8407d795-ae33-4f85-a9bc-d84cc7f17967" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:03:55 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-2293c887-570d-430e-98d6-10e1d285652e tempest-VolumesTransfersV355Test-729404254 None] Lock "cinder-quobyte-8407d795-ae33-4f85-a9bc-d84cc7f17967" acquired by "delete_volume" :: waited 0.025s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:03:55 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c2249f3-792e-4f93-a900-0fb385aec6e3]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:03:55 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-2293c887-570d-430e-98d6-10e1d285652e tempest-VolumesTransfersV355Test-729404254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-8407d795-ae33-4f85-a9bc-d84cc7f17967 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:03:55 devstack sudo[94296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-8407d795-ae33-4f85-a9bc-d84cc7f17967 Sep 07 10:03:55 devstack sudo[94296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:03:55 devstack sudo[94296]: pam_unix(sudo:session): session closed for user root Sep 07 10:03:55 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-2293c887-570d-430e-98d6-10e1d285652e tempest-VolumesTransfersV355Test-729404254 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-8407d795-ae33-4f85-a9bc-d84cc7f17967" returned: 0 in 0.555s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:03:55 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-2293c887-570d-430e-98d6-10e1d285652e tempest-VolumesTransfersV355Test-729404254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-8407d795-ae33-4f85-a9bc-d84cc7f17967 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:03:55 devstack sudo[94301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-8407d795-ae33-4f85-a9bc-d84cc7f17967 Sep 07 10:03:55 devstack sudo[94301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:03:55 devstack sudo[94301]: pam_unix(sudo:session): session closed for user root Sep 07 10:03:55 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-2293c887-570d-430e-98d6-10e1d285652e tempest-VolumesTransfersV355Test-729404254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-8407d795-ae33-4f85-a9bc-d84cc7f17967" returned: 0 in 0.342s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:03:55 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-2293c887-570d-430e-98d6-10e1d285652e tempest-VolumesTransfersV355Test-729404254 None] Lock "cinder-quobyte-8407d795-ae33-4f85-a9bc-d84cc7f17967" released by "delete_volume" :: held 0.973s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:03:56 devstack cinder-volume[87515]: DEBUG cinder.quota [None req-2293c887-570d-430e-98d6-10e1d285652e tempest-VolumesTransfersV355Test-729404254 None] Created reservations ['3eae75b7-3430-4874-b229-e72f6eb063da', 'aa8c0d47-3612-4db4-9fad-2c155c743528', '1c90f497-da8b-4496-bc4b-d7c20185050f', '79a6e2ed-51cf-4b63-9714-5bd25687f02a'] {{(pid=87515) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:03:56 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-2293c887-570d-430e-98d6-10e1d285652e tempest-VolumesTransfersV355Test-729404254 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:03:56 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-2293c887-570d-430e-98d6-10e1d285652e tempest-VolumesTransfersV355Test-729404254 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:03:56 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-2293c887-570d-430e-98d6-10e1d285652e tempest-VolumesTransfersV355Test-729404254 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:03:56 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-2293c887-570d-430e-98d6-10e1d285652e tempest-VolumesTransfersV355Test-729404254 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:03:56 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-2293c887-570d-430e-98d6-10e1d285652e tempest-VolumesTransfersV355Test-729404254 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:03:56 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-2293c887-570d-430e-98d6-10e1d285652e tempest-VolumesTransfersV355Test-729404254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:03:56 devstack sudo[94304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a Sep 07 10:03:56 devstack sudo[94304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:03:56 devstack sudo[94304]: pam_unix(sudo:session): session closed for user root Sep 07 10:03:56 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-2293c887-570d-430e-98d6-10e1d285652e tempest-VolumesTransfersV355Test-729404254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a" returned: 0 in 0.372s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:03:56 devstack cinder-volume[87515]: DEBUG cinder.manager [None req-2293c887-570d-430e-98d6-10e1d285652e tempest-VolumesTransfersV355Test-729404254 None] Notifying Schedulers of capabilities ... {{(pid=87515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:03:56 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-2293c887-570d-430e-98d6-10e1d285652e tempest-VolumesTransfersV355Test-729404254 None] Deleted volume successfully. Sep 07 10:03:56 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-2293c887-570d-430e-98d6-10e1d285652e tempest-VolumesTransfersV355Test-729404254 None] Lock "cinder-8407d795-ae33-4f85-a9bc-d84cc7f17967-delete_volume" released by "delete_volume" :: held 1.688s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:03:59 devstack cinder-volume[87515]: DEBUG cinder.volume.flows.manager.create_volume [None req-04a5b864-3774-40db-af88-5beee117cf64 tempest-VolumesActionsTest-1631371612 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 10:03:59 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-04a5b864-3774-40db-af88-5beee117cf64 tempest-VolumesActionsTest-1631371612 None] Flow 'volume_create_manager' (61148343-b93e-45cf-8c23-dadd5451f4f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:03:59 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-04a5b864-3774-40db-af88-5beee117cf64 tempest-VolumesActionsTest-1631371612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63b59257-99fa-4fe5-91ee-ff8b642cf8d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:03:59 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-04a5b864-3774-40db-af88-5beee117cf64 tempest-VolumesActionsTest-1631371612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63b59257-99fa-4fe5-91ee-ff8b642cf8d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:03:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1708238104',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e6a3de9-6f37-4b18-9e1f-fe41adcbc9fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee2f5c5241f043bcad7e7eb79fd4cbb2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:03:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:03:59Z,use_quota=True,user_id='a8f664905d5941f7a87283d9429fe770',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3a092cd-7947-4cbf-abff-4ba9567becf0),volume_type_id=f3a092cd-7947-4cbf-abff-4ba9567becf0)' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:03:59 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-04a5b864-3774-40db-af88-5beee117cf64 tempest-VolumesActionsTest-1631371612 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85f5c258-4c88-4e14-ab1c-ece7a293bcb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:03:59 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-04a5b864-3774-40db-af88-5beee117cf64 tempest-VolumesActionsTest-1631371612 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85f5c258-4c88-4e14-ab1c-ece7a293bcb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:03:59 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-04a5b864-3774-40db-af88-5beee117cf64 tempest-VolumesActionsTest-1631371612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ad6a06e-34c1-4537-bd6e-ff31c482cb2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:03:59 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-04a5b864-3774-40db-af88-5beee117cf64 tempest-VolumesActionsTest-1631371612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ad6a06e-34c1-4537-bd6e-ff31c482cb2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5e6a3de9-6f37-4b18-9e1f-fe41adcbc9fe', 'volume_name': 'volume-5e6a3de9-6f37-4b18-9e1f-fe41adcbc9fe', 'volume_size': 1}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:03:59 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-04a5b864-3774-40db-af88-5beee117cf64 tempest-VolumesActionsTest-1631371612 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a169773f-87ee-4391-b483-afa74f4f5c18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:03:59 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-04a5b864-3774-40db-af88-5beee117cf64 tempest-VolumesActionsTest-1631371612 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a169773f-87ee-4391-b483-afa74f4f5c18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:03:59 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-04a5b864-3774-40db-af88-5beee117cf64 tempest-VolumesActionsTest-1631371612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d43d4490-1e55-4e7b-880f-ddba547594bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:03:59 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-04a5b864-3774-40db-af88-5beee117cf64 tempest-VolumesActionsTest-1631371612 None] Volume 5e6a3de9-6f37-4b18-9e1f-fe41adcbc9fe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5e6a3de9-6f37-4b18-9e1f-fe41adcbc9fe', 'volume_size': 1} Sep 07 10:03:59 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-04a5b864-3774-40db-af88-5beee117cf64 tempest-VolumesActionsTest-1631371612 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:03:59 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-04a5b864-3774-40db-af88-5beee117cf64 tempest-VolumesActionsTest-1631371612 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:03:59 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-04a5b864-3774-40db-af88-5beee117cf64 tempest-VolumesActionsTest-1631371612 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:03:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1708238104',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e6a3de9-6f37-4b18-9e1f-fe41adcbc9fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee2f5c5241f043bcad7e7eb79fd4cbb2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:03:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:03:59Z,use_quota=True,user_id='a8f664905d5941f7a87283d9429fe770',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3a092cd-7947-4cbf-abff-4ba9567becf0),volume_type_id=f3a092cd-7947-4cbf-abff-4ba9567becf0)}" {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 10:03:59 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-04a5b864-3774-40db-af88-5beee117cf64 tempest-VolumesActionsTest-1631371612 None] Creating volume 5e6a3de9-6f37-4b18-9e1f-fe41adcbc9fe {{(pid=87515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 10:03:59 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-04a5b864-3774-40db-af88-5beee117cf64 tempest-VolumesActionsTest-1631371612 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:03:59 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-04a5b864-3774-40db-af88-5beee117cf64 tempest-VolumesActionsTest-1631371612 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:03:59 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-04a5b864-3774-40db-af88-5beee117cf64 tempest-VolumesActionsTest-1631371612 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:03:59 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-04a5b864-3774-40db-af88-5beee117cf64 tempest-VolumesActionsTest-1631371612 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:03:59 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-04a5b864-3774-40db-af88-5beee117cf64 tempest-VolumesActionsTest-1631371612 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:03:59 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-04a5b864-3774-40db-af88-5beee117cf64 tempest-VolumesActionsTest-1631371612 None] Selected osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c as target Quobyte volume. {{(pid=87515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 10:03:59 devstack cinder-volume[87515]: INFO cinder.volume.drivers.remotefs [None req-04a5b864-3774-40db-af88-5beee117cf64 tempest-VolumesActionsTest-1631371612 None] casted to osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c Sep 07 10:03:59 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-04a5b864-3774-40db-af88-5beee117cf64 tempest-VolumesActionsTest-1631371612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-5e6a3de9-6f37-4b18-9e1f-fe41adcbc9fe 1073741824 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:03:59 devstack cinder-volume[87515]: DEBUG cinder.volume.flows.manager.create_volume [None req-404f30d6-54a6-4f25-ad66-d34d452f1dcb tempest-VolumesTransfersV355Test-537106762 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 10:03:59 devstack sudo[94379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-5e6a3de9-6f37-4b18-9e1f-fe41adcbc9fe 1073741824 Sep 07 10:03:59 devstack sudo[94379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:03:59 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-404f30d6-54a6-4f25-ad66-d34d452f1dcb tempest-VolumesTransfersV355Test-537106762 None] Flow 'volume_create_manager' (61fc4a5f-7743-4e9e-adf0-e0cd91ae72c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:03:59 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-404f30d6-54a6-4f25-ad66-d34d452f1dcb tempest-VolumesTransfersV355Test-537106762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04db5a76-b84f-4d2a-a2f1-36b9957624f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:03:59 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-404f30d6-54a6-4f25-ad66-d34d452f1dcb tempest-VolumesTransfersV355Test-537106762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04db5a76-b84f-4d2a-a2f1-36b9957624f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:03:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-785473979',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=daa1d036-83fd-496c-9d19-1b22ddf89567,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a78613a413a44d6871af1f1b3ad0bdf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:03:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:03:59Z,use_quota=True,user_id='8a5f674fe97a490bb08da5e435e20cee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3a092cd-7947-4cbf-abff-4ba9567becf0),volume_type_id=f3a092cd-7947-4cbf-abff-4ba9567becf0)' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:03:59 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-404f30d6-54a6-4f25-ad66-d34d452f1dcb tempest-VolumesTransfersV355Test-537106762 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eaa1798f-5669-47f8-b9f0-6af605eaa6ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:03:59 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-404f30d6-54a6-4f25-ad66-d34d452f1dcb tempest-VolumesTransfersV355Test-537106762 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eaa1798f-5669-47f8-b9f0-6af605eaa6ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:03:59 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-404f30d6-54a6-4f25-ad66-d34d452f1dcb tempest-VolumesTransfersV355Test-537106762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (514e26b0-66ad-4d73-8980-e1d38990abf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:03:59 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-404f30d6-54a6-4f25-ad66-d34d452f1dcb tempest-VolumesTransfersV355Test-537106762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (514e26b0-66ad-4d73-8980-e1d38990abf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'daa1d036-83fd-496c-9d19-1b22ddf89567', 'volume_name': 'volume-daa1d036-83fd-496c-9d19-1b22ddf89567', 'volume_size': 1}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:03:59 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-404f30d6-54a6-4f25-ad66-d34d452f1dcb tempest-VolumesTransfersV355Test-537106762 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1202973d-a4a8-4329-aaf4-1b8b55de2f4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:03:59 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-404f30d6-54a6-4f25-ad66-d34d452f1dcb tempest-VolumesTransfersV355Test-537106762 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1202973d-a4a8-4329-aaf4-1b8b55de2f4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:03:59 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-404f30d6-54a6-4f25-ad66-d34d452f1dcb tempest-VolumesTransfersV355Test-537106762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66a41e21-522c-478d-82da-eeddeb70bb53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:03:59 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-404f30d6-54a6-4f25-ad66-d34d452f1dcb tempest-VolumesTransfersV355Test-537106762 None] Volume daa1d036-83fd-496c-9d19-1b22ddf89567: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-daa1d036-83fd-496c-9d19-1b22ddf89567', 'volume_size': 1} Sep 07 10:03:59 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-404f30d6-54a6-4f25-ad66-d34d452f1dcb tempest-VolumesTransfersV355Test-537106762 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:03:59 devstack cinder-volume[87515]: INFO cinder.volume.manager [req-6cd08174-4d56-4121-b77e-52f9681f934e req-fbab95f2-548d-4e4f-af2c-f3a50dd0c9d3 tempest-AttachVolumeNegativeTest-1630918730 None] Terminate volume connection completed successfully. Sep 07 10:03:59 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [req-6cd08174-4d56-4121-b77e-52f9681f934e req-fbab95f2-548d-4e4f-af2c-f3a50dd0c9d3 tempest-AttachVolumeNegativeTest-1630918730 None] Deleting attachment 2e904dac-89dd-4bd0-a45f-0f2873906bba. {{(pid=87515) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 07 10:03:59 devstack sudo[94379]: pam_unix(sudo:session): session closed for user root Sep 07 10:03:59 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-04a5b864-3774-40db-af88-5beee117cf64 tempest-VolumesActionsTest-1631371612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-5e6a3de9-6f37-4b18-9e1f-fe41adcbc9fe 1073741824" returned: 0 in 0.702s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:04:00 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-04a5b864-3774-40db-af88-5beee117cf64 tempest-VolumesActionsTest-1631371612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-5e6a3de9-6f37-4b18-9e1f-fe41adcbc9fe {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:04:00 devstack sudo[94390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-5e6a3de9-6f37-4b18-9e1f-fe41adcbc9fe Sep 07 10:04:00 devstack sudo[94390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:04:00 devstack sudo[94390]: pam_unix(sudo:session): session closed for user root Sep 07 10:04:00 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-04a5b864-3774-40db-af88-5beee117cf64 tempest-VolumesActionsTest-1631371612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-5e6a3de9-6f37-4b18-9e1f-fe41adcbc9fe" returned: 0 in 0.305s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:04:00 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-04a5b864-3774-40db-af88-5beee117cf64 tempest-VolumesActionsTest-1631371612 None] <== create_volume: return (1060ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'} {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 10:04:00 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-04a5b864-3774-40db-af88-5beee117cf64 tempest-VolumesActionsTest-1631371612 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.064s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:04:00 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-404f30d6-54a6-4f25-ad66-d34d452f1dcb tempest-VolumesTransfersV355Test-537106762 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.876s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:04:00 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-404f30d6-54a6-4f25-ad66-d34d452f1dcb tempest-VolumesTransfersV355Test-537106762 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:03:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-785473979',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=daa1d036-83fd-496c-9d19-1b22ddf89567,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a78613a413a44d6871af1f1b3ad0bdf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:03:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:03:59Z,use_quota=True,user_id='8a5f674fe97a490bb08da5e435e20cee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3a092cd-7947-4cbf-abff-4ba9567becf0),volume_type_id=f3a092cd-7947-4cbf-abff-4ba9567becf0)}" {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 10:04:00 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-404f30d6-54a6-4f25-ad66-d34d452f1dcb tempest-VolumesTransfersV355Test-537106762 None] Creating volume daa1d036-83fd-496c-9d19-1b22ddf89567 {{(pid=87515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 10:04:00 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-404f30d6-54a6-4f25-ad66-d34d452f1dcb tempest-VolumesTransfersV355Test-537106762 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:04:00 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-404f30d6-54a6-4f25-ad66-d34d452f1dcb tempest-VolumesTransfersV355Test-537106762 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:04:00 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-404f30d6-54a6-4f25-ad66-d34d452f1dcb tempest-VolumesTransfersV355Test-537106762 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:04:00 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-404f30d6-54a6-4f25-ad66-d34d452f1dcb tempest-VolumesTransfersV355Test-537106762 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:04:00 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-404f30d6-54a6-4f25-ad66-d34d452f1dcb tempest-VolumesTransfersV355Test-537106762 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:04:00 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-404f30d6-54a6-4f25-ad66-d34d452f1dcb tempest-VolumesTransfersV355Test-537106762 None] Selected osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c as target Quobyte volume. {{(pid=87515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 10:04:00 devstack cinder-volume[87515]: INFO cinder.volume.drivers.remotefs [None req-404f30d6-54a6-4f25-ad66-d34d452f1dcb tempest-VolumesTransfersV355Test-537106762 None] casted to osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c Sep 07 10:04:00 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-404f30d6-54a6-4f25-ad66-d34d452f1dcb tempest-VolumesTransfersV355Test-537106762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-daa1d036-83fd-496c-9d19-1b22ddf89567 1073741824 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:04:00 devstack sudo[94393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-daa1d036-83fd-496c-9d19-1b22ddf89567 1073741824 Sep 07 10:04:00 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-04a5b864-3774-40db-af88-5beee117cf64 tempest-VolumesActionsTest-1631371612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d43d4490-1e55-4e7b-880f-ddba547594bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5e6a3de9-6f37-4b18-9e1f-fe41adcbc9fe', 'volume_size': 1}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:04:00 devstack sudo[94393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:04:00 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-04a5b864-3774-40db-af88-5beee117cf64 tempest-VolumesActionsTest-1631371612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35a820bb-866f-49d5-9b63-c28c16d374fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:04:00 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-04a5b864-3774-40db-af88-5beee117cf64 tempest-VolumesActionsTest-1631371612 None] Volume volume-5e6a3de9-6f37-4b18-9e1f-fe41adcbc9fe (5e6a3de9-6f37-4b18-9e1f-fe41adcbc9fe): created successfully Sep 07 10:04:00 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-04a5b864-3774-40db-af88-5beee117cf64 tempest-VolumesActionsTest-1631371612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35a820bb-866f-49d5-9b63-c28c16d374fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:04:00 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-04a5b864-3774-40db-af88-5beee117cf64 tempest-VolumesActionsTest-1631371612 None] Flow 'volume_create_manager' (61148343-b93e-45cf-8c23-dadd5451f4f6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:04:00 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-04a5b864-3774-40db-af88-5beee117cf64 tempest-VolumesActionsTest-1631371612 None] Created volume successfully. Sep 07 10:04:01 devstack sudo[94393]: pam_unix(sudo:session): session closed for user root Sep 07 10:04:01 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-404f30d6-54a6-4f25-ad66-d34d452f1dcb tempest-VolumesTransfersV355Test-537106762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-daa1d036-83fd-496c-9d19-1b22ddf89567 1073741824" returned: 0 in 1.083s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:04:01 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-404f30d6-54a6-4f25-ad66-d34d452f1dcb tempest-VolumesTransfersV355Test-537106762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-daa1d036-83fd-496c-9d19-1b22ddf89567 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:04:01 devstack sudo[94419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-daa1d036-83fd-496c-9d19-1b22ddf89567 Sep 07 10:04:01 devstack sudo[94419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:04:01 devstack sudo[94419]: pam_unix(sudo:session): session closed for user root Sep 07 10:04:01 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-404f30d6-54a6-4f25-ad66-d34d452f1dcb tempest-VolumesTransfersV355Test-537106762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-daa1d036-83fd-496c-9d19-1b22ddf89567" returned: 0 in 0.347s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:04:01 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-404f30d6-54a6-4f25-ad66-d34d452f1dcb tempest-VolumesTransfersV355Test-537106762 None] <== create_volume: return (1497ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'} {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 10:04:01 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-404f30d6-54a6-4f25-ad66-d34d452f1dcb tempest-VolumesTransfersV355Test-537106762 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.500s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:04:01 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-404f30d6-54a6-4f25-ad66-d34d452f1dcb tempest-VolumesTransfersV355Test-537106762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66a41e21-522c-478d-82da-eeddeb70bb53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-daa1d036-83fd-496c-9d19-1b22ddf89567', 'volume_size': 1}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:04:01 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-404f30d6-54a6-4f25-ad66-d34d452f1dcb tempest-VolumesTransfersV355Test-537106762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c58fc1d-f3cf-48f3-9982-a0e679f501f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:04:01 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-404f30d6-54a6-4f25-ad66-d34d452f1dcb tempest-VolumesTransfersV355Test-537106762 None] Volume volume-daa1d036-83fd-496c-9d19-1b22ddf89567 (daa1d036-83fd-496c-9d19-1b22ddf89567): created successfully Sep 07 10:04:01 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-404f30d6-54a6-4f25-ad66-d34d452f1dcb tempest-VolumesTransfersV355Test-537106762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c58fc1d-f3cf-48f3-9982-a0e679f501f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:04:01 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-404f30d6-54a6-4f25-ad66-d34d452f1dcb tempest-VolumesTransfersV355Test-537106762 None] Flow 'volume_create_manager' (61fc4a5f-7743-4e9e-adf0-e0cd91ae72c5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:04:01 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-404f30d6-54a6-4f25-ad66-d34d452f1dcb tempest-VolumesTransfersV355Test-537106762 None] Created volume successfully. Sep 07 10:04:02 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-07482c62-ee05-4ee1-9ea9-0dcb21245e50 tempest-VolumesTransfersV355Test-729404254 None] Acquiring lock "cinder-daa1d036-83fd-496c-9d19-1b22ddf89567-delete_volume" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:04:02 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-07482c62-ee05-4ee1-9ea9-0dcb21245e50 tempest-VolumesTransfersV355Test-729404254 None] Lock "cinder-daa1d036-83fd-496c-9d19-1b22ddf89567-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:04:02 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-07482c62-ee05-4ee1-9ea9-0dcb21245e50 tempest-VolumesTransfersV355Test-729404254 None] Acquiring lock "cinder-quobyte-daa1d036-83fd-496c-9d19-1b22ddf89567" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:04:02 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-07482c62-ee05-4ee1-9ea9-0dcb21245e50 tempest-VolumesTransfersV355Test-729404254 None] Lock "cinder-quobyte-daa1d036-83fd-496c-9d19-1b22ddf89567" acquired by "delete_volume" :: waited 0.042s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:04:02 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bcb5349-94e4-4132-bbd5-3e8c40511d0a]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:04:02 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-07482c62-ee05-4ee1-9ea9-0dcb21245e50 tempest-VolumesTransfersV355Test-729404254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-daa1d036-83fd-496c-9d19-1b22ddf89567 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:04:03 devstack sudo[94423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-daa1d036-83fd-496c-9d19-1b22ddf89567 Sep 07 10:04:03 devstack sudo[94423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:04:03 devstack sudo[94423]: pam_unix(sudo:session): session closed for user root Sep 07 10:04:03 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-07482c62-ee05-4ee1-9ea9-0dcb21245e50 tempest-VolumesTransfersV355Test-729404254 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-daa1d036-83fd-496c-9d19-1b22ddf89567" returned: 0 in 0.643s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:04:03 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-07482c62-ee05-4ee1-9ea9-0dcb21245e50 tempest-VolumesTransfersV355Test-729404254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-daa1d036-83fd-496c-9d19-1b22ddf89567 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:04:03 devstack sudo[94432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-daa1d036-83fd-496c-9d19-1b22ddf89567 Sep 07 10:04:03 devstack sudo[94432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:04:03 devstack sudo[94432]: pam_unix(sudo:session): session closed for user root Sep 07 10:04:03 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-07482c62-ee05-4ee1-9ea9-0dcb21245e50 tempest-VolumesTransfersV355Test-729404254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-daa1d036-83fd-496c-9d19-1b22ddf89567" returned: 0 in 0.336s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:04:03 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-07482c62-ee05-4ee1-9ea9-0dcb21245e50 tempest-VolumesTransfersV355Test-729404254 None] Lock "cinder-quobyte-daa1d036-83fd-496c-9d19-1b22ddf89567" released by "delete_volume" :: held 1.056s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:04:04 devstack cinder-volume[87515]: DEBUG cinder.quota [None req-07482c62-ee05-4ee1-9ea9-0dcb21245e50 tempest-VolumesTransfersV355Test-729404254 None] Created reservations ['f865b690-b308-4b7c-9daf-f9caa17a598b', '60904b90-3412-47ed-bb9d-76fe3cb2af0b', '0ee9eece-8aa1-49a7-b914-0b4bb4541946', '4f99a2f0-0a28-4935-89b0-f592e569acfd'] {{(pid=87515) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:04:04 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-07482c62-ee05-4ee1-9ea9-0dcb21245e50 tempest-VolumesTransfersV355Test-729404254 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:04:04 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-07482c62-ee05-4ee1-9ea9-0dcb21245e50 tempest-VolumesTransfersV355Test-729404254 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:04:04 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-07482c62-ee05-4ee1-9ea9-0dcb21245e50 tempest-VolumesTransfersV355Test-729404254 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:04:04 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-07482c62-ee05-4ee1-9ea9-0dcb21245e50 tempest-VolumesTransfersV355Test-729404254 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:04:04 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-07482c62-ee05-4ee1-9ea9-0dcb21245e50 tempest-VolumesTransfersV355Test-729404254 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:04:04 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-07482c62-ee05-4ee1-9ea9-0dcb21245e50 tempest-VolumesTransfersV355Test-729404254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:04:04 devstack sudo[94435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a Sep 07 10:04:04 devstack sudo[94435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:04:04 devstack sudo[94435]: pam_unix(sudo:session): session closed for user root Sep 07 10:04:04 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-07482c62-ee05-4ee1-9ea9-0dcb21245e50 tempest-VolumesTransfersV355Test-729404254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a" returned: 0 in 0.532s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:04:04 devstack cinder-volume[87515]: DEBUG cinder.manager [None req-07482c62-ee05-4ee1-9ea9-0dcb21245e50 tempest-VolumesTransfersV355Test-729404254 None] Notifying Schedulers of capabilities ... {{(pid=87515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:04:04 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-07482c62-ee05-4ee1-9ea9-0dcb21245e50 tempest-VolumesTransfersV355Test-729404254 None] Deleted volume successfully. Sep 07 10:04:04 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-07482c62-ee05-4ee1-9ea9-0dcb21245e50 tempest-VolumesTransfersV355Test-729404254 None] Lock "cinder-daa1d036-83fd-496c-9d19-1b22ddf89567-delete_volume" released by "delete_volume" :: held 1.965s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:04:11 devstack cinder-volume[87515]: DEBUG oslo_service.periodic_task [None req-cebd6a9d-3073-42a1-b65a-b38d444d85ed None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87515) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 10:04:11 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-cebd6a9d-3073-42a1-b65a-b38d444d85ed None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:04:11 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-cebd6a9d-3073-42a1-b65a-b38d444d85ed None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:04:11 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-cebd6a9d-3073-42a1-b65a-b38d444d85ed None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:04:11 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-cebd6a9d-3073-42a1-b65a-b38d444d85ed None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:04:11 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-cebd6a9d-3073-42a1-b65a-b38d444d85ed None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:04:11 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-cebd6a9d-3073-42a1-b65a-b38d444d85ed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:04:11 devstack sudo[94477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a Sep 07 10:04:11 devstack sudo[94477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:04:12 devstack sudo[94477]: pam_unix(sudo:session): session closed for user root Sep 07 10:04:12 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-cebd6a9d-3073-42a1-b65a-b38d444d85ed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a" returned: 0 in 0.555s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:04:12 devstack cinder-volume[87515]: DEBUG cinder.manager [None req-cebd6a9d-3073-42a1-b65a-b38d444d85ed None None] Notifying Schedulers of capabilities ... {{(pid=87515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:04:12 devstack cinder-volume[87515]: DEBUG oslo_service.periodic_task [None req-cebd6a9d-3073-42a1-b65a-b38d444d85ed None None] Running periodic task VolumeManager._thread_info {{(pid=87515) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 10:04:12 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-cebd6a9d-3073-42a1-b65a-b38d444d85ed None None] thread count: 28 {{(pid=87515) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 07 10:04:12 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-cebd6a9d-3073-42a1-b65a-b38d444d85ed None None] thread info: [<_MainThread(MainThread, started 131647121809536)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87515) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 07 10:04:14 devstack cinder-volume[87515]: DEBUG dbcounter [-] [87515] Writing DB stats cinder:SELECT=18,cinder:UPDATE=25,cinder:DELETE=3,cinder:INSERT=5 {{(pid=87515) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 10:04:14 devstack cinder-volume[87515]: DEBUG dbcounter [-] [87515] Writing DB stats cinder:UPDATE=25,cinder:SELECT=17,cinder:INSERT=6,cinder:DELETE=2 {{(pid=87515) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 10:04:15 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-69ee66c7-6e32-4339-b353-b5d4c055199c tempest-VolumesActionsTest-1631371612 None] Acquiring lock "cinder-5e6a3de9-6f37-4b18-9e1f-fe41adcbc9fe" by "attach_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:04:15 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-69ee66c7-6e32-4339-b353-b5d4c055199c tempest-VolumesActionsTest-1631371612 None] Lock "cinder-5e6a3de9-6f37-4b18-9e1f-fe41adcbc9fe" acquired by "attach_volume" :: waited 0.046s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:04:15 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-69ee66c7-6e32-4339-b353-b5d4c055199c tempest-VolumesActionsTest-1631371612 None] Attaching volume 5e6a3de9-6f37-4b18-9e1f-fe41adcbc9fe to instance 828745b9-c39f-4fd3-8548-7bde7fa4491a at mountpoint /dev/vdb on host None. Sep 07 10:04:15 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-69ee66c7-6e32-4339-b353-b5d4c055199c tempest-VolumesActionsTest-1631371612 None] Attach volume completed successfully. Sep 07 10:04:15 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-69ee66c7-6e32-4339-b353-b5d4c055199c tempest-VolumesActionsTest-1631371612 None] Lock "cinder-5e6a3de9-6f37-4b18-9e1f-fe41adcbc9fe" released by "attach_volume" :: held 0.246s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:04:15 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-16c68406-371e-4c99-82b7-e7555cc51f12 tempest-VolumesActionsTest-1631371612 None] Acquiring lock "cinder-5e6a3de9-6f37-4b18-9e1f-fe41adcbc9fe-detach_volume" by "detach_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:04:15 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-16c68406-371e-4c99-82b7-e7555cc51f12 tempest-VolumesActionsTest-1631371612 None] Lock "cinder-5e6a3de9-6f37-4b18-9e1f-fe41adcbc9fe-detach_volume" acquired by "detach_volume" :: waited 0.022s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:04:15 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-16c68406-371e-4c99-82b7-e7555cc51f12 tempest-VolumesActionsTest-1631371612 None] Detaching volume 5e6a3de9-6f37-4b18-9e1f-fe41adcbc9fe from instance 828745b9-c39f-4fd3-8548-7bde7fa4491a. Sep 07 10:04:15 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-16c68406-371e-4c99-82b7-e7555cc51f12 tempest-VolumesActionsTest-1631371612 None] Detach volume completed successfully. Sep 07 10:04:15 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-16c68406-371e-4c99-82b7-e7555cc51f12 tempest-VolumesActionsTest-1631371612 None] Lock "cinder-5e6a3de9-6f37-4b18-9e1f-fe41adcbc9fe-detach_volume" released by "detach_volume" :: held 0.120s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:04:18 devstack cinder-volume[87515]: DEBUG cinder.volume.flows.manager.create_volume [None req-307320bd-613b-4c29-a491-6df91aa79557 tempest-VolumesListTestJSON-253340558 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 10:04:18 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-307320bd-613b-4c29-a491-6df91aa79557 tempest-VolumesListTestJSON-253340558 None] Flow 'volume_create_manager' (2ce81baa-c6ea-4d71-8fd2-109550fdd993) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:04:18 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-307320bd-613b-4c29-a491-6df91aa79557 tempest-VolumesListTestJSON-253340558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14d83122-8962-4e73-abd6-834a58869f9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:04:18 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-307320bd-613b-4c29-a491-6df91aa79557 tempest-VolumesListTestJSON-253340558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14d83122-8962-4e73-abd6-834a58869f9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:04:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1738004998',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83909af8-65de-4da1-a7f2-6b6c387dd1e8,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='50cde43bd23e40d5ac3df247a1328307',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:04:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:04:18Z,use_quota=True,user_id='8e0817ae3fe24edd977a87bcb764f64f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3a092cd-7947-4cbf-abff-4ba9567becf0),volume_type_id=f3a092cd-7947-4cbf-abff-4ba9567becf0)' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:04:18 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-307320bd-613b-4c29-a491-6df91aa79557 tempest-VolumesListTestJSON-253340558 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c5bab09-88c1-4b0f-a7b8-e2c3354d17f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:04:18 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-307320bd-613b-4c29-a491-6df91aa79557 tempest-VolumesListTestJSON-253340558 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c5bab09-88c1-4b0f-a7b8-e2c3354d17f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:04:18 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-307320bd-613b-4c29-a491-6df91aa79557 tempest-VolumesListTestJSON-253340558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4962ce58-f1d2-44c5-91c9-eb7f79e29b5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:04:18 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-307320bd-613b-4c29-a491-6df91aa79557 tempest-VolumesListTestJSON-253340558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4962ce58-f1d2-44c5-91c9-eb7f79e29b5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '83909af8-65de-4da1-a7f2-6b6c387dd1e8', 'volume_name': 'volume-83909af8-65de-4da1-a7f2-6b6c387dd1e8', 'volume_size': 1}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:04:18 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-307320bd-613b-4c29-a491-6df91aa79557 tempest-VolumesListTestJSON-253340558 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2567168-265e-4e75-8690-a2d4d40a9e09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:04:18 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-307320bd-613b-4c29-a491-6df91aa79557 tempest-VolumesListTestJSON-253340558 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2567168-265e-4e75-8690-a2d4d40a9e09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:04:18 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-307320bd-613b-4c29-a491-6df91aa79557 tempest-VolumesListTestJSON-253340558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d80a1a0f-dc27-4dfa-8945-6d4fbc69eebe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:04:18 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-307320bd-613b-4c29-a491-6df91aa79557 tempest-VolumesListTestJSON-253340558 None] Volume 83909af8-65de-4da1-a7f2-6b6c387dd1e8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-83909af8-65de-4da1-a7f2-6b6c387dd1e8', 'volume_size': 1} Sep 07 10:04:18 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-307320bd-613b-4c29-a491-6df91aa79557 tempest-VolumesListTestJSON-253340558 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:04:18 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-307320bd-613b-4c29-a491-6df91aa79557 tempest-VolumesListTestJSON-253340558 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:04:18 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-307320bd-613b-4c29-a491-6df91aa79557 tempest-VolumesListTestJSON-253340558 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:04:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1738004998',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83909af8-65de-4da1-a7f2-6b6c387dd1e8,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='50cde43bd23e40d5ac3df247a1328307',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:04:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:04:18Z,use_quota=True,user_id='8e0817ae3fe24edd977a87bcb764f64f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3a092cd-7947-4cbf-abff-4ba9567becf0),volume_type_id=f3a092cd-7947-4cbf-abff-4ba9567becf0)}" {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 10:04:18 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-307320bd-613b-4c29-a491-6df91aa79557 tempest-VolumesListTestJSON-253340558 None] Creating volume 83909af8-65de-4da1-a7f2-6b6c387dd1e8 {{(pid=87515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 10:04:18 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-307320bd-613b-4c29-a491-6df91aa79557 tempest-VolumesListTestJSON-253340558 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:04:18 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-307320bd-613b-4c29-a491-6df91aa79557 tempest-VolumesListTestJSON-253340558 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:04:18 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-307320bd-613b-4c29-a491-6df91aa79557 tempest-VolumesListTestJSON-253340558 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:04:18 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-307320bd-613b-4c29-a491-6df91aa79557 tempest-VolumesListTestJSON-253340558 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:04:18 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-307320bd-613b-4c29-a491-6df91aa79557 tempest-VolumesListTestJSON-253340558 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:04:18 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-307320bd-613b-4c29-a491-6df91aa79557 tempest-VolumesListTestJSON-253340558 None] Selected osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c as target Quobyte volume. {{(pid=87515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 10:04:18 devstack cinder-volume[87515]: INFO cinder.volume.drivers.remotefs [None req-307320bd-613b-4c29-a491-6df91aa79557 tempest-VolumesListTestJSON-253340558 None] casted to osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c Sep 07 10:04:18 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-307320bd-613b-4c29-a491-6df91aa79557 tempest-VolumesListTestJSON-253340558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-83909af8-65de-4da1-a7f2-6b6c387dd1e8 1073741824 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:04:18 devstack sudo[94646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-83909af8-65de-4da1-a7f2-6b6c387dd1e8 1073741824 Sep 07 10:04:18 devstack sudo[94646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:04:19 devstack sudo[94646]: pam_unix(sudo:session): session closed for user root Sep 07 10:04:19 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-307320bd-613b-4c29-a491-6df91aa79557 tempest-VolumesListTestJSON-253340558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-83909af8-65de-4da1-a7f2-6b6c387dd1e8 1073741824" returned: 0 in 0.617s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:04:19 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-307320bd-613b-4c29-a491-6df91aa79557 tempest-VolumesListTestJSON-253340558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-83909af8-65de-4da1-a7f2-6b6c387dd1e8 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:04:19 devstack sudo[94655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-83909af8-65de-4da1-a7f2-6b6c387dd1e8 Sep 07 10:04:19 devstack sudo[94655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:04:19 devstack sudo[94655]: pam_unix(sudo:session): session closed for user root Sep 07 10:04:19 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-307320bd-613b-4c29-a491-6df91aa79557 tempest-VolumesListTestJSON-253340558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-83909af8-65de-4da1-a7f2-6b6c387dd1e8" returned: 0 in 0.408s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:04:19 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-307320bd-613b-4c29-a491-6df91aa79557 tempest-VolumesListTestJSON-253340558 None] <== create_volume: return (1100ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'} {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 10:04:19 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-307320bd-613b-4c29-a491-6df91aa79557 tempest-VolumesListTestJSON-253340558 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.102s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:04:19 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-307320bd-613b-4c29-a491-6df91aa79557 tempest-VolumesListTestJSON-253340558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d80a1a0f-dc27-4dfa-8945-6d4fbc69eebe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-83909af8-65de-4da1-a7f2-6b6c387dd1e8', 'volume_size': 1}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:04:19 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-307320bd-613b-4c29-a491-6df91aa79557 tempest-VolumesListTestJSON-253340558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (671047f6-224a-4a2a-9207-fe2f6f5b2cc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:04:19 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-307320bd-613b-4c29-a491-6df91aa79557 tempest-VolumesListTestJSON-253340558 None] Volume volume-83909af8-65de-4da1-a7f2-6b6c387dd1e8 (83909af8-65de-4da1-a7f2-6b6c387dd1e8): created successfully Sep 07 10:04:19 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-307320bd-613b-4c29-a491-6df91aa79557 tempest-VolumesListTestJSON-253340558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (671047f6-224a-4a2a-9207-fe2f6f5b2cc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:04:19 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-307320bd-613b-4c29-a491-6df91aa79557 tempest-VolumesListTestJSON-253340558 None] Flow 'volume_create_manager' (2ce81baa-c6ea-4d71-8fd2-109550fdd993) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:04:19 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-307320bd-613b-4c29-a491-6df91aa79557 tempest-VolumesListTestJSON-253340558 None] Created volume successfully. Sep 07 10:04:21 devstack cinder-volume[87515]: DEBUG cinder.volume.flows.manager.create_volume [None req-40cb8cc6-4c73-4bdf-9cb2-e8bb13d41d58 tempest-VolumesListTestJSON-253340558 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 10:04:21 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-40cb8cc6-4c73-4bdf-9cb2-e8bb13d41d58 tempest-VolumesListTestJSON-253340558 None] Flow 'volume_create_manager' (d7d40d62-717a-49e4-912b-29f388eb55e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:04:21 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-40cb8cc6-4c73-4bdf-9cb2-e8bb13d41d58 tempest-VolumesListTestJSON-253340558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32a831b6-b247-4d67-b4f5-4e1406f28c04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:04:21 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-40cb8cc6-4c73-4bdf-9cb2-e8bb13d41d58 tempest-VolumesListTestJSON-253340558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32a831b6-b247-4d67-b4f5-4e1406f28c04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:04:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-671443405',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0acf1077-3705-4528-a91d-cce49347ec9f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='50cde43bd23e40d5ac3df247a1328307',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:04:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:04:22Z,use_quota=True,user_id='8e0817ae3fe24edd977a87bcb764f64f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3a092cd-7947-4cbf-abff-4ba9567becf0),volume_type_id=f3a092cd-7947-4cbf-abff-4ba9567becf0)' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:04:21 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-40cb8cc6-4c73-4bdf-9cb2-e8bb13d41d58 tempest-VolumesListTestJSON-253340558 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aba4b1d5-6909-4a1d-bb34-95ed734c2311) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:04:21 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-40cb8cc6-4c73-4bdf-9cb2-e8bb13d41d58 tempest-VolumesListTestJSON-253340558 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aba4b1d5-6909-4a1d-bb34-95ed734c2311) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:04:21 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-40cb8cc6-4c73-4bdf-9cb2-e8bb13d41d58 tempest-VolumesListTestJSON-253340558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9f36af3-94d9-4d59-a1c5-998efcdf6dcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:04:21 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-40cb8cc6-4c73-4bdf-9cb2-e8bb13d41d58 tempest-VolumesListTestJSON-253340558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9f36af3-94d9-4d59-a1c5-998efcdf6dcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0acf1077-3705-4528-a91d-cce49347ec9f', 'volume_name': 'volume-0acf1077-3705-4528-a91d-cce49347ec9f', 'volume_size': 1}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:04:21 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-40cb8cc6-4c73-4bdf-9cb2-e8bb13d41d58 tempest-VolumesListTestJSON-253340558 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2eae77e-4065-45af-b2a7-c6524e5569d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:04:21 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-40cb8cc6-4c73-4bdf-9cb2-e8bb13d41d58 tempest-VolumesListTestJSON-253340558 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2eae77e-4065-45af-b2a7-c6524e5569d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:04:21 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-40cb8cc6-4c73-4bdf-9cb2-e8bb13d41d58 tempest-VolumesListTestJSON-253340558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13d72d27-d918-4548-bbbc-594750635df6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:04:21 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-40cb8cc6-4c73-4bdf-9cb2-e8bb13d41d58 tempest-VolumesListTestJSON-253340558 None] Volume 0acf1077-3705-4528-a91d-cce49347ec9f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0acf1077-3705-4528-a91d-cce49347ec9f', 'volume_size': 1} Sep 07 10:04:21 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-40cb8cc6-4c73-4bdf-9cb2-e8bb13d41d58 tempest-VolumesListTestJSON-253340558 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:04:21 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-40cb8cc6-4c73-4bdf-9cb2-e8bb13d41d58 tempest-VolumesListTestJSON-253340558 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:04:21 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-40cb8cc6-4c73-4bdf-9cb2-e8bb13d41d58 tempest-VolumesListTestJSON-253340558 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:04:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-671443405',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0acf1077-3705-4528-a91d-cce49347ec9f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='50cde43bd23e40d5ac3df247a1328307',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:04:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:04:22Z,use_quota=True,user_id='8e0817ae3fe24edd977a87bcb764f64f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3a092cd-7947-4cbf-abff-4ba9567becf0),volume_type_id=f3a092cd-7947-4cbf-abff-4ba9567becf0)}" {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 10:04:21 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-40cb8cc6-4c73-4bdf-9cb2-e8bb13d41d58 tempest-VolumesListTestJSON-253340558 None] Creating volume 0acf1077-3705-4528-a91d-cce49347ec9f {{(pid=87515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 10:04:21 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-40cb8cc6-4c73-4bdf-9cb2-e8bb13d41d58 tempest-VolumesListTestJSON-253340558 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:04:21 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-40cb8cc6-4c73-4bdf-9cb2-e8bb13d41d58 tempest-VolumesListTestJSON-253340558 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:04:21 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-40cb8cc6-4c73-4bdf-9cb2-e8bb13d41d58 tempest-VolumesListTestJSON-253340558 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:04:21 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-40cb8cc6-4c73-4bdf-9cb2-e8bb13d41d58 tempest-VolumesListTestJSON-253340558 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:04:21 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-40cb8cc6-4c73-4bdf-9cb2-e8bb13d41d58 tempest-VolumesListTestJSON-253340558 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:04:21 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-40cb8cc6-4c73-4bdf-9cb2-e8bb13d41d58 tempest-VolumesListTestJSON-253340558 None] Selected osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c as target Quobyte volume. {{(pid=87515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 10:04:21 devstack cinder-volume[87515]: INFO cinder.volume.drivers.remotefs [None req-40cb8cc6-4c73-4bdf-9cb2-e8bb13d41d58 tempest-VolumesListTestJSON-253340558 None] casted to osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c Sep 07 10:04:21 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-40cb8cc6-4c73-4bdf-9cb2-e8bb13d41d58 tempest-VolumesListTestJSON-253340558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-0acf1077-3705-4528-a91d-cce49347ec9f 1073741824 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:04:21 devstack sudo[94725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-0acf1077-3705-4528-a91d-cce49347ec9f 1073741824 Sep 07 10:04:21 devstack sudo[94725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:04:22 devstack sudo[94725]: pam_unix(sudo:session): session closed for user root Sep 07 10:04:22 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-40cb8cc6-4c73-4bdf-9cb2-e8bb13d41d58 tempest-VolumesListTestJSON-253340558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-0acf1077-3705-4528-a91d-cce49347ec9f 1073741824" returned: 0 in 0.803s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:04:22 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-40cb8cc6-4c73-4bdf-9cb2-e8bb13d41d58 tempest-VolumesListTestJSON-253340558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-0acf1077-3705-4528-a91d-cce49347ec9f {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:04:22 devstack sudo[94737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-0acf1077-3705-4528-a91d-cce49347ec9f Sep 07 10:04:22 devstack sudo[94737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:04:22 devstack sudo[94737]: pam_unix(sudo:session): session closed for user root Sep 07 10:04:22 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-40cb8cc6-4c73-4bdf-9cb2-e8bb13d41d58 tempest-VolumesListTestJSON-253340558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-0acf1077-3705-4528-a91d-cce49347ec9f" returned: 0 in 0.265s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:04:22 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-40cb8cc6-4c73-4bdf-9cb2-e8bb13d41d58 tempest-VolumesListTestJSON-253340558 None] <== create_volume: return (1143ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'} {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 10:04:22 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-40cb8cc6-4c73-4bdf-9cb2-e8bb13d41d58 tempest-VolumesListTestJSON-253340558 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.146s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:04:22 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-40cb8cc6-4c73-4bdf-9cb2-e8bb13d41d58 tempest-VolumesListTestJSON-253340558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13d72d27-d918-4548-bbbc-594750635df6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0acf1077-3705-4528-a91d-cce49347ec9f', 'volume_size': 1}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:04:22 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-40cb8cc6-4c73-4bdf-9cb2-e8bb13d41d58 tempest-VolumesListTestJSON-253340558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (833f818c-be33-401d-aebb-18776ecc6e3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:04:22 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-40cb8cc6-4c73-4bdf-9cb2-e8bb13d41d58 tempest-VolumesListTestJSON-253340558 None] Volume volume-0acf1077-3705-4528-a91d-cce49347ec9f (0acf1077-3705-4528-a91d-cce49347ec9f): created successfully Sep 07 10:04:23 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-40cb8cc6-4c73-4bdf-9cb2-e8bb13d41d58 tempest-VolumesListTestJSON-253340558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (833f818c-be33-401d-aebb-18776ecc6e3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:04:23 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-40cb8cc6-4c73-4bdf-9cb2-e8bb13d41d58 tempest-VolumesListTestJSON-253340558 None] Flow 'volume_create_manager' (d7d40d62-717a-49e4-912b-29f388eb55e4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:04:23 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-40cb8cc6-4c73-4bdf-9cb2-e8bb13d41d58 tempest-VolumesListTestJSON-253340558 None] Created volume successfully. Sep 07 10:04:25 devstack cinder-volume[87515]: DEBUG cinder.volume.flows.manager.create_volume [None req-348e4f74-5fcf-4d69-b224-edd8190bdb39 tempest-VolumesListTestJSON-253340558 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 10:04:25 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-348e4f74-5fcf-4d69-b224-edd8190bdb39 tempest-VolumesListTestJSON-253340558 None] Flow 'volume_create_manager' (8916f80f-2dc4-4394-a215-2e2f45cb6b5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:04:25 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-348e4f74-5fcf-4d69-b224-edd8190bdb39 tempest-VolumesListTestJSON-253340558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c687cee-acb4-4565-a713-ea50361e4d44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:04:25 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-348e4f74-5fcf-4d69-b224-edd8190bdb39 tempest-VolumesListTestJSON-253340558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c687cee-acb4-4565-a713-ea50361e4d44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:04:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1910512414',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7355b453-cbd7-4f6c-bd16-9d25bdf2ea1b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='50cde43bd23e40d5ac3df247a1328307',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:04:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:04:25Z,use_quota=True,user_id='8e0817ae3fe24edd977a87bcb764f64f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3a092cd-7947-4cbf-abff-4ba9567becf0),volume_type_id=f3a092cd-7947-4cbf-abff-4ba9567becf0)' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:04:25 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-348e4f74-5fcf-4d69-b224-edd8190bdb39 tempest-VolumesListTestJSON-253340558 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f50959b-ebe6-4c5f-9e99-29fc9b49a4e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:04:25 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-348e4f74-5fcf-4d69-b224-edd8190bdb39 tempest-VolumesListTestJSON-253340558 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f50959b-ebe6-4c5f-9e99-29fc9b49a4e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:04:25 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-348e4f74-5fcf-4d69-b224-edd8190bdb39 tempest-VolumesListTestJSON-253340558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bece3d3e-83fc-4815-b6a8-76966ecda46c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:04:25 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-348e4f74-5fcf-4d69-b224-edd8190bdb39 tempest-VolumesListTestJSON-253340558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bece3d3e-83fc-4815-b6a8-76966ecda46c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7355b453-cbd7-4f6c-bd16-9d25bdf2ea1b', 'volume_name': 'volume-7355b453-cbd7-4f6c-bd16-9d25bdf2ea1b', 'volume_size': 1}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:04:25 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-348e4f74-5fcf-4d69-b224-edd8190bdb39 tempest-VolumesListTestJSON-253340558 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa2282a5-2194-4f35-80cd-7b823946b941) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:04:25 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-348e4f74-5fcf-4d69-b224-edd8190bdb39 tempest-VolumesListTestJSON-253340558 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa2282a5-2194-4f35-80cd-7b823946b941) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:04:25 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-348e4f74-5fcf-4d69-b224-edd8190bdb39 tempest-VolumesListTestJSON-253340558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9777c6f5-b37c-4a11-94b1-8cb1984a6318) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:04:25 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-348e4f74-5fcf-4d69-b224-edd8190bdb39 tempest-VolumesListTestJSON-253340558 None] Volume 7355b453-cbd7-4f6c-bd16-9d25bdf2ea1b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7355b453-cbd7-4f6c-bd16-9d25bdf2ea1b', 'volume_size': 1} Sep 07 10:04:25 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-348e4f74-5fcf-4d69-b224-edd8190bdb39 tempest-VolumesListTestJSON-253340558 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:04:25 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-348e4f74-5fcf-4d69-b224-edd8190bdb39 tempest-VolumesListTestJSON-253340558 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:04:25 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-348e4f74-5fcf-4d69-b224-edd8190bdb39 tempest-VolumesListTestJSON-253340558 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:04:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1910512414',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7355b453-cbd7-4f6c-bd16-9d25bdf2ea1b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='50cde43bd23e40d5ac3df247a1328307',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:04:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:04:25Z,use_quota=True,user_id='8e0817ae3fe24edd977a87bcb764f64f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3a092cd-7947-4cbf-abff-4ba9567becf0),volume_type_id=f3a092cd-7947-4cbf-abff-4ba9567becf0)}" {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 10:04:25 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-348e4f74-5fcf-4d69-b224-edd8190bdb39 tempest-VolumesListTestJSON-253340558 None] Creating volume 7355b453-cbd7-4f6c-bd16-9d25bdf2ea1b {{(pid=87515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 10:04:25 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-348e4f74-5fcf-4d69-b224-edd8190bdb39 tempest-VolumesListTestJSON-253340558 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:04:25 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-348e4f74-5fcf-4d69-b224-edd8190bdb39 tempest-VolumesListTestJSON-253340558 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:04:25 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-348e4f74-5fcf-4d69-b224-edd8190bdb39 tempest-VolumesListTestJSON-253340558 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:04:25 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-348e4f74-5fcf-4d69-b224-edd8190bdb39 tempest-VolumesListTestJSON-253340558 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:04:25 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-348e4f74-5fcf-4d69-b224-edd8190bdb39 tempest-VolumesListTestJSON-253340558 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:04:25 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-348e4f74-5fcf-4d69-b224-edd8190bdb39 tempest-VolumesListTestJSON-253340558 None] Selected osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c as target Quobyte volume. {{(pid=87515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 10:04:25 devstack cinder-volume[87515]: INFO cinder.volume.drivers.remotefs [None req-348e4f74-5fcf-4d69-b224-edd8190bdb39 tempest-VolumesListTestJSON-253340558 None] casted to osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c Sep 07 10:04:25 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-348e4f74-5fcf-4d69-b224-edd8190bdb39 tempest-VolumesListTestJSON-253340558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-7355b453-cbd7-4f6c-bd16-9d25bdf2ea1b 1073741824 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:04:25 devstack sudo[94766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-7355b453-cbd7-4f6c-bd16-9d25bdf2ea1b 1073741824 Sep 07 10:04:25 devstack sudo[94766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:04:25 devstack sudo[94766]: pam_unix(sudo:session): session closed for user root Sep 07 10:04:25 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-348e4f74-5fcf-4d69-b224-edd8190bdb39 tempest-VolumesListTestJSON-253340558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-7355b453-cbd7-4f6c-bd16-9d25bdf2ea1b 1073741824" returned: 0 in 0.663s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:04:25 devstack cinder-volume[87515]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb71f7f7-014f-456a-a643-91614a64ee08 tempest-AttachVolumeTestJSON-1590815735 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 10:04:25 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-fb71f7f7-014f-456a-a643-91614a64ee08 tempest-AttachVolumeTestJSON-1590815735 None] Flow 'volume_create_manager' (001c16ed-ff73-45fd-b3bd-bdfd515632ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:04:25 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-fb71f7f7-014f-456a-a643-91614a64ee08 tempest-AttachVolumeTestJSON-1590815735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (099119d1-a71e-4289-9004-65ef4427a817) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:04:25 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-348e4f74-5fcf-4d69-b224-edd8190bdb39 tempest-VolumesListTestJSON-253340558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-7355b453-cbd7-4f6c-bd16-9d25bdf2ea1b {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:04:26 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-fb71f7f7-014f-456a-a643-91614a64ee08 tempest-AttachVolumeTestJSON-1590815735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (099119d1-a71e-4289-9004-65ef4427a817) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:04:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-785332360',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3cbf7d0-c035-4334-a5d3-89d79ae3af8b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9e91b48f7db4cf18bf33a75a55d9962',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:04:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:04:26Z,use_quota=True,user_id='e7c670e0921542d08e3ffa09e69b6d6c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3a092cd-7947-4cbf-abff-4ba9567becf0),volume_type_id=f3a092cd-7947-4cbf-abff-4ba9567becf0)' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:04:26 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-fb71f7f7-014f-456a-a643-91614a64ee08 tempest-AttachVolumeTestJSON-1590815735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cef0e32f-619d-478c-bfd5-229aa941399d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:04:26 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-fb71f7f7-014f-456a-a643-91614a64ee08 tempest-AttachVolumeTestJSON-1590815735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cef0e32f-619d-478c-bfd5-229aa941399d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:04:26 devstack sudo[94772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-7355b453-cbd7-4f6c-bd16-9d25bdf2ea1b Sep 07 10:04:26 devstack sudo[94772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:04:26 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-fb71f7f7-014f-456a-a643-91614a64ee08 tempest-AttachVolumeTestJSON-1590815735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49af8522-5229-4ef1-b1e7-59fea29ae25a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:04:26 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-fb71f7f7-014f-456a-a643-91614a64ee08 tempest-AttachVolumeTestJSON-1590815735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49af8522-5229-4ef1-b1e7-59fea29ae25a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f3cbf7d0-c035-4334-a5d3-89d79ae3af8b', 'volume_name': 'volume-f3cbf7d0-c035-4334-a5d3-89d79ae3af8b', 'volume_size': 1}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:04:26 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-fb71f7f7-014f-456a-a643-91614a64ee08 tempest-AttachVolumeTestJSON-1590815735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65adfa54-8918-4036-bd49-0229883a07d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:04:26 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-fb71f7f7-014f-456a-a643-91614a64ee08 tempest-AttachVolumeTestJSON-1590815735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65adfa54-8918-4036-bd49-0229883a07d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:04:26 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-fb71f7f7-014f-456a-a643-91614a64ee08 tempest-AttachVolumeTestJSON-1590815735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73ee6a2d-1c1f-458f-aa3f-354bae830d14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:04:26 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-fb71f7f7-014f-456a-a643-91614a64ee08 tempest-AttachVolumeTestJSON-1590815735 None] Volume f3cbf7d0-c035-4334-a5d3-89d79ae3af8b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f3cbf7d0-c035-4334-a5d3-89d79ae3af8b', 'volume_size': 1} Sep 07 10:04:26 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-fb71f7f7-014f-456a-a643-91614a64ee08 tempest-AttachVolumeTestJSON-1590815735 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:04:26 devstack sudo[94772]: pam_unix(sudo:session): session closed for user root Sep 07 10:04:26 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-348e4f74-5fcf-4d69-b224-edd8190bdb39 tempest-VolumesListTestJSON-253340558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-7355b453-cbd7-4f6c-bd16-9d25bdf2ea1b" returned: 0 in 0.379s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:04:26 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-348e4f74-5fcf-4d69-b224-edd8190bdb39 tempest-VolumesListTestJSON-253340558 None] <== create_volume: return (1151ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'} {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 10:04:26 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-348e4f74-5fcf-4d69-b224-edd8190bdb39 tempest-VolumesListTestJSON-253340558 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.156s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:04:26 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-fb71f7f7-014f-456a-a643-91614a64ee08 tempest-AttachVolumeTestJSON-1590815735 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.298s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:04:26 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-fb71f7f7-014f-456a-a643-91614a64ee08 tempest-AttachVolumeTestJSON-1590815735 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:04:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-785332360',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3cbf7d0-c035-4334-a5d3-89d79ae3af8b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9e91b48f7db4cf18bf33a75a55d9962',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:04:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:04:26Z,use_quota=True,user_id='e7c670e0921542d08e3ffa09e69b6d6c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3a092cd-7947-4cbf-abff-4ba9567becf0),volume_type_id=f3a092cd-7947-4cbf-abff-4ba9567becf0)}" {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 10:04:26 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-fb71f7f7-014f-456a-a643-91614a64ee08 tempest-AttachVolumeTestJSON-1590815735 None] Creating volume f3cbf7d0-c035-4334-a5d3-89d79ae3af8b {{(pid=87515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 10:04:26 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-fb71f7f7-014f-456a-a643-91614a64ee08 tempest-AttachVolumeTestJSON-1590815735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:04:26 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-fb71f7f7-014f-456a-a643-91614a64ee08 tempest-AttachVolumeTestJSON-1590815735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:04:26 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-fb71f7f7-014f-456a-a643-91614a64ee08 tempest-AttachVolumeTestJSON-1590815735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:04:26 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-fb71f7f7-014f-456a-a643-91614a64ee08 tempest-AttachVolumeTestJSON-1590815735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:04:26 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-fb71f7f7-014f-456a-a643-91614a64ee08 tempest-AttachVolumeTestJSON-1590815735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:04:26 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-fb71f7f7-014f-456a-a643-91614a64ee08 tempest-AttachVolumeTestJSON-1590815735 None] Selected osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c as target Quobyte volume. {{(pid=87515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 10:04:26 devstack cinder-volume[87515]: INFO cinder.volume.drivers.remotefs [None req-fb71f7f7-014f-456a-a643-91614a64ee08 tempest-AttachVolumeTestJSON-1590815735 None] casted to osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c Sep 07 10:04:26 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-fb71f7f7-014f-456a-a643-91614a64ee08 tempest-AttachVolumeTestJSON-1590815735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-f3cbf7d0-c035-4334-a5d3-89d79ae3af8b 1073741824 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:04:26 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-348e4f74-5fcf-4d69-b224-edd8190bdb39 tempest-VolumesListTestJSON-253340558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9777c6f5-b37c-4a11-94b1-8cb1984a6318) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7355b453-cbd7-4f6c-bd16-9d25bdf2ea1b', 'volume_size': 1}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:04:26 devstack sudo[94776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-f3cbf7d0-c035-4334-a5d3-89d79ae3af8b 1073741824 Sep 07 10:04:26 devstack sudo[94776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:04:26 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-348e4f74-5fcf-4d69-b224-edd8190bdb39 tempest-VolumesListTestJSON-253340558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db15c60c-e4e3-4c0e-824c-1271199c2554) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:04:26 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-348e4f74-5fcf-4d69-b224-edd8190bdb39 tempest-VolumesListTestJSON-253340558 None] Volume volume-7355b453-cbd7-4f6c-bd16-9d25bdf2ea1b (7355b453-cbd7-4f6c-bd16-9d25bdf2ea1b): created successfully Sep 07 10:04:26 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-348e4f74-5fcf-4d69-b224-edd8190bdb39 tempest-VolumesListTestJSON-253340558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db15c60c-e4e3-4c0e-824c-1271199c2554) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:04:26 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-348e4f74-5fcf-4d69-b224-edd8190bdb39 tempest-VolumesListTestJSON-253340558 None] Flow 'volume_create_manager' (8916f80f-2dc4-4394-a215-2e2f45cb6b5b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:04:26 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-348e4f74-5fcf-4d69-b224-edd8190bdb39 tempest-VolumesListTestJSON-253340558 None] Created volume successfully. Sep 07 10:04:27 devstack sudo[94776]: pam_unix(sudo:session): session closed for user root Sep 07 10:04:27 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-fb71f7f7-014f-456a-a643-91614a64ee08 tempest-AttachVolumeTestJSON-1590815735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-f3cbf7d0-c035-4334-a5d3-89d79ae3af8b 1073741824" returned: 0 in 0.735s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:04:27 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-fb71f7f7-014f-456a-a643-91614a64ee08 tempest-AttachVolumeTestJSON-1590815735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-f3cbf7d0-c035-4334-a5d3-89d79ae3af8b {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:04:27 devstack sudo[94782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-f3cbf7d0-c035-4334-a5d3-89d79ae3af8b Sep 07 10:04:27 devstack sudo[94782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:04:27 devstack sudo[94782]: pam_unix(sudo:session): session closed for user root Sep 07 10:04:27 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-fb71f7f7-014f-456a-a643-91614a64ee08 tempest-AttachVolumeTestJSON-1590815735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-f3cbf7d0-c035-4334-a5d3-89d79ae3af8b" returned: 0 in 0.461s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:04:27 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-fb71f7f7-014f-456a-a643-91614a64ee08 tempest-AttachVolumeTestJSON-1590815735 None] <== create_volume: return (1259ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'} {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 10:04:27 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-fb71f7f7-014f-456a-a643-91614a64ee08 tempest-AttachVolumeTestJSON-1590815735 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.262s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:04:27 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-fb71f7f7-014f-456a-a643-91614a64ee08 tempest-AttachVolumeTestJSON-1590815735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73ee6a2d-1c1f-458f-aa3f-354bae830d14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f3cbf7d0-c035-4334-a5d3-89d79ae3af8b', 'volume_size': 1}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:04:27 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-fb71f7f7-014f-456a-a643-91614a64ee08 tempest-AttachVolumeTestJSON-1590815735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18416364-ed24-4afa-aec5-5ebf49641098) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:04:27 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-fb71f7f7-014f-456a-a643-91614a64ee08 tempest-AttachVolumeTestJSON-1590815735 None] Volume volume-f3cbf7d0-c035-4334-a5d3-89d79ae3af8b (f3cbf7d0-c035-4334-a5d3-89d79ae3af8b): created successfully Sep 07 10:04:27 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-fb71f7f7-014f-456a-a643-91614a64ee08 tempest-AttachVolumeTestJSON-1590815735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18416364-ed24-4afa-aec5-5ebf49641098) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:04:27 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-fb71f7f7-014f-456a-a643-91614a64ee08 tempest-AttachVolumeTestJSON-1590815735 None] Flow 'volume_create_manager' (001c16ed-ff73-45fd-b3bd-bdfd515632ee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:04:27 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-fb71f7f7-014f-456a-a643-91614a64ee08 tempest-AttachVolumeTestJSON-1590815735 None] Created volume successfully. Sep 07 10:04:30 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-09c7f8a4-4ad2-4056-9081-eb847c7c6f4b tempest-VolumesListTestJSON-253340558 None] Acquiring lock "cinder-7355b453-cbd7-4f6c-bd16-9d25bdf2ea1b-delete_volume" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:04:30 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-09c7f8a4-4ad2-4056-9081-eb847c7c6f4b tempest-VolumesListTestJSON-253340558 None] Lock "cinder-7355b453-cbd7-4f6c-bd16-9d25bdf2ea1b-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:04:30 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-09c7f8a4-4ad2-4056-9081-eb847c7c6f4b tempest-VolumesListTestJSON-253340558 None] Acquiring lock "cinder-quobyte-7355b453-cbd7-4f6c-bd16-9d25bdf2ea1b" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:04:31 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-09c7f8a4-4ad2-4056-9081-eb847c7c6f4b tempest-VolumesListTestJSON-253340558 None] Lock "cinder-quobyte-7355b453-cbd7-4f6c-bd16-9d25bdf2ea1b" acquired by "delete_volume" :: waited 0.023s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:04:31 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ce4b7c4-e413-4f7d-bd45-68b79bfa4651]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:04:31 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-09c7f8a4-4ad2-4056-9081-eb847c7c6f4b tempest-VolumesListTestJSON-253340558 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-7355b453-cbd7-4f6c-bd16-9d25bdf2ea1b {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:04:31 devstack sudo[94861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-7355b453-cbd7-4f6c-bd16-9d25bdf2ea1b Sep 07 10:04:31 devstack sudo[94861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:04:31 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [req-137b2583-1cef-45f1-8806-f5ec32876797 req-19dc87f0-a81c-42a6-b621-38ed38c7aa96 tempest-AttachVolumeTestJSON-1590815735 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:04:31 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [req-137b2583-1cef-45f1-8806-f5ec32876797 req-19dc87f0-a81c-42a6-b621-38ed38c7aa96 tempest-AttachVolumeTestJSON-1590815735 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:04:31 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [req-137b2583-1cef-45f1-8806-f5ec32876797 req-19dc87f0-a81c-42a6-b621-38ed38c7aa96 tempest-AttachVolumeTestJSON-1590815735 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:04:31 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [req-137b2583-1cef-45f1-8806-f5ec32876797 req-19dc87f0-a81c-42a6-b621-38ed38c7aa96 tempest-AttachVolumeTestJSON-1590815735 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c', 'name': 'volume-f3cbf7d0-c035-4334-a5d3-89d79ae3af8b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '814feec1-1e1d-481d-8f6a-7dee230359db', 'enforce_multipath': True} {{(pid=87515) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 07 10:04:31 devstack cinder-volume[87515]: INFO cinder.volume.manager [req-137b2583-1cef-45f1-8806-f5ec32876797 req-19dc87f0-a81c-42a6-b621-38ed38c7aa96 tempest-AttachVolumeTestJSON-1590815735 None] attachment_update completed successfully. Sep 07 10:04:31 devstack sudo[94861]: pam_unix(sudo:session): session closed for user root Sep 07 10:04:31 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-09c7f8a4-4ad2-4056-9081-eb847c7c6f4b tempest-VolumesListTestJSON-253340558 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-7355b453-cbd7-4f6c-bd16-9d25bdf2ea1b" returned: 0 in 0.792s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:04:31 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-09c7f8a4-4ad2-4056-9081-eb847c7c6f4b tempest-VolumesListTestJSON-253340558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-7355b453-cbd7-4f6c-bd16-9d25bdf2ea1b {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:04:31 devstack sudo[94874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-7355b453-cbd7-4f6c-bd16-9d25bdf2ea1b Sep 07 10:04:31 devstack sudo[94874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:04:32 devstack sudo[94874]: pam_unix(sudo:session): session closed for user root Sep 07 10:04:32 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-09c7f8a4-4ad2-4056-9081-eb847c7c6f4b tempest-VolumesListTestJSON-253340558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-7355b453-cbd7-4f6c-bd16-9d25bdf2ea1b" returned: 0 in 0.453s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:04:32 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-09c7f8a4-4ad2-4056-9081-eb847c7c6f4b tempest-VolumesListTestJSON-253340558 None] Lock "cinder-quobyte-7355b453-cbd7-4f6c-bd16-9d25bdf2ea1b" released by "delete_volume" :: held 1.345s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:04:32 devstack cinder-volume[87515]: DEBUG cinder.quota [None req-09c7f8a4-4ad2-4056-9081-eb847c7c6f4b tempest-VolumesListTestJSON-253340558 None] Created reservations ['b9a9e67d-f78c-4f1f-8507-4577e07141ad', '21504b30-2a7e-487e-883d-70cbe323381d', '3e556aeb-fe5f-44a6-97b6-895c5e4ab9d8', '2381d1c1-0de3-4bd1-9e52-9c489a11d17d'] {{(pid=87515) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:04:32 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-09c7f8a4-4ad2-4056-9081-eb847c7c6f4b tempest-VolumesListTestJSON-253340558 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:04:32 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-09c7f8a4-4ad2-4056-9081-eb847c7c6f4b tempest-VolumesListTestJSON-253340558 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:04:32 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-09c7f8a4-4ad2-4056-9081-eb847c7c6f4b tempest-VolumesListTestJSON-253340558 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:04:32 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-09c7f8a4-4ad2-4056-9081-eb847c7c6f4b tempest-VolumesListTestJSON-253340558 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:04:32 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-09c7f8a4-4ad2-4056-9081-eb847c7c6f4b tempest-VolumesListTestJSON-253340558 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:04:32 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-09c7f8a4-4ad2-4056-9081-eb847c7c6f4b tempest-VolumesListTestJSON-253340558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:04:32 devstack sudo[95259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a Sep 07 10:04:32 devstack sudo[95259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:04:32 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-c18fc8a8-6c3b-4960-b623-40a770e64784 tempest-VolumesActionsTest-1631371612 None] Acquiring lock "cinder-5e6a3de9-6f37-4b18-9e1f-fe41adcbc9fe" by "attach_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:04:32 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-c18fc8a8-6c3b-4960-b623-40a770e64784 tempest-VolumesActionsTest-1631371612 None] Lock "cinder-5e6a3de9-6f37-4b18-9e1f-fe41adcbc9fe" acquired by "attach_volume" :: waited 0.065s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:04:33 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-c18fc8a8-6c3b-4960-b623-40a770e64784 tempest-VolumesActionsTest-1631371612 None] Attaching volume 5e6a3de9-6f37-4b18-9e1f-fe41adcbc9fe to instance 29205cd7-9899-4628-bd16-f1315781aa16 at mountpoint /dev/vdb on host None. Sep 07 10:04:33 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-c18fc8a8-6c3b-4960-b623-40a770e64784 tempest-VolumesActionsTest-1631371612 None] Attach volume completed successfully. Sep 07 10:04:33 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-c18fc8a8-6c3b-4960-b623-40a770e64784 tempest-VolumesActionsTest-1631371612 None] Lock "cinder-5e6a3de9-6f37-4b18-9e1f-fe41adcbc9fe" released by "attach_volume" :: held 0.193s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:04:33 devstack sudo[95259]: pam_unix(sudo:session): session closed for user root Sep 07 10:04:33 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-09c7f8a4-4ad2-4056-9081-eb847c7c6f4b tempest-VolumesListTestJSON-253340558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a" returned: 0 in 0.551s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:04:33 devstack cinder-volume[87515]: DEBUG cinder.manager [None req-09c7f8a4-4ad2-4056-9081-eb847c7c6f4b tempest-VolumesListTestJSON-253340558 None] Notifying Schedulers of capabilities ... {{(pid=87515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:04:33 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-09c7f8a4-4ad2-4056-9081-eb847c7c6f4b tempest-VolumesListTestJSON-253340558 None] Deleted volume successfully. Sep 07 10:04:33 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-09c7f8a4-4ad2-4056-9081-eb847c7c6f4b tempest-VolumesListTestJSON-253340558 None] Lock "cinder-7355b453-cbd7-4f6c-bd16-9d25bdf2ea1b-delete_volume" released by "delete_volume" :: held 2.397s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:04:33 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-61420176-a4dc-47bb-ac4a-519a9ae7b219 tempest-VolumesListTestJSON-253340558 None] Acquiring lock "cinder-0acf1077-3705-4528-a91d-cce49347ec9f-delete_volume" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:04:33 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-61420176-a4dc-47bb-ac4a-519a9ae7b219 tempest-VolumesListTestJSON-253340558 None] Lock "cinder-0acf1077-3705-4528-a91d-cce49347ec9f-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:04:33 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-61420176-a4dc-47bb-ac4a-519a9ae7b219 tempest-VolumesListTestJSON-253340558 None] Acquiring lock "cinder-quobyte-0acf1077-3705-4528-a91d-cce49347ec9f" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:04:33 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-61420176-a4dc-47bb-ac4a-519a9ae7b219 tempest-VolumesListTestJSON-253340558 None] Lock "cinder-quobyte-0acf1077-3705-4528-a91d-cce49347ec9f" acquired by "delete_volume" :: waited 0.029s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:04:33 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[1493c309-b714-44c4-9dd6-c026fee55161]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:04:33 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-61420176-a4dc-47bb-ac4a-519a9ae7b219 tempest-VolumesListTestJSON-253340558 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-0acf1077-3705-4528-a91d-cce49347ec9f {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:04:33 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-44cf2a06-e4bb-42fb-addf-9249f474b8d1 tempest-VolumesActionsTest-1631371612 None] Acquiring lock "cinder-5e6a3de9-6f37-4b18-9e1f-fe41adcbc9fe-detach_volume" by "detach_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:04:33 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-44cf2a06-e4bb-42fb-addf-9249f474b8d1 tempest-VolumesActionsTest-1631371612 None] Lock "cinder-5e6a3de9-6f37-4b18-9e1f-fe41adcbc9fe-detach_volume" acquired by "detach_volume" :: waited 0.030s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:04:33 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-44cf2a06-e4bb-42fb-addf-9249f474b8d1 tempest-VolumesActionsTest-1631371612 None] Detaching volume 5e6a3de9-6f37-4b18-9e1f-fe41adcbc9fe from instance 29205cd7-9899-4628-bd16-f1315781aa16. Sep 07 10:04:33 devstack sudo[95262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-0acf1077-3705-4528-a91d-cce49347ec9f Sep 07 10:04:33 devstack sudo[95262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:04:34 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-44cf2a06-e4bb-42fb-addf-9249f474b8d1 tempest-VolumesActionsTest-1631371612 None] Detach volume completed successfully. Sep 07 10:04:34 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-44cf2a06-e4bb-42fb-addf-9249f474b8d1 tempest-VolumesActionsTest-1631371612 None] Lock "cinder-5e6a3de9-6f37-4b18-9e1f-fe41adcbc9fe-detach_volume" released by "detach_volume" :: held 0.113s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:04:34 devstack sudo[95262]: pam_unix(sudo:session): session closed for user root Sep 07 10:04:34 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-61420176-a4dc-47bb-ac4a-519a9ae7b219 tempest-VolumesListTestJSON-253340558 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-0acf1077-3705-4528-a91d-cce49347ec9f" returned: 0 in 0.584s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:04:34 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-61420176-a4dc-47bb-ac4a-519a9ae7b219 tempest-VolumesListTestJSON-253340558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-0acf1077-3705-4528-a91d-cce49347ec9f {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:04:34 devstack sudo[95267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-0acf1077-3705-4528-a91d-cce49347ec9f Sep 07 10:04:34 devstack sudo[95267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:04:34 devstack sudo[95267]: pam_unix(sudo:session): session closed for user root Sep 07 10:04:34 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-61420176-a4dc-47bb-ac4a-519a9ae7b219 tempest-VolumesListTestJSON-253340558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-0acf1077-3705-4528-a91d-cce49347ec9f" returned: 0 in 0.505s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:04:34 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-61420176-a4dc-47bb-ac4a-519a9ae7b219 tempest-VolumesListTestJSON-253340558 None] Lock "cinder-quobyte-0acf1077-3705-4528-a91d-cce49347ec9f" released by "delete_volume" :: held 1.189s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:04:35 devstack cinder-volume[87515]: DEBUG cinder.quota [None req-61420176-a4dc-47bb-ac4a-519a9ae7b219 tempest-VolumesListTestJSON-253340558 None] Created reservations ['af4cb028-266f-4ae9-8a60-044dd0ac6cc1', '4ecf3a76-7d03-4d9b-be26-afef30e33dae', 'b5888bd4-2a5a-4184-b484-aee9716b63d8', '5f1cd0c6-0b37-487f-90a3-1633062f1e96'] {{(pid=87515) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:04:35 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-61420176-a4dc-47bb-ac4a-519a9ae7b219 tempest-VolumesListTestJSON-253340558 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:04:35 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-61420176-a4dc-47bb-ac4a-519a9ae7b219 tempest-VolumesListTestJSON-253340558 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:04:35 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-61420176-a4dc-47bb-ac4a-519a9ae7b219 tempest-VolumesListTestJSON-253340558 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:04:35 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-61420176-a4dc-47bb-ac4a-519a9ae7b219 tempest-VolumesListTestJSON-253340558 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:04:35 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-61420176-a4dc-47bb-ac4a-519a9ae7b219 tempest-VolumesListTestJSON-253340558 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:04:35 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-61420176-a4dc-47bb-ac4a-519a9ae7b219 tempest-VolumesListTestJSON-253340558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:04:35 devstack sudo[95330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a Sep 07 10:04:35 devstack sudo[95330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:04:35 devstack sudo[95330]: pam_unix(sudo:session): session closed for user root Sep 07 10:04:35 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-61420176-a4dc-47bb-ac4a-519a9ae7b219 tempest-VolumesListTestJSON-253340558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a" returned: 0 in 0.333s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:04:35 devstack cinder-volume[87515]: DEBUG cinder.manager [None req-61420176-a4dc-47bb-ac4a-519a9ae7b219 tempest-VolumesListTestJSON-253340558 None] Notifying Schedulers of capabilities ... {{(pid=87515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:04:35 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-61420176-a4dc-47bb-ac4a-519a9ae7b219 tempest-VolumesListTestJSON-253340558 None] Deleted volume successfully. Sep 07 10:04:35 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-61420176-a4dc-47bb-ac4a-519a9ae7b219 tempest-VolumesListTestJSON-253340558 None] Lock "cinder-0acf1077-3705-4528-a91d-cce49347ec9f-delete_volume" released by "delete_volume" :: held 2.218s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:04:36 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-53722ab0-b493-433f-9081-e383b5187aae tempest-VolumesListTestJSON-253340558 None] Acquiring lock "cinder-83909af8-65de-4da1-a7f2-6b6c387dd1e8-delete_volume" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:04:36 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-53722ab0-b493-433f-9081-e383b5187aae tempest-VolumesListTestJSON-253340558 None] Lock "cinder-83909af8-65de-4da1-a7f2-6b6c387dd1e8-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:04:36 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-53722ab0-b493-433f-9081-e383b5187aae tempest-VolumesListTestJSON-253340558 None] Acquiring lock "cinder-quobyte-83909af8-65de-4da1-a7f2-6b6c387dd1e8" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:04:36 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-53722ab0-b493-433f-9081-e383b5187aae tempest-VolumesListTestJSON-253340558 None] Lock "cinder-quobyte-83909af8-65de-4da1-a7f2-6b6c387dd1e8" acquired by "delete_volume" :: waited 0.017s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:04:36 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b5c9061-f7ae-4210-ac56-37d4f0fd69bf]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:04:36 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-53722ab0-b493-433f-9081-e383b5187aae tempest-VolumesListTestJSON-253340558 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-83909af8-65de-4da1-a7f2-6b6c387dd1e8 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:04:36 devstack sudo[95334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-83909af8-65de-4da1-a7f2-6b6c387dd1e8 Sep 07 10:04:36 devstack sudo[95334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:04:36 devstack sudo[95334]: pam_unix(sudo:session): session closed for user root Sep 07 10:04:36 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-53722ab0-b493-433f-9081-e383b5187aae tempest-VolumesListTestJSON-253340558 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-83909af8-65de-4da1-a7f2-6b6c387dd1e8" returned: 0 in 0.462s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:04:36 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-53722ab0-b493-433f-9081-e383b5187aae tempest-VolumesListTestJSON-253340558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-83909af8-65de-4da1-a7f2-6b6c387dd1e8 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:04:36 devstack sudo[95348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-83909af8-65de-4da1-a7f2-6b6c387dd1e8 Sep 07 10:04:36 devstack sudo[95348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:04:36 devstack sudo[95348]: pam_unix(sudo:session): session closed for user root Sep 07 10:04:36 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-53722ab0-b493-433f-9081-e383b5187aae tempest-VolumesListTestJSON-253340558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-83909af8-65de-4da1-a7f2-6b6c387dd1e8" returned: 0 in 0.279s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:04:36 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-53722ab0-b493-433f-9081-e383b5187aae tempest-VolumesListTestJSON-253340558 None] Lock "cinder-quobyte-83909af8-65de-4da1-a7f2-6b6c387dd1e8" released by "delete_volume" :: held 0.790s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:04:36 devstack cinder-volume[87515]: DEBUG cinder.quota [None req-53722ab0-b493-433f-9081-e383b5187aae tempest-VolumesListTestJSON-253340558 None] Created reservations ['0eb30568-9789-4292-adaf-fa98257d8f84', '9cf1e881-c316-449e-87fc-a7b515bf0b2c', '1a91dda1-9dc2-4b97-83b4-b2d2c9b328d4', 'ae1ed891-04b3-4995-8416-338208ec013f'] {{(pid=87515) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:04:37 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-53722ab0-b493-433f-9081-e383b5187aae tempest-VolumesListTestJSON-253340558 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:04:37 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-53722ab0-b493-433f-9081-e383b5187aae tempest-VolumesListTestJSON-253340558 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:04:37 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-53722ab0-b493-433f-9081-e383b5187aae tempest-VolumesListTestJSON-253340558 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:04:37 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-53722ab0-b493-433f-9081-e383b5187aae tempest-VolumesListTestJSON-253340558 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:04:37 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-53722ab0-b493-433f-9081-e383b5187aae tempest-VolumesListTestJSON-253340558 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:04:37 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-53722ab0-b493-433f-9081-e383b5187aae tempest-VolumesListTestJSON-253340558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:04:37 devstack sudo[95351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a Sep 07 10:04:37 devstack sudo[95351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:04:37 devstack sudo[95351]: pam_unix(sudo:session): session closed for user root Sep 07 10:04:37 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-53722ab0-b493-433f-9081-e383b5187aae tempest-VolumesListTestJSON-253340558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a" returned: 0 in 0.260s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:04:37 devstack cinder-volume[87515]: DEBUG cinder.manager [None req-53722ab0-b493-433f-9081-e383b5187aae tempest-VolumesListTestJSON-253340558 None] Notifying Schedulers of capabilities ... {{(pid=87515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:04:37 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-53722ab0-b493-433f-9081-e383b5187aae tempest-VolumesListTestJSON-253340558 None] Deleted volume successfully. Sep 07 10:04:37 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-53722ab0-b493-433f-9081-e383b5187aae tempest-VolumesListTestJSON-253340558 None] Lock "cinder-83909af8-65de-4da1-a7f2-6b6c387dd1e8-delete_volume" released by "delete_volume" :: held 1.298s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:04:40 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-6ed811ed-25fc-4429-b87f-3f81e9192b7c tempest-VolumesActionsTest-1631371612 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:04:40 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-6ed811ed-25fc-4429-b87f-3f81e9192b7c tempest-VolumesActionsTest-1631371612 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:04:40 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c2276ee-4b6d-4150-a184-9b737ba49d96]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:04:40 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-6ed811ed-25fc-4429-b87f-3f81e9192b7c tempest-VolumesActionsTest-1631371612 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-5e6a3de9-6f37-4b18-9e1f-fe41adcbc9fe {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:04:40 devstack sudo[95836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-5e6a3de9-6f37-4b18-9e1f-fe41adcbc9fe Sep 07 10:04:40 devstack sudo[95836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:04:40 devstack sudo[95836]: pam_unix(sudo:session): session closed for user root Sep 07 10:04:40 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-6ed811ed-25fc-4429-b87f-3f81e9192b7c tempest-VolumesActionsTest-1631371612 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-5e6a3de9-6f37-4b18-9e1f-fe41adcbc9fe" returned: 0 in 0.697s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:04:40 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[739e1a6d-c3de-485d-acc8-3a36c0fdd6cf]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:04:40 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-6ed811ed-25fc-4429-b87f-3f81e9192b7c tempest-VolumesActionsTest-1631371612 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-5e6a3de9-6f37-4b18-9e1f-fe41adcbc9fe {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:04:41 devstack sudo[95859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-5e6a3de9-6f37-4b18-9e1f-fe41adcbc9fe Sep 07 10:04:41 devstack sudo[95859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:04:41 devstack sudo[95859]: pam_unix(sudo:session): session closed for user root Sep 07 10:04:41 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-6ed811ed-25fc-4429-b87f-3f81e9192b7c tempest-VolumesActionsTest-1631371612 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-5e6a3de9-6f37-4b18-9e1f-fe41adcbc9fe" returned: 0 in 0.428s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:04:41 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-6ed811ed-25fc-4429-b87f-3f81e9192b7c tempest-VolumesActionsTest-1631371612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-5e6a3de9-6f37-4b18-9e1f-fe41adcbc9fe /opt/stack/data/cinder/conversion/5e6a3de9-6f37-4b18-9e1f-fe41adcbc9fe.temp_image.5744d9c1-53ed-4b7c-a4ed-9def414194a4tuabjjbx.img {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:04:41 devstack sudo[95864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-5e6a3de9-6f37-4b18-9e1f-fe41adcbc9fe /opt/stack/data/cinder/conversion/5e6a3de9-6f37-4b18-9e1f-fe41adcbc9fe.temp_image.5744d9c1-53ed-4b7c-a4ed-9def414194a4tuabjjbx.img Sep 07 10:04:41 devstack sudo[95864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:04:47 devstack cinder-volume[87515]: DEBUG dbcounter [-] [87515] Writing DB stats cinder:SELECT=39,cinder:UPDATE=48,cinder:INSERT=10,cinder:DELETE=4 {{(pid=87515) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 10:04:48 devstack sudo[95864]: pam_unix(sudo:session): session closed for user root Sep 07 10:04:48 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-6ed811ed-25fc-4429-b87f-3f81e9192b7c tempest-VolumesActionsTest-1631371612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-5e6a3de9-6f37-4b18-9e1f-fe41adcbc9fe /opt/stack/data/cinder/conversion/5e6a3de9-6f37-4b18-9e1f-fe41adcbc9fe.temp_image.5744d9c1-53ed-4b7c-a4ed-9def414194a4tuabjjbx.img" returned: 0 in 7.346s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:04:48 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[943beaf9-be98-4220-91a3-6ce8b52c8536]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:04:48 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-6ed811ed-25fc-4429-b87f-3f81e9192b7c tempest-VolumesActionsTest-1631371612 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-5e6a3de9-6f37-4b18-9e1f-fe41adcbc9fe {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:04:48 devstack sudo[95884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-5e6a3de9-6f37-4b18-9e1f-fe41adcbc9fe Sep 07 10:04:48 devstack sudo[95884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:04:49 devstack cinder-volume[87515]: DEBUG cinder.volume.flows.manager.create_volume [None req-63cd8586-db66-4823-b8bf-554641d833ce tempest-AttachVolumeNegativeTest-1630918730 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 10:04:49 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-63cd8586-db66-4823-b8bf-554641d833ce tempest-AttachVolumeNegativeTest-1630918730 None] Flow 'volume_create_manager' (37586700-8871-4f44-b0ce-a65eb224194f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:04:49 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-63cd8586-db66-4823-b8bf-554641d833ce tempest-AttachVolumeNegativeTest-1630918730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c514d5b2-4bf9-4ecf-a737-dc0d7d3ec87c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:04:49 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-63cd8586-db66-4823-b8bf-554641d833ce tempest-AttachVolumeNegativeTest-1630918730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c514d5b2-4bf9-4ecf-a737-dc0d7d3ec87c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:04:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1351043359',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9fc23352-9691-48be-9bb8-7def7491c408,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ca0169dc2c14d879d1f7bad9cb3ca6f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:04:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:04:49Z,use_quota=True,user_id='5752280db2e54f83a8c72a8f4626a43c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3a092cd-7947-4cbf-abff-4ba9567becf0),volume_type_id=f3a092cd-7947-4cbf-abff-4ba9567becf0)' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:04:49 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-63cd8586-db66-4823-b8bf-554641d833ce tempest-AttachVolumeNegativeTest-1630918730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0a26e0e-af39-4842-9736-38745264a617) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:04:49 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-63cd8586-db66-4823-b8bf-554641d833ce tempest-AttachVolumeNegativeTest-1630918730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0a26e0e-af39-4842-9736-38745264a617) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:04:49 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-63cd8586-db66-4823-b8bf-554641d833ce tempest-AttachVolumeNegativeTest-1630918730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c204f3ed-9ea5-43bc-8f32-24e1142446c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:04:49 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-63cd8586-db66-4823-b8bf-554641d833ce tempest-AttachVolumeNegativeTest-1630918730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c204f3ed-9ea5-43bc-8f32-24e1142446c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9fc23352-9691-48be-9bb8-7def7491c408', 'volume_name': 'volume-9fc23352-9691-48be-9bb8-7def7491c408', 'volume_size': 1}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:04:49 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-63cd8586-db66-4823-b8bf-554641d833ce tempest-AttachVolumeNegativeTest-1630918730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca0aca50-9cd3-45b1-9aa6-f8a12de1c339) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:04:49 devstack sudo[95884]: pam_unix(sudo:session): session closed for user root Sep 07 10:04:49 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-63cd8586-db66-4823-b8bf-554641d833ce tempest-AttachVolumeNegativeTest-1630918730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca0aca50-9cd3-45b1-9aa6-f8a12de1c339) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:04:49 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-63cd8586-db66-4823-b8bf-554641d833ce tempest-AttachVolumeNegativeTest-1630918730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ec1ec4e-d1ad-437b-9510-a3933e36f667) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:04:49 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-63cd8586-db66-4823-b8bf-554641d833ce tempest-AttachVolumeNegativeTest-1630918730 None] Volume 9fc23352-9691-48be-9bb8-7def7491c408: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9fc23352-9691-48be-9bb8-7def7491c408', 'volume_size': 1} Sep 07 10:04:49 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-63cd8586-db66-4823-b8bf-554641d833ce tempest-AttachVolumeNegativeTest-1630918730 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:04:49 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-6ed811ed-25fc-4429-b87f-3f81e9192b7c tempest-VolumesActionsTest-1631371612 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-5e6a3de9-6f37-4b18-9e1f-fe41adcbc9fe" returned: 0 in 0.766s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:04:49 devstack cinder-volume[87515]: DEBUG cinder.image.image_utils [None req-6ed811ed-25fc-4429-b87f-3f81e9192b7c tempest-VolumesActionsTest-1631371612 None] Image conversion details: src /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-5e6a3de9-6f37-4b18-9e1f-fe41adcbc9fe, size 1024.00 MB, duration 7.35 sec, destination /opt/stack/data/cinder/conversion/5e6a3de9-6f37-4b18-9e1f-fe41adcbc9fe.temp_image.5744d9c1-53ed-4b7c-a4ed-9def414194a4tuabjjbx.img {{(pid=87515) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 07 10:04:49 devstack cinder-volume[87515]: INFO cinder.image.image_utils [None req-6ed811ed-25fc-4429-b87f-3f81e9192b7c tempest-VolumesActionsTest-1631371612 None] Converted 1024.00 MB image at 139.37 MB/s Sep 07 10:04:49 devstack cinder-volume[87515]: DEBUG cinder.image.image_utils [None req-6ed811ed-25fc-4429-b87f-3f81e9192b7c tempest-VolumesActionsTest-1631371612 None] 5744d9c1-53ed-4b7c-a4ed-9def414194a4 was raw, no need to convert to raw {{(pid=87515) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Sep 07 10:05:01 devstack cinder-volume[87515]: DEBUG cinder.volume.flows.manager.create_volume [None req-25d44b12-b4a5-4af8-a358-397742073e07 tempest-VolumesSnapshotTestJSON-2041623630 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 10:05:01 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-25d44b12-b4a5-4af8-a358-397742073e07 tempest-VolumesSnapshotTestJSON-2041623630 None] Flow 'volume_create_manager' (bbc646cc-445e-44c4-b48f-8719c75af518) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:05:01 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-25d44b12-b4a5-4af8-a358-397742073e07 tempest-VolumesSnapshotTestJSON-2041623630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25617a60-6f66-424e-b381-809bf6841c89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:05:01 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-25d44b12-b4a5-4af8-a358-397742073e07 tempest-VolumesSnapshotTestJSON-2041623630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25617a60-6f66-424e-b381-809bf6841c89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:05:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-744519711',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=745a4758-26ab-429e-9009-55e8b0d24ad0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='940eb7dc41254b3f8fe361a280cc52b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:05:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:05:01Z,use_quota=True,user_id='37b1985156f54ab4853962fe1a63200f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3a092cd-7947-4cbf-abff-4ba9567becf0),volume_type_id=f3a092cd-7947-4cbf-abff-4ba9567becf0)' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:05:01 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-25d44b12-b4a5-4af8-a358-397742073e07 tempest-VolumesSnapshotTestJSON-2041623630 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cdd22ac2-c2ab-46b3-aaf4-247a6d5997e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:05:01 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-25d44b12-b4a5-4af8-a358-397742073e07 tempest-VolumesSnapshotTestJSON-2041623630 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cdd22ac2-c2ab-46b3-aaf4-247a6d5997e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:05:01 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-25d44b12-b4a5-4af8-a358-397742073e07 tempest-VolumesSnapshotTestJSON-2041623630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ff0c513-a062-4da2-b521-a7f1a5fe059a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:05:01 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-25d44b12-b4a5-4af8-a358-397742073e07 tempest-VolumesSnapshotTestJSON-2041623630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ff0c513-a062-4da2-b521-a7f1a5fe059a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '745a4758-26ab-429e-9009-55e8b0d24ad0', 'volume_name': 'volume-745a4758-26ab-429e-9009-55e8b0d24ad0', 'volume_size': 1}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:05:01 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-25d44b12-b4a5-4af8-a358-397742073e07 tempest-VolumesSnapshotTestJSON-2041623630 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b96d80a-e89f-40ac-a180-70cf5f87c84e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:05:01 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-25d44b12-b4a5-4af8-a358-397742073e07 tempest-VolumesSnapshotTestJSON-2041623630 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b96d80a-e89f-40ac-a180-70cf5f87c84e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:05:01 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-25d44b12-b4a5-4af8-a358-397742073e07 tempest-VolumesSnapshotTestJSON-2041623630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe1ccbec-90da-4c44-bdf9-6105b41eb74a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:05:01 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-25d44b12-b4a5-4af8-a358-397742073e07 tempest-VolumesSnapshotTestJSON-2041623630 None] Volume 745a4758-26ab-429e-9009-55e8b0d24ad0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-745a4758-26ab-429e-9009-55e8b0d24ad0', 'volume_size': 1} Sep 07 10:05:01 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-25d44b12-b4a5-4af8-a358-397742073e07 tempest-VolumesSnapshotTestJSON-2041623630 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:05:11 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-6ed811ed-25fc-4429-b87f-3f81e9192b7c tempest-VolumesActionsTest-1631371612 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 31.025s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:05:11 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-6ed811ed-25fc-4429-b87f-3f81e9192b7c tempest-VolumesActionsTest-1631371612 None] Uploaded volume to glance image-id: 5744d9c1-53ed-4b7c-a4ed-9def414194a4. {{(pid=87515) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 07 10:05:11 devstack cinder-volume[87515]: DEBUG dbcounter [-] [87515] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1 {{(pid=87515) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 10:05:11 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-63cd8586-db66-4823-b8bf-554641d833ce tempest-AttachVolumeNegativeTest-1630918730 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 21.683s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:05:11 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-63cd8586-db66-4823-b8bf-554641d833ce tempest-AttachVolumeNegativeTest-1630918730 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:04:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1351043359',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9fc23352-9691-48be-9bb8-7def7491c408,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ca0169dc2c14d879d1f7bad9cb3ca6f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:04:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:04:49Z,use_quota=True,user_id='5752280db2e54f83a8c72a8f4626a43c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3a092cd-7947-4cbf-abff-4ba9567becf0),volume_type_id=f3a092cd-7947-4cbf-abff-4ba9567becf0)}" {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 10:05:11 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-63cd8586-db66-4823-b8bf-554641d833ce tempest-AttachVolumeNegativeTest-1630918730 None] Creating volume 9fc23352-9691-48be-9bb8-7def7491c408 {{(pid=87515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 10:05:11 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-63cd8586-db66-4823-b8bf-554641d833ce tempest-AttachVolumeNegativeTest-1630918730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:05:11 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-63cd8586-db66-4823-b8bf-554641d833ce tempest-AttachVolumeNegativeTest-1630918730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:05:11 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-63cd8586-db66-4823-b8bf-554641d833ce tempest-AttachVolumeNegativeTest-1630918730 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:05:11 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-63cd8586-db66-4823-b8bf-554641d833ce tempest-AttachVolumeNegativeTest-1630918730 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:05:11 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-63cd8586-db66-4823-b8bf-554641d833ce tempest-AttachVolumeNegativeTest-1630918730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:05:11 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-63cd8586-db66-4823-b8bf-554641d833ce tempest-AttachVolumeNegativeTest-1630918730 None] Selected osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c as target Quobyte volume. {{(pid=87515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 10:05:11 devstack cinder-volume[87515]: INFO cinder.volume.drivers.remotefs [None req-63cd8586-db66-4823-b8bf-554641d833ce tempest-AttachVolumeNegativeTest-1630918730 None] casted to osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c Sep 07 10:05:11 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-63cd8586-db66-4823-b8bf-554641d833ce tempest-AttachVolumeNegativeTest-1630918730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-9fc23352-9691-48be-9bb8-7def7491c408 1073741824 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:05:11 devstack sudo[95945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-9fc23352-9691-48be-9bb8-7def7491c408 1073741824 Sep 07 10:05:11 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-6ed811ed-25fc-4429-b87f-3f81e9192b7c tempest-VolumesActionsTest-1631371612 None] Copy volume to image completed successfully. Sep 07 10:05:11 devstack sudo[95945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:05:11 devstack cinder-volume[87515]: DEBUG oslo_service.periodic_task [None req-cebd6a9d-3073-42a1-b65a-b38d444d85ed None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87515) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 10:05:11 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-cebd6a9d-3073-42a1-b65a-b38d444d85ed None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:05:11 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-cebd6a9d-3073-42a1-b65a-b38d444d85ed None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:05:11 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-cebd6a9d-3073-42a1-b65a-b38d444d85ed None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:05:11 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-cebd6a9d-3073-42a1-b65a-b38d444d85ed None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:05:11 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-cebd6a9d-3073-42a1-b65a-b38d444d85ed None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:05:11 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-cebd6a9d-3073-42a1-b65a-b38d444d85ed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:05:11 devstack sudo[95951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a Sep 07 10:05:11 devstack sudo[95951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:05:11 devstack sudo[95945]: pam_unix(sudo:session): session closed for user root Sep 07 10:05:11 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-63cd8586-db66-4823-b8bf-554641d833ce tempest-AttachVolumeNegativeTest-1630918730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-9fc23352-9691-48be-9bb8-7def7491c408 1073741824" returned: 0 in 0.422s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:05:11 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-63cd8586-db66-4823-b8bf-554641d833ce tempest-AttachVolumeNegativeTest-1630918730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-9fc23352-9691-48be-9bb8-7def7491c408 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:05:11 devstack sudo[95953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-9fc23352-9691-48be-9bb8-7def7491c408 Sep 07 10:05:11 devstack sudo[95953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:05:11 devstack sudo[95951]: pam_unix(sudo:session): session closed for user root Sep 07 10:05:11 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-cebd6a9d-3073-42a1-b65a-b38d444d85ed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a" returned: 0 in 0.255s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:05:11 devstack cinder-volume[87515]: DEBUG cinder.manager [None req-cebd6a9d-3073-42a1-b65a-b38d444d85ed None None] Notifying Schedulers of capabilities ... {{(pid=87515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:05:11 devstack cinder-volume[87515]: DEBUG oslo_service.periodic_task [None req-cebd6a9d-3073-42a1-b65a-b38d444d85ed None None] Running periodic task VolumeManager._thread_info {{(pid=87515) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 10:05:11 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-cebd6a9d-3073-42a1-b65a-b38d444d85ed None None] thread count: 28 {{(pid=87515) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 07 10:05:11 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-cebd6a9d-3073-42a1-b65a-b38d444d85ed None None] thread info: [<_MainThread(MainThread, started 131647121809536)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87515) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 07 10:05:11 devstack sudo[95953]: pam_unix(sudo:session): session closed for user root Sep 07 10:05:11 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-63cd8586-db66-4823-b8bf-554641d833ce tempest-AttachVolumeNegativeTest-1630918730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-9fc23352-9691-48be-9bb8-7def7491c408" returned: 0 in 0.253s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:05:11 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-63cd8586-db66-4823-b8bf-554641d833ce tempest-AttachVolumeNegativeTest-1630918730 None] <== create_volume: return (719ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'} {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 10:05:11 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-63cd8586-db66-4823-b8bf-554641d833ce tempest-AttachVolumeNegativeTest-1630918730 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.723s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:05:11 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-25d44b12-b4a5-4af8-a358-397742073e07 tempest-VolumesSnapshotTestJSON-2041623630 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.656s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:05:11 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-25d44b12-b4a5-4af8-a358-397742073e07 tempest-VolumesSnapshotTestJSON-2041623630 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:05:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-744519711',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=745a4758-26ab-429e-9009-55e8b0d24ad0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='940eb7dc41254b3f8fe361a280cc52b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:05:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:05:01Z,use_quota=True,user_id='37b1985156f54ab4853962fe1a63200f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3a092cd-7947-4cbf-abff-4ba9567becf0),volume_type_id=f3a092cd-7947-4cbf-abff-4ba9567becf0)}" {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 10:05:11 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-25d44b12-b4a5-4af8-a358-397742073e07 tempest-VolumesSnapshotTestJSON-2041623630 None] Creating volume 745a4758-26ab-429e-9009-55e8b0d24ad0 {{(pid=87515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 10:05:11 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-25d44b12-b4a5-4af8-a358-397742073e07 tempest-VolumesSnapshotTestJSON-2041623630 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:05:11 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-25d44b12-b4a5-4af8-a358-397742073e07 tempest-VolumesSnapshotTestJSON-2041623630 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:05:11 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-25d44b12-b4a5-4af8-a358-397742073e07 tempest-VolumesSnapshotTestJSON-2041623630 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:05:11 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-25d44b12-b4a5-4af8-a358-397742073e07 tempest-VolumesSnapshotTestJSON-2041623630 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:05:11 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-25d44b12-b4a5-4af8-a358-397742073e07 tempest-VolumesSnapshotTestJSON-2041623630 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:05:11 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-25d44b12-b4a5-4af8-a358-397742073e07 tempest-VolumesSnapshotTestJSON-2041623630 None] Selected osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c as target Quobyte volume. {{(pid=87515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 10:05:11 devstack cinder-volume[87515]: INFO cinder.volume.drivers.remotefs [None req-25d44b12-b4a5-4af8-a358-397742073e07 tempest-VolumesSnapshotTestJSON-2041623630 None] casted to osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c Sep 07 10:05:11 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-25d44b12-b4a5-4af8-a358-397742073e07 tempest-VolumesSnapshotTestJSON-2041623630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-745a4758-26ab-429e-9009-55e8b0d24ad0 1073741824 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:05:11 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-63cd8586-db66-4823-b8bf-554641d833ce tempest-AttachVolumeNegativeTest-1630918730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ec1ec4e-d1ad-437b-9510-a3933e36f667) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9fc23352-9691-48be-9bb8-7def7491c408', 'volume_size': 1}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:05:11 devstack sudo[95957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-745a4758-26ab-429e-9009-55e8b0d24ad0 1073741824 Sep 07 10:05:11 devstack sudo[95957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:05:11 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-63cd8586-db66-4823-b8bf-554641d833ce tempest-AttachVolumeNegativeTest-1630918730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c7545ff-ed78-48d9-8ed4-22aa9a1f0981) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:05:11 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-63cd8586-db66-4823-b8bf-554641d833ce tempest-AttachVolumeNegativeTest-1630918730 None] Volume volume-9fc23352-9691-48be-9bb8-7def7491c408 (9fc23352-9691-48be-9bb8-7def7491c408): created successfully Sep 07 10:05:11 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-63cd8586-db66-4823-b8bf-554641d833ce tempest-AttachVolumeNegativeTest-1630918730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c7545ff-ed78-48d9-8ed4-22aa9a1f0981) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:05:11 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-63cd8586-db66-4823-b8bf-554641d833ce tempest-AttachVolumeNegativeTest-1630918730 None] Flow 'volume_create_manager' (37586700-8871-4f44-b0ce-a65eb224194f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:05:11 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-63cd8586-db66-4823-b8bf-554641d833ce tempest-AttachVolumeNegativeTest-1630918730 None] Created volume successfully. Sep 07 10:05:12 devstack sudo[95957]: pam_unix(sudo:session): session closed for user root Sep 07 10:05:12 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-25d44b12-b4a5-4af8-a358-397742073e07 tempest-VolumesSnapshotTestJSON-2041623630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-745a4758-26ab-429e-9009-55e8b0d24ad0 1073741824" returned: 0 in 0.511s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:05:12 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-25d44b12-b4a5-4af8-a358-397742073e07 tempest-VolumesSnapshotTestJSON-2041623630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-745a4758-26ab-429e-9009-55e8b0d24ad0 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:05:12 devstack sudo[95967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-745a4758-26ab-429e-9009-55e8b0d24ad0 Sep 07 10:05:12 devstack sudo[95967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:05:12 devstack sudo[95967]: pam_unix(sudo:session): session closed for user root Sep 07 10:05:12 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-25d44b12-b4a5-4af8-a358-397742073e07 tempest-VolumesSnapshotTestJSON-2041623630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-745a4758-26ab-429e-9009-55e8b0d24ad0" returned: 0 in 0.293s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:05:12 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-25d44b12-b4a5-4af8-a358-397742073e07 tempest-VolumesSnapshotTestJSON-2041623630 None] <== create_volume: return (859ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'} {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 10:05:12 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-25d44b12-b4a5-4af8-a358-397742073e07 tempest-VolumesSnapshotTestJSON-2041623630 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.866s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:05:12 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-25d44b12-b4a5-4af8-a358-397742073e07 tempest-VolumesSnapshotTestJSON-2041623630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe1ccbec-90da-4c44-bdf9-6105b41eb74a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-745a4758-26ab-429e-9009-55e8b0d24ad0', 'volume_size': 1}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:05:12 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-25d44b12-b4a5-4af8-a358-397742073e07 tempest-VolumesSnapshotTestJSON-2041623630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dfc46338-558d-4a42-a347-fed32fd89e1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:05:12 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-25d44b12-b4a5-4af8-a358-397742073e07 tempest-VolumesSnapshotTestJSON-2041623630 None] Volume volume-745a4758-26ab-429e-9009-55e8b0d24ad0 (745a4758-26ab-429e-9009-55e8b0d24ad0): created successfully Sep 07 10:05:12 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-25d44b12-b4a5-4af8-a358-397742073e07 tempest-VolumesSnapshotTestJSON-2041623630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dfc46338-558d-4a42-a347-fed32fd89e1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:05:12 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-25d44b12-b4a5-4af8-a358-397742073e07 tempest-VolumesSnapshotTestJSON-2041623630 None] Flow 'volume_create_manager' (bbc646cc-445e-44c4-b48f-8719c75af518) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:05:12 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-25d44b12-b4a5-4af8-a358-397742073e07 tempest-VolumesSnapshotTestJSON-2041623630 None] Created volume successfully. Sep 07 10:05:13 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-e934047a-2996-458c-8dad-0608c36d5570 tempest-VolumesActionsTest-1631371612 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:05:13 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-e934047a-2996-458c-8dad-0608c36d5570 tempest-VolumesActionsTest-1631371612 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:05:13 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[660b2e80-4a5c-453e-843d-0884b514206e]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:05:13 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-e934047a-2996-458c-8dad-0608c36d5570 tempest-VolumesActionsTest-1631371612 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-5e6a3de9-6f37-4b18-9e1f-fe41adcbc9fe {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:05:13 devstack sudo[95971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-5e6a3de9-6f37-4b18-9e1f-fe41adcbc9fe Sep 07 10:05:13 devstack sudo[95971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:05:13 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [req-21bd2a22-4682-44c1-a8b7-772d335ee2b1 req-e1e55924-9892-41f8-8a2d-6fee70323294 tempest-AttachVolumeNegativeTest-1630918730 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:05:13 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-c19b59a2-7ba4-4d7d-8a39-68527cb44566 tempest-VolumesSnapshotTestJSON-2041623630 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:05:13 devstack sudo[95971]: pam_unix(sudo:session): session closed for user root Sep 07 10:05:13 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-e934047a-2996-458c-8dad-0608c36d5570 tempest-VolumesActionsTest-1631371612 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-5e6a3de9-6f37-4b18-9e1f-fe41adcbc9fe" returned: 0 in 0.436s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:05:13 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd505ba7-4c11-4c47-a8ca-e4e0a1d7933e]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:05:13 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-e934047a-2996-458c-8dad-0608c36d5570 tempest-VolumesActionsTest-1631371612 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-5e6a3de9-6f37-4b18-9e1f-fe41adcbc9fe {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:05:13 devstack sudo[95984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-5e6a3de9-6f37-4b18-9e1f-fe41adcbc9fe Sep 07 10:05:13 devstack sudo[95984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:05:13 devstack sudo[95984]: pam_unix(sudo:session): session closed for user root Sep 07 10:05:13 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-e934047a-2996-458c-8dad-0608c36d5570 tempest-VolumesActionsTest-1631371612 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-5e6a3de9-6f37-4b18-9e1f-fe41adcbc9fe" returned: 0 in 0.359s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:05:13 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-e934047a-2996-458c-8dad-0608c36d5570 tempest-VolumesActionsTest-1631371612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-5e6a3de9-6f37-4b18-9e1f-fe41adcbc9fe /opt/stack/data/cinder/conversion/5e6a3de9-6f37-4b18-9e1f-fe41adcbc9fe.temp_image.bca37cf6-38b9-48e6-b139-ffc969a3589fb3v5pd92.img {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:05:13 devstack sudo[95989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-5e6a3de9-6f37-4b18-9e1f-fe41adcbc9fe /opt/stack/data/cinder/conversion/5e6a3de9-6f37-4b18-9e1f-fe41adcbc9fe.temp_image.bca37cf6-38b9-48e6-b139-ffc969a3589fb3v5pd92.img Sep 07 10:05:13 devstack sudo[95989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:05:18 devstack sudo[95989]: pam_unix(sudo:session): session closed for user root Sep 07 10:05:18 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-e934047a-2996-458c-8dad-0608c36d5570 tempest-VolumesActionsTest-1631371612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-5e6a3de9-6f37-4b18-9e1f-fe41adcbc9fe /opt/stack/data/cinder/conversion/5e6a3de9-6f37-4b18-9e1f-fe41adcbc9fe.temp_image.bca37cf6-38b9-48e6-b139-ffc969a3589fb3v5pd92.img" returned: 0 in 4.283s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:05:18 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[2abf168d-bac1-42f1-90ae-2f8b13865cba]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:05:18 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-e934047a-2996-458c-8dad-0608c36d5570 tempest-VolumesActionsTest-1631371612 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-5e6a3de9-6f37-4b18-9e1f-fe41adcbc9fe {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:05:18 devstack sudo[96039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-5e6a3de9-6f37-4b18-9e1f-fe41adcbc9fe Sep 07 10:05:18 devstack sudo[96039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:05:18 devstack sudo[96039]: pam_unix(sudo:session): session closed for user root Sep 07 10:05:18 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-e934047a-2996-458c-8dad-0608c36d5570 tempest-VolumesActionsTest-1631371612 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-5e6a3de9-6f37-4b18-9e1f-fe41adcbc9fe" returned: 0 in 0.588s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:05:18 devstack cinder-volume[87515]: DEBUG cinder.image.image_utils [None req-e934047a-2996-458c-8dad-0608c36d5570 tempest-VolumesActionsTest-1631371612 None] Image conversion details: src /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-5e6a3de9-6f37-4b18-9e1f-fe41adcbc9fe, size 1024.00 MB, duration 4.28 sec, destination /opt/stack/data/cinder/conversion/5e6a3de9-6f37-4b18-9e1f-fe41adcbc9fe.temp_image.bca37cf6-38b9-48e6-b139-ffc969a3589fb3v5pd92.img {{(pid=87515) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 07 10:05:18 devstack cinder-volume[87515]: INFO cinder.image.image_utils [None req-e934047a-2996-458c-8dad-0608c36d5570 tempest-VolumesActionsTest-1631371612 None] Converted 1024.00 MB image at 239.04 MB/s Sep 07 10:05:18 devstack cinder-volume[87515]: DEBUG dbcounter [-] [87515] Writing DB stats cinder:INSERT=12,cinder:SELECT=56,cinder:UPDATE=47,cinder:DELETE=5 {{(pid=87515) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 10:05:18 devstack cinder-volume[87515]: DEBUG cinder.image.image_utils [None req-e934047a-2996-458c-8dad-0608c36d5570 tempest-VolumesActionsTest-1631371612 None] bca37cf6-38b9-48e6-b139-ffc969a3589f was raw, converting to qcow2 {{(pid=87515) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}} Sep 07 10:05:18 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[7aa59a1e-3d61-4918-926d-c1078a27cabe]: (4, 'raw') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:05:18 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-e934047a-2996-458c-8dad-0608c36d5570 tempest-VolumesActionsTest-1631371612 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/5e6a3de9-6f37-4b18-9e1f-fe41adcbc9fe.temp_image.bca37cf6-38b9-48e6-b139-ffc969a3589fb3v5pd92.img {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:05:18 devstack sudo[96048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/5e6a3de9-6f37-4b18-9e1f-fe41adcbc9fe.temp_image.bca37cf6-38b9-48e6-b139-ffc969a3589fb3v5pd92.img Sep 07 10:05:18 devstack sudo[96048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:05:19 devstack cinder-volume[87515]: INFO cinder.volume.manager [req-2072135a-f4c8-4a76-a218-0076922ea9cb req-69f611f3-9c65-4591-96d0-f4845b76fa47 tempest-AttachVolumeTestJSON-1590815735 None] Terminate volume connection completed successfully. Sep 07 10:05:19 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [req-2072135a-f4c8-4a76-a218-0076922ea9cb req-69f611f3-9c65-4591-96d0-f4845b76fa47 tempest-AttachVolumeTestJSON-1590815735 None] Deleting attachment 814feec1-1e1d-481d-8f6a-7dee230359db. {{(pid=87515) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 07 10:05:19 devstack sudo[96048]: pam_unix(sudo:session): session closed for user root Sep 07 10:05:19 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-e934047a-2996-458c-8dad-0608c36d5570 tempest-VolumesActionsTest-1631371612 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/5e6a3de9-6f37-4b18-9e1f-fe41adcbc9fe.temp_image.bca37cf6-38b9-48e6-b139-ffc969a3589fb3v5pd92.img" returned: 0 in 0.361s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:05:19 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-e934047a-2996-458c-8dad-0608c36d5570 tempest-VolumesActionsTest-1631371612 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/5e6a3de9-6f37-4b18-9e1f-fe41adcbc9fe.temp_image.bca37cf6-38b9-48e6-b139-ffc969a3589fb3v5pd92.img {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:05:19 devstack sudo[96056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/5e6a3de9-6f37-4b18-9e1f-fe41adcbc9fe.temp_image.bca37cf6-38b9-48e6-b139-ffc969a3589fb3v5pd92.img Sep 07 10:05:19 devstack sudo[96056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:05:19 devstack sudo[96056]: pam_unix(sudo:session): session closed for user root Sep 07 10:05:19 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-e934047a-2996-458c-8dad-0608c36d5570 tempest-VolumesActionsTest-1631371612 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/5e6a3de9-6f37-4b18-9e1f-fe41adcbc9fe.temp_image.bca37cf6-38b9-48e6-b139-ffc969a3589fb3v5pd92.img" returned: 1 in 0.371s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:05:19 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-e934047a-2996-458c-8dad-0608c36d5570 tempest-VolumesActionsTest-1631371612 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/5e6a3de9-6f37-4b18-9e1f-fe41adcbc9fe.temp_image.bca37cf6-38b9-48e6-b139-ffc969a3589fb3v5pd92.img' failed. Not Retrying. {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 07 10:05:19 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-e934047a-2996-458c-8dad-0608c36d5570 tempest-VolumesActionsTest-1631371612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/5e6a3de9-6f37-4b18-9e1f-fe41adcbc9fe.temp_image.bca37cf6-38b9-48e6-b139-ffc969a3589fb3v5pd92.img /opt/stack/data/cinder/conversion/vol_upload_5e7bw_dj {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:05:19 devstack sudo[96061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/5e6a3de9-6f37-4b18-9e1f-fe41adcbc9fe.temp_image.bca37cf6-38b9-48e6-b139-ffc969a3589fb3v5pd92.img /opt/stack/data/cinder/conversion/vol_upload_5e7bw_dj Sep 07 10:05:19 devstack sudo[96061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:05:19 devstack sudo[96061]: pam_unix(sudo:session): session closed for user root Sep 07 10:05:19 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-e934047a-2996-458c-8dad-0608c36d5570 tempest-VolumesActionsTest-1631371612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/5e6a3de9-6f37-4b18-9e1f-fe41adcbc9fe.temp_image.bca37cf6-38b9-48e6-b139-ffc969a3589fb3v5pd92.img /opt/stack/data/cinder/conversion/vol_upload_5e7bw_dj" returned: 0 in 0.268s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:05:19 devstack cinder-volume[87515]: DEBUG cinder.image.image_utils [None req-e934047a-2996-458c-8dad-0608c36d5570 tempest-VolumesActionsTest-1631371612 None] Image conversion details: src /opt/stack/data/cinder/conversion/5e6a3de9-6f37-4b18-9e1f-fe41adcbc9fe.temp_image.bca37cf6-38b9-48e6-b139-ffc969a3589fb3v5pd92.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_5e7bw_dj {{(pid=87515) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 07 10:05:19 devstack cinder-volume[87515]: INFO cinder.image.image_utils [None req-e934047a-2996-458c-8dad-0608c36d5570 tempest-VolumesActionsTest-1631371612 None] Converted 1024.00 MB image at 1024.00 MB/s Sep 07 10:05:19 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7db6e93-8cb2-4945-aa2f-2ea1c19e6762]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:05:19 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-e934047a-2996-458c-8dad-0608c36d5570 tempest-VolumesActionsTest-1631371612 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_5e7bw_dj {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:05:19 devstack sudo[96066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_5e7bw_dj Sep 07 10:05:19 devstack sudo[96066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:05:20 devstack sudo[96066]: pam_unix(sudo:session): session closed for user root Sep 07 10:05:20 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-e934047a-2996-458c-8dad-0608c36d5570 tempest-VolumesActionsTest-1631371612 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_5e7bw_dj" returned: 0 in 0.358s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:05:21 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-e934047a-2996-458c-8dad-0608c36d5570 tempest-VolumesActionsTest-1631371612 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 8.676s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:05:21 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-e934047a-2996-458c-8dad-0608c36d5570 tempest-VolumesActionsTest-1631371612 None] Uploaded volume to glance image-id: bca37cf6-38b9-48e6-b139-ffc969a3589f. {{(pid=87515) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 07 10:05:21 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [req-21bd2a22-4682-44c1-a8b7-772d335ee2b1 req-e1e55924-9892-41f8-8a2d-6fee70323294 tempest-AttachVolumeNegativeTest-1630918730 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 8.343s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:05:21 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [req-21bd2a22-4682-44c1-a8b7-772d335ee2b1 req-e1e55924-9892-41f8-8a2d-6fee70323294 tempest-AttachVolumeNegativeTest-1630918730 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.028s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:05:21 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-c19b59a2-7ba4-4d7d-8a39-68527cb44566 tempest-VolumesSnapshotTestJSON-2041623630 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 8.370s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:05:21 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-e934047a-2996-458c-8dad-0608c36d5570 tempest-VolumesActionsTest-1631371612 None] Copy volume to image completed successfully. Sep 07 10:05:21 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-c19b59a2-7ba4-4d7d-8a39-68527cb44566 tempest-VolumesSnapshotTestJSON-2041623630 None] Creating offline snapshot fa7fcf98-ad34-4dd9-82e1-362e9967c66b of volume 745a4758-26ab-429e-9009-55e8b0d24ad0 {{(pid=87515) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 10:05:21 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3334914-9c59-4ab6-9783-1647816c76a8]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:05:21 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-c19b59a2-7ba4-4d7d-8a39-68527cb44566 tempest-VolumesSnapshotTestJSON-2041623630 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-745a4758-26ab-429e-9009-55e8b0d24ad0 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:05:21 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [req-21bd2a22-4682-44c1-a8b7-772d335ee2b1 req-e1e55924-9892-41f8-8a2d-6fee70323294 tempest-AttachVolumeNegativeTest-1630918730 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c', 'name': 'volume-9fc23352-9691-48be-9bb8-7def7491c408', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0fc9e814-3ee7-4665-9b90-9bcbd82ffc2e', 'enforce_multipath': True} {{(pid=87515) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 07 10:05:21 devstack cinder-volume[87515]: INFO cinder.volume.manager [req-21bd2a22-4682-44c1-a8b7-772d335ee2b1 req-e1e55924-9892-41f8-8a2d-6fee70323294 tempest-AttachVolumeNegativeTest-1630918730 None] attachment_update completed successfully. Sep 07 10:05:21 devstack sudo[96076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-745a4758-26ab-429e-9009-55e8b0d24ad0 Sep 07 10:05:21 devstack sudo[96076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:05:22 devstack sudo[96076]: pam_unix(sudo:session): session closed for user root Sep 07 10:05:22 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-c19b59a2-7ba4-4d7d-8a39-68527cb44566 tempest-VolumesSnapshotTestJSON-2041623630 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-745a4758-26ab-429e-9009-55e8b0d24ad0" returned: 0 in 0.477s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:05:22 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-c19b59a2-7ba4-4d7d-8a39-68527cb44566 tempest-VolumesSnapshotTestJSON-2041623630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-745a4758-26ab-429e-9009-55e8b0d24ad0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-745a4758-26ab-429e-9009-55e8b0d24ad0.fa7fcf98-ad34-4dd9-82e1-362e9967c66b 1G {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:05:22 devstack sudo[96462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-745a4758-26ab-429e-9009-55e8b0d24ad0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-745a4758-26ab-429e-9009-55e8b0d24ad0.fa7fcf98-ad34-4dd9-82e1-362e9967c66b 1G Sep 07 10:05:22 devstack sudo[96462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:05:23 devstack sudo[96462]: pam_unix(sudo:session): session closed for user root Sep 07 10:05:23 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-c19b59a2-7ba4-4d7d-8a39-68527cb44566 tempest-VolumesSnapshotTestJSON-2041623630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-745a4758-26ab-429e-9009-55e8b0d24ad0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-745a4758-26ab-429e-9009-55e8b0d24ad0.fa7fcf98-ad34-4dd9-82e1-362e9967c66b 1G" returned: 0 in 0.803s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:05:23 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-c19b59a2-7ba4-4d7d-8a39-68527cb44566 tempest-VolumesSnapshotTestJSON-2041623630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-745a4758-26ab-429e-9009-55e8b0d24ad0 -F qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-745a4758-26ab-429e-9009-55e8b0d24ad0.fa7fcf98-ad34-4dd9-82e1-362e9967c66b {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:05:23 devstack sudo[96486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-745a4758-26ab-429e-9009-55e8b0d24ad0 -F qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-745a4758-26ab-429e-9009-55e8b0d24ad0.fa7fcf98-ad34-4dd9-82e1-362e9967c66b Sep 07 10:05:23 devstack sudo[96486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:05:23 devstack sudo[96486]: pam_unix(sudo:session): session closed for user root Sep 07 10:05:23 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-c19b59a2-7ba4-4d7d-8a39-68527cb44566 tempest-VolumesSnapshotTestJSON-2041623630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-745a4758-26ab-429e-9009-55e8b0d24ad0 -F qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-745a4758-26ab-429e-9009-55e8b0d24ad0.fa7fcf98-ad34-4dd9-82e1-362e9967c66b" returned: 0 in 0.473s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:05:23 devstack cinder-volume[87515]: WARNING cinder.volume.drivers.remotefs [None req-c19b59a2-7ba4-4d7d-8a39-68527cb44566 tempest-VolumesSnapshotTestJSON-2041623630 None] /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-745a4758-26ab-429e-9009-55e8b0d24ad0.fa7fcf98-ad34-4dd9-82e1-362e9967c66b is being set with open permissions: ugo+rw Sep 07 10:05:23 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-c19b59a2-7ba4-4d7d-8a39-68527cb44566 tempest-VolumesSnapshotTestJSON-2041623630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-745a4758-26ab-429e-9009-55e8b0d24ad0.fa7fcf98-ad34-4dd9-82e1-362e9967c66b {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:05:23 devstack sudo[96498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-745a4758-26ab-429e-9009-55e8b0d24ad0.fa7fcf98-ad34-4dd9-82e1-362e9967c66b Sep 07 10:05:23 devstack sudo[96498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:05:23 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-ce4d6dd8-856a-40f9-8f2d-a2c00891dc8e tempest-VolumesActionsTest-1631371612 None] Acquiring lock "cinder-5e6a3de9-6f37-4b18-9e1f-fe41adcbc9fe-delete_volume" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:05:23 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-ce4d6dd8-856a-40f9-8f2d-a2c00891dc8e tempest-VolumesActionsTest-1631371612 None] Lock "cinder-5e6a3de9-6f37-4b18-9e1f-fe41adcbc9fe-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:05:23 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-ce4d6dd8-856a-40f9-8f2d-a2c00891dc8e tempest-VolumesActionsTest-1631371612 None] Acquiring lock "cinder-quobyte-5e6a3de9-6f37-4b18-9e1f-fe41adcbc9fe" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:05:23 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-ce4d6dd8-856a-40f9-8f2d-a2c00891dc8e tempest-VolumesActionsTest-1631371612 None] Lock "cinder-quobyte-5e6a3de9-6f37-4b18-9e1f-fe41adcbc9fe" acquired by "delete_volume" :: waited 0.021s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:05:23 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba68fb7c-97ed-44aa-afc4-90f0f54ed804]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:05:23 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-ce4d6dd8-856a-40f9-8f2d-a2c00891dc8e tempest-VolumesActionsTest-1631371612 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-5e6a3de9-6f37-4b18-9e1f-fe41adcbc9fe {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:05:23 devstack sudo[96498]: pam_unix(sudo:session): session closed for user root Sep 07 10:05:23 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-c19b59a2-7ba4-4d7d-8a39-68527cb44566 tempest-VolumesSnapshotTestJSON-2041623630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-745a4758-26ab-429e-9009-55e8b0d24ad0.fa7fcf98-ad34-4dd9-82e1-362e9967c66b" returned: 0 in 0.378s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:05:23 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-c19b59a2-7ba4-4d7d-8a39-68527cb44566 tempest-VolumesSnapshotTestJSON-2041623630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-745a4758-26ab-429e-9009-55e8b0d24ad0.info {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:05:23 devstack sudo[96508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-745a4758-26ab-429e-9009-55e8b0d24ad0.info Sep 07 10:05:23 devstack sudo[96508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:05:24 devstack sudo[96506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-5e6a3de9-6f37-4b18-9e1f-fe41adcbc9fe Sep 07 10:05:24 devstack sudo[96506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:05:24 devstack sudo[96508]: pam_unix(sudo:session): session closed for user root Sep 07 10:05:24 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-c19b59a2-7ba4-4d7d-8a39-68527cb44566 tempest-VolumesSnapshotTestJSON-2041623630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-745a4758-26ab-429e-9009-55e8b0d24ad0.info" returned: 0 in 0.554s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:05:24 devstack cinder-volume[87515]: WARNING cinder.volume.drivers.remotefs [None req-c19b59a2-7ba4-4d7d-8a39-68527cb44566 tempest-VolumesSnapshotTestJSON-2041623630 None] /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-745a4758-26ab-429e-9009-55e8b0d24ad0.info is being set with open permissions: ugo+rw Sep 07 10:05:24 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-c19b59a2-7ba4-4d7d-8a39-68527cb44566 tempest-VolumesSnapshotTestJSON-2041623630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-745a4758-26ab-429e-9009-55e8b0d24ad0.info {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:05:24 devstack sudo[96553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-745a4758-26ab-429e-9009-55e8b0d24ad0.info Sep 07 10:05:24 devstack sudo[96553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:05:24 devstack sudo[96506]: pam_unix(sudo:session): session closed for user root Sep 07 10:05:24 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-ce4d6dd8-856a-40f9-8f2d-a2c00891dc8e tempest-VolumesActionsTest-1631371612 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-5e6a3de9-6f37-4b18-9e1f-fe41adcbc9fe" returned: 0 in 0.871s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:05:24 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-ce4d6dd8-856a-40f9-8f2d-a2c00891dc8e tempest-VolumesActionsTest-1631371612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-5e6a3de9-6f37-4b18-9e1f-fe41adcbc9fe {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:05:24 devstack sudo[96572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-5e6a3de9-6f37-4b18-9e1f-fe41adcbc9fe Sep 07 10:05:24 devstack sudo[96572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:05:25 devstack sudo[96553]: pam_unix(sudo:session): session closed for user root Sep 07 10:05:25 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-c19b59a2-7ba4-4d7d-8a39-68527cb44566 tempest-VolumesSnapshotTestJSON-2041623630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-745a4758-26ab-429e-9009-55e8b0d24ad0.info" returned: 0 in 0.515s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:05:25 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-c19b59a2-7ba4-4d7d-8a39-68527cb44566 tempest-VolumesSnapshotTestJSON-2041623630 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.340s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:05:25 devstack cinder-volume[87515]: INFO cinder.volume.manager [req-e96fd02a-cb16-4e66-81ad-9a008c0febef req-50ee2f6d-f4a4-4322-b550-89715e52ac68 tempest-AttachVolumeNegativeTest-1630918730 None] Terminate volume connection completed successfully. Sep 07 10:05:25 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [req-e96fd02a-cb16-4e66-81ad-9a008c0febef req-50ee2f6d-f4a4-4322-b550-89715e52ac68 tempest-AttachVolumeNegativeTest-1630918730 None] Deleting attachment 0fc9e814-3ee7-4665-9b90-9bcbd82ffc2e. {{(pid=87515) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 07 10:05:25 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-c19b59a2-7ba4-4d7d-8a39-68527cb44566 tempest-VolumesSnapshotTestJSON-2041623630 None] Create snapshot completed successfully Sep 07 10:05:25 devstack sudo[96572]: pam_unix(sudo:session): session closed for user root Sep 07 10:05:25 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-ce4d6dd8-856a-40f9-8f2d-a2c00891dc8e tempest-VolumesActionsTest-1631371612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-5e6a3de9-6f37-4b18-9e1f-fe41adcbc9fe" returned: 0 in 0.645s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:05:25 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-ce4d6dd8-856a-40f9-8f2d-a2c00891dc8e tempest-VolumesActionsTest-1631371612 None] Lock "cinder-quobyte-5e6a3de9-6f37-4b18-9e1f-fe41adcbc9fe" released by "delete_volume" :: held 1.603s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:05:25 devstack cinder-volume[87515]: DEBUG cinder.quota [None req-ce4d6dd8-856a-40f9-8f2d-a2c00891dc8e tempest-VolumesActionsTest-1631371612 None] Created reservations ['4750824f-47c0-4772-8dc4-9da8125ba693', 'd260fb5a-a247-4464-a71d-46f0e6b8e406', 'e12eb376-2890-4d08-aa8f-1303b56c9f45', 'ff80c282-74f5-4b9e-b8f1-0524429058d7'] {{(pid=87515) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:05:25 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-ce4d6dd8-856a-40f9-8f2d-a2c00891dc8e tempest-VolumesActionsTest-1631371612 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:05:25 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-ce4d6dd8-856a-40f9-8f2d-a2c00891dc8e tempest-VolumesActionsTest-1631371612 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:05:25 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-ce4d6dd8-856a-40f9-8f2d-a2c00891dc8e tempest-VolumesActionsTest-1631371612 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:05:25 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-ce4d6dd8-856a-40f9-8f2d-a2c00891dc8e tempest-VolumesActionsTest-1631371612 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:05:25 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-ce4d6dd8-856a-40f9-8f2d-a2c00891dc8e tempest-VolumesActionsTest-1631371612 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:05:25 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-ce4d6dd8-856a-40f9-8f2d-a2c00891dc8e tempest-VolumesActionsTest-1631371612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:05:25 devstack sudo[96615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a Sep 07 10:05:25 devstack sudo[96615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:05:26 devstack sudo[96615]: pam_unix(sudo:session): session closed for user root Sep 07 10:05:26 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-ce4d6dd8-856a-40f9-8f2d-a2c00891dc8e tempest-VolumesActionsTest-1631371612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a" returned: 0 in 0.324s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:05:26 devstack cinder-volume[87515]: DEBUG cinder.manager [None req-ce4d6dd8-856a-40f9-8f2d-a2c00891dc8e tempest-VolumesActionsTest-1631371612 None] Notifying Schedulers of capabilities ... {{(pid=87515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:05:26 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-ce4d6dd8-856a-40f9-8f2d-a2c00891dc8e tempest-VolumesActionsTest-1631371612 None] Deleted volume successfully. Sep 07 10:05:26 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-ce4d6dd8-856a-40f9-8f2d-a2c00891dc8e tempest-VolumesActionsTest-1631371612 None] Lock "cinder-5e6a3de9-6f37-4b18-9e1f-fe41adcbc9fe-delete_volume" released by "delete_volume" :: held 2.417s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:05:26 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-a2ab94f8-76a9-40a3-9a9d-c0c6e9be30e0 tempest-VolumesSnapshotTestJSON-2041623630 None] Acquiring lock "cinder-fa7fcf98-ad34-4dd9-82e1-362e9967c66b-delete_snapshot" by "delete_snapshot" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:05:27 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-a2ab94f8-76a9-40a3-9a9d-c0c6e9be30e0 tempest-VolumesSnapshotTestJSON-2041623630 None] Lock "cinder-fa7fcf98-ad34-4dd9-82e1-362e9967c66b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.076s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:05:27 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-a2ab94f8-76a9-40a3-9a9d-c0c6e9be30e0 tempest-VolumesSnapshotTestJSON-2041623630 None] Acquiring lock "cinder-quobyte-745a4758-26ab-429e-9009-55e8b0d24ad0" by "delete_snapshot" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:05:27 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-a2ab94f8-76a9-40a3-9a9d-c0c6e9be30e0 tempest-VolumesSnapshotTestJSON-2041623630 None] Lock "cinder-quobyte-745a4758-26ab-429e-9009-55e8b0d24ad0" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:05:27 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-a2ab94f8-76a9-40a3-9a9d-c0c6e9be30e0 tempest-VolumesSnapshotTestJSON-2041623630 None] Acquiring lock "cinder-quobyte-fa7fcf98-ad34-4dd9-82e1-362e9967c66b" by "_delete_snapshot" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:05:27 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-a2ab94f8-76a9-40a3-9a9d-c0c6e9be30e0 tempest-VolumesSnapshotTestJSON-2041623630 None] Lock "cinder-quobyte-fa7fcf98-ad34-4dd9-82e1-362e9967c66b" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:05:27 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-a2ab94f8-76a9-40a3-9a9d-c0c6e9be30e0 tempest-VolumesSnapshotTestJSON-2041623630 None] Deleting offline snapshot fa7fcf98-ad34-4dd9-82e1-362e9967c66b of volume 745a4758-26ab-429e-9009-55e8b0d24ad0 {{(pid=87515) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 10:05:27 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-a2ab94f8-76a9-40a3-9a9d-c0c6e9be30e0 tempest-VolumesSnapshotTestJSON-2041623630 None] snapshot_file for this snap is: volume-745a4758-26ab-429e-9009-55e8b0d24ad0.fa7fcf98-ad34-4dd9-82e1-362e9967c66b {{(pid=87515) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 10:05:27 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc847488-7de7-445c-95cc-2667dd46c447]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:05:27 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-a2ab94f8-76a9-40a3-9a9d-c0c6e9be30e0 tempest-VolumesSnapshotTestJSON-2041623630 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-745a4758-26ab-429e-9009-55e8b0d24ad0.fa7fcf98-ad34-4dd9-82e1-362e9967c66b {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:05:27 devstack sudo[96639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-745a4758-26ab-429e-9009-55e8b0d24ad0.fa7fcf98-ad34-4dd9-82e1-362e9967c66b Sep 07 10:05:27 devstack sudo[96639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:05:28 devstack sudo[96639]: pam_unix(sudo:session): session closed for user root Sep 07 10:05:28 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-a2ab94f8-76a9-40a3-9a9d-c0c6e9be30e0 tempest-VolumesSnapshotTestJSON-2041623630 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-745a4758-26ab-429e-9009-55e8b0d24ad0.fa7fcf98-ad34-4dd9-82e1-362e9967c66b" returned: 0 in 1.069s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:05:28 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-a2ab94f8-76a9-40a3-9a9d-c0c6e9be30e0 tempest-VolumesSnapshotTestJSON-2041623630 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-745a4758-26ab-429e-9009-55e8b0d24ad0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87515) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 10:05:28 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[e19e2722-c72f-436e-b959-359688dc0c3c]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:05:28 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-a2ab94f8-76a9-40a3-9a9d-c0c6e9be30e0 tempest-VolumesSnapshotTestJSON-2041623630 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-745a4758-26ab-429e-9009-55e8b0d24ad0 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:05:28 devstack sudo[96646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-745a4758-26ab-429e-9009-55e8b0d24ad0 Sep 07 10:05:28 devstack sudo[96646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:05:29 devstack sudo[96646]: pam_unix(sudo:session): session closed for user root Sep 07 10:05:29 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-a2ab94f8-76a9-40a3-9a9d-c0c6e9be30e0 tempest-VolumesSnapshotTestJSON-2041623630 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-745a4758-26ab-429e-9009-55e8b0d24ad0" returned: 0 in 0.624s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:05:29 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-a2ab94f8-76a9-40a3-9a9d-c0c6e9be30e0 tempest-VolumesSnapshotTestJSON-2041623630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-745a4758-26ab-429e-9009-55e8b0d24ad0.fa7fcf98-ad34-4dd9-82e1-362e9967c66b {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:05:29 devstack sudo[96652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-745a4758-26ab-429e-9009-55e8b0d24ad0.fa7fcf98-ad34-4dd9-82e1-362e9967c66b Sep 07 10:05:29 devstack sudo[96652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:05:29 devstack sudo[96652]: pam_unix(sudo:session): session closed for user root Sep 07 10:05:29 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-a2ab94f8-76a9-40a3-9a9d-c0c6e9be30e0 tempest-VolumesSnapshotTestJSON-2041623630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-745a4758-26ab-429e-9009-55e8b0d24ad0.fa7fcf98-ad34-4dd9-82e1-362e9967c66b" returned: 0 in 0.786s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:05:29 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-a2ab94f8-76a9-40a3-9a9d-c0c6e9be30e0 tempest-VolumesSnapshotTestJSON-2041623630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-745a4758-26ab-429e-9009-55e8b0d24ad0.fa7fcf98-ad34-4dd9-82e1-362e9967c66b {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:05:29 devstack sudo[96658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-745a4758-26ab-429e-9009-55e8b0d24ad0.fa7fcf98-ad34-4dd9-82e1-362e9967c66b Sep 07 10:05:29 devstack sudo[96658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:05:30 devstack sudo[96658]: pam_unix(sudo:session): session closed for user root Sep 07 10:05:30 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-a2ab94f8-76a9-40a3-9a9d-c0c6e9be30e0 tempest-VolumesSnapshotTestJSON-2041623630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-745a4758-26ab-429e-9009-55e8b0d24ad0.fa7fcf98-ad34-4dd9-82e1-362e9967c66b" returned: 0 in 0.465s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:05:30 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-a2ab94f8-76a9-40a3-9a9d-c0c6e9be30e0 tempest-VolumesSnapshotTestJSON-2041623630 None] Lock "cinder-quobyte-fa7fcf98-ad34-4dd9-82e1-362e9967c66b" released by "_delete_snapshot" :: held 3.192s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:05:30 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-a2ab94f8-76a9-40a3-9a9d-c0c6e9be30e0 tempest-VolumesSnapshotTestJSON-2041623630 None] Lock "cinder-quobyte-745a4758-26ab-429e-9009-55e8b0d24ad0" released by "delete_snapshot" :: held 3.241s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:05:30 devstack cinder-volume[87515]: DEBUG cinder.quota [None req-a2ab94f8-76a9-40a3-9a9d-c0c6e9be30e0 tempest-VolumesSnapshotTestJSON-2041623630 None] Created reservations ['9d5e0cbb-1b3f-4b59-ac30-dd37cf4f0d36', 'caf52e6c-d1bc-459e-9ac0-d452c90228b8', '9ae04a91-6f7f-4543-a83e-8d523f9b8928', '18da08df-9905-4026-9d94-035d37aca4d5'] {{(pid=87515) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:05:30 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-a2ab94f8-76a9-40a3-9a9d-c0c6e9be30e0 tempest-VolumesSnapshotTestJSON-2041623630 None] Delete snapshot completed successfully. Sep 07 10:05:30 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-a2ab94f8-76a9-40a3-9a9d-c0c6e9be30e0 tempest-VolumesSnapshotTestJSON-2041623630 None] Lock "cinder-fa7fcf98-ad34-4dd9-82e1-362e9967c66b-delete_snapshot" released by "delete_snapshot" :: held 3.557s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:05:32 devstack cinder-volume[87515]: DEBUG cinder.volume.flows.manager.create_volume [None req-68964a17-799d-428f-abce-2abcc5286bda tempest-VolumesSnapshotTestJSON-2041623630 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 10:05:32 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-68964a17-799d-428f-abce-2abcc5286bda tempest-VolumesSnapshotTestJSON-2041623630 None] Flow 'volume_create_manager' (dab5edd0-acf3-4430-a9fb-ae517f4e85a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:05:32 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-68964a17-799d-428f-abce-2abcc5286bda tempest-VolumesSnapshotTestJSON-2041623630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ec82dde-c3e7-4d6a-9e4a-a4c92b3b894a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:05:32 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-68964a17-799d-428f-abce-2abcc5286bda tempest-VolumesSnapshotTestJSON-2041623630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ec82dde-c3e7-4d6a-9e4a-a4c92b3b894a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:05:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-343705515',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3cadf05-04df-49eb-ae32-3af71c48e1d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='940eb7dc41254b3f8fe361a280cc52b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:05:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:05:32Z,use_quota=True,user_id='37b1985156f54ab4853962fe1a63200f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3a092cd-7947-4cbf-abff-4ba9567becf0),volume_type_id=f3a092cd-7947-4cbf-abff-4ba9567becf0)' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:05:32 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-68964a17-799d-428f-abce-2abcc5286bda tempest-VolumesSnapshotTestJSON-2041623630 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9774c54e-68c0-47c1-84b1-13804d845632) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:05:32 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-68964a17-799d-428f-abce-2abcc5286bda tempest-VolumesSnapshotTestJSON-2041623630 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9774c54e-68c0-47c1-84b1-13804d845632) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:05:32 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-68964a17-799d-428f-abce-2abcc5286bda tempest-VolumesSnapshotTestJSON-2041623630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (682f92c8-f8f4-451b-83c4-2eb52d8df085) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:05:32 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-68964a17-799d-428f-abce-2abcc5286bda tempest-VolumesSnapshotTestJSON-2041623630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (682f92c8-f8f4-451b-83c4-2eb52d8df085) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a3cadf05-04df-49eb-ae32-3af71c48e1d8', 'volume_name': 'volume-a3cadf05-04df-49eb-ae32-3af71c48e1d8', 'volume_size': 1}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:05:32 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-68964a17-799d-428f-abce-2abcc5286bda tempest-VolumesSnapshotTestJSON-2041623630 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (579b9b04-65ec-40a6-8b9f-1ba6919a1672) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:05:32 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-68964a17-799d-428f-abce-2abcc5286bda tempest-VolumesSnapshotTestJSON-2041623630 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (579b9b04-65ec-40a6-8b9f-1ba6919a1672) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:05:32 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-68964a17-799d-428f-abce-2abcc5286bda tempest-VolumesSnapshotTestJSON-2041623630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b182d1a1-9aee-41db-bc07-196ad2988e21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:05:32 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-68964a17-799d-428f-abce-2abcc5286bda tempest-VolumesSnapshotTestJSON-2041623630 None] Volume a3cadf05-04df-49eb-ae32-3af71c48e1d8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a3cadf05-04df-49eb-ae32-3af71c48e1d8', 'volume_size': 1} Sep 07 10:05:32 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-68964a17-799d-428f-abce-2abcc5286bda tempest-VolumesSnapshotTestJSON-2041623630 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:05:32 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-68964a17-799d-428f-abce-2abcc5286bda tempest-VolumesSnapshotTestJSON-2041623630 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:05:32 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-68964a17-799d-428f-abce-2abcc5286bda tempest-VolumesSnapshotTestJSON-2041623630 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:05:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-343705515',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3cadf05-04df-49eb-ae32-3af71c48e1d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='940eb7dc41254b3f8fe361a280cc52b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:05:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:05:32Z,use_quota=True,user_id='37b1985156f54ab4853962fe1a63200f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3a092cd-7947-4cbf-abff-4ba9567becf0),volume_type_id=f3a092cd-7947-4cbf-abff-4ba9567becf0)}" {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 10:05:32 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-68964a17-799d-428f-abce-2abcc5286bda tempest-VolumesSnapshotTestJSON-2041623630 None] Creating volume a3cadf05-04df-49eb-ae32-3af71c48e1d8 {{(pid=87515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 10:05:32 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-68964a17-799d-428f-abce-2abcc5286bda tempest-VolumesSnapshotTestJSON-2041623630 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:05:32 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-68964a17-799d-428f-abce-2abcc5286bda tempest-VolumesSnapshotTestJSON-2041623630 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:05:32 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-68964a17-799d-428f-abce-2abcc5286bda tempest-VolumesSnapshotTestJSON-2041623630 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:05:32 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-68964a17-799d-428f-abce-2abcc5286bda tempest-VolumesSnapshotTestJSON-2041623630 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:05:32 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-68964a17-799d-428f-abce-2abcc5286bda tempest-VolumesSnapshotTestJSON-2041623630 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:05:32 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-68964a17-799d-428f-abce-2abcc5286bda tempest-VolumesSnapshotTestJSON-2041623630 None] Selected osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c as target Quobyte volume. {{(pid=87515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 10:05:32 devstack cinder-volume[87515]: INFO cinder.volume.drivers.remotefs [None req-68964a17-799d-428f-abce-2abcc5286bda tempest-VolumesSnapshotTestJSON-2041623630 None] casted to osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c Sep 07 10:05:32 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-68964a17-799d-428f-abce-2abcc5286bda tempest-VolumesSnapshotTestJSON-2041623630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-a3cadf05-04df-49eb-ae32-3af71c48e1d8 1073741824 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:05:32 devstack sudo[96662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-a3cadf05-04df-49eb-ae32-3af71c48e1d8 1073741824 Sep 07 10:05:32 devstack sudo[96662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:05:32 devstack sudo[96662]: pam_unix(sudo:session): session closed for user root Sep 07 10:05:32 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-68964a17-799d-428f-abce-2abcc5286bda tempest-VolumesSnapshotTestJSON-2041623630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-a3cadf05-04df-49eb-ae32-3af71c48e1d8 1073741824" returned: 0 in 0.552s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:05:32 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-68964a17-799d-428f-abce-2abcc5286bda tempest-VolumesSnapshotTestJSON-2041623630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-a3cadf05-04df-49eb-ae32-3af71c48e1d8 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:05:33 devstack sudo[96668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-a3cadf05-04df-49eb-ae32-3af71c48e1d8 Sep 07 10:05:33 devstack sudo[96668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:05:33 devstack sudo[96668]: pam_unix(sudo:session): session closed for user root Sep 07 10:05:33 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-68964a17-799d-428f-abce-2abcc5286bda tempest-VolumesSnapshotTestJSON-2041623630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-a3cadf05-04df-49eb-ae32-3af71c48e1d8" returned: 0 in 0.484s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:05:33 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-68964a17-799d-428f-abce-2abcc5286bda tempest-VolumesSnapshotTestJSON-2041623630 None] <== create_volume: return (1101ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'} {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 10:05:33 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-68964a17-799d-428f-abce-2abcc5286bda tempest-VolumesSnapshotTestJSON-2041623630 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.107s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:05:33 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-68964a17-799d-428f-abce-2abcc5286bda tempest-VolumesSnapshotTestJSON-2041623630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b182d1a1-9aee-41db-bc07-196ad2988e21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a3cadf05-04df-49eb-ae32-3af71c48e1d8', 'volume_size': 1}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:05:33 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-68964a17-799d-428f-abce-2abcc5286bda tempest-VolumesSnapshotTestJSON-2041623630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0328365b-7b88-46ef-9d68-1614e0c25ce0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:05:33 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-68964a17-799d-428f-abce-2abcc5286bda tempest-VolumesSnapshotTestJSON-2041623630 None] Volume volume-a3cadf05-04df-49eb-ae32-3af71c48e1d8 (a3cadf05-04df-49eb-ae32-3af71c48e1d8): created successfully Sep 07 10:05:33 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-68964a17-799d-428f-abce-2abcc5286bda tempest-VolumesSnapshotTestJSON-2041623630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0328365b-7b88-46ef-9d68-1614e0c25ce0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:05:33 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-68964a17-799d-428f-abce-2abcc5286bda tempest-VolumesSnapshotTestJSON-2041623630 None] Flow 'volume_create_manager' (dab5edd0-acf3-4430-a9fb-ae517f4e85a2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:05:33 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-68964a17-799d-428f-abce-2abcc5286bda tempest-VolumesSnapshotTestJSON-2041623630 None] Created volume successfully. Sep 07 10:05:34 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-335e7512-77b2-4af2-92b3-28d892d058d7 tempest-VolumesSnapshotTestJSON-2041623630 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:05:34 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-335e7512-77b2-4af2-92b3-28d892d058d7 tempest-VolumesSnapshotTestJSON-2041623630 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:05:34 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-335e7512-77b2-4af2-92b3-28d892d058d7 tempest-VolumesSnapshotTestJSON-2041623630 None] Creating offline snapshot 83feebf2-1eca-4fba-aa73-7763ef423b56 of volume a3cadf05-04df-49eb-ae32-3af71c48e1d8 {{(pid=87515) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 10:05:34 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[db7bf4d8-8798-416b-b0b7-fe2ad693f5bf]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:05:34 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-335e7512-77b2-4af2-92b3-28d892d058d7 tempest-VolumesSnapshotTestJSON-2041623630 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-a3cadf05-04df-49eb-ae32-3af71c48e1d8 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:05:35 devstack sudo[96672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-a3cadf05-04df-49eb-ae32-3af71c48e1d8 Sep 07 10:05:35 devstack sudo[96672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:05:35 devstack sudo[96672]: pam_unix(sudo:session): session closed for user root Sep 07 10:05:35 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-335e7512-77b2-4af2-92b3-28d892d058d7 tempest-VolumesSnapshotTestJSON-2041623630 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-a3cadf05-04df-49eb-ae32-3af71c48e1d8" returned: 0 in 0.527s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:05:35 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-335e7512-77b2-4af2-92b3-28d892d058d7 tempest-VolumesSnapshotTestJSON-2041623630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-a3cadf05-04df-49eb-ae32-3af71c48e1d8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-a3cadf05-04df-49eb-ae32-3af71c48e1d8.83feebf2-1eca-4fba-aa73-7763ef423b56 1G {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:05:35 devstack sudo[96677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-a3cadf05-04df-49eb-ae32-3af71c48e1d8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-a3cadf05-04df-49eb-ae32-3af71c48e1d8.83feebf2-1eca-4fba-aa73-7763ef423b56 1G Sep 07 10:05:35 devstack sudo[96677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:05:36 devstack sudo[96677]: pam_unix(sudo:session): session closed for user root Sep 07 10:05:36 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-335e7512-77b2-4af2-92b3-28d892d058d7 tempest-VolumesSnapshotTestJSON-2041623630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-a3cadf05-04df-49eb-ae32-3af71c48e1d8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-a3cadf05-04df-49eb-ae32-3af71c48e1d8.83feebf2-1eca-4fba-aa73-7763ef423b56 1G" returned: 0 in 0.604s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:05:36 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-335e7512-77b2-4af2-92b3-28d892d058d7 tempest-VolumesSnapshotTestJSON-2041623630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a3cadf05-04df-49eb-ae32-3af71c48e1d8 -F qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-a3cadf05-04df-49eb-ae32-3af71c48e1d8.83feebf2-1eca-4fba-aa73-7763ef423b56 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:05:36 devstack sudo[96686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a3cadf05-04df-49eb-ae32-3af71c48e1d8 -F qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-a3cadf05-04df-49eb-ae32-3af71c48e1d8.83feebf2-1eca-4fba-aa73-7763ef423b56 Sep 07 10:05:36 devstack sudo[96686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:05:36 devstack sudo[96686]: pam_unix(sudo:session): session closed for user root Sep 07 10:05:36 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-335e7512-77b2-4af2-92b3-28d892d058d7 tempest-VolumesSnapshotTestJSON-2041623630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a3cadf05-04df-49eb-ae32-3af71c48e1d8 -F qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-a3cadf05-04df-49eb-ae32-3af71c48e1d8.83feebf2-1eca-4fba-aa73-7763ef423b56" returned: 0 in 0.412s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:05:36 devstack cinder-volume[87515]: WARNING cinder.volume.drivers.remotefs [None req-335e7512-77b2-4af2-92b3-28d892d058d7 tempest-VolumesSnapshotTestJSON-2041623630 None] /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-a3cadf05-04df-49eb-ae32-3af71c48e1d8.83feebf2-1eca-4fba-aa73-7763ef423b56 is being set with open permissions: ugo+rw Sep 07 10:05:36 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-335e7512-77b2-4af2-92b3-28d892d058d7 tempest-VolumesSnapshotTestJSON-2041623630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-a3cadf05-04df-49eb-ae32-3af71c48e1d8.83feebf2-1eca-4fba-aa73-7763ef423b56 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:05:36 devstack sudo[96694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-a3cadf05-04df-49eb-ae32-3af71c48e1d8.83feebf2-1eca-4fba-aa73-7763ef423b56 Sep 07 10:05:36 devstack sudo[96694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:05:36 devstack sudo[96694]: pam_unix(sudo:session): session closed for user root Sep 07 10:05:36 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-335e7512-77b2-4af2-92b3-28d892d058d7 tempest-VolumesSnapshotTestJSON-2041623630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-a3cadf05-04df-49eb-ae32-3af71c48e1d8.83feebf2-1eca-4fba-aa73-7763ef423b56" returned: 0 in 0.350s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:05:36 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-335e7512-77b2-4af2-92b3-28d892d058d7 tempest-VolumesSnapshotTestJSON-2041623630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-a3cadf05-04df-49eb-ae32-3af71c48e1d8.info {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:05:36 devstack sudo[96700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-a3cadf05-04df-49eb-ae32-3af71c48e1d8.info Sep 07 10:05:36 devstack sudo[96700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:05:37 devstack sudo[96700]: pam_unix(sudo:session): session closed for user root Sep 07 10:05:37 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-335e7512-77b2-4af2-92b3-28d892d058d7 tempest-VolumesSnapshotTestJSON-2041623630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-a3cadf05-04df-49eb-ae32-3af71c48e1d8.info" returned: 0 in 0.332s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:05:37 devstack cinder-volume[87515]: WARNING cinder.volume.drivers.remotefs [None req-335e7512-77b2-4af2-92b3-28d892d058d7 tempest-VolumesSnapshotTestJSON-2041623630 None] /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-a3cadf05-04df-49eb-ae32-3af71c48e1d8.info is being set with open permissions: ugo+rw Sep 07 10:05:37 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-335e7512-77b2-4af2-92b3-28d892d058d7 tempest-VolumesSnapshotTestJSON-2041623630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-a3cadf05-04df-49eb-ae32-3af71c48e1d8.info {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:05:37 devstack sudo[96703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-a3cadf05-04df-49eb-ae32-3af71c48e1d8.info Sep 07 10:05:37 devstack sudo[96703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:05:37 devstack sudo[96703]: pam_unix(sudo:session): session closed for user root Sep 07 10:05:37 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-335e7512-77b2-4af2-92b3-28d892d058d7 tempest-VolumesSnapshotTestJSON-2041623630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-a3cadf05-04df-49eb-ae32-3af71c48e1d8.info" returned: 0 in 0.401s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:05:37 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-335e7512-77b2-4af2-92b3-28d892d058d7 tempest-VolumesSnapshotTestJSON-2041623630 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.790s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:05:37 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-335e7512-77b2-4af2-92b3-28d892d058d7 tempest-VolumesSnapshotTestJSON-2041623630 None] Create snapshot completed successfully Sep 07 10:05:38 devstack cinder-volume[87515]: DEBUG cinder.volume.flows.manager.create_volume [None req-83c15997-ba84-4ce7-a48c-865d3a895bf2 tempest-VolumesSnapshotTestJSON-2041623630 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 10:05:38 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-83c15997-ba84-4ce7-a48c-865d3a895bf2 tempest-VolumesSnapshotTestJSON-2041623630 None] Flow 'volume_create_manager' (27ad766e-8b7e-4faa-8053-b8c6aded018d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:05:38 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-83c15997-ba84-4ce7-a48c-865d3a895bf2 tempest-VolumesSnapshotTestJSON-2041623630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a48f433-34ea-4a6f-8f51-b9f68ad73cba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:05:39 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-83c15997-ba84-4ce7-a48c-865d3a895bf2 tempest-VolumesSnapshotTestJSON-2041623630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a48f433-34ea-4a6f-8f51-b9f68ad73cba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:05:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-656143774',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f844052-47e8-4056-83c9-cd89fcc66060,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='940eb7dc41254b3f8fe361a280cc52b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:05:39Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=83feebf2-1eca-4fba-aa73-7763ef423b56,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:05:39Z,use_quota=True,user_id='37b1985156f54ab4853962fe1a63200f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3a092cd-7947-4cbf-abff-4ba9567becf0),volume_type_id=f3a092cd-7947-4cbf-abff-4ba9567becf0)' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:05:39 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-83c15997-ba84-4ce7-a48c-865d3a895bf2 tempest-VolumesSnapshotTestJSON-2041623630 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6839b801-5635-4a9b-8089-f3e158425416) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:05:39 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-83c15997-ba84-4ce7-a48c-865d3a895bf2 tempest-VolumesSnapshotTestJSON-2041623630 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6839b801-5635-4a9b-8089-f3e158425416) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:05:39 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-83c15997-ba84-4ce7-a48c-865d3a895bf2 tempest-VolumesSnapshotTestJSON-2041623630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27819647-9658-4f82-858c-09df50c64b21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:05:39 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-83c15997-ba84-4ce7-a48c-865d3a895bf2 tempest-VolumesSnapshotTestJSON-2041623630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27819647-9658-4f82-858c-09df50c64b21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '2f844052-47e8-4056-83c9-cd89fcc66060', 'volume_name': 'volume-2f844052-47e8-4056-83c9-cd89fcc66060', 'volume_size': 2, 'snapshot_id': '83feebf2-1eca-4fba-aa73-7763ef423b56'}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:05:39 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-83c15997-ba84-4ce7-a48c-865d3a895bf2 tempest-VolumesSnapshotTestJSON-2041623630 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37e3d64b-cd7e-4a03-9563-c64350eae87e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:05:39 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-83c15997-ba84-4ce7-a48c-865d3a895bf2 tempest-VolumesSnapshotTestJSON-2041623630 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37e3d64b-cd7e-4a03-9563-c64350eae87e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:05:39 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-83c15997-ba84-4ce7-a48c-865d3a895bf2 tempest-VolumesSnapshotTestJSON-2041623630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a50a4c6d-65ab-4c54-87ac-362317693f74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:05:39 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-83c15997-ba84-4ce7-a48c-865d3a895bf2 tempest-VolumesSnapshotTestJSON-2041623630 None] Volume 2f844052-47e8-4056-83c9-cd89fcc66060: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-2f844052-47e8-4056-83c9-cd89fcc66060', 'volume_size': 2, 'snapshot_id': '83feebf2-1eca-4fba-aa73-7763ef423b56'} Sep 07 10:05:39 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-83c15997-ba84-4ce7-a48c-865d3a895bf2 tempest-VolumesSnapshotTestJSON-2041623630 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:05:39 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-83c15997-ba84-4ce7-a48c-865d3a895bf2 tempest-VolumesSnapshotTestJSON-2041623630 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:05:39 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-83c15997-ba84-4ce7-a48c-865d3a895bf2 tempest-VolumesSnapshotTestJSON-2041623630 None] Acquiring lock "cinder-quobyte-83feebf2-1eca-4fba-aa73-7763ef423b56-2f844052-47e8-4056-83c9-cd89fcc66060" by "_create_volume_from_snapshot" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:05:39 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-83c15997-ba84-4ce7-a48c-865d3a895bf2 tempest-VolumesSnapshotTestJSON-2041623630 None] Lock "cinder-quobyte-83feebf2-1eca-4fba-aa73-7763ef423b56-2f844052-47e8-4056-83c9-cd89fcc66060" acquired by "_create_volume_from_snapshot" :: waited 0.035s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:05:39 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-83c15997-ba84-4ce7-a48c-865d3a895bf2 tempest-VolumesSnapshotTestJSON-2041623630 None] Creating volume 2f844052-47e8-4056-83c9-cd89fcc66060 from snapshot 83feebf2-1eca-4fba-aa73-7763ef423b56 {{(pid=87515) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 07 10:05:39 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-83c15997-ba84-4ce7-a48c-865d3a895bf2 tempest-VolumesSnapshotTestJSON-2041623630 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:05:39 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-83c15997-ba84-4ce7-a48c-865d3a895bf2 tempest-VolumesSnapshotTestJSON-2041623630 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:05:39 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-83c15997-ba84-4ce7-a48c-865d3a895bf2 tempest-VolumesSnapshotTestJSON-2041623630 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:05:39 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-83c15997-ba84-4ce7-a48c-865d3a895bf2 tempest-VolumesSnapshotTestJSON-2041623630 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:05:39 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-83c15997-ba84-4ce7-a48c-865d3a895bf2 tempest-VolumesSnapshotTestJSON-2041623630 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:05:39 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-83c15997-ba84-4ce7-a48c-865d3a895bf2 tempest-VolumesSnapshotTestJSON-2041623630 None] Selected osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c as target Quobyte volume. {{(pid=87515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 10:05:39 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-83c15997-ba84-4ce7-a48c-865d3a895bf2 tempest-VolumesSnapshotTestJSON-2041623630 None] Acquiring lock "cinder-quobyte-2f844052-47e8-4056-83c9-cd89fcc66060" by "_copy_volume_from_snapshot" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:05:39 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-83c15997-ba84-4ce7-a48c-865d3a895bf2 tempest-VolumesSnapshotTestJSON-2041623630 None] Lock "cinder-quobyte-2f844052-47e8-4056-83c9-cd89fcc66060" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:05:39 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-83c15997-ba84-4ce7-a48c-865d3a895bf2 tempest-VolumesSnapshotTestJSON-2041623630 None] snapshot: 83feebf2-1eca-4fba-aa73-7763ef423b56, volume: 2f844052-47e8-4056-83c9-cd89fcc66060, {{(pid=87515) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 07 10:05:39 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-83c15997-ba84-4ce7-a48c-865d3a895bf2 tempest-VolumesSnapshotTestJSON-2041623630 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:05:39 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-83c15997-ba84-4ce7-a48c-865d3a895bf2 tempest-VolumesSnapshotTestJSON-2041623630 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:05:39 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-83c15997-ba84-4ce7-a48c-865d3a895bf2 tempest-VolumesSnapshotTestJSON-2041623630 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:05:39 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-83c15997-ba84-4ce7-a48c-865d3a895bf2 tempest-VolumesSnapshotTestJSON-2041623630 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:05:39 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-83c15997-ba84-4ce7-a48c-865d3a895bf2 tempest-VolumesSnapshotTestJSON-2041623630 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:05:39 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d84a6ce-5e04-4bde-88e2-b472348ee3e0]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:05:39 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-83c15997-ba84-4ce7-a48c-865d3a895bf2 tempest-VolumesSnapshotTestJSON-2041623630 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-a3cadf05-04df-49eb-ae32-3af71c48e1d8.83feebf2-1eca-4fba-aa73-7763ef423b56 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:05:39 devstack cinder-volume[87515]: DEBUG cinder.volume.flows.manager.create_volume [None req-1c4c1452-125c-4f60-8081-d926814090d6 tempest-VolumesCloneTest-756928913 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 10:05:39 devstack sudo[96733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-a3cadf05-04df-49eb-ae32-3af71c48e1d8.83feebf2-1eca-4fba-aa73-7763ef423b56 Sep 07 10:05:39 devstack sudo[96733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:05:39 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-1c4c1452-125c-4f60-8081-d926814090d6 tempest-VolumesCloneTest-756928913 None] Flow 'volume_create_manager' (7faaf655-edfd-4ee0-9581-8deacfa74221) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:05:39 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-1c4c1452-125c-4f60-8081-d926814090d6 tempest-VolumesCloneTest-756928913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09a6de58-d257-48ff-9da4-6d0bfaff7a9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:05:39 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-1c4c1452-125c-4f60-8081-d926814090d6 tempest-VolumesCloneTest-756928913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09a6de58-d257-48ff-9da4-6d0bfaff7a9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:05:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1484777829',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f15ed322-f882-4adb-aee5-e2f6aae6cca8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1519620336b4a9f9e4c7653e59ee111',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:05:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:05:39Z,use_quota=True,user_id='8d3224c40424485f910093e24ad3918a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3a092cd-7947-4cbf-abff-4ba9567becf0),volume_type_id=f3a092cd-7947-4cbf-abff-4ba9567becf0)' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:05:39 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-1c4c1452-125c-4f60-8081-d926814090d6 tempest-VolumesCloneTest-756928913 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a3902a7-5174-46ce-9e22-fedc9cd4fa1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:05:39 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-1c4c1452-125c-4f60-8081-d926814090d6 tempest-VolumesCloneTest-756928913 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a3902a7-5174-46ce-9e22-fedc9cd4fa1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:05:39 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-1c4c1452-125c-4f60-8081-d926814090d6 tempest-VolumesCloneTest-756928913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7107623-1ad3-4404-8f8a-6f18909ee81f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:05:39 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-1c4c1452-125c-4f60-8081-d926814090d6 tempest-VolumesCloneTest-756928913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7107623-1ad3-4404-8f8a-6f18909ee81f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f15ed322-f882-4adb-aee5-e2f6aae6cca8', 'volume_name': 'volume-f15ed322-f882-4adb-aee5-e2f6aae6cca8', 'volume_size': 1}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:05:39 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-1c4c1452-125c-4f60-8081-d926814090d6 tempest-VolumesCloneTest-756928913 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a0be29d-f2e0-48b3-b9e8-fe8ae8c095a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:05:39 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-1c4c1452-125c-4f60-8081-d926814090d6 tempest-VolumesCloneTest-756928913 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a0be29d-f2e0-48b3-b9e8-fe8ae8c095a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:05:39 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-1c4c1452-125c-4f60-8081-d926814090d6 tempest-VolumesCloneTest-756928913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba0ff8aa-9525-4462-b96e-484ac1925d0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:05:39 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-1c4c1452-125c-4f60-8081-d926814090d6 tempest-VolumesCloneTest-756928913 None] Volume f15ed322-f882-4adb-aee5-e2f6aae6cca8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f15ed322-f882-4adb-aee5-e2f6aae6cca8', 'volume_size': 1} Sep 07 10:05:39 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-1c4c1452-125c-4f60-8081-d926814090d6 tempest-VolumesCloneTest-756928913 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:05:39 devstack sudo[96733]: pam_unix(sudo:session): session closed for user root Sep 07 10:05:39 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-83c15997-ba84-4ce7-a48c-865d3a895bf2 tempest-VolumesSnapshotTestJSON-2041623630 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-a3cadf05-04df-49eb-ae32-3af71c48e1d8.83feebf2-1eca-4fba-aa73-7763ef423b56" returned: 0 in 0.459s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:05:39 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-83c15997-ba84-4ce7-a48c-865d3a895bf2 tempest-VolumesSnapshotTestJSON-2041623630 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a3cadf05-04df-49eb-ae32-3af71c48e1d8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87515) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 10:05:39 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcce5cf5-1bb2-4d8f-ac96-09c6888da67a]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:05:39 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-83c15997-ba84-4ce7-a48c-865d3a895bf2 tempest-VolumesSnapshotTestJSON-2041623630 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-a3cadf05-04df-49eb-ae32-3af71c48e1d8 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:05:39 devstack sudo[96738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-a3cadf05-04df-49eb-ae32-3af71c48e1d8 Sep 07 10:05:39 devstack sudo[96738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:05:40 devstack sudo[96738]: pam_unix(sudo:session): session closed for user root Sep 07 10:05:40 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-83c15997-ba84-4ce7-a48c-865d3a895bf2 tempest-VolumesSnapshotTestJSON-2041623630 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-a3cadf05-04df-49eb-ae32-3af71c48e1d8" returned: 0 in 0.395s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:05:40 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-83c15997-ba84-4ce7-a48c-865d3a895bf2 tempest-VolumesSnapshotTestJSON-2041623630 None] will copy from snapshot at /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-a3cadf05-04df-49eb-ae32-3af71c48e1d8 {{(pid=87515) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 07 10:05:40 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-83c15997-ba84-4ce7-a48c-865d3a895bf2 tempest-VolumesSnapshotTestJSON-2041623630 None] Creating direct copy from snapshot {{(pid=87515) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 07 10:05:40 devstack cinder-volume[87515]: DEBUG cinder.utils [None req-83c15997-ba84-4ce7-a48c-865d3a895bf2 tempest-VolumesSnapshotTestJSON-2041623630 None] Path /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-2f844052-47e8-4056-83c9-cd89fcc66060 not found in is_blk_device check {{(pid=87515) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 07 10:05:40 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-83c15997-ba84-4ce7-a48c-865d3a895bf2 tempest-VolumesSnapshotTestJSON-2041623630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-a3cadf05-04df-49eb-ae32-3af71c48e1d8 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-2f844052-47e8-4056-83c9-cd89fcc66060 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:05:40 devstack sudo[96743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-a3cadf05-04df-49eb-ae32-3af71c48e1d8 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-2f844052-47e8-4056-83c9-cd89fcc66060 Sep 07 10:05:40 devstack sudo[96743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:05:46 devstack sudo[96743]: pam_unix(sudo:session): session closed for user root Sep 07 10:05:46 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-83c15997-ba84-4ce7-a48c-865d3a895bf2 tempest-VolumesSnapshotTestJSON-2041623630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-a3cadf05-04df-49eb-ae32-3af71c48e1d8 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-2f844052-47e8-4056-83c9-cd89fcc66060" returned: 0 in 6.552s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:05:46 devstack cinder-volume[87515]: DEBUG cinder.image.image_utils [None req-83c15997-ba84-4ce7-a48c-865d3a895bf2 tempest-VolumesSnapshotTestJSON-2041623630 None] Image conversion details: src /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-a3cadf05-04df-49eb-ae32-3af71c48e1d8, size 1024.00 MB, duration 6.55 sec, destination /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-2f844052-47e8-4056-83c9-cd89fcc66060 {{(pid=87515) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 07 10:05:46 devstack cinder-volume[87515]: INFO cinder.image.image_utils [None req-83c15997-ba84-4ce7-a48c-865d3a895bf2 tempest-VolumesSnapshotTestJSON-2041623630 None] Converted 1024.00 MB image at 156.25 MB/s Sep 07 10:05:46 devstack cinder-volume[87515]: WARNING cinder.volume.drivers.remotefs [None req-83c15997-ba84-4ce7-a48c-865d3a895bf2 tempest-VolumesSnapshotTestJSON-2041623630 None] /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-2f844052-47e8-4056-83c9-cd89fcc66060 is being set with open permissions: ugo+rw Sep 07 10:05:46 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-83c15997-ba84-4ce7-a48c-865d3a895bf2 tempest-VolumesSnapshotTestJSON-2041623630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-2f844052-47e8-4056-83c9-cd89fcc66060 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:05:46 devstack sudo[96826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-2f844052-47e8-4056-83c9-cd89fcc66060 Sep 07 10:05:46 devstack sudo[96826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:05:46 devstack sudo[96826]: pam_unix(sudo:session): session closed for user root Sep 07 10:05:46 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-83c15997-ba84-4ce7-a48c-865d3a895bf2 tempest-VolumesSnapshotTestJSON-2041623630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-2f844052-47e8-4056-83c9-cd89fcc66060" returned: 0 in 0.306s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:05:46 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-83c15997-ba84-4ce7-a48c-865d3a895bf2 tempest-VolumesSnapshotTestJSON-2041623630 None] Lock "cinder-quobyte-2f844052-47e8-4056-83c9-cd89fcc66060" released by "_copy_volume_from_snapshot" :: held 7.815s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:05:47 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-83c15997-ba84-4ce7-a48c-865d3a895bf2 tempest-VolumesSnapshotTestJSON-2041623630 None] Lock "cinder-quobyte-83feebf2-1eca-4fba-aa73-7763ef423b56-2f844052-47e8-4056-83c9-cd89fcc66060" released by "_create_volume_from_snapshot" :: held 7.901s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:05:47 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-83c15997-ba84-4ce7-a48c-865d3a895bf2 tempest-VolumesSnapshotTestJSON-2041623630 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.937s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:05:47 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-1c4c1452-125c-4f60-8081-d926814090d6 tempest-VolumesCloneTest-756928913 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.512s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:05:47 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-1c4c1452-125c-4f60-8081-d926814090d6 tempest-VolumesCloneTest-756928913 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:05:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1484777829',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f15ed322-f882-4adb-aee5-e2f6aae6cca8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1519620336b4a9f9e4c7653e59ee111',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:05:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:05:39Z,use_quota=True,user_id='8d3224c40424485f910093e24ad3918a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3a092cd-7947-4cbf-abff-4ba9567becf0),volume_type_id=f3a092cd-7947-4cbf-abff-4ba9567becf0)}" {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 10:05:47 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-1c4c1452-125c-4f60-8081-d926814090d6 tempest-VolumesCloneTest-756928913 None] Creating volume f15ed322-f882-4adb-aee5-e2f6aae6cca8 {{(pid=87515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 10:05:47 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-1c4c1452-125c-4f60-8081-d926814090d6 tempest-VolumesCloneTest-756928913 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:05:47 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-1c4c1452-125c-4f60-8081-d926814090d6 tempest-VolumesCloneTest-756928913 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:05:47 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-1c4c1452-125c-4f60-8081-d926814090d6 tempest-VolumesCloneTest-756928913 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:05:47 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-1c4c1452-125c-4f60-8081-d926814090d6 tempest-VolumesCloneTest-756928913 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:05:47 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-1c4c1452-125c-4f60-8081-d926814090d6 tempest-VolumesCloneTest-756928913 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:05:47 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-1c4c1452-125c-4f60-8081-d926814090d6 tempest-VolumesCloneTest-756928913 None] Selected osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c as target Quobyte volume. {{(pid=87515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 10:05:47 devstack cinder-volume[87515]: INFO cinder.volume.drivers.remotefs [None req-1c4c1452-125c-4f60-8081-d926814090d6 tempest-VolumesCloneTest-756928913 None] casted to osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c Sep 07 10:05:47 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-1c4c1452-125c-4f60-8081-d926814090d6 tempest-VolumesCloneTest-756928913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-f15ed322-f882-4adb-aee5-e2f6aae6cca8 1073741824 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:05:47 devstack sudo[96829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-f15ed322-f882-4adb-aee5-e2f6aae6cca8 1073741824 Sep 07 10:05:47 devstack sudo[96829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:05:47 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-83c15997-ba84-4ce7-a48c-865d3a895bf2 tempest-VolumesSnapshotTestJSON-2041623630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a50a4c6d-65ab-4c54-87ac-362317693f74) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2f844052-47e8-4056-83c9-cd89fcc66060', 'volume_size': 2, 'snapshot_id': '83feebf2-1eca-4fba-aa73-7763ef423b56'}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:05:47 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-83c15997-ba84-4ce7-a48c-865d3a895bf2 tempest-VolumesSnapshotTestJSON-2041623630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8bc5674b-eddc-4f80-986d-a0245392c114) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:05:47 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-83c15997-ba84-4ce7-a48c-865d3a895bf2 tempest-VolumesSnapshotTestJSON-2041623630 None] Volume volume-2f844052-47e8-4056-83c9-cd89fcc66060 (2f844052-47e8-4056-83c9-cd89fcc66060): created successfully Sep 07 10:05:47 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-83c15997-ba84-4ce7-a48c-865d3a895bf2 tempest-VolumesSnapshotTestJSON-2041623630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8bc5674b-eddc-4f80-986d-a0245392c114) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:05:47 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-83c15997-ba84-4ce7-a48c-865d3a895bf2 tempest-VolumesSnapshotTestJSON-2041623630 None] Flow 'volume_create_manager' (27ad766e-8b7e-4faa-8053-b8c6aded018d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:05:47 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-83c15997-ba84-4ce7-a48c-865d3a895bf2 tempest-VolumesSnapshotTestJSON-2041623630 None] Created volume successfully. Sep 07 10:05:47 devstack sudo[96829]: pam_unix(sudo:session): session closed for user root Sep 07 10:05:47 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-1c4c1452-125c-4f60-8081-d926814090d6 tempest-VolumesCloneTest-756928913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-f15ed322-f882-4adb-aee5-e2f6aae6cca8 1073741824" returned: 0 in 0.649s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:05:47 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-1c4c1452-125c-4f60-8081-d926814090d6 tempest-VolumesCloneTest-756928913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-f15ed322-f882-4adb-aee5-e2f6aae6cca8 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:05:47 devstack sudo[96835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-f15ed322-f882-4adb-aee5-e2f6aae6cca8 Sep 07 10:05:47 devstack sudo[96835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:05:48 devstack sudo[96835]: pam_unix(sudo:session): session closed for user root Sep 07 10:05:48 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-1c4c1452-125c-4f60-8081-d926814090d6 tempest-VolumesCloneTest-756928913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-f15ed322-f882-4adb-aee5-e2f6aae6cca8" returned: 0 in 0.289s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:05:48 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-1c4c1452-125c-4f60-8081-d926814090d6 tempest-VolumesCloneTest-756928913 None] <== create_volume: return (1000ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'} {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 10:05:48 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-1c4c1452-125c-4f60-8081-d926814090d6 tempest-VolumesCloneTest-756928913 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.006s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:05:48 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-1c4c1452-125c-4f60-8081-d926814090d6 tempest-VolumesCloneTest-756928913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba0ff8aa-9525-4462-b96e-484ac1925d0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f15ed322-f882-4adb-aee5-e2f6aae6cca8', 'volume_size': 1}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:05:48 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-1c4c1452-125c-4f60-8081-d926814090d6 tempest-VolumesCloneTest-756928913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e718a746-2e30-4ce8-9c31-c175df54a169) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:05:48 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-1c4c1452-125c-4f60-8081-d926814090d6 tempest-VolumesCloneTest-756928913 None] Volume volume-f15ed322-f882-4adb-aee5-e2f6aae6cca8 (f15ed322-f882-4adb-aee5-e2f6aae6cca8): created successfully Sep 07 10:05:48 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-1c4c1452-125c-4f60-8081-d926814090d6 tempest-VolumesCloneTest-756928913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e718a746-2e30-4ce8-9c31-c175df54a169) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:05:48 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-1c4c1452-125c-4f60-8081-d926814090d6 tempest-VolumesCloneTest-756928913 None] Flow 'volume_create_manager' (7faaf655-edfd-4ee0-9581-8deacfa74221) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:05:48 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-1c4c1452-125c-4f60-8081-d926814090d6 tempest-VolumesCloneTest-756928913 None] Created volume successfully. Sep 07 10:05:48 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-d5eba1e2-de8a-4dbc-9fc0-31bb1a197ba5 tempest-VolumesSnapshotTestJSON-2041623630 None] Acquiring lock "cinder-2f844052-47e8-4056-83c9-cd89fcc66060-delete_volume" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:05:48 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-d5eba1e2-de8a-4dbc-9fc0-31bb1a197ba5 tempest-VolumesSnapshotTestJSON-2041623630 None] Lock "cinder-2f844052-47e8-4056-83c9-cd89fcc66060-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:05:48 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-d5eba1e2-de8a-4dbc-9fc0-31bb1a197ba5 tempest-VolumesSnapshotTestJSON-2041623630 None] Acquiring lock "cinder-quobyte-2f844052-47e8-4056-83c9-cd89fcc66060" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:05:48 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-d5eba1e2-de8a-4dbc-9fc0-31bb1a197ba5 tempest-VolumesSnapshotTestJSON-2041623630 None] Lock "cinder-quobyte-2f844052-47e8-4056-83c9-cd89fcc66060" acquired by "delete_volume" :: waited 0.020s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:05:48 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[8be55866-d990-4944-b737-b4aab03a31f0]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:05:48 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-d5eba1e2-de8a-4dbc-9fc0-31bb1a197ba5 tempest-VolumesSnapshotTestJSON-2041623630 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-2f844052-47e8-4056-83c9-cd89fcc66060 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:05:48 devstack sudo[96838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-2f844052-47e8-4056-83c9-cd89fcc66060 Sep 07 10:05:48 devstack sudo[96838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:05:48 devstack sudo[96838]: pam_unix(sudo:session): session closed for user root Sep 07 10:05:48 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-d5eba1e2-de8a-4dbc-9fc0-31bb1a197ba5 tempest-VolumesSnapshotTestJSON-2041623630 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-2f844052-47e8-4056-83c9-cd89fcc66060" returned: 0 in 0.561s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:05:48 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-d5eba1e2-de8a-4dbc-9fc0-31bb1a197ba5 tempest-VolumesSnapshotTestJSON-2041623630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-2f844052-47e8-4056-83c9-cd89fcc66060 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:05:48 devstack sudo[96846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-2f844052-47e8-4056-83c9-cd89fcc66060 Sep 07 10:05:48 devstack sudo[96846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:05:49 devstack sudo[96846]: pam_unix(sudo:session): session closed for user root Sep 07 10:05:49 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-d5eba1e2-de8a-4dbc-9fc0-31bb1a197ba5 tempest-VolumesSnapshotTestJSON-2041623630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-2f844052-47e8-4056-83c9-cd89fcc66060" returned: 0 in 0.409s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:05:49 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-d5eba1e2-de8a-4dbc-9fc0-31bb1a197ba5 tempest-VolumesSnapshotTestJSON-2041623630 None] Lock "cinder-quobyte-2f844052-47e8-4056-83c9-cd89fcc66060" released by "delete_volume" :: held 1.051s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:05:49 devstack cinder-volume[87515]: DEBUG cinder.quota [None req-d5eba1e2-de8a-4dbc-9fc0-31bb1a197ba5 tempest-VolumesSnapshotTestJSON-2041623630 None] Created reservations ['99be89b9-e1a8-4065-8fa0-1079751e3ce0', 'c512a2e5-a0ff-4fea-aa2b-272c703fca50', 'bb2aefbf-df78-4ec1-90ad-4ed9af331967', 'da328b2d-bd95-4adf-9512-089135ec414a'] {{(pid=87515) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:05:49 devstack cinder-volume[87515]: DEBUG cinder.volume.flows.manager.create_volume [None req-4ac48416-16f8-4df5-be15-f5db57f94fb2 tempest-VolumesCloneTest-756928913 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 10:05:49 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-4ac48416-16f8-4df5-be15-f5db57f94fb2 tempest-VolumesCloneTest-756928913 None] Flow 'volume_create_manager' (f94f9fc6-f2c1-4543-b9ca-20e68a7df79b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:05:49 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-4ac48416-16f8-4df5-be15-f5db57f94fb2 tempest-VolumesCloneTest-756928913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f4f6c37-a742-4b33-9643-e53a559a0b31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:05:49 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-4ac48416-16f8-4df5-be15-f5db57f94fb2 tempest-VolumesCloneTest-756928913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f4f6c37-a742-4b33-9643-e53a559a0b31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:05:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-2094700253',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dccc77d9-6f4c-4f5d-9121-5f05777ffad8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1519620336b4a9f9e4c7653e59ee111',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:05:49Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=f15ed322-f882-4adb-aee5-e2f6aae6cca8,status='creating',terminated_at=None,updated_at=2026-09-07T08:05:49Z,use_quota=True,user_id='8d3224c40424485f910093e24ad3918a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3a092cd-7947-4cbf-abff-4ba9567becf0),volume_type_id=f3a092cd-7947-4cbf-abff-4ba9567becf0)' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:05:49 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-4ac48416-16f8-4df5-be15-f5db57f94fb2 tempest-VolumesCloneTest-756928913 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (557100a8-bfb8-4d8d-8d9f-319ac3d61eb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:05:49 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-4ac48416-16f8-4df5-be15-f5db57f94fb2 tempest-VolumesCloneTest-756928913 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (557100a8-bfb8-4d8d-8d9f-319ac3d61eb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:05:49 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-4ac48416-16f8-4df5-be15-f5db57f94fb2 tempest-VolumesCloneTest-756928913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99bbccbd-b33e-4570-96a4-71c5535dafea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:05:49 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-4ac48416-16f8-4df5-be15-f5db57f94fb2 tempest-VolumesCloneTest-756928913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99bbccbd-b33e-4570-96a4-71c5535dafea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'dccc77d9-6f4c-4f5d-9121-5f05777ffad8', 'volume_name': 'volume-dccc77d9-6f4c-4f5d-9121-5f05777ffad8', 'volume_size': 2, 'source_volid': 'f15ed322-f882-4adb-aee5-e2f6aae6cca8', 'source_volstatus': 'available'}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:05:49 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-4ac48416-16f8-4df5-be15-f5db57f94fb2 tempest-VolumesCloneTest-756928913 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01bf6b37-730d-4385-b4c2-ac52e6c448b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:05:49 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-4ac48416-16f8-4df5-be15-f5db57f94fb2 tempest-VolumesCloneTest-756928913 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01bf6b37-730d-4385-b4c2-ac52e6c448b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:05:49 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-4ac48416-16f8-4df5-be15-f5db57f94fb2 tempest-VolumesCloneTest-756928913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d98b3139-1297-454d-b03d-81f8213e0356) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:05:49 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-4ac48416-16f8-4df5-be15-f5db57f94fb2 tempest-VolumesCloneTest-756928913 None] Volume dccc77d9-6f4c-4f5d-9121-5f05777ffad8: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-dccc77d9-6f4c-4f5d-9121-5f05777ffad8', 'volume_size': 2, 'source_volid': 'f15ed322-f882-4adb-aee5-e2f6aae6cca8', 'source_volstatus': 'available'} Sep 07 10:05:49 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-4ac48416-16f8-4df5-be15-f5db57f94fb2 tempest-VolumesCloneTest-756928913 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:05:49 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-4ac48416-16f8-4df5-be15-f5db57f94fb2 tempest-VolumesCloneTest-756928913 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:05:49 devstack cinder-volume[87515]: INFO cinder.volume.drivers.remotefs [None req-4ac48416-16f8-4df5-be15-f5db57f94fb2 tempest-VolumesCloneTest-756928913 None] Cloning volume f15ed322-f882-4adb-aee5-e2f6aae6cca8 to volume dccc77d9-6f4c-4f5d-9121-5f05777ffad8 Sep 07 10:05:49 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-d5eba1e2-de8a-4dbc-9fc0-31bb1a197ba5 tempest-VolumesSnapshotTestJSON-2041623630 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:05:49 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-d5eba1e2-de8a-4dbc-9fc0-31bb1a197ba5 tempest-VolumesSnapshotTestJSON-2041623630 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:05:49 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-d5eba1e2-de8a-4dbc-9fc0-31bb1a197ba5 tempest-VolumesSnapshotTestJSON-2041623630 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:05:49 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-d5eba1e2-de8a-4dbc-9fc0-31bb1a197ba5 tempest-VolumesSnapshotTestJSON-2041623630 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:05:49 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-d5eba1e2-de8a-4dbc-9fc0-31bb1a197ba5 tempest-VolumesSnapshotTestJSON-2041623630 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:05:49 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-d5eba1e2-de8a-4dbc-9fc0-31bb1a197ba5 tempest-VolumesSnapshotTestJSON-2041623630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:05:49 devstack sudo[96852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a Sep 07 10:05:49 devstack sudo[96852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:05:49 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-4ac48416-16f8-4df5-be15-f5db57f94fb2 tempest-VolumesCloneTest-756928913 None] Creating offline snapshot a12451d1-fa1b-41f5-8f37-c80859d1688a of volume f15ed322-f882-4adb-aee5-e2f6aae6cca8 {{(pid=87515) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 10:05:49 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fda2f66-028e-48ba-ac39-53b640c710a0]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:05:49 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-4ac48416-16f8-4df5-be15-f5db57f94fb2 tempest-VolumesCloneTest-756928913 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-f15ed322-f882-4adb-aee5-e2f6aae6cca8 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:05:49 devstack sudo[96854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-f15ed322-f882-4adb-aee5-e2f6aae6cca8 Sep 07 10:05:49 devstack sudo[96854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:05:50 devstack sudo[96852]: pam_unix(sudo:session): session closed for user root Sep 07 10:05:50 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-d5eba1e2-de8a-4dbc-9fc0-31bb1a197ba5 tempest-VolumesSnapshotTestJSON-2041623630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a" returned: 0 in 0.445s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:05:50 devstack cinder-volume[87515]: DEBUG cinder.manager [None req-d5eba1e2-de8a-4dbc-9fc0-31bb1a197ba5 tempest-VolumesSnapshotTestJSON-2041623630 None] Notifying Schedulers of capabilities ... {{(pid=87515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:05:50 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-d5eba1e2-de8a-4dbc-9fc0-31bb1a197ba5 tempest-VolumesSnapshotTestJSON-2041623630 None] Deleted volume successfully. Sep 07 10:05:50 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-d5eba1e2-de8a-4dbc-9fc0-31bb1a197ba5 tempest-VolumesSnapshotTestJSON-2041623630 None] Lock "cinder-2f844052-47e8-4056-83c9-cd89fcc66060-delete_volume" released by "delete_volume" :: held 1.978s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:05:50 devstack sudo[96854]: pam_unix(sudo:session): session closed for user root Sep 07 10:05:50 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-4ac48416-16f8-4df5-be15-f5db57f94fb2 tempest-VolumesCloneTest-756928913 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-f15ed322-f882-4adb-aee5-e2f6aae6cca8" returned: 0 in 0.647s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:05:50 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-4ac48416-16f8-4df5-be15-f5db57f94fb2 tempest-VolumesCloneTest-756928913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-f15ed322-f882-4adb-aee5-e2f6aae6cca8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-f15ed322-f882-4adb-aee5-e2f6aae6cca8.a12451d1-fa1b-41f5-8f37-c80859d1688a 1G {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:05:50 devstack sudo[96861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-f15ed322-f882-4adb-aee5-e2f6aae6cca8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-f15ed322-f882-4adb-aee5-e2f6aae6cca8.a12451d1-fa1b-41f5-8f37-c80859d1688a 1G Sep 07 10:05:50 devstack sudo[96861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:05:50 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-9ab2ff79-15d3-4b08-817f-1432e2d56874 tempest-VolumesSnapshotTestJSON-2041623630 None] Acquiring lock "cinder-83feebf2-1eca-4fba-aa73-7763ef423b56-delete_snapshot" by "delete_snapshot" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:05:50 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-9ab2ff79-15d3-4b08-817f-1432e2d56874 tempest-VolumesSnapshotTestJSON-2041623630 None] Lock "cinder-83feebf2-1eca-4fba-aa73-7763ef423b56-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:05:50 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-9ab2ff79-15d3-4b08-817f-1432e2d56874 tempest-VolumesSnapshotTestJSON-2041623630 None] Acquiring lock "cinder-quobyte-a3cadf05-04df-49eb-ae32-3af71c48e1d8" by "delete_snapshot" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:05:50 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-9ab2ff79-15d3-4b08-817f-1432e2d56874 tempest-VolumesSnapshotTestJSON-2041623630 None] Lock "cinder-quobyte-a3cadf05-04df-49eb-ae32-3af71c48e1d8" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:05:50 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-9ab2ff79-15d3-4b08-817f-1432e2d56874 tempest-VolumesSnapshotTestJSON-2041623630 None] Acquiring lock "cinder-quobyte-83feebf2-1eca-4fba-aa73-7763ef423b56" by "_delete_snapshot" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:05:50 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-9ab2ff79-15d3-4b08-817f-1432e2d56874 tempest-VolumesSnapshotTestJSON-2041623630 None] Lock "cinder-quobyte-83feebf2-1eca-4fba-aa73-7763ef423b56" acquired by "_delete_snapshot" :: waited 0.037s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:05:50 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-9ab2ff79-15d3-4b08-817f-1432e2d56874 tempest-VolumesSnapshotTestJSON-2041623630 None] Deleting offline snapshot 83feebf2-1eca-4fba-aa73-7763ef423b56 of volume a3cadf05-04df-49eb-ae32-3af71c48e1d8 {{(pid=87515) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 10:05:50 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-9ab2ff79-15d3-4b08-817f-1432e2d56874 tempest-VolumesSnapshotTestJSON-2041623630 None] snapshot_file for this snap is: volume-a3cadf05-04df-49eb-ae32-3af71c48e1d8.83feebf2-1eca-4fba-aa73-7763ef423b56 {{(pid=87515) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 10:05:50 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6d1470b-ed86-4ecd-8ad9-ed00cd8dbef0]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:05:50 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-9ab2ff79-15d3-4b08-817f-1432e2d56874 tempest-VolumesSnapshotTestJSON-2041623630 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-a3cadf05-04df-49eb-ae32-3af71c48e1d8.83feebf2-1eca-4fba-aa73-7763ef423b56 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:05:51 devstack sudo[96877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-a3cadf05-04df-49eb-ae32-3af71c48e1d8.83feebf2-1eca-4fba-aa73-7763ef423b56 Sep 07 10:05:51 devstack sudo[96877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:05:51 devstack sudo[96861]: pam_unix(sudo:session): session closed for user root Sep 07 10:05:51 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-4ac48416-16f8-4df5-be15-f5db57f94fb2 tempest-VolumesCloneTest-756928913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-f15ed322-f882-4adb-aee5-e2f6aae6cca8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-f15ed322-f882-4adb-aee5-e2f6aae6cca8.a12451d1-fa1b-41f5-8f37-c80859d1688a 1G" returned: 0 in 0.858s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:05:51 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-4ac48416-16f8-4df5-be15-f5db57f94fb2 tempest-VolumesCloneTest-756928913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f15ed322-f882-4adb-aee5-e2f6aae6cca8 -F qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-f15ed322-f882-4adb-aee5-e2f6aae6cca8.a12451d1-fa1b-41f5-8f37-c80859d1688a {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:05:51 devstack sudo[96893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f15ed322-f882-4adb-aee5-e2f6aae6cca8 -F qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-f15ed322-f882-4adb-aee5-e2f6aae6cca8.a12451d1-fa1b-41f5-8f37-c80859d1688a Sep 07 10:05:51 devstack sudo[96893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:05:51 devstack sudo[96877]: pam_unix(sudo:session): session closed for user root Sep 07 10:05:51 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-9ab2ff79-15d3-4b08-817f-1432e2d56874 tempest-VolumesSnapshotTestJSON-2041623630 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-a3cadf05-04df-49eb-ae32-3af71c48e1d8.83feebf2-1eca-4fba-aa73-7763ef423b56" returned: 0 in 0.739s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:05:51 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-9ab2ff79-15d3-4b08-817f-1432e2d56874 tempest-VolumesSnapshotTestJSON-2041623630 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a3cadf05-04df-49eb-ae32-3af71c48e1d8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87515) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 10:05:51 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdae3adf-b535-49b4-92bc-9b042708dc6c]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:05:51 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-9ab2ff79-15d3-4b08-817f-1432e2d56874 tempest-VolumesSnapshotTestJSON-2041623630 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-a3cadf05-04df-49eb-ae32-3af71c48e1d8 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:05:51 devstack sudo[96893]: pam_unix(sudo:session): session closed for user root Sep 07 10:05:51 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-4ac48416-16f8-4df5-be15-f5db57f94fb2 tempest-VolumesCloneTest-756928913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f15ed322-f882-4adb-aee5-e2f6aae6cca8 -F qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-f15ed322-f882-4adb-aee5-e2f6aae6cca8.a12451d1-fa1b-41f5-8f37-c80859d1688a" returned: 0 in 0.475s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:05:51 devstack cinder-volume[87515]: WARNING cinder.volume.drivers.remotefs [None req-4ac48416-16f8-4df5-be15-f5db57f94fb2 tempest-VolumesCloneTest-756928913 None] /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-f15ed322-f882-4adb-aee5-e2f6aae6cca8.a12451d1-fa1b-41f5-8f37-c80859d1688a is being set with open permissions: ugo+rw Sep 07 10:05:51 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-4ac48416-16f8-4df5-be15-f5db57f94fb2 tempest-VolumesCloneTest-756928913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-f15ed322-f882-4adb-aee5-e2f6aae6cca8.a12451d1-fa1b-41f5-8f37-c80859d1688a {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:05:51 devstack sudo[96901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-a3cadf05-04df-49eb-ae32-3af71c48e1d8 Sep 07 10:05:51 devstack sudo[96901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:05:51 devstack sudo[96902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-f15ed322-f882-4adb-aee5-e2f6aae6cca8.a12451d1-fa1b-41f5-8f37-c80859d1688a Sep 07 10:05:51 devstack sudo[96902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:05:52 devstack sudo[96902]: pam_unix(sudo:session): session closed for user root Sep 07 10:05:52 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-4ac48416-16f8-4df5-be15-f5db57f94fb2 tempest-VolumesCloneTest-756928913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-f15ed322-f882-4adb-aee5-e2f6aae6cca8.a12451d1-fa1b-41f5-8f37-c80859d1688a" returned: 0 in 0.463s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:05:52 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-4ac48416-16f8-4df5-be15-f5db57f94fb2 tempest-VolumesCloneTest-756928913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-f15ed322-f882-4adb-aee5-e2f6aae6cca8.info {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:05:52 devstack sudo[96909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-f15ed322-f882-4adb-aee5-e2f6aae6cca8.info Sep 07 10:05:52 devstack sudo[96909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:05:52 devstack sudo[96901]: pam_unix(sudo:session): session closed for user root Sep 07 10:05:52 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-9ab2ff79-15d3-4b08-817f-1432e2d56874 tempest-VolumesSnapshotTestJSON-2041623630 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-a3cadf05-04df-49eb-ae32-3af71c48e1d8" returned: 0 in 0.874s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:05:52 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-9ab2ff79-15d3-4b08-817f-1432e2d56874 tempest-VolumesSnapshotTestJSON-2041623630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-a3cadf05-04df-49eb-ae32-3af71c48e1d8.83feebf2-1eca-4fba-aa73-7763ef423b56 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:05:52 devstack sudo[96913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-a3cadf05-04df-49eb-ae32-3af71c48e1d8.83feebf2-1eca-4fba-aa73-7763ef423b56 Sep 07 10:05:52 devstack sudo[96913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:05:52 devstack sudo[96909]: pam_unix(sudo:session): session closed for user root Sep 07 10:05:52 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-4ac48416-16f8-4df5-be15-f5db57f94fb2 tempest-VolumesCloneTest-756928913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-f15ed322-f882-4adb-aee5-e2f6aae6cca8.info" returned: 0 in 0.503s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:05:52 devstack cinder-volume[87515]: WARNING cinder.volume.drivers.remotefs [None req-4ac48416-16f8-4df5-be15-f5db57f94fb2 tempest-VolumesCloneTest-756928913 None] /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-f15ed322-f882-4adb-aee5-e2f6aae6cca8.info is being set with open permissions: ugo+rw Sep 07 10:05:52 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-4ac48416-16f8-4df5-be15-f5db57f94fb2 tempest-VolumesCloneTest-756928913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-f15ed322-f882-4adb-aee5-e2f6aae6cca8.info {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:05:52 devstack sudo[96916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-f15ed322-f882-4adb-aee5-e2f6aae6cca8.info Sep 07 10:05:52 devstack sudo[96916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:05:53 devstack sudo[96913]: pam_unix(sudo:session): session closed for user root Sep 07 10:05:53 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-9ab2ff79-15d3-4b08-817f-1432e2d56874 tempest-VolumesSnapshotTestJSON-2041623630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-a3cadf05-04df-49eb-ae32-3af71c48e1d8.83feebf2-1eca-4fba-aa73-7763ef423b56" returned: 0 in 0.660s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:05:53 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-9ab2ff79-15d3-4b08-817f-1432e2d56874 tempest-VolumesSnapshotTestJSON-2041623630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-a3cadf05-04df-49eb-ae32-3af71c48e1d8.83feebf2-1eca-4fba-aa73-7763ef423b56 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:05:53 devstack sudo[96923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-a3cadf05-04df-49eb-ae32-3af71c48e1d8.83feebf2-1eca-4fba-aa73-7763ef423b56 Sep 07 10:05:53 devstack sudo[96923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:05:53 devstack sudo[96916]: pam_unix(sudo:session): session closed for user root Sep 07 10:05:53 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-4ac48416-16f8-4df5-be15-f5db57f94fb2 tempest-VolumesCloneTest-756928913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-f15ed322-f882-4adb-aee5-e2f6aae6cca8.info" returned: 0 in 0.449s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:05:53 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-4ac48416-16f8-4df5-be15-f5db57f94fb2 tempest-VolumesCloneTest-756928913 None] Acquiring lock "cinder-quobyte-dccc77d9-6f4c-4f5d-9121-5f05777ffad8" by "_copy_volume_from_snapshot" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:05:53 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-4ac48416-16f8-4df5-be15-f5db57f94fb2 tempest-VolumesCloneTest-756928913 None] Lock "cinder-quobyte-dccc77d9-6f4c-4f5d-9121-5f05777ffad8" acquired by "_copy_volume_from_snapshot" :: waited 0.028s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:05:53 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-4ac48416-16f8-4df5-be15-f5db57f94fb2 tempest-VolumesCloneTest-756928913 None] snapshot: a12451d1-fa1b-41f5-8f37-c80859d1688a, volume: dccc77d9-6f4c-4f5d-9121-5f05777ffad8, {{(pid=87515) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 07 10:05:53 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-4ac48416-16f8-4df5-be15-f5db57f94fb2 tempest-VolumesCloneTest-756928913 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:05:53 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-4ac48416-16f8-4df5-be15-f5db57f94fb2 tempest-VolumesCloneTest-756928913 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:05:53 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-4ac48416-16f8-4df5-be15-f5db57f94fb2 tempest-VolumesCloneTest-756928913 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:05:53 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-4ac48416-16f8-4df5-be15-f5db57f94fb2 tempest-VolumesCloneTest-756928913 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:05:53 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-4ac48416-16f8-4df5-be15-f5db57f94fb2 tempest-VolumesCloneTest-756928913 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:05:53 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebeb6fa5-b754-4c51-a7a1-56b4cbb5f9fc]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:05:53 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-4ac48416-16f8-4df5-be15-f5db57f94fb2 tempest-VolumesCloneTest-756928913 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-f15ed322-f882-4adb-aee5-e2f6aae6cca8.a12451d1-fa1b-41f5-8f37-c80859d1688a {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:05:53 devstack sudo[96925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-f15ed322-f882-4adb-aee5-e2f6aae6cca8.a12451d1-fa1b-41f5-8f37-c80859d1688a Sep 07 10:05:53 devstack sudo[96925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:05:53 devstack sudo[96923]: pam_unix(sudo:session): session closed for user root Sep 07 10:05:53 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-9ab2ff79-15d3-4b08-817f-1432e2d56874 tempest-VolumesSnapshotTestJSON-2041623630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-a3cadf05-04df-49eb-ae32-3af71c48e1d8.83feebf2-1eca-4fba-aa73-7763ef423b56" returned: 0 in 0.456s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:05:53 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-9ab2ff79-15d3-4b08-817f-1432e2d56874 tempest-VolumesSnapshotTestJSON-2041623630 None] Lock "cinder-quobyte-83feebf2-1eca-4fba-aa73-7763ef423b56" released by "_delete_snapshot" :: held 2.982s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:05:53 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-9ab2ff79-15d3-4b08-817f-1432e2d56874 tempest-VolumesSnapshotTestJSON-2041623630 None] Lock "cinder-quobyte-a3cadf05-04df-49eb-ae32-3af71c48e1d8" released by "delete_snapshot" :: held 3.041s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:05:53 devstack cinder-volume[87515]: DEBUG cinder.quota [None req-9ab2ff79-15d3-4b08-817f-1432e2d56874 tempest-VolumesSnapshotTestJSON-2041623630 None] Created reservations ['674f1d8c-5032-4d5b-8e3d-25bd2e0b5c76', 'eed5f040-953c-41c0-82c3-8e2600432875', '3e4a34fb-0a9a-4cec-b9e6-65dfe08c3537', '5c3d4011-2a54-45f5-ae38-efa62236690e'] {{(pid=87515) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:05:53 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-9ab2ff79-15d3-4b08-817f-1432e2d56874 tempest-VolumesSnapshotTestJSON-2041623630 None] Delete snapshot completed successfully. Sep 07 10:05:53 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-9ab2ff79-15d3-4b08-817f-1432e2d56874 tempest-VolumesSnapshotTestJSON-2041623630 None] Lock "cinder-83feebf2-1eca-4fba-aa73-7763ef423b56-delete_snapshot" released by "delete_snapshot" :: held 3.298s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:05:53 devstack sudo[96925]: pam_unix(sudo:session): session closed for user root Sep 07 10:05:53 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-4ac48416-16f8-4df5-be15-f5db57f94fb2 tempest-VolumesCloneTest-756928913 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-f15ed322-f882-4adb-aee5-e2f6aae6cca8.a12451d1-fa1b-41f5-8f37-c80859d1688a" returned: 0 in 0.619s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:05:53 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-4ac48416-16f8-4df5-be15-f5db57f94fb2 tempest-VolumesCloneTest-756928913 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f15ed322-f882-4adb-aee5-e2f6aae6cca8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87515) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 10:05:54 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[6625c78e-997c-4bfe-8989-e4af957d0c1b]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:05:54 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-4ac48416-16f8-4df5-be15-f5db57f94fb2 tempest-VolumesCloneTest-756928913 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-f15ed322-f882-4adb-aee5-e2f6aae6cca8 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:05:54 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-8a9625ef-9382-408e-b7ea-3088c083f072 tempest-VolumesSnapshotTestJSON-2041623630 None] Acquiring lock "cinder-a3cadf05-04df-49eb-ae32-3af71c48e1d8-delete_volume" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:05:54 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-8a9625ef-9382-408e-b7ea-3088c083f072 tempest-VolumesSnapshotTestJSON-2041623630 None] Lock "cinder-a3cadf05-04df-49eb-ae32-3af71c48e1d8-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:05:54 devstack sudo[96932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-f15ed322-f882-4adb-aee5-e2f6aae6cca8 Sep 07 10:05:54 devstack sudo[96932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:05:54 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-8a9625ef-9382-408e-b7ea-3088c083f072 tempest-VolumesSnapshotTestJSON-2041623630 None] Acquiring lock "cinder-quobyte-a3cadf05-04df-49eb-ae32-3af71c48e1d8" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:05:54 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-8a9625ef-9382-408e-b7ea-3088c083f072 tempest-VolumesSnapshotTestJSON-2041623630 None] Lock "cinder-quobyte-a3cadf05-04df-49eb-ae32-3af71c48e1d8" acquired by "delete_volume" :: waited 0.029s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:05:54 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[63e2b037-f6f3-4789-a8f4-1fd9cc7d797e]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:05:54 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-8a9625ef-9382-408e-b7ea-3088c083f072 tempest-VolumesSnapshotTestJSON-2041623630 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-a3cadf05-04df-49eb-ae32-3af71c48e1d8 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:05:54 devstack sudo[96934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-a3cadf05-04df-49eb-ae32-3af71c48e1d8 Sep 07 10:05:54 devstack sudo[96934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:05:54 devstack sudo[96932]: pam_unix(sudo:session): session closed for user root Sep 07 10:05:54 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-4ac48416-16f8-4df5-be15-f5db57f94fb2 tempest-VolumesCloneTest-756928913 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-f15ed322-f882-4adb-aee5-e2f6aae6cca8" returned: 0 in 0.424s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:05:54 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-4ac48416-16f8-4df5-be15-f5db57f94fb2 tempest-VolumesCloneTest-756928913 None] will copy from snapshot at /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-f15ed322-f882-4adb-aee5-e2f6aae6cca8 {{(pid=87515) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 07 10:05:54 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-4ac48416-16f8-4df5-be15-f5db57f94fb2 tempest-VolumesCloneTest-756928913 None] Creating direct copy from snapshot {{(pid=87515) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 07 10:05:54 devstack cinder-volume[87515]: DEBUG cinder.utils [None req-4ac48416-16f8-4df5-be15-f5db57f94fb2 tempest-VolumesCloneTest-756928913 None] Path /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-dccc77d9-6f4c-4f5d-9121-5f05777ffad8 not found in is_blk_device check {{(pid=87515) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 07 10:05:54 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-4ac48416-16f8-4df5-be15-f5db57f94fb2 tempest-VolumesCloneTest-756928913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-f15ed322-f882-4adb-aee5-e2f6aae6cca8 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-dccc77d9-6f4c-4f5d-9121-5f05777ffad8 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:05:54 devstack sudo[96939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-f15ed322-f882-4adb-aee5-e2f6aae6cca8 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-dccc77d9-6f4c-4f5d-9121-5f05777ffad8 Sep 07 10:05:54 devstack sudo[96939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:05:54 devstack sudo[96934]: pam_unix(sudo:session): session closed for user root Sep 07 10:05:54 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-8a9625ef-9382-408e-b7ea-3088c083f072 tempest-VolumesSnapshotTestJSON-2041623630 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-a3cadf05-04df-49eb-ae32-3af71c48e1d8" returned: 0 in 0.414s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:05:54 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-8a9625ef-9382-408e-b7ea-3088c083f072 tempest-VolumesSnapshotTestJSON-2041623630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-a3cadf05-04df-49eb-ae32-3af71c48e1d8 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:05:54 devstack sudo[96944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-a3cadf05-04df-49eb-ae32-3af71c48e1d8 Sep 07 10:05:54 devstack sudo[96944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:05:54 devstack sudo[96944]: pam_unix(sudo:session): session closed for user root Sep 07 10:05:54 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-8a9625ef-9382-408e-b7ea-3088c083f072 tempest-VolumesSnapshotTestJSON-2041623630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-a3cadf05-04df-49eb-ae32-3af71c48e1d8" returned: 0 in 0.356s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:05:55 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-8a9625ef-9382-408e-b7ea-3088c083f072 tempest-VolumesSnapshotTestJSON-2041623630 None] Lock "cinder-quobyte-a3cadf05-04df-49eb-ae32-3af71c48e1d8" released by "delete_volume" :: held 0.877s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:05:55 devstack cinder-volume[87515]: DEBUG cinder.quota [None req-8a9625ef-9382-408e-b7ea-3088c083f072 tempest-VolumesSnapshotTestJSON-2041623630 None] Created reservations ['ebf036b0-ac10-49da-9083-f4f88caff048', 'd04cb00f-87fe-4937-b3b3-461b03df12e4', '3cc6833a-8741-4fb9-94f0-344cfb6b7961', '653523c5-876a-40ef-87ff-b92c99929339'] {{(pid=87515) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:05:55 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-8a9625ef-9382-408e-b7ea-3088c083f072 tempest-VolumesSnapshotTestJSON-2041623630 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:05:55 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-8a9625ef-9382-408e-b7ea-3088c083f072 tempest-VolumesSnapshotTestJSON-2041623630 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:05:55 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-8a9625ef-9382-408e-b7ea-3088c083f072 tempest-VolumesSnapshotTestJSON-2041623630 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:05:55 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-8a9625ef-9382-408e-b7ea-3088c083f072 tempest-VolumesSnapshotTestJSON-2041623630 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:05:55 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-8a9625ef-9382-408e-b7ea-3088c083f072 tempest-VolumesSnapshotTestJSON-2041623630 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.044s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:05:55 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-8a9625ef-9382-408e-b7ea-3088c083f072 tempest-VolumesSnapshotTestJSON-2041623630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:05:55 devstack sudo[96963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a Sep 07 10:05:55 devstack sudo[96963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:05:56 devstack sudo[96963]: pam_unix(sudo:session): session closed for user root Sep 07 10:05:56 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-8a9625ef-9382-408e-b7ea-3088c083f072 tempest-VolumesSnapshotTestJSON-2041623630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a" returned: 0 in 0.972s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:05:56 devstack cinder-volume[87515]: DEBUG cinder.manager [None req-8a9625ef-9382-408e-b7ea-3088c083f072 tempest-VolumesSnapshotTestJSON-2041623630 None] Notifying Schedulers of capabilities ... {{(pid=87515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:05:56 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-8a9625ef-9382-408e-b7ea-3088c083f072 tempest-VolumesSnapshotTestJSON-2041623630 None] Deleted volume successfully. Sep 07 10:05:56 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-8a9625ef-9382-408e-b7ea-3088c083f072 tempest-VolumesSnapshotTestJSON-2041623630 None] Lock "cinder-a3cadf05-04df-49eb-ae32-3af71c48e1d8-delete_volume" released by "delete_volume" :: held 2.753s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:05:58 devstack cinder-volume[87515]: DEBUG cinder.volume.flows.manager.create_volume [None req-9f4cfc47-4461-410d-981d-a262e73c6ff5 tempest-VolumesSnapshotTestJSON-2041623630 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 10:05:58 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-9f4cfc47-4461-410d-981d-a262e73c6ff5 tempest-VolumesSnapshotTestJSON-2041623630 None] Flow 'volume_create_manager' (bb4340f6-1eee-408b-b28b-14d428c4db62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:05:58 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-9f4cfc47-4461-410d-981d-a262e73c6ff5 tempest-VolumesSnapshotTestJSON-2041623630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (438112bd-6f32-4376-92cb-a9247e8688c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:05:58 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-9f4cfc47-4461-410d-981d-a262e73c6ff5 tempest-VolumesSnapshotTestJSON-2041623630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (438112bd-6f32-4376-92cb-a9247e8688c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:05:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-91519356',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83501d97-cadf-4b50-accf-2e0e4c885d58,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='940eb7dc41254b3f8fe361a280cc52b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:05:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:05:58Z,use_quota=True,user_id='37b1985156f54ab4853962fe1a63200f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3a092cd-7947-4cbf-abff-4ba9567becf0),volume_type_id=f3a092cd-7947-4cbf-abff-4ba9567becf0)' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:05:58 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-9f4cfc47-4461-410d-981d-a262e73c6ff5 tempest-VolumesSnapshotTestJSON-2041623630 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (966fb0dc-0df4-4ca2-a972-bedc781f4d4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:05:58 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-9f4cfc47-4461-410d-981d-a262e73c6ff5 tempest-VolumesSnapshotTestJSON-2041623630 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (966fb0dc-0df4-4ca2-a972-bedc781f4d4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:05:58 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-9f4cfc47-4461-410d-981d-a262e73c6ff5 tempest-VolumesSnapshotTestJSON-2041623630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (957879e4-4e53-466c-9da2-92ef321a6f37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:05:58 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-9f4cfc47-4461-410d-981d-a262e73c6ff5 tempest-VolumesSnapshotTestJSON-2041623630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (957879e4-4e53-466c-9da2-92ef321a6f37) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '83501d97-cadf-4b50-accf-2e0e4c885d58', 'volume_name': 'volume-83501d97-cadf-4b50-accf-2e0e4c885d58', 'volume_size': 1}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:05:58 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-9f4cfc47-4461-410d-981d-a262e73c6ff5 tempest-VolumesSnapshotTestJSON-2041623630 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97c0f583-af65-443d-8ade-c779be1112ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:05:58 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-9f4cfc47-4461-410d-981d-a262e73c6ff5 tempest-VolumesSnapshotTestJSON-2041623630 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97c0f583-af65-443d-8ade-c779be1112ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:05:58 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-9f4cfc47-4461-410d-981d-a262e73c6ff5 tempest-VolumesSnapshotTestJSON-2041623630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b2652f5-84c9-4ac4-a44b-623554aea8cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:05:58 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-9f4cfc47-4461-410d-981d-a262e73c6ff5 tempest-VolumesSnapshotTestJSON-2041623630 None] Volume 83501d97-cadf-4b50-accf-2e0e4c885d58: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-83501d97-cadf-4b50-accf-2e0e4c885d58', 'volume_size': 1} Sep 07 10:05:58 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-9f4cfc47-4461-410d-981d-a262e73c6ff5 tempest-VolumesSnapshotTestJSON-2041623630 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:06:01 devstack sudo[96939]: pam_unix(sudo:session): session closed for user root Sep 07 10:06:01 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-4ac48416-16f8-4df5-be15-f5db57f94fb2 tempest-VolumesCloneTest-756928913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-f15ed322-f882-4adb-aee5-e2f6aae6cca8 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-dccc77d9-6f4c-4f5d-9121-5f05777ffad8" returned: 0 in 6.928s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:06:01 devstack cinder-volume[87515]: DEBUG cinder.image.image_utils [None req-4ac48416-16f8-4df5-be15-f5db57f94fb2 tempest-VolumesCloneTest-756928913 None] Image conversion details: src /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-f15ed322-f882-4adb-aee5-e2f6aae6cca8, size 1024.00 MB, duration 6.93 sec, destination /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-dccc77d9-6f4c-4f5d-9121-5f05777ffad8 {{(pid=87515) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 07 10:06:01 devstack cinder-volume[87515]: INFO cinder.image.image_utils [None req-4ac48416-16f8-4df5-be15-f5db57f94fb2 tempest-VolumesCloneTest-756928913 None] Converted 1024.00 MB image at 147.79 MB/s Sep 07 10:06:01 devstack cinder-volume[87515]: WARNING cinder.volume.drivers.remotefs [None req-4ac48416-16f8-4df5-be15-f5db57f94fb2 tempest-VolumesCloneTest-756928913 None] /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-dccc77d9-6f4c-4f5d-9121-5f05777ffad8 is being set with open permissions: ugo+rw Sep 07 10:06:01 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-4ac48416-16f8-4df5-be15-f5db57f94fb2 tempest-VolumesCloneTest-756928913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-dccc77d9-6f4c-4f5d-9121-5f05777ffad8 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:06:01 devstack sudo[96985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-dccc77d9-6f4c-4f5d-9121-5f05777ffad8 Sep 07 10:06:01 devstack sudo[96985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:06:01 devstack sudo[96985]: pam_unix(sudo:session): session closed for user root Sep 07 10:06:01 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-4ac48416-16f8-4df5-be15-f5db57f94fb2 tempest-VolumesCloneTest-756928913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-dccc77d9-6f4c-4f5d-9121-5f05777ffad8" returned: 0 in 0.249s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:06:01 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-4ac48416-16f8-4df5-be15-f5db57f94fb2 tempest-VolumesCloneTest-756928913 None] Lock "cinder-quobyte-dccc77d9-6f4c-4f5d-9121-5f05777ffad8" released by "_copy_volume_from_snapshot" :: held 8.329s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:06:01 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-4ac48416-16f8-4df5-be15-f5db57f94fb2 tempest-VolumesCloneTest-756928913 None] Acquiring lock "cinder-quobyte-a12451d1-fa1b-41f5-8f37-c80859d1688a" by "_delete_snapshot" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:06:01 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-4ac48416-16f8-4df5-be15-f5db57f94fb2 tempest-VolumesCloneTest-756928913 None] Lock "cinder-quobyte-a12451d1-fa1b-41f5-8f37-c80859d1688a" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:06:01 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-4ac48416-16f8-4df5-be15-f5db57f94fb2 tempest-VolumesCloneTest-756928913 None] Deleting offline snapshot a12451d1-fa1b-41f5-8f37-c80859d1688a of volume f15ed322-f882-4adb-aee5-e2f6aae6cca8 {{(pid=87515) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 10:06:01 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-4ac48416-16f8-4df5-be15-f5db57f94fb2 tempest-VolumesCloneTest-756928913 None] snapshot_file for this snap is: volume-f15ed322-f882-4adb-aee5-e2f6aae6cca8.a12451d1-fa1b-41f5-8f37-c80859d1688a {{(pid=87515) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 10:06:01 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[a03aec6d-1fee-4d35-bcd9-26e23cf7cbf0]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:06:01 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-4ac48416-16f8-4df5-be15-f5db57f94fb2 tempest-VolumesCloneTest-756928913 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-f15ed322-f882-4adb-aee5-e2f6aae6cca8.a12451d1-fa1b-41f5-8f37-c80859d1688a {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:06:01 devstack sudo[96988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-f15ed322-f882-4adb-aee5-e2f6aae6cca8.a12451d1-fa1b-41f5-8f37-c80859d1688a Sep 07 10:06:01 devstack sudo[96988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:06:02 devstack sudo[96988]: pam_unix(sudo:session): session closed for user root Sep 07 10:06:02 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-4ac48416-16f8-4df5-be15-f5db57f94fb2 tempest-VolumesCloneTest-756928913 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-f15ed322-f882-4adb-aee5-e2f6aae6cca8.a12451d1-fa1b-41f5-8f37-c80859d1688a" returned: 0 in 0.380s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:06:02 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-4ac48416-16f8-4df5-be15-f5db57f94fb2 tempest-VolumesCloneTest-756928913 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f15ed322-f882-4adb-aee5-e2f6aae6cca8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87515) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 10:06:02 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0aa1d90-bda5-4de8-aad0-396c1f4d3864]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:06:02 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-4ac48416-16f8-4df5-be15-f5db57f94fb2 tempest-VolumesCloneTest-756928913 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-f15ed322-f882-4adb-aee5-e2f6aae6cca8 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:06:02 devstack sudo[96993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-f15ed322-f882-4adb-aee5-e2f6aae6cca8 Sep 07 10:06:02 devstack sudo[96993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:06:02 devstack sudo[96993]: pam_unix(sudo:session): session closed for user root Sep 07 10:06:02 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-4ac48416-16f8-4df5-be15-f5db57f94fb2 tempest-VolumesCloneTest-756928913 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-f15ed322-f882-4adb-aee5-e2f6aae6cca8" returned: 0 in 0.558s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:06:02 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-4ac48416-16f8-4df5-be15-f5db57f94fb2 tempest-VolumesCloneTest-756928913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-f15ed322-f882-4adb-aee5-e2f6aae6cca8.a12451d1-fa1b-41f5-8f37-c80859d1688a {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:06:02 devstack sudo[96998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-f15ed322-f882-4adb-aee5-e2f6aae6cca8.a12451d1-fa1b-41f5-8f37-c80859d1688a Sep 07 10:06:02 devstack sudo[96998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:06:03 devstack sudo[96998]: pam_unix(sudo:session): session closed for user root Sep 07 10:06:03 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-4ac48416-16f8-4df5-be15-f5db57f94fb2 tempest-VolumesCloneTest-756928913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-f15ed322-f882-4adb-aee5-e2f6aae6cca8.a12451d1-fa1b-41f5-8f37-c80859d1688a" returned: 0 in 0.362s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:06:03 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-4ac48416-16f8-4df5-be15-f5db57f94fb2 tempest-VolumesCloneTest-756928913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-f15ed322-f882-4adb-aee5-e2f6aae6cca8.a12451d1-fa1b-41f5-8f37-c80859d1688a {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:06:03 devstack sudo[97006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-f15ed322-f882-4adb-aee5-e2f6aae6cca8.a12451d1-fa1b-41f5-8f37-c80859d1688a Sep 07 10:06:03 devstack sudo[97006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:06:03 devstack sudo[97006]: pam_unix(sudo:session): session closed for user root Sep 07 10:06:03 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-4ac48416-16f8-4df5-be15-f5db57f94fb2 tempest-VolumesCloneTest-756928913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-f15ed322-f882-4adb-aee5-e2f6aae6cca8.a12451d1-fa1b-41f5-8f37-c80859d1688a" returned: 0 in 0.266s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:06:03 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-4ac48416-16f8-4df5-be15-f5db57f94fb2 tempest-VolumesCloneTest-756928913 None] Lock "cinder-quobyte-a12451d1-fa1b-41f5-8f37-c80859d1688a" released by "_delete_snapshot" :: held 1.672s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:06:03 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-4ac48416-16f8-4df5-be15-f5db57f94fb2 tempest-VolumesCloneTest-756928913 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 13.702s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:06:03 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-9f4cfc47-4461-410d-981d-a262e73c6ff5 tempest-VolumesSnapshotTestJSON-2041623630 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.689s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:06:03 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-9f4cfc47-4461-410d-981d-a262e73c6ff5 tempest-VolumesSnapshotTestJSON-2041623630 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:05:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-91519356',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83501d97-cadf-4b50-accf-2e0e4c885d58,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='940eb7dc41254b3f8fe361a280cc52b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:05:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:05:58Z,use_quota=True,user_id='37b1985156f54ab4853962fe1a63200f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3a092cd-7947-4cbf-abff-4ba9567becf0),volume_type_id=f3a092cd-7947-4cbf-abff-4ba9567becf0)}" {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 10:06:03 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-9f4cfc47-4461-410d-981d-a262e73c6ff5 tempest-VolumesSnapshotTestJSON-2041623630 None] Creating volume 83501d97-cadf-4b50-accf-2e0e4c885d58 {{(pid=87515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 10:06:03 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-9f4cfc47-4461-410d-981d-a262e73c6ff5 tempest-VolumesSnapshotTestJSON-2041623630 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:06:03 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-9f4cfc47-4461-410d-981d-a262e73c6ff5 tempest-VolumesSnapshotTestJSON-2041623630 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:06:03 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-9f4cfc47-4461-410d-981d-a262e73c6ff5 tempest-VolumesSnapshotTestJSON-2041623630 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:06:03 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-9f4cfc47-4461-410d-981d-a262e73c6ff5 tempest-VolumesSnapshotTestJSON-2041623630 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:06:03 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-9f4cfc47-4461-410d-981d-a262e73c6ff5 tempest-VolumesSnapshotTestJSON-2041623630 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:06:03 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-9f4cfc47-4461-410d-981d-a262e73c6ff5 tempest-VolumesSnapshotTestJSON-2041623630 None] Selected osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c as target Quobyte volume. {{(pid=87515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 10:06:03 devstack cinder-volume[87515]: INFO cinder.volume.drivers.remotefs [None req-9f4cfc47-4461-410d-981d-a262e73c6ff5 tempest-VolumesSnapshotTestJSON-2041623630 None] casted to osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c Sep 07 10:06:03 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-9f4cfc47-4461-410d-981d-a262e73c6ff5 tempest-VolumesSnapshotTestJSON-2041623630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-83501d97-cadf-4b50-accf-2e0e4c885d58 1073741824 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:06:03 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-4ac48416-16f8-4df5-be15-f5db57f94fb2 tempest-VolumesCloneTest-756928913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d98b3139-1297-454d-b03d-81f8213e0356) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dccc77d9-6f4c-4f5d-9121-5f05777ffad8', 'volume_size': 2, 'source_volid': 'f15ed322-f882-4adb-aee5-e2f6aae6cca8', 'source_volstatus': 'available'}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:06:03 devstack sudo[97009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-83501d97-cadf-4b50-accf-2e0e4c885d58 1073741824 Sep 07 10:06:03 devstack sudo[97009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:06:03 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-4ac48416-16f8-4df5-be15-f5db57f94fb2 tempest-VolumesCloneTest-756928913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7f133dc-6e8c-47ab-a9d6-ab82c7e03237) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:06:03 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-4ac48416-16f8-4df5-be15-f5db57f94fb2 tempest-VolumesCloneTest-756928913 None] Volume volume-dccc77d9-6f4c-4f5d-9121-5f05777ffad8 (dccc77d9-6f4c-4f5d-9121-5f05777ffad8): created successfully Sep 07 10:06:03 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-4ac48416-16f8-4df5-be15-f5db57f94fb2 tempest-VolumesCloneTest-756928913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7f133dc-6e8c-47ab-a9d6-ab82c7e03237) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:06:03 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-4ac48416-16f8-4df5-be15-f5db57f94fb2 tempest-VolumesCloneTest-756928913 None] Flow 'volume_create_manager' (f94f9fc6-f2c1-4543-b9ca-20e68a7df79b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:06:03 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-4ac48416-16f8-4df5-be15-f5db57f94fb2 tempest-VolumesCloneTest-756928913 None] Created volume successfully. Sep 07 10:06:03 devstack sudo[97009]: pam_unix(sudo:session): session closed for user root Sep 07 10:06:03 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-9f4cfc47-4461-410d-981d-a262e73c6ff5 tempest-VolumesSnapshotTestJSON-2041623630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-83501d97-cadf-4b50-accf-2e0e4c885d58 1073741824" returned: 0 in 0.504s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:06:03 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-9f4cfc47-4461-410d-981d-a262e73c6ff5 tempest-VolumesSnapshotTestJSON-2041623630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-83501d97-cadf-4b50-accf-2e0e4c885d58 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:06:03 devstack sudo[97015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-83501d97-cadf-4b50-accf-2e0e4c885d58 Sep 07 10:06:03 devstack sudo[97015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:06:04 devstack sudo[97015]: pam_unix(sudo:session): session closed for user root Sep 07 10:06:04 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-9f4cfc47-4461-410d-981d-a262e73c6ff5 tempest-VolumesSnapshotTestJSON-2041623630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-83501d97-cadf-4b50-accf-2e0e4c885d58" returned: 0 in 0.287s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:06:04 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-9f4cfc47-4461-410d-981d-a262e73c6ff5 tempest-VolumesSnapshotTestJSON-2041623630 None] <== create_volume: return (850ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'} {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 10:06:04 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-9f4cfc47-4461-410d-981d-a262e73c6ff5 tempest-VolumesSnapshotTestJSON-2041623630 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.855s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:06:04 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-9f4cfc47-4461-410d-981d-a262e73c6ff5 tempest-VolumesSnapshotTestJSON-2041623630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b2652f5-84c9-4ac4-a44b-623554aea8cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-83501d97-cadf-4b50-accf-2e0e4c885d58', 'volume_size': 1}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:06:04 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-9f4cfc47-4461-410d-981d-a262e73c6ff5 tempest-VolumesSnapshotTestJSON-2041623630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (034bafbf-6bc5-4f1d-a325-6877f9f35de4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:06:04 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-9f4cfc47-4461-410d-981d-a262e73c6ff5 tempest-VolumesSnapshotTestJSON-2041623630 None] Volume volume-83501d97-cadf-4b50-accf-2e0e4c885d58 (83501d97-cadf-4b50-accf-2e0e4c885d58): created successfully Sep 07 10:06:04 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-9f4cfc47-4461-410d-981d-a262e73c6ff5 tempest-VolumesSnapshotTestJSON-2041623630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (034bafbf-6bc5-4f1d-a325-6877f9f35de4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:06:04 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-9f4cfc47-4461-410d-981d-a262e73c6ff5 tempest-VolumesSnapshotTestJSON-2041623630 None] Flow 'volume_create_manager' (bb4340f6-1eee-408b-b28b-14d428c4db62) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:06:04 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-9f4cfc47-4461-410d-981d-a262e73c6ff5 tempest-VolumesSnapshotTestJSON-2041623630 None] Created volume successfully. Sep 07 10:06:04 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-6f18c1b3-8b0d-440a-bb4e-fe8fb345a5a5 tempest-VolumesCloneTest-756928913 None] Acquiring lock "cinder-dccc77d9-6f4c-4f5d-9121-5f05777ffad8-delete_volume" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:06:04 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-6f18c1b3-8b0d-440a-bb4e-fe8fb345a5a5 tempest-VolumesCloneTest-756928913 None] Lock "cinder-dccc77d9-6f4c-4f5d-9121-5f05777ffad8-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:06:04 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-6f18c1b3-8b0d-440a-bb4e-fe8fb345a5a5 tempest-VolumesCloneTest-756928913 None] Acquiring lock "cinder-quobyte-dccc77d9-6f4c-4f5d-9121-5f05777ffad8" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:06:04 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-6f18c1b3-8b0d-440a-bb4e-fe8fb345a5a5 tempest-VolumesCloneTest-756928913 None] Lock "cinder-quobyte-dccc77d9-6f4c-4f5d-9121-5f05777ffad8" acquired by "delete_volume" :: waited 0.030s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:06:04 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[dde4cad9-261d-44b2-87ed-29d53278a72a]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:06:04 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-6f18c1b3-8b0d-440a-bb4e-fe8fb345a5a5 tempest-VolumesCloneTest-756928913 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-dccc77d9-6f4c-4f5d-9121-5f05777ffad8 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:06:05 devstack sudo[97032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-dccc77d9-6f4c-4f5d-9121-5f05777ffad8 Sep 07 10:06:05 devstack sudo[97032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:06:05 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-527da316-4013-4b47-932e-d844d788b41c tempest-VolumesSnapshotTestJSON-2041623630 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:06:05 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-527da316-4013-4b47-932e-d844d788b41c tempest-VolumesSnapshotTestJSON-2041623630 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:06:05 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-527da316-4013-4b47-932e-d844d788b41c tempest-VolumesSnapshotTestJSON-2041623630 None] Creating offline snapshot 8c29601d-d10a-4fcf-aa70-cc33fb387cb8 of volume 83501d97-cadf-4b50-accf-2e0e4c885d58 {{(pid=87515) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 10:06:05 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[929cc575-aa0a-4dc0-89cf-ee97f2f8042e]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:06:05 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-527da316-4013-4b47-932e-d844d788b41c tempest-VolumesSnapshotTestJSON-2041623630 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-83501d97-cadf-4b50-accf-2e0e4c885d58 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:06:05 devstack sudo[97032]: pam_unix(sudo:session): session closed for user root Sep 07 10:06:05 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-6f18c1b3-8b0d-440a-bb4e-fe8fb345a5a5 tempest-VolumesCloneTest-756928913 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-dccc77d9-6f4c-4f5d-9121-5f05777ffad8" returned: 0 in 0.623s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:06:05 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-6f18c1b3-8b0d-440a-bb4e-fe8fb345a5a5 tempest-VolumesCloneTest-756928913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-dccc77d9-6f4c-4f5d-9121-5f05777ffad8 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:06:05 devstack sudo[97040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-dccc77d9-6f4c-4f5d-9121-5f05777ffad8 Sep 07 10:06:05 devstack sudo[97040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:06:05 devstack sudo[97039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-83501d97-cadf-4b50-accf-2e0e4c885d58 Sep 07 10:06:05 devstack sudo[97039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:06:05 devstack sudo[97040]: pam_unix(sudo:session): session closed for user root Sep 07 10:06:05 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-6f18c1b3-8b0d-440a-bb4e-fe8fb345a5a5 tempest-VolumesCloneTest-756928913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-dccc77d9-6f4c-4f5d-9121-5f05777ffad8" returned: 0 in 0.342s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:06:05 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-6f18c1b3-8b0d-440a-bb4e-fe8fb345a5a5 tempest-VolumesCloneTest-756928913 None] Lock "cinder-quobyte-dccc77d9-6f4c-4f5d-9121-5f05777ffad8" released by "delete_volume" :: held 1.062s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:06:05 devstack sudo[97039]: pam_unix(sudo:session): session closed for user root Sep 07 10:06:05 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-527da316-4013-4b47-932e-d844d788b41c tempest-VolumesSnapshotTestJSON-2041623630 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-83501d97-cadf-4b50-accf-2e0e4c885d58" returned: 0 in 0.544s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:06:05 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-527da316-4013-4b47-932e-d844d788b41c tempest-VolumesSnapshotTestJSON-2041623630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-83501d97-cadf-4b50-accf-2e0e4c885d58,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-83501d97-cadf-4b50-accf-2e0e4c885d58.8c29601d-d10a-4fcf-aa70-cc33fb387cb8 1G {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:06:06 devstack cinder-volume[87515]: DEBUG cinder.quota [None req-6f18c1b3-8b0d-440a-bb4e-fe8fb345a5a5 tempest-VolumesCloneTest-756928913 None] Created reservations ['4e9b9c62-c432-4f17-ba9f-a1b3bc2d73bc', '9913b917-db23-4aad-a73e-a239271b9eef', '24d8a199-d825-4ff3-837c-26de9b98298e', 'd0f8f0f3-cc25-4145-9af6-32535c93714b'] {{(pid=87515) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:06:05 devstack sudo[97047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-83501d97-cadf-4b50-accf-2e0e4c885d58,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-83501d97-cadf-4b50-accf-2e0e4c885d58.8c29601d-d10a-4fcf-aa70-cc33fb387cb8 1G Sep 07 10:06:05 devstack sudo[97047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:06:06 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-6f18c1b3-8b0d-440a-bb4e-fe8fb345a5a5 tempest-VolumesCloneTest-756928913 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:06:06 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-6f18c1b3-8b0d-440a-bb4e-fe8fb345a5a5 tempest-VolumesCloneTest-756928913 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:06:06 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-6f18c1b3-8b0d-440a-bb4e-fe8fb345a5a5 tempest-VolumesCloneTest-756928913 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:06:06 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-6f18c1b3-8b0d-440a-bb4e-fe8fb345a5a5 tempest-VolumesCloneTest-756928913 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:06:06 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-6f18c1b3-8b0d-440a-bb4e-fe8fb345a5a5 tempest-VolumesCloneTest-756928913 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:06:06 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-6f18c1b3-8b0d-440a-bb4e-fe8fb345a5a5 tempest-VolumesCloneTest-756928913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:06:06 devstack sudo[97049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a Sep 07 10:06:06 devstack sudo[97049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:06:06 devstack sudo[97049]: pam_unix(sudo:session): session closed for user root Sep 07 10:06:06 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-6f18c1b3-8b0d-440a-bb4e-fe8fb345a5a5 tempest-VolumesCloneTest-756928913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a" returned: 0 in 0.376s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:06:06 devstack cinder-volume[87515]: DEBUG cinder.manager [None req-6f18c1b3-8b0d-440a-bb4e-fe8fb345a5a5 tempest-VolumesCloneTest-756928913 None] Notifying Schedulers of capabilities ... {{(pid=87515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:06:06 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-6f18c1b3-8b0d-440a-bb4e-fe8fb345a5a5 tempest-VolumesCloneTest-756928913 None] Deleted volume successfully. Sep 07 10:06:06 devstack sudo[97047]: pam_unix(sudo:session): session closed for user root Sep 07 10:06:06 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-527da316-4013-4b47-932e-d844d788b41c tempest-VolumesSnapshotTestJSON-2041623630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-83501d97-cadf-4b50-accf-2e0e4c885d58,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-83501d97-cadf-4b50-accf-2e0e4c885d58.8c29601d-d10a-4fcf-aa70-cc33fb387cb8 1G" returned: 0 in 0.550s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:06:06 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-527da316-4013-4b47-932e-d844d788b41c tempest-VolumesSnapshotTestJSON-2041623630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-83501d97-cadf-4b50-accf-2e0e4c885d58 -F qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-83501d97-cadf-4b50-accf-2e0e4c885d58.8c29601d-d10a-4fcf-aa70-cc33fb387cb8 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:06:06 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-6f18c1b3-8b0d-440a-bb4e-fe8fb345a5a5 tempest-VolumesCloneTest-756928913 None] Lock "cinder-dccc77d9-6f4c-4f5d-9121-5f05777ffad8-delete_volume" released by "delete_volume" :: held 1.822s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:06:06 devstack sudo[97056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-83501d97-cadf-4b50-accf-2e0e4c885d58 -F qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-83501d97-cadf-4b50-accf-2e0e4c885d58.8c29601d-d10a-4fcf-aa70-cc33fb387cb8 Sep 07 10:06:06 devstack sudo[97056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:06:06 devstack sudo[97056]: pam_unix(sudo:session): session closed for user root Sep 07 10:06:06 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-527da316-4013-4b47-932e-d844d788b41c tempest-VolumesSnapshotTestJSON-2041623630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-83501d97-cadf-4b50-accf-2e0e4c885d58 -F qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-83501d97-cadf-4b50-accf-2e0e4c885d58.8c29601d-d10a-4fcf-aa70-cc33fb387cb8" returned: 0 in 0.376s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:06:06 devstack cinder-volume[87515]: WARNING cinder.volume.drivers.remotefs [None req-527da316-4013-4b47-932e-d844d788b41c tempest-VolumesSnapshotTestJSON-2041623630 None] /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-83501d97-cadf-4b50-accf-2e0e4c885d58.8c29601d-d10a-4fcf-aa70-cc33fb387cb8 is being set with open permissions: ugo+rw Sep 07 10:06:06 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-527da316-4013-4b47-932e-d844d788b41c tempest-VolumesSnapshotTestJSON-2041623630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-83501d97-cadf-4b50-accf-2e0e4c885d58.8c29601d-d10a-4fcf-aa70-cc33fb387cb8 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:06:06 devstack sudo[97062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-83501d97-cadf-4b50-accf-2e0e4c885d58.8c29601d-d10a-4fcf-aa70-cc33fb387cb8 Sep 07 10:06:06 devstack sudo[97062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:06:07 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-113ee068-547d-4b69-ab9e-06fdc98327a3 tempest-VolumesCloneTest-756928913 None] Acquiring lock "cinder-f15ed322-f882-4adb-aee5-e2f6aae6cca8-delete_volume" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:06:07 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-113ee068-547d-4b69-ab9e-06fdc98327a3 tempest-VolumesCloneTest-756928913 None] Lock "cinder-f15ed322-f882-4adb-aee5-e2f6aae6cca8-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:06:07 devstack sudo[97062]: pam_unix(sudo:session): session closed for user root Sep 07 10:06:07 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-527da316-4013-4b47-932e-d844d788b41c tempest-VolumesSnapshotTestJSON-2041623630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-83501d97-cadf-4b50-accf-2e0e4c885d58.8c29601d-d10a-4fcf-aa70-cc33fb387cb8" returned: 0 in 0.382s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:06:07 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-113ee068-547d-4b69-ab9e-06fdc98327a3 tempest-VolumesCloneTest-756928913 None] Acquiring lock "cinder-quobyte-f15ed322-f882-4adb-aee5-e2f6aae6cca8" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:06:07 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-113ee068-547d-4b69-ab9e-06fdc98327a3 tempest-VolumesCloneTest-756928913 None] Lock "cinder-quobyte-f15ed322-f882-4adb-aee5-e2f6aae6cca8" acquired by "delete_volume" :: waited 0.021s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:06:07 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-527da316-4013-4b47-932e-d844d788b41c tempest-VolumesSnapshotTestJSON-2041623630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-83501d97-cadf-4b50-accf-2e0e4c885d58.info {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:06:07 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfa19e85-6cf0-464b-aafc-b1dc4213145f]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:06:07 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-113ee068-547d-4b69-ab9e-06fdc98327a3 tempest-VolumesCloneTest-756928913 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-f15ed322-f882-4adb-aee5-e2f6aae6cca8 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:06:07 devstack sudo[97065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-83501d97-cadf-4b50-accf-2e0e4c885d58.info Sep 07 10:06:07 devstack sudo[97065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:06:07 devstack sudo[97069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-f15ed322-f882-4adb-aee5-e2f6aae6cca8 Sep 07 10:06:07 devstack sudo[97069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:06:07 devstack sudo[97065]: pam_unix(sudo:session): session closed for user root Sep 07 10:06:07 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-527da316-4013-4b47-932e-d844d788b41c tempest-VolumesSnapshotTestJSON-2041623630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-83501d97-cadf-4b50-accf-2e0e4c885d58.info" returned: 0 in 0.605s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:06:07 devstack cinder-volume[87515]: WARNING cinder.volume.drivers.remotefs [None req-527da316-4013-4b47-932e-d844d788b41c tempest-VolumesSnapshotTestJSON-2041623630 None] /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-83501d97-cadf-4b50-accf-2e0e4c885d58.info is being set with open permissions: ugo+rw Sep 07 10:06:07 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-527da316-4013-4b47-932e-d844d788b41c tempest-VolumesSnapshotTestJSON-2041623630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-83501d97-cadf-4b50-accf-2e0e4c885d58.info {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:06:08 devstack sudo[97110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-83501d97-cadf-4b50-accf-2e0e4c885d58.info Sep 07 10:06:08 devstack sudo[97110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:06:08 devstack sudo[97069]: pam_unix(sudo:session): session closed for user root Sep 07 10:06:08 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-113ee068-547d-4b69-ab9e-06fdc98327a3 tempest-VolumesCloneTest-756928913 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-f15ed322-f882-4adb-aee5-e2f6aae6cca8" returned: 0 in 0.807s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:06:08 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-113ee068-547d-4b69-ab9e-06fdc98327a3 tempest-VolumesCloneTest-756928913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-f15ed322-f882-4adb-aee5-e2f6aae6cca8 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:06:08 devstack sudo[97130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-f15ed322-f882-4adb-aee5-e2f6aae6cca8 Sep 07 10:06:08 devstack sudo[97130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:06:08 devstack sudo[97110]: pam_unix(sudo:session): session closed for user root Sep 07 10:06:08 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-527da316-4013-4b47-932e-d844d788b41c tempest-VolumesSnapshotTestJSON-2041623630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-83501d97-cadf-4b50-accf-2e0e4c885d58.info" returned: 0 in 0.484s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:06:08 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-527da316-4013-4b47-932e-d844d788b41c tempest-VolumesSnapshotTestJSON-2041623630 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.137s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:06:08 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-527da316-4013-4b47-932e-d844d788b41c tempest-VolumesSnapshotTestJSON-2041623630 None] Create snapshot completed successfully Sep 07 10:06:08 devstack sudo[97130]: pam_unix(sudo:session): session closed for user root Sep 07 10:06:08 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-113ee068-547d-4b69-ab9e-06fdc98327a3 tempest-VolumesCloneTest-756928913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-f15ed322-f882-4adb-aee5-e2f6aae6cca8" returned: 0 in 0.508s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:06:08 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-113ee068-547d-4b69-ab9e-06fdc98327a3 tempest-VolumesCloneTest-756928913 None] Lock "cinder-quobyte-f15ed322-f882-4adb-aee5-e2f6aae6cca8" released by "delete_volume" :: held 1.443s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:06:08 devstack cinder-volume[87515]: DEBUG cinder.quota [None req-113ee068-547d-4b69-ab9e-06fdc98327a3 tempest-VolumesCloneTest-756928913 None] Created reservations ['4ca875bc-f989-452c-b7a8-35e0a2c79590', '3dde89fc-9558-4c0e-9b7d-f14d9c7dd4f6', '684d49ba-39eb-4af2-a8c4-578a12db7245', '1d259b15-4751-4002-a7c7-18552e2d58f1'] {{(pid=87515) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:06:08 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-113ee068-547d-4b69-ab9e-06fdc98327a3 tempest-VolumesCloneTest-756928913 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:06:08 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-113ee068-547d-4b69-ab9e-06fdc98327a3 tempest-VolumesCloneTest-756928913 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:06:08 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-113ee068-547d-4b69-ab9e-06fdc98327a3 tempest-VolumesCloneTest-756928913 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:06:08 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-113ee068-547d-4b69-ab9e-06fdc98327a3 tempest-VolumesCloneTest-756928913 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:06:08 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-113ee068-547d-4b69-ab9e-06fdc98327a3 tempest-VolumesCloneTest-756928913 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:06:08 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-113ee068-547d-4b69-ab9e-06fdc98327a3 tempest-VolumesCloneTest-756928913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:06:09 devstack sudo[97148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a Sep 07 10:06:09 devstack sudo[97148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:06:09 devstack sudo[97148]: pam_unix(sudo:session): session closed for user root Sep 07 10:06:09 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-113ee068-547d-4b69-ab9e-06fdc98327a3 tempest-VolumesCloneTest-756928913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a" returned: 0 in 0.297s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:06:09 devstack cinder-volume[87515]: DEBUG cinder.manager [None req-113ee068-547d-4b69-ab9e-06fdc98327a3 tempest-VolumesCloneTest-756928913 None] Notifying Schedulers of capabilities ... {{(pid=87515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:06:09 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-113ee068-547d-4b69-ab9e-06fdc98327a3 tempest-VolumesCloneTest-756928913 None] Deleted volume successfully. Sep 07 10:06:09 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-113ee068-547d-4b69-ab9e-06fdc98327a3 tempest-VolumesCloneTest-756928913 None] Lock "cinder-f15ed322-f882-4adb-aee5-e2f6aae6cca8-delete_volume" released by "delete_volume" :: held 2.114s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:06:09 devstack cinder-volume[87515]: DEBUG cinder.volume.flows.manager.create_volume [None req-17631559-5bb4-4b58-823a-edd10764064f tempest-AttachVolumeNegativeTest-1630918730 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 10:06:09 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-17631559-5bb4-4b58-823a-edd10764064f tempest-AttachVolumeNegativeTest-1630918730 None] Flow 'volume_create_manager' (d9a57937-b85f-4632-b2f6-39e146340dd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:06:09 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-17631559-5bb4-4b58-823a-edd10764064f tempest-AttachVolumeNegativeTest-1630918730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01e27875-94d8-475d-8e66-3f06b30f7368) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:06:09 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-17631559-5bb4-4b58-823a-edd10764064f tempest-AttachVolumeNegativeTest-1630918730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01e27875-94d8-475d-8e66-3f06b30f7368) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:06:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1405288277',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=125b18c2-9526-4da4-8de4-2b69a6f14715,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ca0169dc2c14d879d1f7bad9cb3ca6f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:06:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:06:10Z,use_quota=True,user_id='5752280db2e54f83a8c72a8f4626a43c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3a092cd-7947-4cbf-abff-4ba9567becf0),volume_type_id=f3a092cd-7947-4cbf-abff-4ba9567becf0)' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:06:09 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-17631559-5bb4-4b58-823a-edd10764064f tempest-AttachVolumeNegativeTest-1630918730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6fc77485-65be-4c9b-8660-f8652b058ea6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:06:09 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-17631559-5bb4-4b58-823a-edd10764064f tempest-AttachVolumeNegativeTest-1630918730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6fc77485-65be-4c9b-8660-f8652b058ea6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:06:09 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-17631559-5bb4-4b58-823a-edd10764064f tempest-AttachVolumeNegativeTest-1630918730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81f8a972-96b3-4d0d-ba85-ce2837136e1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:06:09 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-17631559-5bb4-4b58-823a-edd10764064f tempest-AttachVolumeNegativeTest-1630918730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81f8a972-96b3-4d0d-ba85-ce2837136e1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '125b18c2-9526-4da4-8de4-2b69a6f14715', 'volume_name': 'volume-125b18c2-9526-4da4-8de4-2b69a6f14715', 'volume_size': 1}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:06:09 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-17631559-5bb4-4b58-823a-edd10764064f tempest-AttachVolumeNegativeTest-1630918730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (856eeafc-80a0-4f1d-953a-1d1b35771616) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:06:09 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-17631559-5bb4-4b58-823a-edd10764064f tempest-AttachVolumeNegativeTest-1630918730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (856eeafc-80a0-4f1d-953a-1d1b35771616) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:06:09 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-17631559-5bb4-4b58-823a-edd10764064f tempest-AttachVolumeNegativeTest-1630918730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b20225a0-6746-4c6f-8dad-0c331be7395e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:06:09 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-17631559-5bb4-4b58-823a-edd10764064f tempest-AttachVolumeNegativeTest-1630918730 None] Volume 125b18c2-9526-4da4-8de4-2b69a6f14715: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-125b18c2-9526-4da4-8de4-2b69a6f14715', 'volume_size': 1} Sep 07 10:06:09 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-17631559-5bb4-4b58-823a-edd10764064f tempest-AttachVolumeNegativeTest-1630918730 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:06:09 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-17631559-5bb4-4b58-823a-edd10764064f tempest-AttachVolumeNegativeTest-1630918730 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:06:09 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-17631559-5bb4-4b58-823a-edd10764064f tempest-AttachVolumeNegativeTest-1630918730 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:06:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1405288277',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=125b18c2-9526-4da4-8de4-2b69a6f14715,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ca0169dc2c14d879d1f7bad9cb3ca6f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:06:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:06:10Z,use_quota=True,user_id='5752280db2e54f83a8c72a8f4626a43c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3a092cd-7947-4cbf-abff-4ba9567becf0),volume_type_id=f3a092cd-7947-4cbf-abff-4ba9567becf0)}" {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 10:06:09 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-17631559-5bb4-4b58-823a-edd10764064f tempest-AttachVolumeNegativeTest-1630918730 None] Creating volume 125b18c2-9526-4da4-8de4-2b69a6f14715 {{(pid=87515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 10:06:09 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-17631559-5bb4-4b58-823a-edd10764064f tempest-AttachVolumeNegativeTest-1630918730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:06:09 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-17631559-5bb4-4b58-823a-edd10764064f tempest-AttachVolumeNegativeTest-1630918730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:06:09 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-17631559-5bb4-4b58-823a-edd10764064f tempest-AttachVolumeNegativeTest-1630918730 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:06:09 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-17631559-5bb4-4b58-823a-edd10764064f tempest-AttachVolumeNegativeTest-1630918730 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:06:09 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-17631559-5bb4-4b58-823a-edd10764064f tempest-AttachVolumeNegativeTest-1630918730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:06:09 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-17631559-5bb4-4b58-823a-edd10764064f tempest-AttachVolumeNegativeTest-1630918730 None] Selected osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c as target Quobyte volume. {{(pid=87515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 10:06:09 devstack cinder-volume[87515]: INFO cinder.volume.drivers.remotefs [None req-17631559-5bb4-4b58-823a-edd10764064f tempest-AttachVolumeNegativeTest-1630918730 None] casted to osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c Sep 07 10:06:09 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-17631559-5bb4-4b58-823a-edd10764064f tempest-AttachVolumeNegativeTest-1630918730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-125b18c2-9526-4da4-8de4-2b69a6f14715 1073741824 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:06:10 devstack sudo[97153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-125b18c2-9526-4da4-8de4-2b69a6f14715 1073741824 Sep 07 10:06:10 devstack sudo[97153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:06:10 devstack cinder-volume[87515]: DEBUG cinder.volume.flows.manager.create_volume [None req-d8701e7f-f34a-4d27-9e59-a5aea955545b tempest-VolumesSnapshotTestJSON-2041623630 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 10:06:10 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-d8701e7f-f34a-4d27-9e59-a5aea955545b tempest-VolumesSnapshotTestJSON-2041623630 None] Flow 'volume_create_manager' (352e2cba-4243-4236-9ed4-b26a9d4c833e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:06:10 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-d8701e7f-f34a-4d27-9e59-a5aea955545b tempest-VolumesSnapshotTestJSON-2041623630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d91f6087-d9a3-4d33-973e-499595f86b43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:06:10 devstack sudo[97153]: pam_unix(sudo:session): session closed for user root Sep 07 10:06:10 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-17631559-5bb4-4b58-823a-edd10764064f tempest-AttachVolumeNegativeTest-1630918730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-125b18c2-9526-4da4-8de4-2b69a6f14715 1073741824" returned: 0 in 0.704s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:06:10 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-d8701e7f-f34a-4d27-9e59-a5aea955545b tempest-VolumesSnapshotTestJSON-2041623630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d91f6087-d9a3-4d33-973e-499595f86b43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:06:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-374570516',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56737883-d237-49e5-8555-415207a93efe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='940eb7dc41254b3f8fe361a280cc52b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:06:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=8c29601d-d10a-4fcf-aa70-cc33fb387cb8,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:06:11Z,use_quota=True,user_id='37b1985156f54ab4853962fe1a63200f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3a092cd-7947-4cbf-abff-4ba9567becf0),volume_type_id=f3a092cd-7947-4cbf-abff-4ba9567becf0)' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:06:10 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-d8701e7f-f34a-4d27-9e59-a5aea955545b tempest-VolumesSnapshotTestJSON-2041623630 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6fe5a603-650a-4985-a2ba-115b4d6d143c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:06:10 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-d8701e7f-f34a-4d27-9e59-a5aea955545b tempest-VolumesSnapshotTestJSON-2041623630 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6fe5a603-650a-4985-a2ba-115b4d6d143c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:06:10 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-d8701e7f-f34a-4d27-9e59-a5aea955545b tempest-VolumesSnapshotTestJSON-2041623630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b8f9151-5b86-4f3a-b81c-44710d8976bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:06:10 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-d8701e7f-f34a-4d27-9e59-a5aea955545b tempest-VolumesSnapshotTestJSON-2041623630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b8f9151-5b86-4f3a-b81c-44710d8976bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '56737883-d237-49e5-8555-415207a93efe', 'volume_name': 'volume-56737883-d237-49e5-8555-415207a93efe', 'volume_size': 1, 'snapshot_id': '8c29601d-d10a-4fcf-aa70-cc33fb387cb8'}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:06:10 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-d8701e7f-f34a-4d27-9e59-a5aea955545b tempest-VolumesSnapshotTestJSON-2041623630 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6140d1f-cf32-4b86-b353-236e2722406f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:06:10 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-d8701e7f-f34a-4d27-9e59-a5aea955545b tempest-VolumesSnapshotTestJSON-2041623630 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6140d1f-cf32-4b86-b353-236e2722406f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:06:10 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-d8701e7f-f34a-4d27-9e59-a5aea955545b tempest-VolumesSnapshotTestJSON-2041623630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e7b0332-689a-4715-9abc-86ce31c81a8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:06:10 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-d8701e7f-f34a-4d27-9e59-a5aea955545b tempest-VolumesSnapshotTestJSON-2041623630 None] Volume 56737883-d237-49e5-8555-415207a93efe: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-56737883-d237-49e5-8555-415207a93efe', 'volume_size': 1, 'snapshot_id': '8c29601d-d10a-4fcf-aa70-cc33fb387cb8'} Sep 07 10:06:10 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-d8701e7f-f34a-4d27-9e59-a5aea955545b tempest-VolumesSnapshotTestJSON-2041623630 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:06:10 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-17631559-5bb4-4b58-823a-edd10764064f tempest-AttachVolumeNegativeTest-1630918730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-125b18c2-9526-4da4-8de4-2b69a6f14715 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:06:10 devstack sudo[97159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-125b18c2-9526-4da4-8de4-2b69a6f14715 Sep 07 10:06:10 devstack sudo[97159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:06:11 devstack sudo[97159]: pam_unix(sudo:session): session closed for user root Sep 07 10:06:11 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-17631559-5bb4-4b58-823a-edd10764064f tempest-AttachVolumeNegativeTest-1630918730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-125b18c2-9526-4da4-8de4-2b69a6f14715" returned: 0 in 0.313s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:06:11 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-17631559-5bb4-4b58-823a-edd10764064f tempest-AttachVolumeNegativeTest-1630918730 None] <== create_volume: return (1125ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'} {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 10:06:11 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-17631559-5bb4-4b58-823a-edd10764064f tempest-AttachVolumeNegativeTest-1630918730 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.135s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:06:11 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-d8701e7f-f34a-4d27-9e59-a5aea955545b tempest-VolumesSnapshotTestJSON-2041623630 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.346s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:06:11 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-d8701e7f-f34a-4d27-9e59-a5aea955545b tempest-VolumesSnapshotTestJSON-2041623630 None] Acquiring lock "cinder-quobyte-8c29601d-d10a-4fcf-aa70-cc33fb387cb8-56737883-d237-49e5-8555-415207a93efe" by "_create_volume_from_snapshot" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:06:11 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-17631559-5bb4-4b58-823a-edd10764064f tempest-AttachVolumeNegativeTest-1630918730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b20225a0-6746-4c6f-8dad-0c331be7395e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-125b18c2-9526-4da4-8de4-2b69a6f14715', 'volume_size': 1}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:06:11 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-17631559-5bb4-4b58-823a-edd10764064f tempest-AttachVolumeNegativeTest-1630918730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (578f897d-cfa8-45a6-a6ed-dbb91e2e2758) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:06:11 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-d8701e7f-f34a-4d27-9e59-a5aea955545b tempest-VolumesSnapshotTestJSON-2041623630 None] Lock "cinder-quobyte-8c29601d-d10a-4fcf-aa70-cc33fb387cb8-56737883-d237-49e5-8555-415207a93efe" acquired by "_create_volume_from_snapshot" :: waited 0.048s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:06:11 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-d8701e7f-f34a-4d27-9e59-a5aea955545b tempest-VolumesSnapshotTestJSON-2041623630 None] Creating volume 56737883-d237-49e5-8555-415207a93efe from snapshot 8c29601d-d10a-4fcf-aa70-cc33fb387cb8 {{(pid=87515) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 07 10:06:11 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-d8701e7f-f34a-4d27-9e59-a5aea955545b tempest-VolumesSnapshotTestJSON-2041623630 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:06:11 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-d8701e7f-f34a-4d27-9e59-a5aea955545b tempest-VolumesSnapshotTestJSON-2041623630 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:06:11 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-d8701e7f-f34a-4d27-9e59-a5aea955545b tempest-VolumesSnapshotTestJSON-2041623630 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:06:11 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-d8701e7f-f34a-4d27-9e59-a5aea955545b tempest-VolumesSnapshotTestJSON-2041623630 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:06:11 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-d8701e7f-f34a-4d27-9e59-a5aea955545b tempest-VolumesSnapshotTestJSON-2041623630 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:06:11 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-d8701e7f-f34a-4d27-9e59-a5aea955545b tempest-VolumesSnapshotTestJSON-2041623630 None] Selected osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c as target Quobyte volume. {{(pid=87515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 10:06:11 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-d8701e7f-f34a-4d27-9e59-a5aea955545b tempest-VolumesSnapshotTestJSON-2041623630 None] Acquiring lock "cinder-quobyte-56737883-d237-49e5-8555-415207a93efe" by "_copy_volume_from_snapshot" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:06:11 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-17631559-5bb4-4b58-823a-edd10764064f tempest-AttachVolumeNegativeTest-1630918730 None] Volume volume-125b18c2-9526-4da4-8de4-2b69a6f14715 (125b18c2-9526-4da4-8de4-2b69a6f14715): created successfully Sep 07 10:06:11 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-17631559-5bb4-4b58-823a-edd10764064f tempest-AttachVolumeNegativeTest-1630918730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (578f897d-cfa8-45a6-a6ed-dbb91e2e2758) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:06:11 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-17631559-5bb4-4b58-823a-edd10764064f tempest-AttachVolumeNegativeTest-1630918730 None] Flow 'volume_create_manager' (d9a57937-b85f-4632-b2f6-39e146340dd6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:06:11 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-d8701e7f-f34a-4d27-9e59-a5aea955545b tempest-VolumesSnapshotTestJSON-2041623630 None] Lock "cinder-quobyte-56737883-d237-49e5-8555-415207a93efe" acquired by "_copy_volume_from_snapshot" :: waited 0.039s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:06:11 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-d8701e7f-f34a-4d27-9e59-a5aea955545b tempest-VolumesSnapshotTestJSON-2041623630 None] snapshot: 8c29601d-d10a-4fcf-aa70-cc33fb387cb8, volume: 56737883-d237-49e5-8555-415207a93efe, {{(pid=87515) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 07 10:06:11 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-17631559-5bb4-4b58-823a-edd10764064f tempest-AttachVolumeNegativeTest-1630918730 None] Created volume successfully. Sep 07 10:06:11 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-d8701e7f-f34a-4d27-9e59-a5aea955545b tempest-VolumesSnapshotTestJSON-2041623630 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:06:11 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-d8701e7f-f34a-4d27-9e59-a5aea955545b tempest-VolumesSnapshotTestJSON-2041623630 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:06:11 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-d8701e7f-f34a-4d27-9e59-a5aea955545b tempest-VolumesSnapshotTestJSON-2041623630 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:06:11 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-d8701e7f-f34a-4d27-9e59-a5aea955545b tempest-VolumesSnapshotTestJSON-2041623630 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:06:11 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-d8701e7f-f34a-4d27-9e59-a5aea955545b tempest-VolumesSnapshotTestJSON-2041623630 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:06:11 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[adb75f90-787e-4305-8e18-d9a642677a0d]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:06:11 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-d8701e7f-f34a-4d27-9e59-a5aea955545b tempest-VolumesSnapshotTestJSON-2041623630 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-83501d97-cadf-4b50-accf-2e0e4c885d58.8c29601d-d10a-4fcf-aa70-cc33fb387cb8 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:06:11 devstack sudo[97162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-83501d97-cadf-4b50-accf-2e0e4c885d58.8c29601d-d10a-4fcf-aa70-cc33fb387cb8 Sep 07 10:06:11 devstack sudo[97162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:06:11 devstack cinder-volume[87515]: DEBUG oslo_service.periodic_task [None req-cebd6a9d-3073-42a1-b65a-b38d444d85ed None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87515) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 10:06:11 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-cebd6a9d-3073-42a1-b65a-b38d444d85ed None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:06:11 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-cebd6a9d-3073-42a1-b65a-b38d444d85ed None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:06:11 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-cebd6a9d-3073-42a1-b65a-b38d444d85ed None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:06:11 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-cebd6a9d-3073-42a1-b65a-b38d444d85ed None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:06:11 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-cebd6a9d-3073-42a1-b65a-b38d444d85ed None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:06:11 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-cebd6a9d-3073-42a1-b65a-b38d444d85ed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:06:11 devstack sudo[97164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a Sep 07 10:06:11 devstack sudo[97164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:06:11 devstack sudo[97162]: pam_unix(sudo:session): session closed for user root Sep 07 10:06:11 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-d8701e7f-f34a-4d27-9e59-a5aea955545b tempest-VolumesSnapshotTestJSON-2041623630 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-83501d97-cadf-4b50-accf-2e0e4c885d58.8c29601d-d10a-4fcf-aa70-cc33fb387cb8" returned: 0 in 0.533s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:06:11 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-d8701e7f-f34a-4d27-9e59-a5aea955545b tempest-VolumesSnapshotTestJSON-2041623630 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-83501d97-cadf-4b50-accf-2e0e4c885d58(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87515) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 10:06:11 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[87bd6851-87d3-474f-9928-9e34c023b94a]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:06:11 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-d8701e7f-f34a-4d27-9e59-a5aea955545b tempest-VolumesSnapshotTestJSON-2041623630 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-83501d97-cadf-4b50-accf-2e0e4c885d58 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:06:12 devstack sudo[97169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-83501d97-cadf-4b50-accf-2e0e4c885d58 Sep 07 10:06:12 devstack sudo[97169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:06:12 devstack sudo[97164]: pam_unix(sudo:session): session closed for user root Sep 07 10:06:12 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-cebd6a9d-3073-42a1-b65a-b38d444d85ed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a" returned: 0 in 0.576s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:06:12 devstack cinder-volume[87515]: DEBUG cinder.manager [None req-cebd6a9d-3073-42a1-b65a-b38d444d85ed None None] Notifying Schedulers of capabilities ... {{(pid=87515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:06:12 devstack cinder-volume[87515]: DEBUG oslo_service.periodic_task [None req-cebd6a9d-3073-42a1-b65a-b38d444d85ed None None] Running periodic task VolumeManager._thread_info {{(pid=87515) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 10:06:12 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-cebd6a9d-3073-42a1-b65a-b38d444d85ed None None] thread count: 28 {{(pid=87515) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 07 10:06:12 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-cebd6a9d-3073-42a1-b65a-b38d444d85ed None None] thread info: [<_MainThread(MainThread, started 131647121809536)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87515) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 07 10:06:12 devstack sudo[97169]: pam_unix(sudo:session): session closed for user root Sep 07 10:06:12 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-d8701e7f-f34a-4d27-9e59-a5aea955545b tempest-VolumesSnapshotTestJSON-2041623630 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-83501d97-cadf-4b50-accf-2e0e4c885d58" returned: 0 in 0.712s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:06:12 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-d8701e7f-f34a-4d27-9e59-a5aea955545b tempest-VolumesSnapshotTestJSON-2041623630 None] will copy from snapshot at /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-83501d97-cadf-4b50-accf-2e0e4c885d58 {{(pid=87515) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 07 10:06:12 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-d8701e7f-f34a-4d27-9e59-a5aea955545b tempest-VolumesSnapshotTestJSON-2041623630 None] Creating direct copy from snapshot {{(pid=87515) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 07 10:06:12 devstack cinder-volume[87515]: DEBUG cinder.utils [None req-d8701e7f-f34a-4d27-9e59-a5aea955545b tempest-VolumesSnapshotTestJSON-2041623630 None] Path /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-56737883-d237-49e5-8555-415207a93efe not found in is_blk_device check {{(pid=87515) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 07 10:06:12 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-d8701e7f-f34a-4d27-9e59-a5aea955545b tempest-VolumesSnapshotTestJSON-2041623630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-83501d97-cadf-4b50-accf-2e0e4c885d58 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-56737883-d237-49e5-8555-415207a93efe {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:06:12 devstack sudo[97178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-83501d97-cadf-4b50-accf-2e0e4c885d58 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-56737883-d237-49e5-8555-415207a93efe Sep 07 10:06:12 devstack sudo[97178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:06:13 devstack cinder-volume[87515]: DEBUG dbcounter [-] [87515] Writing DB stats cinder:UPDATE=86,cinder:SELECT=94,cinder:INSERT=21,cinder:DELETE=4 {{(pid=87515) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 10:06:13 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [req-9811b34a-3195-4943-a667-44ac008f073f req-b8aeb7e9-8a09-45cd-a617-6d8c39c54908 tempest-AttachVolumeNegativeTest-1630918730 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:06:19 devstack sudo[97178]: pam_unix(sudo:session): session closed for user root Sep 07 10:06:19 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-d8701e7f-f34a-4d27-9e59-a5aea955545b tempest-VolumesSnapshotTestJSON-2041623630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-83501d97-cadf-4b50-accf-2e0e4c885d58 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-56737883-d237-49e5-8555-415207a93efe" returned: 0 in 7.312s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:06:19 devstack cinder-volume[87515]: DEBUG cinder.image.image_utils [None req-d8701e7f-f34a-4d27-9e59-a5aea955545b tempest-VolumesSnapshotTestJSON-2041623630 None] Image conversion details: src /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-83501d97-cadf-4b50-accf-2e0e4c885d58, size 1024.00 MB, duration 7.31 sec, destination /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-56737883-d237-49e5-8555-415207a93efe {{(pid=87515) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 07 10:06:19 devstack cinder-volume[87515]: INFO cinder.image.image_utils [None req-d8701e7f-f34a-4d27-9e59-a5aea955545b tempest-VolumesSnapshotTestJSON-2041623630 None] Converted 1024.00 MB image at 140.02 MB/s Sep 07 10:06:19 devstack cinder-volume[87515]: WARNING cinder.volume.drivers.remotefs [None req-d8701e7f-f34a-4d27-9e59-a5aea955545b tempest-VolumesSnapshotTestJSON-2041623630 None] /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-56737883-d237-49e5-8555-415207a93efe is being set with open permissions: ugo+rw Sep 07 10:06:19 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-d8701e7f-f34a-4d27-9e59-a5aea955545b tempest-VolumesSnapshotTestJSON-2041623630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-56737883-d237-49e5-8555-415207a93efe {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:06:19 devstack sudo[97239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-56737883-d237-49e5-8555-415207a93efe Sep 07 10:06:19 devstack sudo[97239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:06:20 devstack cinder-volume[87515]: DEBUG cinder.volume.flows.manager.create_volume [None req-ccc78d6a-4e3e-4464-818f-afd2b6b7479d tempest-VolumesSnapshotListTestJSON-237454856 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 10:06:20 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-ccc78d6a-4e3e-4464-818f-afd2b6b7479d tempest-VolumesSnapshotListTestJSON-237454856 None] Flow 'volume_create_manager' (677bea1f-05e2-4c92-92f6-36a78c481047) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:06:20 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-ccc78d6a-4e3e-4464-818f-afd2b6b7479d tempest-VolumesSnapshotListTestJSON-237454856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f90bd023-01c0-4060-b720-45132a482a99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:06:20 devstack cinder-volume[87515]: DEBUG dbcounter [-] [87515] Writing DB stats cinder:SELECT=73,cinder:UPDATE=75,cinder:INSERT=18,cinder:DELETE=10 {{(pid=87515) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 10:06:20 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-ccc78d6a-4e3e-4464-818f-afd2b6b7479d tempest-VolumesSnapshotListTestJSON-237454856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f90bd023-01c0-4060-b720-45132a482a99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:06:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-2008082533',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3092285-7fd4-4c05-bbbe-f98719cf7261,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='691d68c9c6204347a6525efa36a25b51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:06:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:06:20Z,use_quota=True,user_id='6e48ad964bfe44349ce91a8cc1092ed6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3a092cd-7947-4cbf-abff-4ba9567becf0),volume_type_id=f3a092cd-7947-4cbf-abff-4ba9567becf0)' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:06:20 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-ccc78d6a-4e3e-4464-818f-afd2b6b7479d tempest-VolumesSnapshotListTestJSON-237454856 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a213c28d-e327-4f50-bcd6-5b29420a003b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:06:20 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-ccc78d6a-4e3e-4464-818f-afd2b6b7479d tempest-VolumesSnapshotListTestJSON-237454856 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a213c28d-e327-4f50-bcd6-5b29420a003b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:06:20 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-ccc78d6a-4e3e-4464-818f-afd2b6b7479d tempest-VolumesSnapshotListTestJSON-237454856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f71349cb-7c3c-4fb4-8d3a-837701cf4866) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:06:20 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-ccc78d6a-4e3e-4464-818f-afd2b6b7479d tempest-VolumesSnapshotListTestJSON-237454856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f71349cb-7c3c-4fb4-8d3a-837701cf4866) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd3092285-7fd4-4c05-bbbe-f98719cf7261', 'volume_name': 'volume-d3092285-7fd4-4c05-bbbe-f98719cf7261', 'volume_size': 1}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:06:20 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-ccc78d6a-4e3e-4464-818f-afd2b6b7479d tempest-VolumesSnapshotListTestJSON-237454856 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b631370c-20e8-4d6c-9f5d-efe491945d77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:06:20 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-ccc78d6a-4e3e-4464-818f-afd2b6b7479d tempest-VolumesSnapshotListTestJSON-237454856 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b631370c-20e8-4d6c-9f5d-efe491945d77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:06:20 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-ccc78d6a-4e3e-4464-818f-afd2b6b7479d tempest-VolumesSnapshotListTestJSON-237454856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (278cc869-28ce-405f-99d8-a4d6c7e0f9af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:06:20 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-ccc78d6a-4e3e-4464-818f-afd2b6b7479d tempest-VolumesSnapshotListTestJSON-237454856 None] Volume d3092285-7fd4-4c05-bbbe-f98719cf7261: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d3092285-7fd4-4c05-bbbe-f98719cf7261', 'volume_size': 1} Sep 07 10:06:20 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-ccc78d6a-4e3e-4464-818f-afd2b6b7479d tempest-VolumesSnapshotListTestJSON-237454856 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:06:20 devstack sudo[97239]: pam_unix(sudo:session): session closed for user root Sep 07 10:06:20 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-d8701e7f-f34a-4d27-9e59-a5aea955545b tempest-VolumesSnapshotTestJSON-2041623630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-56737883-d237-49e5-8555-415207a93efe" returned: 0 in 0.263s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:06:20 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-d8701e7f-f34a-4d27-9e59-a5aea955545b tempest-VolumesSnapshotTestJSON-2041623630 None] Lock "cinder-quobyte-56737883-d237-49e5-8555-415207a93efe" released by "_copy_volume_from_snapshot" :: held 8.995s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:06:20 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-d8701e7f-f34a-4d27-9e59-a5aea955545b tempest-VolumesSnapshotTestJSON-2041623630 None] Lock "cinder-quobyte-8c29601d-d10a-4fcf-aa70-cc33fb387cb8-56737883-d237-49e5-8555-415207a93efe" released by "_create_volume_from_snapshot" :: held 9.089s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:06:20 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-d8701e7f-f34a-4d27-9e59-a5aea955545b tempest-VolumesSnapshotTestJSON-2041623630 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.140s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:06:20 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [req-9811b34a-3195-4943-a667-44ac008f073f req-b8aeb7e9-8a09-45cd-a617-6d8c39c54908 tempest-AttachVolumeNegativeTest-1630918730 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 6.998s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:06:20 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [req-9811b34a-3195-4943-a667-44ac008f073f req-b8aeb7e9-8a09-45cd-a617-6d8c39c54908 tempest-AttachVolumeNegativeTest-1630918730 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.025s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:06:20 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-ccc78d6a-4e3e-4464-818f-afd2b6b7479d tempest-VolumesSnapshotListTestJSON-237454856 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.147s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:06:20 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-ccc78d6a-4e3e-4464-818f-afd2b6b7479d tempest-VolumesSnapshotListTestJSON-237454856 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:06:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-2008082533',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3092285-7fd4-4c05-bbbe-f98719cf7261,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='691d68c9c6204347a6525efa36a25b51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:06:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:06:20Z,use_quota=True,user_id='6e48ad964bfe44349ce91a8cc1092ed6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3a092cd-7947-4cbf-abff-4ba9567becf0),volume_type_id=f3a092cd-7947-4cbf-abff-4ba9567becf0)}" {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 10:06:20 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-ccc78d6a-4e3e-4464-818f-afd2b6b7479d tempest-VolumesSnapshotListTestJSON-237454856 None] Creating volume d3092285-7fd4-4c05-bbbe-f98719cf7261 {{(pid=87515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 10:06:20 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-ccc78d6a-4e3e-4464-818f-afd2b6b7479d tempest-VolumesSnapshotListTestJSON-237454856 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:06:20 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-ccc78d6a-4e3e-4464-818f-afd2b6b7479d tempest-VolumesSnapshotListTestJSON-237454856 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:06:20 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-ccc78d6a-4e3e-4464-818f-afd2b6b7479d tempest-VolumesSnapshotListTestJSON-237454856 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:06:20 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-ccc78d6a-4e3e-4464-818f-afd2b6b7479d tempest-VolumesSnapshotListTestJSON-237454856 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:06:20 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-ccc78d6a-4e3e-4464-818f-afd2b6b7479d tempest-VolumesSnapshotListTestJSON-237454856 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:06:20 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-ccc78d6a-4e3e-4464-818f-afd2b6b7479d tempest-VolumesSnapshotListTestJSON-237454856 None] Selected osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c as target Quobyte volume. {{(pid=87515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 10:06:20 devstack cinder-volume[87515]: INFO cinder.volume.drivers.remotefs [None req-ccc78d6a-4e3e-4464-818f-afd2b6b7479d tempest-VolumesSnapshotListTestJSON-237454856 None] casted to osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c Sep 07 10:06:20 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-ccc78d6a-4e3e-4464-818f-afd2b6b7479d tempest-VolumesSnapshotListTestJSON-237454856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-d3092285-7fd4-4c05-bbbe-f98719cf7261 1073741824 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:06:20 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-d8701e7f-f34a-4d27-9e59-a5aea955545b tempest-VolumesSnapshotTestJSON-2041623630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e7b0332-689a-4715-9abc-86ce31c81a8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-56737883-d237-49e5-8555-415207a93efe', 'volume_size': 1, 'snapshot_id': '8c29601d-d10a-4fcf-aa70-cc33fb387cb8'}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:06:20 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-d8701e7f-f34a-4d27-9e59-a5aea955545b tempest-VolumesSnapshotTestJSON-2041623630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1990f1d-2600-493e-a7e6-d8ab16d22fb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:06:20 devstack sudo[97242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-d3092285-7fd4-4c05-bbbe-f98719cf7261 1073741824 Sep 07 10:06:20 devstack sudo[97242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:06:20 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-d8701e7f-f34a-4d27-9e59-a5aea955545b tempest-VolumesSnapshotTestJSON-2041623630 None] Volume volume-56737883-d237-49e5-8555-415207a93efe (56737883-d237-49e5-8555-415207a93efe): created successfully Sep 07 10:06:20 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-d8701e7f-f34a-4d27-9e59-a5aea955545b tempest-VolumesSnapshotTestJSON-2041623630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1990f1d-2600-493e-a7e6-d8ab16d22fb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:06:20 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-d8701e7f-f34a-4d27-9e59-a5aea955545b tempest-VolumesSnapshotTestJSON-2041623630 None] Flow 'volume_create_manager' (352e2cba-4243-4236-9ed4-b26a9d4c833e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:06:20 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [req-9811b34a-3195-4943-a667-44ac008f073f req-b8aeb7e9-8a09-45cd-a617-6d8c39c54908 tempest-AttachVolumeNegativeTest-1630918730 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c', 'name': 'volume-125b18c2-9526-4da4-8de4-2b69a6f14715', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '80f32a1e-ee1e-43f6-a706-a22d8525bd73', 'enforce_multipath': True} {{(pid=87515) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 07 10:06:20 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-d8701e7f-f34a-4d27-9e59-a5aea955545b tempest-VolumesSnapshotTestJSON-2041623630 None] Created volume successfully. Sep 07 10:06:20 devstack cinder-volume[87515]: INFO cinder.volume.manager [req-9811b34a-3195-4943-a667-44ac008f073f req-b8aeb7e9-8a09-45cd-a617-6d8c39c54908 tempest-AttachVolumeNegativeTest-1630918730 None] attachment_update completed successfully. Sep 07 10:06:20 devstack sudo[97242]: pam_unix(sudo:session): session closed for user root Sep 07 10:06:20 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-ccc78d6a-4e3e-4464-818f-afd2b6b7479d tempest-VolumesSnapshotListTestJSON-237454856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-d3092285-7fd4-4c05-bbbe-f98719cf7261 1073741824" returned: 0 in 0.472s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:06:20 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-ccc78d6a-4e3e-4464-818f-afd2b6b7479d tempest-VolumesSnapshotListTestJSON-237454856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-d3092285-7fd4-4c05-bbbe-f98719cf7261 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:06:20 devstack sudo[97630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-d3092285-7fd4-4c05-bbbe-f98719cf7261 Sep 07 10:06:20 devstack sudo[97630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:06:21 devstack sudo[97630]: pam_unix(sudo:session): session closed for user root Sep 07 10:06:21 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-ccc78d6a-4e3e-4464-818f-afd2b6b7479d tempest-VolumesSnapshotListTestJSON-237454856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-d3092285-7fd4-4c05-bbbe-f98719cf7261" returned: 0 in 0.385s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:06:21 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-ccc78d6a-4e3e-4464-818f-afd2b6b7479d tempest-VolumesSnapshotListTestJSON-237454856 None] <== create_volume: return (902ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'} {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 10:06:21 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-ccc78d6a-4e3e-4464-818f-afd2b6b7479d tempest-VolumesSnapshotListTestJSON-237454856 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.904s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:06:21 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-ccc78d6a-4e3e-4464-818f-afd2b6b7479d tempest-VolumesSnapshotListTestJSON-237454856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (278cc869-28ce-405f-99d8-a4d6c7e0f9af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d3092285-7fd4-4c05-bbbe-f98719cf7261', 'volume_size': 1}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:06:21 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-ccc78d6a-4e3e-4464-818f-afd2b6b7479d tempest-VolumesSnapshotListTestJSON-237454856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97d80dbd-8699-4253-92d8-02bbae46de87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:06:21 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-4de15477-24a0-4e9c-a4d4-12e60a15c523 tempest-VolumesSnapshotTestJSON-2041623630 None] Acquiring lock "cinder-56737883-d237-49e5-8555-415207a93efe-delete_volume" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:06:21 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-ccc78d6a-4e3e-4464-818f-afd2b6b7479d tempest-VolumesSnapshotListTestJSON-237454856 None] Volume volume-d3092285-7fd4-4c05-bbbe-f98719cf7261 (d3092285-7fd4-4c05-bbbe-f98719cf7261): created successfully Sep 07 10:06:21 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-ccc78d6a-4e3e-4464-818f-afd2b6b7479d tempest-VolumesSnapshotListTestJSON-237454856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97d80dbd-8699-4253-92d8-02bbae46de87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:06:21 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-ccc78d6a-4e3e-4464-818f-afd2b6b7479d tempest-VolumesSnapshotListTestJSON-237454856 None] Flow 'volume_create_manager' (677bea1f-05e2-4c92-92f6-36a78c481047) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:06:21 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-4de15477-24a0-4e9c-a4d4-12e60a15c523 tempest-VolumesSnapshotTestJSON-2041623630 None] Lock "cinder-56737883-d237-49e5-8555-415207a93efe-delete_volume" acquired by "delete_volume" :: waited 0.060s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:06:21 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-ccc78d6a-4e3e-4464-818f-afd2b6b7479d tempest-VolumesSnapshotListTestJSON-237454856 None] Created volume successfully. Sep 07 10:06:21 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-4de15477-24a0-4e9c-a4d4-12e60a15c523 tempest-VolumesSnapshotTestJSON-2041623630 None] Acquiring lock "cinder-quobyte-56737883-d237-49e5-8555-415207a93efe" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:06:21 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-4de15477-24a0-4e9c-a4d4-12e60a15c523 tempest-VolumesSnapshotTestJSON-2041623630 None] Lock "cinder-quobyte-56737883-d237-49e5-8555-415207a93efe" acquired by "delete_volume" :: waited 0.027s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:06:21 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3185439-93e0-4af8-a8b9-06fb001a7741]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:06:21 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-4de15477-24a0-4e9c-a4d4-12e60a15c523 tempest-VolumesSnapshotTestJSON-2041623630 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-56737883-d237-49e5-8555-415207a93efe {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:06:21 devstack sudo[97633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-56737883-d237-49e5-8555-415207a93efe Sep 07 10:06:21 devstack sudo[97633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:06:21 devstack sudo[97633]: pam_unix(sudo:session): session closed for user root Sep 07 10:06:21 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-4de15477-24a0-4e9c-a4d4-12e60a15c523 tempest-VolumesSnapshotTestJSON-2041623630 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-56737883-d237-49e5-8555-415207a93efe" returned: 0 in 0.400s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:06:21 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-4de15477-24a0-4e9c-a4d4-12e60a15c523 tempest-VolumesSnapshotTestJSON-2041623630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-56737883-d237-49e5-8555-415207a93efe {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:06:21 devstack sudo[97638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-56737883-d237-49e5-8555-415207a93efe Sep 07 10:06:21 devstack sudo[97638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:06:22 devstack sudo[97638]: pam_unix(sudo:session): session closed for user root Sep 07 10:06:22 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-4de15477-24a0-4e9c-a4d4-12e60a15c523 tempest-VolumesSnapshotTestJSON-2041623630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-56737883-d237-49e5-8555-415207a93efe" returned: 0 in 0.253s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:06:22 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-4de15477-24a0-4e9c-a4d4-12e60a15c523 tempest-VolumesSnapshotTestJSON-2041623630 None] Lock "cinder-quobyte-56737883-d237-49e5-8555-415207a93efe" released by "delete_volume" :: held 0.727s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:06:22 devstack cinder-volume[87515]: DEBUG cinder.quota [None req-4de15477-24a0-4e9c-a4d4-12e60a15c523 tempest-VolumesSnapshotTestJSON-2041623630 None] Created reservations ['65bb8e89-f715-43f7-acf9-ec59dcb06d35', 'df7ebe9e-63c0-499b-ba12-d18b92a86f62', '1c5d422b-c862-483f-84a1-adb98b28c747', '99c695a6-786d-4726-b8c7-cdc635b5963a'] {{(pid=87515) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:06:22 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-4de15477-24a0-4e9c-a4d4-12e60a15c523 tempest-VolumesSnapshotTestJSON-2041623630 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:06:22 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-4de15477-24a0-4e9c-a4d4-12e60a15c523 tempest-VolumesSnapshotTestJSON-2041623630 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:06:22 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-4de15477-24a0-4e9c-a4d4-12e60a15c523 tempest-VolumesSnapshotTestJSON-2041623630 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:06:22 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-4de15477-24a0-4e9c-a4d4-12e60a15c523 tempest-VolumesSnapshotTestJSON-2041623630 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:06:22 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-4de15477-24a0-4e9c-a4d4-12e60a15c523 tempest-VolumesSnapshotTestJSON-2041623630 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:06:22 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-4de15477-24a0-4e9c-a4d4-12e60a15c523 tempest-VolumesSnapshotTestJSON-2041623630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:06:22 devstack sudo[97643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a Sep 07 10:06:22 devstack sudo[97643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:06:22 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-bc12bf1c-4825-46e3-ae97-77965facdba2 tempest-VolumesSnapshotTestJSON-2041623630 None] Acquiring lock "cinder-8c29601d-d10a-4fcf-aa70-cc33fb387cb8-delete_snapshot" by "delete_snapshot" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:06:22 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-f54f6263-3882-491f-8650-da86600e84ac tempest-VolumesSnapshotListTestJSON-237454856 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:06:22 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-f54f6263-3882-491f-8650-da86600e84ac tempest-VolumesSnapshotListTestJSON-237454856 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:06:22 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-bc12bf1c-4825-46e3-ae97-77965facdba2 tempest-VolumesSnapshotTestJSON-2041623630 None] Lock "cinder-8c29601d-d10a-4fcf-aa70-cc33fb387cb8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.078s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:06:22 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-bc12bf1c-4825-46e3-ae97-77965facdba2 tempest-VolumesSnapshotTestJSON-2041623630 None] Acquiring lock "cinder-quobyte-83501d97-cadf-4b50-accf-2e0e4c885d58" by "delete_snapshot" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:06:22 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-f54f6263-3882-491f-8650-da86600e84ac tempest-VolumesSnapshotListTestJSON-237454856 None] Creating offline snapshot 37ea6c69-4d85-42c4-975e-14ebd6829a81 of volume d3092285-7fd4-4c05-bbbe-f98719cf7261 {{(pid=87515) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 10:06:22 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-bc12bf1c-4825-46e3-ae97-77965facdba2 tempest-VolumesSnapshotTestJSON-2041623630 None] Lock "cinder-quobyte-83501d97-cadf-4b50-accf-2e0e4c885d58" acquired by "delete_snapshot" :: waited 0.068s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:06:22 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-bc12bf1c-4825-46e3-ae97-77965facdba2 tempest-VolumesSnapshotTestJSON-2041623630 None] Acquiring lock "cinder-quobyte-8c29601d-d10a-4fcf-aa70-cc33fb387cb8" by "_delete_snapshot" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:06:22 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c17181f-a737-472c-94cf-d5ce8ec9ff6c]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:06:22 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-f54f6263-3882-491f-8650-da86600e84ac tempest-VolumesSnapshotListTestJSON-237454856 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-d3092285-7fd4-4c05-bbbe-f98719cf7261 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:06:22 devstack sudo[97643]: pam_unix(sudo:session): session closed for user root Sep 07 10:06:22 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-bc12bf1c-4825-46e3-ae97-77965facdba2 tempest-VolumesSnapshotTestJSON-2041623630 None] Lock "cinder-quobyte-8c29601d-d10a-4fcf-aa70-cc33fb387cb8" acquired by "_delete_snapshot" :: waited 0.057s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:06:22 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-bc12bf1c-4825-46e3-ae97-77965facdba2 tempest-VolumesSnapshotTestJSON-2041623630 None] Deleting offline snapshot 8c29601d-d10a-4fcf-aa70-cc33fb387cb8 of volume 83501d97-cadf-4b50-accf-2e0e4c885d58 {{(pid=87515) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 10:06:22 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-bc12bf1c-4825-46e3-ae97-77965facdba2 tempest-VolumesSnapshotTestJSON-2041623630 None] snapshot_file for this snap is: volume-83501d97-cadf-4b50-accf-2e0e4c885d58.8c29601d-d10a-4fcf-aa70-cc33fb387cb8 {{(pid=87515) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 10:06:22 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-4de15477-24a0-4e9c-a4d4-12e60a15c523 tempest-VolumesSnapshotTestJSON-2041623630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a" returned: 0 in 0.678s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:06:22 devstack cinder-volume[87515]: DEBUG cinder.manager [None req-4de15477-24a0-4e9c-a4d4-12e60a15c523 tempest-VolumesSnapshotTestJSON-2041623630 None] Notifying Schedulers of capabilities ... {{(pid=87515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:06:22 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e429c27-1d5e-465f-ac46-05b8977bdcf2]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:06:22 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-4de15477-24a0-4e9c-a4d4-12e60a15c523 tempest-VolumesSnapshotTestJSON-2041623630 None] Deleted volume successfully. Sep 07 10:06:22 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-bc12bf1c-4825-46e3-ae97-77965facdba2 tempest-VolumesSnapshotTestJSON-2041623630 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-83501d97-cadf-4b50-accf-2e0e4c885d58.8c29601d-d10a-4fcf-aa70-cc33fb387cb8 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:06:23 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-4de15477-24a0-4e9c-a4d4-12e60a15c523 tempest-VolumesSnapshotTestJSON-2041623630 None] Lock "cinder-56737883-d237-49e5-8555-415207a93efe-delete_volume" released by "delete_volume" :: held 1.745s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:06:23 devstack sudo[97669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-d3092285-7fd4-4c05-bbbe-f98719cf7261 Sep 07 10:06:23 devstack sudo[97669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:06:23 devstack sudo[97670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-83501d97-cadf-4b50-accf-2e0e4c885d58.8c29601d-d10a-4fcf-aa70-cc33fb387cb8 Sep 07 10:06:23 devstack sudo[97670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:06:23 devstack cinder-volume[87515]: INFO cinder.volume.manager [req-3e7fefef-3ba1-49a9-b7a7-d8f532ca7a0c req-add59862-e8ae-42a6-b600-b973daf72dc3 tempest-AttachVolumeNegativeTest-1630918730 None] Terminate volume connection completed successfully. Sep 07 10:06:23 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [req-3e7fefef-3ba1-49a9-b7a7-d8f532ca7a0c req-add59862-e8ae-42a6-b600-b973daf72dc3 tempest-AttachVolumeNegativeTest-1630918730 None] Deleting attachment 80f32a1e-ee1e-43f6-a706-a22d8525bd73. {{(pid=87515) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 07 10:06:23 devstack sudo[97669]: pam_unix(sudo:session): session closed for user root Sep 07 10:06:23 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-f54f6263-3882-491f-8650-da86600e84ac tempest-VolumesSnapshotListTestJSON-237454856 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-d3092285-7fd4-4c05-bbbe-f98719cf7261" returned: 0 in 0.488s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:06:23 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-f54f6263-3882-491f-8650-da86600e84ac tempest-VolumesSnapshotListTestJSON-237454856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-d3092285-7fd4-4c05-bbbe-f98719cf7261,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-d3092285-7fd4-4c05-bbbe-f98719cf7261.37ea6c69-4d85-42c4-975e-14ebd6829a81 1G {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:06:23 devstack sudo[97703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-d3092285-7fd4-4c05-bbbe-f98719cf7261,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-d3092285-7fd4-4c05-bbbe-f98719cf7261.37ea6c69-4d85-42c4-975e-14ebd6829a81 1G Sep 07 10:06:23 devstack sudo[97703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:06:23 devstack sudo[97670]: pam_unix(sudo:session): session closed for user root Sep 07 10:06:23 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-bc12bf1c-4825-46e3-ae97-77965facdba2 tempest-VolumesSnapshotTestJSON-2041623630 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-83501d97-cadf-4b50-accf-2e0e4c885d58.8c29601d-d10a-4fcf-aa70-cc33fb387cb8" returned: 0 in 0.500s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:06:23 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-bc12bf1c-4825-46e3-ae97-77965facdba2 tempest-VolumesSnapshotTestJSON-2041623630 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-83501d97-cadf-4b50-accf-2e0e4c885d58(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87515) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 10:06:23 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e28d483-d51c-4056-8b01-ce54639bb392]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:06:23 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-bc12bf1c-4825-46e3-ae97-77965facdba2 tempest-VolumesSnapshotTestJSON-2041623630 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-83501d97-cadf-4b50-accf-2e0e4c885d58 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:06:23 devstack sudo[97707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-83501d97-cadf-4b50-accf-2e0e4c885d58 Sep 07 10:06:23 devstack sudo[97707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:06:23 devstack sudo[97703]: pam_unix(sudo:session): session closed for user root Sep 07 10:06:23 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-f54f6263-3882-491f-8650-da86600e84ac tempest-VolumesSnapshotListTestJSON-237454856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-d3092285-7fd4-4c05-bbbe-f98719cf7261,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-d3092285-7fd4-4c05-bbbe-f98719cf7261.37ea6c69-4d85-42c4-975e-14ebd6829a81 1G" returned: 0 in 0.429s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:06:23 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-f54f6263-3882-491f-8650-da86600e84ac tempest-VolumesSnapshotListTestJSON-237454856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d3092285-7fd4-4c05-bbbe-f98719cf7261 -F qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-d3092285-7fd4-4c05-bbbe-f98719cf7261.37ea6c69-4d85-42c4-975e-14ebd6829a81 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:06:23 devstack sudo[97713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d3092285-7fd4-4c05-bbbe-f98719cf7261 -F qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-d3092285-7fd4-4c05-bbbe-f98719cf7261.37ea6c69-4d85-42c4-975e-14ebd6829a81 Sep 07 10:06:23 devstack sudo[97713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:06:24 devstack sudo[97707]: pam_unix(sudo:session): session closed for user root Sep 07 10:06:24 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-bc12bf1c-4825-46e3-ae97-77965facdba2 tempest-VolumesSnapshotTestJSON-2041623630 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-83501d97-cadf-4b50-accf-2e0e4c885d58" returned: 0 in 0.575s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:06:24 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-bc12bf1c-4825-46e3-ae97-77965facdba2 tempest-VolumesSnapshotTestJSON-2041623630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-83501d97-cadf-4b50-accf-2e0e4c885d58.8c29601d-d10a-4fcf-aa70-cc33fb387cb8 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:06:24 devstack sudo[97721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-83501d97-cadf-4b50-accf-2e0e4c885d58.8c29601d-d10a-4fcf-aa70-cc33fb387cb8 Sep 07 10:06:24 devstack sudo[97721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:06:24 devstack sudo[97713]: pam_unix(sudo:session): session closed for user root Sep 07 10:06:24 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-f54f6263-3882-491f-8650-da86600e84ac tempest-VolumesSnapshotListTestJSON-237454856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d3092285-7fd4-4c05-bbbe-f98719cf7261 -F qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-d3092285-7fd4-4c05-bbbe-f98719cf7261.37ea6c69-4d85-42c4-975e-14ebd6829a81" returned: 0 in 0.332s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:06:24 devstack cinder-volume[87515]: WARNING cinder.volume.drivers.remotefs [None req-f54f6263-3882-491f-8650-da86600e84ac tempest-VolumesSnapshotListTestJSON-237454856 None] /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-d3092285-7fd4-4c05-bbbe-f98719cf7261.37ea6c69-4d85-42c4-975e-14ebd6829a81 is being set with open permissions: ugo+rw Sep 07 10:06:24 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-f54f6263-3882-491f-8650-da86600e84ac tempest-VolumesSnapshotListTestJSON-237454856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-d3092285-7fd4-4c05-bbbe-f98719cf7261.37ea6c69-4d85-42c4-975e-14ebd6829a81 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:06:24 devstack sudo[97723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-d3092285-7fd4-4c05-bbbe-f98719cf7261.37ea6c69-4d85-42c4-975e-14ebd6829a81 Sep 07 10:06:24 devstack sudo[97723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:06:24 devstack sudo[97723]: pam_unix(sudo:session): session closed for user root Sep 07 10:06:24 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-f54f6263-3882-491f-8650-da86600e84ac tempest-VolumesSnapshotListTestJSON-237454856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-d3092285-7fd4-4c05-bbbe-f98719cf7261.37ea6c69-4d85-42c4-975e-14ebd6829a81" returned: 0 in 0.307s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:06:24 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-f54f6263-3882-491f-8650-da86600e84ac tempest-VolumesSnapshotListTestJSON-237454856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-d3092285-7fd4-4c05-bbbe-f98719cf7261.info {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:06:24 devstack sudo[97729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-d3092285-7fd4-4c05-bbbe-f98719cf7261.info Sep 07 10:06:24 devstack sudo[97729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:06:24 devstack sudo[97721]: pam_unix(sudo:session): session closed for user root Sep 07 10:06:24 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-bc12bf1c-4825-46e3-ae97-77965facdba2 tempest-VolumesSnapshotTestJSON-2041623630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-83501d97-cadf-4b50-accf-2e0e4c885d58.8c29601d-d10a-4fcf-aa70-cc33fb387cb8" returned: 0 in 0.474s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:06:24 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-bc12bf1c-4825-46e3-ae97-77965facdba2 tempest-VolumesSnapshotTestJSON-2041623630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-83501d97-cadf-4b50-accf-2e0e4c885d58.8c29601d-d10a-4fcf-aa70-cc33fb387cb8 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:06:24 devstack sudo[97735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-83501d97-cadf-4b50-accf-2e0e4c885d58.8c29601d-d10a-4fcf-aa70-cc33fb387cb8 Sep 07 10:06:24 devstack sudo[97735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:06:24 devstack sudo[97729]: pam_unix(sudo:session): session closed for user root Sep 07 10:06:24 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-f54f6263-3882-491f-8650-da86600e84ac tempest-VolumesSnapshotListTestJSON-237454856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-d3092285-7fd4-4c05-bbbe-f98719cf7261.info" returned: 0 in 0.479s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:06:24 devstack cinder-volume[87515]: WARNING cinder.volume.drivers.remotefs [None req-f54f6263-3882-491f-8650-da86600e84ac tempest-VolumesSnapshotListTestJSON-237454856 None] /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-d3092285-7fd4-4c05-bbbe-f98719cf7261.info is being set with open permissions: ugo+rw Sep 07 10:06:24 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-f54f6263-3882-491f-8650-da86600e84ac tempest-VolumesSnapshotListTestJSON-237454856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-d3092285-7fd4-4c05-bbbe-f98719cf7261.info {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:06:25 devstack sudo[97754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-d3092285-7fd4-4c05-bbbe-f98719cf7261.info Sep 07 10:06:25 devstack sudo[97754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:06:25 devstack sudo[97735]: pam_unix(sudo:session): session closed for user root Sep 07 10:06:25 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-bc12bf1c-4825-46e3-ae97-77965facdba2 tempest-VolumesSnapshotTestJSON-2041623630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-83501d97-cadf-4b50-accf-2e0e4c885d58.8c29601d-d10a-4fcf-aa70-cc33fb387cb8" returned: 0 in 0.446s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:06:25 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-bc12bf1c-4825-46e3-ae97-77965facdba2 tempest-VolumesSnapshotTestJSON-2041623630 None] Lock "cinder-quobyte-8c29601d-d10a-4fcf-aa70-cc33fb387cb8" released by "_delete_snapshot" :: held 2.173s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:06:25 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-bc12bf1c-4825-46e3-ae97-77965facdba2 tempest-VolumesSnapshotTestJSON-2041623630 None] Lock "cinder-quobyte-83501d97-cadf-4b50-accf-2e0e4c885d58" released by "delete_snapshot" :: held 2.245s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:06:25 devstack cinder-volume[87515]: DEBUG cinder.quota [None req-bc12bf1c-4825-46e3-ae97-77965facdba2 tempest-VolumesSnapshotTestJSON-2041623630 None] Created reservations ['d30577b3-178a-4bd2-833b-c6602acc9769', '8edb152d-8ef1-4af1-aae8-7233382a2340', '70fc71f2-dbd5-466d-8c13-04ba07d29146', 'e04d7341-0c6a-495f-a51f-1f4e8f92238f'] {{(pid=87515) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:06:25 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-bc12bf1c-4825-46e3-ae97-77965facdba2 tempest-VolumesSnapshotTestJSON-2041623630 None] Delete snapshot completed successfully. Sep 07 10:06:25 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-bc12bf1c-4825-46e3-ae97-77965facdba2 tempest-VolumesSnapshotTestJSON-2041623630 None] Lock "cinder-8c29601d-d10a-4fcf-aa70-cc33fb387cb8-delete_snapshot" released by "delete_snapshot" :: held 2.471s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:06:25 devstack sudo[97754]: pam_unix(sudo:session): session closed for user root Sep 07 10:06:25 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-f54f6263-3882-491f-8650-da86600e84ac tempest-VolumesSnapshotListTestJSON-237454856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-d3092285-7fd4-4c05-bbbe-f98719cf7261.info" returned: 0 in 0.325s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:06:25 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-f54f6263-3882-491f-8650-da86600e84ac tempest-VolumesSnapshotListTestJSON-237454856 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.549s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:06:25 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-f54f6263-3882-491f-8650-da86600e84ac tempest-VolumesSnapshotListTestJSON-237454856 None] Create snapshot completed successfully Sep 07 10:06:26 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-a8424574-abac-4290-b701-389fe5575802 tempest-VolumesSnapshotTestJSON-2041623630 None] Acquiring lock "cinder-83501d97-cadf-4b50-accf-2e0e4c885d58-delete_volume" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:06:26 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-a8424574-abac-4290-b701-389fe5575802 tempest-VolumesSnapshotTestJSON-2041623630 None] Lock "cinder-83501d97-cadf-4b50-accf-2e0e4c885d58-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:06:26 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-a8424574-abac-4290-b701-389fe5575802 tempest-VolumesSnapshotTestJSON-2041623630 None] Acquiring lock "cinder-quobyte-83501d97-cadf-4b50-accf-2e0e4c885d58" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:06:26 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-a8424574-abac-4290-b701-389fe5575802 tempest-VolumesSnapshotTestJSON-2041623630 None] Lock "cinder-quobyte-83501d97-cadf-4b50-accf-2e0e4c885d58" acquired by "delete_volume" :: waited 0.019s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:06:26 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8a3a5e8-b821-4cbd-9819-7f9162498305]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:06:26 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-a8424574-abac-4290-b701-389fe5575802 tempest-VolumesSnapshotTestJSON-2041623630 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-83501d97-cadf-4b50-accf-2e0e4c885d58 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:06:26 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-a0181c56-583c-42cc-8e86-ec8c7e2f72a7 tempest-VolumesSnapshotListTestJSON-237454856 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:06:26 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-a0181c56-583c-42cc-8e86-ec8c7e2f72a7 tempest-VolumesSnapshotListTestJSON-237454856 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:06:26 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-a0181c56-583c-42cc-8e86-ec8c7e2f72a7 tempest-VolumesSnapshotListTestJSON-237454856 None] Creating offline snapshot 35d4083a-3faa-4302-96f3-bebbc9beb4e3 of volume d3092285-7fd4-4c05-bbbe-f98719cf7261 {{(pid=87515) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 10:06:26 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[b248b8d2-13d9-4f95-8d60-23f260538ae3]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:06:26 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-a0181c56-583c-42cc-8e86-ec8c7e2f72a7 tempest-VolumesSnapshotListTestJSON-237454856 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-d3092285-7fd4-4c05-bbbe-f98719cf7261.37ea6c69-4d85-42c4-975e-14ebd6829a81 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:06:26 devstack sudo[97762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-83501d97-cadf-4b50-accf-2e0e4c885d58 Sep 07 10:06:26 devstack sudo[97762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:06:26 devstack sudo[97764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-d3092285-7fd4-4c05-bbbe-f98719cf7261.37ea6c69-4d85-42c4-975e-14ebd6829a81 Sep 07 10:06:26 devstack sudo[97764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:06:26 devstack sudo[97762]: pam_unix(sudo:session): session closed for user root Sep 07 10:06:26 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-a8424574-abac-4290-b701-389fe5575802 tempest-VolumesSnapshotTestJSON-2041623630 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-83501d97-cadf-4b50-accf-2e0e4c885d58" returned: 0 in 0.438s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:06:26 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-a8424574-abac-4290-b701-389fe5575802 tempest-VolumesSnapshotTestJSON-2041623630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-83501d97-cadf-4b50-accf-2e0e4c885d58 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:06:26 devstack sudo[97769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-83501d97-cadf-4b50-accf-2e0e4c885d58 Sep 07 10:06:26 devstack sudo[97769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:06:26 devstack sudo[97764]: pam_unix(sudo:session): session closed for user root Sep 07 10:06:26 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-a0181c56-583c-42cc-8e86-ec8c7e2f72a7 tempest-VolumesSnapshotListTestJSON-237454856 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-d3092285-7fd4-4c05-bbbe-f98719cf7261.37ea6c69-4d85-42c4-975e-14ebd6829a81" returned: 0 in 0.402s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:06:26 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-a0181c56-583c-42cc-8e86-ec8c7e2f72a7 tempest-VolumesSnapshotListTestJSON-237454856 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d3092285-7fd4-4c05-bbbe-f98719cf7261(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87515) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 10:06:26 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-a0181c56-583c-42cc-8e86-ec8c7e2f72a7 tempest-VolumesSnapshotListTestJSON-237454856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-d3092285-7fd4-4c05-bbbe-f98719cf7261.37ea6c69-4d85-42c4-975e-14ebd6829a81,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-d3092285-7fd4-4c05-bbbe-f98719cf7261.35d4083a-3faa-4302-96f3-bebbc9beb4e3 1G {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:06:26 devstack sudo[97774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-d3092285-7fd4-4c05-bbbe-f98719cf7261.37ea6c69-4d85-42c4-975e-14ebd6829a81,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-d3092285-7fd4-4c05-bbbe-f98719cf7261.35d4083a-3faa-4302-96f3-bebbc9beb4e3 1G Sep 07 10:06:26 devstack sudo[97774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:06:26 devstack sudo[97769]: pam_unix(sudo:session): session closed for user root Sep 07 10:06:26 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-a8424574-abac-4290-b701-389fe5575802 tempest-VolumesSnapshotTestJSON-2041623630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-83501d97-cadf-4b50-accf-2e0e4c885d58" returned: 0 in 0.267s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:06:27 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-a8424574-abac-4290-b701-389fe5575802 tempest-VolumesSnapshotTestJSON-2041623630 None] Lock "cinder-quobyte-83501d97-cadf-4b50-accf-2e0e4c885d58" released by "delete_volume" :: held 0.820s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:06:27 devstack cinder-volume[87515]: DEBUG cinder.quota [None req-a8424574-abac-4290-b701-389fe5575802 tempest-VolumesSnapshotTestJSON-2041623630 None] Created reservations ['8d3bed78-1bb0-4153-bdb4-6c89ec5f2294', 'cff1376f-a31d-4258-b00f-a0d81c0c7443', 'fd05ddbf-6b25-45dc-a718-2476076bb216', '9fc19629-4856-47de-ae19-46589f7016b7'] {{(pid=87515) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:06:27 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-a8424574-abac-4290-b701-389fe5575802 tempest-VolumesSnapshotTestJSON-2041623630 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:06:27 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-a8424574-abac-4290-b701-389fe5575802 tempest-VolumesSnapshotTestJSON-2041623630 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:06:27 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-a8424574-abac-4290-b701-389fe5575802 tempest-VolumesSnapshotTestJSON-2041623630 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:06:27 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-a8424574-abac-4290-b701-389fe5575802 tempest-VolumesSnapshotTestJSON-2041623630 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:06:27 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-a8424574-abac-4290-b701-389fe5575802 tempest-VolumesSnapshotTestJSON-2041623630 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:06:27 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-a8424574-abac-4290-b701-389fe5575802 tempest-VolumesSnapshotTestJSON-2041623630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:06:27 devstack sudo[97780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a Sep 07 10:06:27 devstack sudo[97780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:06:27 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-cca7ee11-628c-4be4-8056-bca4b35f5f52 tempest-VolumesSnapshotTestJSON-2041623630 None] Acquiring lock "cinder-745a4758-26ab-429e-9009-55e8b0d24ad0-delete_volume" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:06:27 devstack sudo[97774]: pam_unix(sudo:session): session closed for user root Sep 07 10:06:27 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-a0181c56-583c-42cc-8e86-ec8c7e2f72a7 tempest-VolumesSnapshotListTestJSON-237454856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-d3092285-7fd4-4c05-bbbe-f98719cf7261.37ea6c69-4d85-42c4-975e-14ebd6829a81,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-d3092285-7fd4-4c05-bbbe-f98719cf7261.35d4083a-3faa-4302-96f3-bebbc9beb4e3 1G" returned: 0 in 0.633s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:06:27 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-a0181c56-583c-42cc-8e86-ec8c7e2f72a7 tempest-VolumesSnapshotListTestJSON-237454856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d3092285-7fd4-4c05-bbbe-f98719cf7261.37ea6c69-4d85-42c4-975e-14ebd6829a81 -F qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-d3092285-7fd4-4c05-bbbe-f98719cf7261.35d4083a-3faa-4302-96f3-bebbc9beb4e3 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:06:27 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-cca7ee11-628c-4be4-8056-bca4b35f5f52 tempest-VolumesSnapshotTestJSON-2041623630 None] Lock "cinder-745a4758-26ab-429e-9009-55e8b0d24ad0-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:06:27 devstack sudo[97782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d3092285-7fd4-4c05-bbbe-f98719cf7261.37ea6c69-4d85-42c4-975e-14ebd6829a81 -F qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-d3092285-7fd4-4c05-bbbe-f98719cf7261.35d4083a-3faa-4302-96f3-bebbc9beb4e3 Sep 07 10:06:27 devstack sudo[97782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:06:27 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-cca7ee11-628c-4be4-8056-bca4b35f5f52 tempest-VolumesSnapshotTestJSON-2041623630 None] Acquiring lock "cinder-quobyte-745a4758-26ab-429e-9009-55e8b0d24ad0" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:06:27 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-cca7ee11-628c-4be4-8056-bca4b35f5f52 tempest-VolumesSnapshotTestJSON-2041623630 None] Lock "cinder-quobyte-745a4758-26ab-429e-9009-55e8b0d24ad0" acquired by "delete_volume" :: waited 0.025s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:06:27 devstack sudo[97780]: pam_unix(sudo:session): session closed for user root Sep 07 10:06:27 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-a8424574-abac-4290-b701-389fe5575802 tempest-VolumesSnapshotTestJSON-2041623630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a" returned: 0 in 0.390s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:06:27 devstack cinder-volume[87515]: DEBUG cinder.manager [None req-a8424574-abac-4290-b701-389fe5575802 tempest-VolumesSnapshotTestJSON-2041623630 None] Notifying Schedulers of capabilities ... {{(pid=87515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:06:27 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-a8424574-abac-4290-b701-389fe5575802 tempest-VolumesSnapshotTestJSON-2041623630 None] Deleted volume successfully. Sep 07 10:06:27 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9a8352f-c808-4d97-822a-89250cafabb7]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:06:27 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-cca7ee11-628c-4be4-8056-bca4b35f5f52 tempest-VolumesSnapshotTestJSON-2041623630 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-745a4758-26ab-429e-9009-55e8b0d24ad0 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:06:27 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-a8424574-abac-4290-b701-389fe5575802 tempest-VolumesSnapshotTestJSON-2041623630 None] Lock "cinder-83501d97-cadf-4b50-accf-2e0e4c885d58-delete_volume" released by "delete_volume" :: held 1.539s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:06:27 devstack sudo[97785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-745a4758-26ab-429e-9009-55e8b0d24ad0 Sep 07 10:06:27 devstack sudo[97785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:06:27 devstack sudo[97782]: pam_unix(sudo:session): session closed for user root Sep 07 10:06:27 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-a0181c56-583c-42cc-8e86-ec8c7e2f72a7 tempest-VolumesSnapshotListTestJSON-237454856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d3092285-7fd4-4c05-bbbe-f98719cf7261.37ea6c69-4d85-42c4-975e-14ebd6829a81 -F qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-d3092285-7fd4-4c05-bbbe-f98719cf7261.35d4083a-3faa-4302-96f3-bebbc9beb4e3" returned: 0 in 0.355s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:06:27 devstack cinder-volume[87515]: WARNING cinder.volume.drivers.remotefs [None req-a0181c56-583c-42cc-8e86-ec8c7e2f72a7 tempest-VolumesSnapshotListTestJSON-237454856 None] /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-d3092285-7fd4-4c05-bbbe-f98719cf7261.35d4083a-3faa-4302-96f3-bebbc9beb4e3 is being set with open permissions: ugo+rw Sep 07 10:06:27 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-a0181c56-583c-42cc-8e86-ec8c7e2f72a7 tempest-VolumesSnapshotListTestJSON-237454856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-d3092285-7fd4-4c05-bbbe-f98719cf7261.35d4083a-3faa-4302-96f3-bebbc9beb4e3 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:06:27 devstack sudo[97791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-d3092285-7fd4-4c05-bbbe-f98719cf7261.35d4083a-3faa-4302-96f3-bebbc9beb4e3 Sep 07 10:06:27 devstack sudo[97791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:06:28 devstack sudo[97785]: pam_unix(sudo:session): session closed for user root Sep 07 10:06:28 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-cca7ee11-628c-4be4-8056-bca4b35f5f52 tempest-VolumesSnapshotTestJSON-2041623630 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-745a4758-26ab-429e-9009-55e8b0d24ad0" returned: 0 in 0.401s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:06:28 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-cca7ee11-628c-4be4-8056-bca4b35f5f52 tempest-VolumesSnapshotTestJSON-2041623630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-745a4758-26ab-429e-9009-55e8b0d24ad0 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:06:28 devstack sudo[97796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-745a4758-26ab-429e-9009-55e8b0d24ad0 Sep 07 10:06:28 devstack sudo[97796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:06:28 devstack sudo[97791]: pam_unix(sudo:session): session closed for user root Sep 07 10:06:28 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-a0181c56-583c-42cc-8e86-ec8c7e2f72a7 tempest-VolumesSnapshotListTestJSON-237454856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-d3092285-7fd4-4c05-bbbe-f98719cf7261.35d4083a-3faa-4302-96f3-bebbc9beb4e3" returned: 0 in 0.286s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:06:28 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-a0181c56-583c-42cc-8e86-ec8c7e2f72a7 tempest-VolumesSnapshotListTestJSON-237454856 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.788s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:06:28 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-7fffe1fb-9137-4973-8b55-cb028f7859fe tempest-AttachVolumeNegativeTest-1630918730 None] Acquiring lock "cinder-125b18c2-9526-4da4-8de4-2b69a6f14715-delete_volume" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:06:28 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-a0181c56-583c-42cc-8e86-ec8c7e2f72a7 tempest-VolumesSnapshotListTestJSON-237454856 None] Create snapshot completed successfully Sep 07 10:06:28 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-7fffe1fb-9137-4973-8b55-cb028f7859fe tempest-AttachVolumeNegativeTest-1630918730 None] Lock "cinder-125b18c2-9526-4da4-8de4-2b69a6f14715-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:06:28 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-7fffe1fb-9137-4973-8b55-cb028f7859fe tempest-AttachVolumeNegativeTest-1630918730 None] Acquiring lock "cinder-quobyte-125b18c2-9526-4da4-8de4-2b69a6f14715" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:06:28 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-7fffe1fb-9137-4973-8b55-cb028f7859fe tempest-AttachVolumeNegativeTest-1630918730 None] Lock "cinder-quobyte-125b18c2-9526-4da4-8de4-2b69a6f14715" acquired by "delete_volume" :: waited 0.016s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:06:28 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f81e51e-d032-4169-8deb-380f39357907]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:06:28 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-7fffe1fb-9137-4973-8b55-cb028f7859fe tempest-AttachVolumeNegativeTest-1630918730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-125b18c2-9526-4da4-8de4-2b69a6f14715 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:06:28 devstack sudo[97796]: pam_unix(sudo:session): session closed for user root Sep 07 10:06:28 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-cca7ee11-628c-4be4-8056-bca4b35f5f52 tempest-VolumesSnapshotTestJSON-2041623630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-745a4758-26ab-429e-9009-55e8b0d24ad0" returned: 0 in 0.269s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:06:28 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-cca7ee11-628c-4be4-8056-bca4b35f5f52 tempest-VolumesSnapshotTestJSON-2041623630 None] Lock "cinder-quobyte-745a4758-26ab-429e-9009-55e8b0d24ad0" released by "delete_volume" :: held 0.743s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:06:28 devstack cinder-volume[87515]: DEBUG cinder.quota [None req-cca7ee11-628c-4be4-8056-bca4b35f5f52 tempest-VolumesSnapshotTestJSON-2041623630 None] Created reservations ['c21ed9ff-ad7d-48c0-808c-5089b3df6ce0', '5ac03845-1545-458a-b614-d4cf8f6cb6ea', '6d457225-4736-4c6f-9585-8fef68dc5f3e', 'a1886123-8537-4626-944b-4414d50ccbc6'] {{(pid=87515) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:06:28 devstack sudo[97800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-125b18c2-9526-4da4-8de4-2b69a6f14715 Sep 07 10:06:28 devstack sudo[97800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:06:28 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-cca7ee11-628c-4be4-8056-bca4b35f5f52 tempest-VolumesSnapshotTestJSON-2041623630 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:06:28 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-cca7ee11-628c-4be4-8056-bca4b35f5f52 tempest-VolumesSnapshotTestJSON-2041623630 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:06:28 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-cca7ee11-628c-4be4-8056-bca4b35f5f52 tempest-VolumesSnapshotTestJSON-2041623630 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:06:28 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-cca7ee11-628c-4be4-8056-bca4b35f5f52 tempest-VolumesSnapshotTestJSON-2041623630 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:06:28 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-cca7ee11-628c-4be4-8056-bca4b35f5f52 tempest-VolumesSnapshotTestJSON-2041623630 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:06:28 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-cca7ee11-628c-4be4-8056-bca4b35f5f52 tempest-VolumesSnapshotTestJSON-2041623630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:06:28 devstack sudo[97802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a Sep 07 10:06:28 devstack sudo[97802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:06:28 devstack sudo[97800]: pam_unix(sudo:session): session closed for user root Sep 07 10:06:28 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-7fffe1fb-9137-4973-8b55-cb028f7859fe tempest-AttachVolumeNegativeTest-1630918730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-125b18c2-9526-4da4-8de4-2b69a6f14715" returned: 0 in 0.480s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:06:28 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-7fffe1fb-9137-4973-8b55-cb028f7859fe tempest-AttachVolumeNegativeTest-1630918730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-125b18c2-9526-4da4-8de4-2b69a6f14715 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:06:28 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-de35db2c-f824-4400-9afd-741d005a97fb tempest-VolumesSnapshotListTestJSON-237454856 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:06:28 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-de35db2c-f824-4400-9afd-741d005a97fb tempest-VolumesSnapshotListTestJSON-237454856 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:06:28 devstack sudo[97808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-125b18c2-9526-4da4-8de4-2b69a6f14715 Sep 07 10:06:28 devstack sudo[97808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:06:28 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-de35db2c-f824-4400-9afd-741d005a97fb tempest-VolumesSnapshotListTestJSON-237454856 None] Creating offline snapshot 89a3a9a4-cbf5-44b5-976a-fb85b3384c82 of volume d3092285-7fd4-4c05-bbbe-f98719cf7261 {{(pid=87515) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 10:06:28 devstack sudo[97802]: pam_unix(sudo:session): session closed for user root Sep 07 10:06:28 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-cca7ee11-628c-4be4-8056-bca4b35f5f52 tempest-VolumesSnapshotTestJSON-2041623630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a" returned: 0 in 0.413s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:06:28 devstack cinder-volume[87515]: DEBUG cinder.manager [None req-cca7ee11-628c-4be4-8056-bca4b35f5f52 tempest-VolumesSnapshotTestJSON-2041623630 None] Notifying Schedulers of capabilities ... {{(pid=87515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:06:28 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-cca7ee11-628c-4be4-8056-bca4b35f5f52 tempest-VolumesSnapshotTestJSON-2041623630 None] Deleted volume successfully. Sep 07 10:06:28 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[6444aa78-b7e9-49a9-8b62-0cb7ad403ad1]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:06:28 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-de35db2c-f824-4400-9afd-741d005a97fb tempest-VolumesSnapshotListTestJSON-237454856 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-d3092285-7fd4-4c05-bbbe-f98719cf7261.35d4083a-3faa-4302-96f3-bebbc9beb4e3 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:06:28 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-cca7ee11-628c-4be4-8056-bca4b35f5f52 tempest-VolumesSnapshotTestJSON-2041623630 None] Lock "cinder-745a4758-26ab-429e-9009-55e8b0d24ad0-delete_volume" released by "delete_volume" :: held 1.438s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:06:29 devstack sudo[97811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-d3092285-7fd4-4c05-bbbe-f98719cf7261.35d4083a-3faa-4302-96f3-bebbc9beb4e3 Sep 07 10:06:29 devstack sudo[97811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:06:29 devstack sudo[97808]: pam_unix(sudo:session): session closed for user root Sep 07 10:06:29 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-7fffe1fb-9137-4973-8b55-cb028f7859fe tempest-AttachVolumeNegativeTest-1630918730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-125b18c2-9526-4da4-8de4-2b69a6f14715" returned: 0 in 0.336s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:06:29 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-7fffe1fb-9137-4973-8b55-cb028f7859fe tempest-AttachVolumeNegativeTest-1630918730 None] Lock "cinder-quobyte-125b18c2-9526-4da4-8de4-2b69a6f14715" released by "delete_volume" :: held 0.867s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:06:29 devstack cinder-volume[87515]: DEBUG cinder.quota [None req-7fffe1fb-9137-4973-8b55-cb028f7859fe tempest-AttachVolumeNegativeTest-1630918730 None] Created reservations ['76730a89-3ef0-4d8c-bc1e-199c47c91dfe', 'e5b1cbf4-10a8-401a-a1fa-fb95d06dfa68', 'db6c6f58-4e7f-4bc0-a8f6-9094251e1506', 'a99b8913-fa31-4339-a16c-5894eab3cebd'] {{(pid=87515) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:06:29 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-7fffe1fb-9137-4973-8b55-cb028f7859fe tempest-AttachVolumeNegativeTest-1630918730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:06:29 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-7fffe1fb-9137-4973-8b55-cb028f7859fe tempest-AttachVolumeNegativeTest-1630918730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:06:29 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-7fffe1fb-9137-4973-8b55-cb028f7859fe tempest-AttachVolumeNegativeTest-1630918730 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:06:29 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-7fffe1fb-9137-4973-8b55-cb028f7859fe tempest-AttachVolumeNegativeTest-1630918730 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:06:29 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-7fffe1fb-9137-4973-8b55-cb028f7859fe tempest-AttachVolumeNegativeTest-1630918730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:06:29 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-7fffe1fb-9137-4973-8b55-cb028f7859fe tempest-AttachVolumeNegativeTest-1630918730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:06:29 devstack sudo[97816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a Sep 07 10:06:29 devstack sudo[97816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:06:29 devstack sudo[97811]: pam_unix(sudo:session): session closed for user root Sep 07 10:06:29 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-de35db2c-f824-4400-9afd-741d005a97fb tempest-VolumesSnapshotListTestJSON-237454856 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-d3092285-7fd4-4c05-bbbe-f98719cf7261.35d4083a-3faa-4302-96f3-bebbc9beb4e3" returned: 0 in 0.559s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:06:29 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-de35db2c-f824-4400-9afd-741d005a97fb tempest-VolumesSnapshotListTestJSON-237454856 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d3092285-7fd4-4c05-bbbe-f98719cf7261(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87515) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 10:06:29 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-de35db2c-f824-4400-9afd-741d005a97fb tempest-VolumesSnapshotListTestJSON-237454856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-d3092285-7fd4-4c05-bbbe-f98719cf7261.35d4083a-3faa-4302-96f3-bebbc9beb4e3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-d3092285-7fd4-4c05-bbbe-f98719cf7261.89a3a9a4-cbf5-44b5-976a-fb85b3384c82 1G {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:06:29 devstack sudo[97819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-d3092285-7fd4-4c05-bbbe-f98719cf7261.35d4083a-3faa-4302-96f3-bebbc9beb4e3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-d3092285-7fd4-4c05-bbbe-f98719cf7261.89a3a9a4-cbf5-44b5-976a-fb85b3384c82 1G Sep 07 10:06:29 devstack sudo[97819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:06:29 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-6c2e1f6d-0591-4a44-96f5-3747b03a98a0 tempest-AttachVolumeNegativeTest-1630918730 None] Acquiring lock "cinder-9fc23352-9691-48be-9bb8-7def7491c408-delete_volume" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:06:29 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-6c2e1f6d-0591-4a44-96f5-3747b03a98a0 tempest-AttachVolumeNegativeTest-1630918730 None] Lock "cinder-9fc23352-9691-48be-9bb8-7def7491c408-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:06:29 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-6c2e1f6d-0591-4a44-96f5-3747b03a98a0 tempest-AttachVolumeNegativeTest-1630918730 None] Acquiring lock "cinder-quobyte-9fc23352-9691-48be-9bb8-7def7491c408" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:06:29 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-6c2e1f6d-0591-4a44-96f5-3747b03a98a0 tempest-AttachVolumeNegativeTest-1630918730 None] Lock "cinder-quobyte-9fc23352-9691-48be-9bb8-7def7491c408" acquired by "delete_volume" :: waited 0.021s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:06:29 devstack sudo[97816]: pam_unix(sudo:session): session closed for user root Sep 07 10:06:29 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-7fffe1fb-9137-4973-8b55-cb028f7859fe tempest-AttachVolumeNegativeTest-1630918730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a" returned: 0 in 0.416s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:06:29 devstack cinder-volume[87515]: DEBUG cinder.manager [None req-7fffe1fb-9137-4973-8b55-cb028f7859fe tempest-AttachVolumeNegativeTest-1630918730 None] Notifying Schedulers of capabilities ... {{(pid=87515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:06:29 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[77dfe629-328c-4b50-a1c0-55fbe5cfcefb]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:06:29 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-6c2e1f6d-0591-4a44-96f5-3747b03a98a0 tempest-AttachVolumeNegativeTest-1630918730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-9fc23352-9691-48be-9bb8-7def7491c408 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:06:29 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-7fffe1fb-9137-4973-8b55-cb028f7859fe tempest-AttachVolumeNegativeTest-1630918730 None] Deleted volume successfully. Sep 07 10:06:29 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-7fffe1fb-9137-4973-8b55-cb028f7859fe tempest-AttachVolumeNegativeTest-1630918730 None] Lock "cinder-125b18c2-9526-4da4-8de4-2b69a6f14715-delete_volume" released by "delete_volume" :: held 1.616s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:06:29 devstack sudo[97822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-9fc23352-9691-48be-9bb8-7def7491c408 Sep 07 10:06:29 devstack sudo[97822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:06:30 devstack sudo[97819]: pam_unix(sudo:session): session closed for user root Sep 07 10:06:30 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-de35db2c-f824-4400-9afd-741d005a97fb tempest-VolumesSnapshotListTestJSON-237454856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-d3092285-7fd4-4c05-bbbe-f98719cf7261.35d4083a-3faa-4302-96f3-bebbc9beb4e3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-d3092285-7fd4-4c05-bbbe-f98719cf7261.89a3a9a4-cbf5-44b5-976a-fb85b3384c82 1G" returned: 0 in 0.613s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:06:30 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-de35db2c-f824-4400-9afd-741d005a97fb tempest-VolumesSnapshotListTestJSON-237454856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d3092285-7fd4-4c05-bbbe-f98719cf7261.35d4083a-3faa-4302-96f3-bebbc9beb4e3 -F qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-d3092285-7fd4-4c05-bbbe-f98719cf7261.89a3a9a4-cbf5-44b5-976a-fb85b3384c82 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:06:30 devstack sudo[97827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d3092285-7fd4-4c05-bbbe-f98719cf7261.35d4083a-3faa-4302-96f3-bebbc9beb4e3 -F qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-d3092285-7fd4-4c05-bbbe-f98719cf7261.89a3a9a4-cbf5-44b5-976a-fb85b3384c82 Sep 07 10:06:30 devstack sudo[97827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:06:30 devstack sudo[97822]: pam_unix(sudo:session): session closed for user root Sep 07 10:06:30 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-6c2e1f6d-0591-4a44-96f5-3747b03a98a0 tempest-AttachVolumeNegativeTest-1630918730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-9fc23352-9691-48be-9bb8-7def7491c408" returned: 0 in 0.486s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:06:30 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-6c2e1f6d-0591-4a44-96f5-3747b03a98a0 tempest-AttachVolumeNegativeTest-1630918730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-9fc23352-9691-48be-9bb8-7def7491c408 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:06:30 devstack sudo[97832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-9fc23352-9691-48be-9bb8-7def7491c408 Sep 07 10:06:30 devstack sudo[97832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:06:30 devstack sudo[97827]: pam_unix(sudo:session): session closed for user root Sep 07 10:06:30 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-de35db2c-f824-4400-9afd-741d005a97fb tempest-VolumesSnapshotListTestJSON-237454856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d3092285-7fd4-4c05-bbbe-f98719cf7261.35d4083a-3faa-4302-96f3-bebbc9beb4e3 -F qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-d3092285-7fd4-4c05-bbbe-f98719cf7261.89a3a9a4-cbf5-44b5-976a-fb85b3384c82" returned: 0 in 0.379s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:06:30 devstack cinder-volume[87515]: WARNING cinder.volume.drivers.remotefs [None req-de35db2c-f824-4400-9afd-741d005a97fb tempest-VolumesSnapshotListTestJSON-237454856 None] /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-d3092285-7fd4-4c05-bbbe-f98719cf7261.89a3a9a4-cbf5-44b5-976a-fb85b3384c82 is being set with open permissions: ugo+rw Sep 07 10:06:30 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-de35db2c-f824-4400-9afd-741d005a97fb tempest-VolumesSnapshotListTestJSON-237454856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-d3092285-7fd4-4c05-bbbe-f98719cf7261.89a3a9a4-cbf5-44b5-976a-fb85b3384c82 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:06:30 devstack sudo[97838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-d3092285-7fd4-4c05-bbbe-f98719cf7261.89a3a9a4-cbf5-44b5-976a-fb85b3384c82 Sep 07 10:06:30 devstack sudo[97838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:06:30 devstack sudo[97832]: pam_unix(sudo:session): session closed for user root Sep 07 10:06:30 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-6c2e1f6d-0591-4a44-96f5-3747b03a98a0 tempest-AttachVolumeNegativeTest-1630918730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-9fc23352-9691-48be-9bb8-7def7491c408" returned: 0 in 0.283s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:06:30 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-6c2e1f6d-0591-4a44-96f5-3747b03a98a0 tempest-AttachVolumeNegativeTest-1630918730 None] Lock "cinder-quobyte-9fc23352-9691-48be-9bb8-7def7491c408" released by "delete_volume" :: held 0.845s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:06:30 devstack cinder-volume[87515]: DEBUG cinder.quota [None req-6c2e1f6d-0591-4a44-96f5-3747b03a98a0 tempest-AttachVolumeNegativeTest-1630918730 None] Created reservations ['cf9d2514-e42a-424f-9244-105b3e89bc99', '720360fb-d38c-4069-adff-db11ed65263b', 'befbdaeb-a3f2-4217-8330-86ffa357c923', '517a6424-adeb-488e-a8c5-816fa3fe9b6e'] {{(pid=87515) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:06:30 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-6c2e1f6d-0591-4a44-96f5-3747b03a98a0 tempest-AttachVolumeNegativeTest-1630918730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:06:30 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-6c2e1f6d-0591-4a44-96f5-3747b03a98a0 tempest-AttachVolumeNegativeTest-1630918730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:06:30 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-6c2e1f6d-0591-4a44-96f5-3747b03a98a0 tempest-AttachVolumeNegativeTest-1630918730 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:06:30 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-6c2e1f6d-0591-4a44-96f5-3747b03a98a0 tempest-AttachVolumeNegativeTest-1630918730 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:06:30 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-6c2e1f6d-0591-4a44-96f5-3747b03a98a0 tempest-AttachVolumeNegativeTest-1630918730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:06:30 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-6c2e1f6d-0591-4a44-96f5-3747b03a98a0 tempest-AttachVolumeNegativeTest-1630918730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:06:30 devstack sudo[97842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a Sep 07 10:06:30 devstack sudo[97842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:06:30 devstack sudo[97838]: pam_unix(sudo:session): session closed for user root Sep 07 10:06:30 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-de35db2c-f824-4400-9afd-741d005a97fb tempest-VolumesSnapshotListTestJSON-237454856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-d3092285-7fd4-4c05-bbbe-f98719cf7261.89a3a9a4-cbf5-44b5-976a-fb85b3384c82" returned: 0 in 0.333s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:06:30 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-de35db2c-f824-4400-9afd-741d005a97fb tempest-VolumesSnapshotListTestJSON-237454856 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.057s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:06:30 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-de35db2c-f824-4400-9afd-741d005a97fb tempest-VolumesSnapshotListTestJSON-237454856 None] Create snapshot completed successfully Sep 07 10:06:31 devstack sudo[97842]: pam_unix(sudo:session): session closed for user root Sep 07 10:06:31 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-6c2e1f6d-0591-4a44-96f5-3747b03a98a0 tempest-AttachVolumeNegativeTest-1630918730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a" returned: 0 in 0.349s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:06:31 devstack cinder-volume[87515]: DEBUG cinder.manager [None req-6c2e1f6d-0591-4a44-96f5-3747b03a98a0 tempest-AttachVolumeNegativeTest-1630918730 None] Notifying Schedulers of capabilities ... {{(pid=87515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:06:31 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-6c2e1f6d-0591-4a44-96f5-3747b03a98a0 tempest-AttachVolumeNegativeTest-1630918730 None] Deleted volume successfully. Sep 07 10:06:31 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-6c2e1f6d-0591-4a44-96f5-3747b03a98a0 tempest-AttachVolumeNegativeTest-1630918730 None] Lock "cinder-9fc23352-9691-48be-9bb8-7def7491c408-delete_volume" released by "delete_volume" :: held 1.560s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:06:31 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-49e75b7e-8768-4900-a81a-66cb6fe20c14 tempest-AttachVolumeNegativeTest-1630918730 None] Acquiring lock "cinder-37707359-cff1-471c-af1d-41a5088f00b1-delete_volume" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:06:31 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-49e75b7e-8768-4900-a81a-66cb6fe20c14 tempest-AttachVolumeNegativeTest-1630918730 None] Lock "cinder-37707359-cff1-471c-af1d-41a5088f00b1-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:06:31 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-49e75b7e-8768-4900-a81a-66cb6fe20c14 tempest-AttachVolumeNegativeTest-1630918730 None] Acquiring lock "cinder-quobyte-37707359-cff1-471c-af1d-41a5088f00b1" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:06:31 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-49e75b7e-8768-4900-a81a-66cb6fe20c14 tempest-AttachVolumeNegativeTest-1630918730 None] Lock "cinder-quobyte-37707359-cff1-471c-af1d-41a5088f00b1" acquired by "delete_volume" :: waited 0.014s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:06:31 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[57241fc2-7f37-4b9f-96f4-a1908da5892b]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:06:31 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-49e75b7e-8768-4900-a81a-66cb6fe20c14 tempest-AttachVolumeNegativeTest-1630918730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-37707359-cff1-471c-af1d-41a5088f00b1 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:06:31 devstack sudo[97845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-37707359-cff1-471c-af1d-41a5088f00b1 Sep 07 10:06:31 devstack sudo[97845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:06:31 devstack sudo[97845]: pam_unix(sudo:session): session closed for user root Sep 07 10:06:31 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-49e75b7e-8768-4900-a81a-66cb6fe20c14 tempest-AttachVolumeNegativeTest-1630918730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-37707359-cff1-471c-af1d-41a5088f00b1" returned: 0 in 0.390s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:06:31 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-49e75b7e-8768-4900-a81a-66cb6fe20c14 tempest-AttachVolumeNegativeTest-1630918730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-37707359-cff1-471c-af1d-41a5088f00b1 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:06:31 devstack sudo[97850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-37707359-cff1-471c-af1d-41a5088f00b1 Sep 07 10:06:31 devstack sudo[97850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:06:31 devstack sudo[97850]: pam_unix(sudo:session): session closed for user root Sep 07 10:06:31 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-49e75b7e-8768-4900-a81a-66cb6fe20c14 tempest-AttachVolumeNegativeTest-1630918730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-37707359-cff1-471c-af1d-41a5088f00b1" returned: 0 in 0.251s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:06:31 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-49e75b7e-8768-4900-a81a-66cb6fe20c14 tempest-AttachVolumeNegativeTest-1630918730 None] Lock "cinder-quobyte-37707359-cff1-471c-af1d-41a5088f00b1" released by "delete_volume" :: held 0.684s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:06:31 devstack cinder-volume[87515]: DEBUG cinder.quota [None req-49e75b7e-8768-4900-a81a-66cb6fe20c14 tempest-AttachVolumeNegativeTest-1630918730 None] Created reservations ['9eb096f0-dcc7-48fd-8574-367f82eabc20', '82b39d1b-8ee0-4848-b2fa-46ae700e3286', '458dd2a4-f779-4edb-a473-8d98795638b4', '271b31ef-f114-40d5-bfff-4a7c243919f8'] {{(pid=87515) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:06:32 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-49e75b7e-8768-4900-a81a-66cb6fe20c14 tempest-AttachVolumeNegativeTest-1630918730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:06:32 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-49e75b7e-8768-4900-a81a-66cb6fe20c14 tempest-AttachVolumeNegativeTest-1630918730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:06:32 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-49e75b7e-8768-4900-a81a-66cb6fe20c14 tempest-AttachVolumeNegativeTest-1630918730 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:06:32 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-49e75b7e-8768-4900-a81a-66cb6fe20c14 tempest-AttachVolumeNegativeTest-1630918730 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:06:32 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-49e75b7e-8768-4900-a81a-66cb6fe20c14 tempest-AttachVolumeNegativeTest-1630918730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:06:32 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-49e75b7e-8768-4900-a81a-66cb6fe20c14 tempest-AttachVolumeNegativeTest-1630918730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:06:32 devstack sudo[97853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a Sep 07 10:06:32 devstack sudo[97853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:06:32 devstack sudo[97853]: pam_unix(sudo:session): session closed for user root Sep 07 10:06:32 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-49e75b7e-8768-4900-a81a-66cb6fe20c14 tempest-AttachVolumeNegativeTest-1630918730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a" returned: 0 in 0.269s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:06:32 devstack cinder-volume[87515]: DEBUG cinder.manager [None req-49e75b7e-8768-4900-a81a-66cb6fe20c14 tempest-AttachVolumeNegativeTest-1630918730 None] Notifying Schedulers of capabilities ... {{(pid=87515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:06:32 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-49e75b7e-8768-4900-a81a-66cb6fe20c14 tempest-AttachVolumeNegativeTest-1630918730 None] Deleted volume successfully. Sep 07 10:06:32 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-49e75b7e-8768-4900-a81a-66cb6fe20c14 tempest-AttachVolumeNegativeTest-1630918730 None] Lock "cinder-37707359-cff1-471c-af1d-41a5088f00b1-delete_volume" released by "delete_volume" :: held 1.172s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:06:33 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-db905f85-e870-4aa2-ba38-0d0843a43d66 tempest-VolumesSnapshotListTestJSON-237454856 None] Acquiring lock "cinder-89a3a9a4-cbf5-44b5-976a-fb85b3384c82-delete_snapshot" by "delete_snapshot" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:06:33 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-db905f85-e870-4aa2-ba38-0d0843a43d66 tempest-VolumesSnapshotListTestJSON-237454856 None] Lock "cinder-89a3a9a4-cbf5-44b5-976a-fb85b3384c82-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:06:33 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-db905f85-e870-4aa2-ba38-0d0843a43d66 tempest-VolumesSnapshotListTestJSON-237454856 None] Acquiring lock "cinder-quobyte-d3092285-7fd4-4c05-bbbe-f98719cf7261" by "delete_snapshot" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:06:33 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-db905f85-e870-4aa2-ba38-0d0843a43d66 tempest-VolumesSnapshotListTestJSON-237454856 None] Lock "cinder-quobyte-d3092285-7fd4-4c05-bbbe-f98719cf7261" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:06:33 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-db905f85-e870-4aa2-ba38-0d0843a43d66 tempest-VolumesSnapshotListTestJSON-237454856 None] Acquiring lock "cinder-quobyte-89a3a9a4-cbf5-44b5-976a-fb85b3384c82" by "_delete_snapshot" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:06:33 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-db905f85-e870-4aa2-ba38-0d0843a43d66 tempest-VolumesSnapshotListTestJSON-237454856 None] Lock "cinder-quobyte-89a3a9a4-cbf5-44b5-976a-fb85b3384c82" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:06:33 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-db905f85-e870-4aa2-ba38-0d0843a43d66 tempest-VolumesSnapshotListTestJSON-237454856 None] Deleting offline snapshot 89a3a9a4-cbf5-44b5-976a-fb85b3384c82 of volume d3092285-7fd4-4c05-bbbe-f98719cf7261 {{(pid=87515) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 10:06:33 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-db905f85-e870-4aa2-ba38-0d0843a43d66 tempest-VolumesSnapshotListTestJSON-237454856 None] snapshot_file for this snap is: volume-d3092285-7fd4-4c05-bbbe-f98719cf7261.89a3a9a4-cbf5-44b5-976a-fb85b3384c82 {{(pid=87515) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 10:06:33 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b4ed09b-ff42-4bae-8a2c-3019c242c925]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:06:33 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-db905f85-e870-4aa2-ba38-0d0843a43d66 tempest-VolumesSnapshotListTestJSON-237454856 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-d3092285-7fd4-4c05-bbbe-f98719cf7261.89a3a9a4-cbf5-44b5-976a-fb85b3384c82 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:06:33 devstack sudo[97856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-d3092285-7fd4-4c05-bbbe-f98719cf7261.89a3a9a4-cbf5-44b5-976a-fb85b3384c82 Sep 07 10:06:33 devstack sudo[97856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:06:33 devstack sudo[97856]: pam_unix(sudo:session): session closed for user root Sep 07 10:06:33 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-db905f85-e870-4aa2-ba38-0d0843a43d66 tempest-VolumesSnapshotListTestJSON-237454856 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-d3092285-7fd4-4c05-bbbe-f98719cf7261.89a3a9a4-cbf5-44b5-976a-fb85b3384c82" returned: 0 in 0.420s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:06:33 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-db905f85-e870-4aa2-ba38-0d0843a43d66 tempest-VolumesSnapshotListTestJSON-237454856 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d3092285-7fd4-4c05-bbbe-f98719cf7261(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87515) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 10:06:33 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cf03ea9-3189-4e59-bfb8-435dc204bf1e]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:06:33 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-db905f85-e870-4aa2-ba38-0d0843a43d66 tempest-VolumesSnapshotListTestJSON-237454856 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-d3092285-7fd4-4c05-bbbe-f98719cf7261.35d4083a-3faa-4302-96f3-bebbc9beb4e3 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:06:33 devstack sudo[97862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-d3092285-7fd4-4c05-bbbe-f98719cf7261.35d4083a-3faa-4302-96f3-bebbc9beb4e3 Sep 07 10:06:33 devstack sudo[97862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:06:34 devstack sudo[97862]: pam_unix(sudo:session): session closed for user root Sep 07 10:06:34 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-db905f85-e870-4aa2-ba38-0d0843a43d66 tempest-VolumesSnapshotListTestJSON-237454856 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-d3092285-7fd4-4c05-bbbe-f98719cf7261.35d4083a-3faa-4302-96f3-bebbc9beb4e3" returned: 0 in 0.416s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:06:34 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-db905f85-e870-4aa2-ba38-0d0843a43d66 tempest-VolumesSnapshotListTestJSON-237454856 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d3092285-7fd4-4c05-bbbe-f98719cf7261(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87515) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 10:06:34 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-db905f85-e870-4aa2-ba38-0d0843a43d66 tempest-VolumesSnapshotListTestJSON-237454856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-d3092285-7fd4-4c05-bbbe-f98719cf7261.89a3a9a4-cbf5-44b5-976a-fb85b3384c82 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:06:34 devstack sudo[97868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-d3092285-7fd4-4c05-bbbe-f98719cf7261.89a3a9a4-cbf5-44b5-976a-fb85b3384c82 Sep 07 10:06:34 devstack sudo[97868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:06:34 devstack sudo[97868]: pam_unix(sudo:session): session closed for user root Sep 07 10:06:34 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-db905f85-e870-4aa2-ba38-0d0843a43d66 tempest-VolumesSnapshotListTestJSON-237454856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-d3092285-7fd4-4c05-bbbe-f98719cf7261.89a3a9a4-cbf5-44b5-976a-fb85b3384c82" returned: 0 in 0.571s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:06:34 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-db905f85-e870-4aa2-ba38-0d0843a43d66 tempest-VolumesSnapshotListTestJSON-237454856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-d3092285-7fd4-4c05-bbbe-f98719cf7261.89a3a9a4-cbf5-44b5-976a-fb85b3384c82 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:06:34 devstack sudo[97875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-d3092285-7fd4-4c05-bbbe-f98719cf7261.89a3a9a4-cbf5-44b5-976a-fb85b3384c82 Sep 07 10:06:34 devstack sudo[97875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:06:35 devstack sudo[97875]: pam_unix(sudo:session): session closed for user root Sep 07 10:06:35 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-db905f85-e870-4aa2-ba38-0d0843a43d66 tempest-VolumesSnapshotListTestJSON-237454856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-d3092285-7fd4-4c05-bbbe-f98719cf7261.89a3a9a4-cbf5-44b5-976a-fb85b3384c82" returned: 0 in 0.382s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:06:35 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-db905f85-e870-4aa2-ba38-0d0843a43d66 tempest-VolumesSnapshotListTestJSON-237454856 None] Lock "cinder-quobyte-89a3a9a4-cbf5-44b5-976a-fb85b3384c82" released by "_delete_snapshot" :: held 1.944s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:06:35 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-db905f85-e870-4aa2-ba38-0d0843a43d66 tempest-VolumesSnapshotListTestJSON-237454856 None] Lock "cinder-quobyte-d3092285-7fd4-4c05-bbbe-f98719cf7261" released by "delete_snapshot" :: held 1.976s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:06:35 devstack cinder-volume[87515]: DEBUG cinder.quota [None req-db905f85-e870-4aa2-ba38-0d0843a43d66 tempest-VolumesSnapshotListTestJSON-237454856 None] Created reservations ['7b9a7685-2042-4fea-bb5d-2ca1f517d618', 'f98417ce-fe91-433f-91ce-f5e01c91bd9e', 'd0fc9a32-b99b-42f7-a376-ebf7cec7dc8c', '5cca2826-014f-45c5-8919-3b4e33887d40'] {{(pid=87515) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:06:35 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-db905f85-e870-4aa2-ba38-0d0843a43d66 tempest-VolumesSnapshotListTestJSON-237454856 None] Delete snapshot completed successfully. Sep 07 10:06:35 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-db905f85-e870-4aa2-ba38-0d0843a43d66 tempest-VolumesSnapshotListTestJSON-237454856 None] Lock "cinder-89a3a9a4-cbf5-44b5-976a-fb85b3384c82-delete_snapshot" released by "delete_snapshot" :: held 2.223s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:06:35 devstack cinder-volume[87515]: DEBUG cinder.volume.flows.manager.create_volume [None req-2d428eda-f90f-4a02-a7ba-b69abe6eb4cb tempest-AttachVolumeTestJSON-1590815735 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 10:06:35 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-2d428eda-f90f-4a02-a7ba-b69abe6eb4cb tempest-AttachVolumeTestJSON-1590815735 None] Flow 'volume_create_manager' (014a21b4-6044-4c2e-9007-dc2ad6a4b07a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:06:35 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-2d428eda-f90f-4a02-a7ba-b69abe6eb4cb tempest-AttachVolumeTestJSON-1590815735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5eedb35c-e430-4d88-ac00-f8166a8c1f81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:06:35 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-2d428eda-f90f-4a02-a7ba-b69abe6eb4cb tempest-AttachVolumeTestJSON-1590815735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5eedb35c-e430-4d88-ac00-f8166a8c1f81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:06:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1492290955',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d26bcda-a1ec-41f1-94b5-ff6290430798,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9e91b48f7db4cf18bf33a75a55d9962',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:06:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:06:36Z,use_quota=True,user_id='e7c670e0921542d08e3ffa09e69b6d6c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3a092cd-7947-4cbf-abff-4ba9567becf0),volume_type_id=f3a092cd-7947-4cbf-abff-4ba9567becf0)' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:06:35 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-2d428eda-f90f-4a02-a7ba-b69abe6eb4cb tempest-AttachVolumeTestJSON-1590815735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d94abccd-6317-4230-8996-7d76a6ff02f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:06:35 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-2d428eda-f90f-4a02-a7ba-b69abe6eb4cb tempest-AttachVolumeTestJSON-1590815735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d94abccd-6317-4230-8996-7d76a6ff02f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:06:35 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-2d428eda-f90f-4a02-a7ba-b69abe6eb4cb tempest-AttachVolumeTestJSON-1590815735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b60592d-dac6-4bf3-973f-780effb0e9a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:06:35 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-2d428eda-f90f-4a02-a7ba-b69abe6eb4cb tempest-AttachVolumeTestJSON-1590815735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b60592d-dac6-4bf3-973f-780effb0e9a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9d26bcda-a1ec-41f1-94b5-ff6290430798', 'volume_name': 'volume-9d26bcda-a1ec-41f1-94b5-ff6290430798', 'volume_size': 1}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:06:35 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-2d428eda-f90f-4a02-a7ba-b69abe6eb4cb tempest-AttachVolumeTestJSON-1590815735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (716ba67e-b253-4f2f-9bc9-b26e38ca58c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:06:35 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-2d428eda-f90f-4a02-a7ba-b69abe6eb4cb tempest-AttachVolumeTestJSON-1590815735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (716ba67e-b253-4f2f-9bc9-b26e38ca58c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:06:35 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-2d428eda-f90f-4a02-a7ba-b69abe6eb4cb tempest-AttachVolumeTestJSON-1590815735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f2a183e-16af-476f-85a0-aa63874f2be4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:06:35 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-2d428eda-f90f-4a02-a7ba-b69abe6eb4cb tempest-AttachVolumeTestJSON-1590815735 None] Volume 9d26bcda-a1ec-41f1-94b5-ff6290430798: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9d26bcda-a1ec-41f1-94b5-ff6290430798', 'volume_size': 1} Sep 07 10:06:35 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-2d428eda-f90f-4a02-a7ba-b69abe6eb4cb tempest-AttachVolumeTestJSON-1590815735 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:06:35 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-2d428eda-f90f-4a02-a7ba-b69abe6eb4cb tempest-AttachVolumeTestJSON-1590815735 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:06:35 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-2d428eda-f90f-4a02-a7ba-b69abe6eb4cb tempest-AttachVolumeTestJSON-1590815735 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:06:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1492290955',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d26bcda-a1ec-41f1-94b5-ff6290430798,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9e91b48f7db4cf18bf33a75a55d9962',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:06:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:06:36Z,use_quota=True,user_id='e7c670e0921542d08e3ffa09e69b6d6c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3a092cd-7947-4cbf-abff-4ba9567becf0),volume_type_id=f3a092cd-7947-4cbf-abff-4ba9567becf0)}" {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 10:06:35 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-2d428eda-f90f-4a02-a7ba-b69abe6eb4cb tempest-AttachVolumeTestJSON-1590815735 None] Creating volume 9d26bcda-a1ec-41f1-94b5-ff6290430798 {{(pid=87515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 10:06:35 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-2d428eda-f90f-4a02-a7ba-b69abe6eb4cb tempest-AttachVolumeTestJSON-1590815735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:06:35 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-2d428eda-f90f-4a02-a7ba-b69abe6eb4cb tempest-AttachVolumeTestJSON-1590815735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:06:35 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-2d428eda-f90f-4a02-a7ba-b69abe6eb4cb tempest-AttachVolumeTestJSON-1590815735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:06:35 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-2d428eda-f90f-4a02-a7ba-b69abe6eb4cb tempest-AttachVolumeTestJSON-1590815735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:06:35 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-2d428eda-f90f-4a02-a7ba-b69abe6eb4cb tempest-AttachVolumeTestJSON-1590815735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:06:35 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-2d428eda-f90f-4a02-a7ba-b69abe6eb4cb tempest-AttachVolumeTestJSON-1590815735 None] Selected osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c as target Quobyte volume. {{(pid=87515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 10:06:35 devstack cinder-volume[87515]: INFO cinder.volume.drivers.remotefs [None req-2d428eda-f90f-4a02-a7ba-b69abe6eb4cb tempest-AttachVolumeTestJSON-1590815735 None] casted to osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c Sep 07 10:06:35 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-2d428eda-f90f-4a02-a7ba-b69abe6eb4cb tempest-AttachVolumeTestJSON-1590815735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-9d26bcda-a1ec-41f1-94b5-ff6290430798 1073741824 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:06:35 devstack sudo[97878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-9d26bcda-a1ec-41f1-94b5-ff6290430798 1073741824 Sep 07 10:06:35 devstack sudo[97878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:06:36 devstack sudo[97878]: pam_unix(sudo:session): session closed for user root Sep 07 10:06:36 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-2d428eda-f90f-4a02-a7ba-b69abe6eb4cb tempest-AttachVolumeTestJSON-1590815735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-9d26bcda-a1ec-41f1-94b5-ff6290430798 1073741824" returned: 0 in 0.457s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:06:36 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-2d428eda-f90f-4a02-a7ba-b69abe6eb4cb tempest-AttachVolumeTestJSON-1590815735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-9d26bcda-a1ec-41f1-94b5-ff6290430798 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:06:36 devstack sudo[97884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-9d26bcda-a1ec-41f1-94b5-ff6290430798 Sep 07 10:06:36 devstack sudo[97884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:06:36 devstack sudo[97884]: pam_unix(sudo:session): session closed for user root Sep 07 10:06:36 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-2d428eda-f90f-4a02-a7ba-b69abe6eb4cb tempest-AttachVolumeTestJSON-1590815735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-9d26bcda-a1ec-41f1-94b5-ff6290430798" returned: 0 in 0.333s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:06:36 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-2d428eda-f90f-4a02-a7ba-b69abe6eb4cb tempest-AttachVolumeTestJSON-1590815735 None] <== create_volume: return (836ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'} {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 10:06:36 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-2d428eda-f90f-4a02-a7ba-b69abe6eb4cb tempest-AttachVolumeTestJSON-1590815735 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.842s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:06:36 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-2d428eda-f90f-4a02-a7ba-b69abe6eb4cb tempest-AttachVolumeTestJSON-1590815735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f2a183e-16af-476f-85a0-aa63874f2be4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9d26bcda-a1ec-41f1-94b5-ff6290430798', 'volume_size': 1}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:06:36 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-2d428eda-f90f-4a02-a7ba-b69abe6eb4cb tempest-AttachVolumeTestJSON-1590815735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5a7cc1b-01e4-4cd8-bc20-41db60989156) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:06:36 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-5bcea253-d8cd-4597-af52-26538a01e345 tempest-VolumesSnapshotListTestJSON-237454856 None] Acquiring lock "cinder-35d4083a-3faa-4302-96f3-bebbc9beb4e3-delete_snapshot" by "delete_snapshot" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:06:36 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-2d428eda-f90f-4a02-a7ba-b69abe6eb4cb tempest-AttachVolumeTestJSON-1590815735 None] Volume volume-9d26bcda-a1ec-41f1-94b5-ff6290430798 (9d26bcda-a1ec-41f1-94b5-ff6290430798): created successfully Sep 07 10:06:36 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-2d428eda-f90f-4a02-a7ba-b69abe6eb4cb tempest-AttachVolumeTestJSON-1590815735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5a7cc1b-01e4-4cd8-bc20-41db60989156) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:06:36 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-2d428eda-f90f-4a02-a7ba-b69abe6eb4cb tempest-AttachVolumeTestJSON-1590815735 None] Flow 'volume_create_manager' (014a21b4-6044-4c2e-9007-dc2ad6a4b07a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:06:36 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-5bcea253-d8cd-4597-af52-26538a01e345 tempest-VolumesSnapshotListTestJSON-237454856 None] Lock "cinder-35d4083a-3faa-4302-96f3-bebbc9beb4e3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.051s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:06:36 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-5bcea253-d8cd-4597-af52-26538a01e345 tempest-VolumesSnapshotListTestJSON-237454856 None] Acquiring lock "cinder-quobyte-d3092285-7fd4-4c05-bbbe-f98719cf7261" by "delete_snapshot" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:06:36 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-2d428eda-f90f-4a02-a7ba-b69abe6eb4cb tempest-AttachVolumeTestJSON-1590815735 None] Created volume successfully. Sep 07 10:06:36 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-5bcea253-d8cd-4597-af52-26538a01e345 tempest-VolumesSnapshotListTestJSON-237454856 None] Lock "cinder-quobyte-d3092285-7fd4-4c05-bbbe-f98719cf7261" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:06:36 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-5bcea253-d8cd-4597-af52-26538a01e345 tempest-VolumesSnapshotListTestJSON-237454856 None] Acquiring lock "cinder-quobyte-35d4083a-3faa-4302-96f3-bebbc9beb4e3" by "_delete_snapshot" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:06:36 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-5bcea253-d8cd-4597-af52-26538a01e345 tempest-VolumesSnapshotListTestJSON-237454856 None] Lock "cinder-quobyte-35d4083a-3faa-4302-96f3-bebbc9beb4e3" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:06:36 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-5bcea253-d8cd-4597-af52-26538a01e345 tempest-VolumesSnapshotListTestJSON-237454856 None] Deleting offline snapshot 35d4083a-3faa-4302-96f3-bebbc9beb4e3 of volume d3092285-7fd4-4c05-bbbe-f98719cf7261 {{(pid=87515) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 10:06:36 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-5bcea253-d8cd-4597-af52-26538a01e345 tempest-VolumesSnapshotListTestJSON-237454856 None] snapshot_file for this snap is: volume-d3092285-7fd4-4c05-bbbe-f98719cf7261.35d4083a-3faa-4302-96f3-bebbc9beb4e3 {{(pid=87515) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 10:06:36 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[26d6500d-40a2-44af-86cd-bf7e22139fa4]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:06:36 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-5bcea253-d8cd-4597-af52-26538a01e345 tempest-VolumesSnapshotListTestJSON-237454856 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-d3092285-7fd4-4c05-bbbe-f98719cf7261.35d4083a-3faa-4302-96f3-bebbc9beb4e3 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:06:36 devstack sudo[97893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-d3092285-7fd4-4c05-bbbe-f98719cf7261.35d4083a-3faa-4302-96f3-bebbc9beb4e3 Sep 07 10:06:36 devstack sudo[97893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:06:37 devstack sudo[97893]: pam_unix(sudo:session): session closed for user root Sep 07 10:06:37 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-5bcea253-d8cd-4597-af52-26538a01e345 tempest-VolumesSnapshotListTestJSON-237454856 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-d3092285-7fd4-4c05-bbbe-f98719cf7261.35d4083a-3faa-4302-96f3-bebbc9beb4e3" returned: 0 in 0.418s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:06:37 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-5bcea253-d8cd-4597-af52-26538a01e345 tempest-VolumesSnapshotListTestJSON-237454856 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d3092285-7fd4-4c05-bbbe-f98719cf7261(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87515) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 10:06:37 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc0cef75-85cb-40c6-8ee4-9ca6a78d9d24]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:06:37 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-5bcea253-d8cd-4597-af52-26538a01e345 tempest-VolumesSnapshotListTestJSON-237454856 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-d3092285-7fd4-4c05-bbbe-f98719cf7261.37ea6c69-4d85-42c4-975e-14ebd6829a81 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:06:37 devstack sudo[97898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-d3092285-7fd4-4c05-bbbe-f98719cf7261.37ea6c69-4d85-42c4-975e-14ebd6829a81 Sep 07 10:06:37 devstack sudo[97898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:06:37 devstack sudo[97898]: pam_unix(sudo:session): session closed for user root Sep 07 10:06:37 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-5bcea253-d8cd-4597-af52-26538a01e345 tempest-VolumesSnapshotListTestJSON-237454856 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-d3092285-7fd4-4c05-bbbe-f98719cf7261.37ea6c69-4d85-42c4-975e-14ebd6829a81" returned: 0 in 0.552s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:06:37 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-5bcea253-d8cd-4597-af52-26538a01e345 tempest-VolumesSnapshotListTestJSON-237454856 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d3092285-7fd4-4c05-bbbe-f98719cf7261(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87515) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 10:06:37 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-5bcea253-d8cd-4597-af52-26538a01e345 tempest-VolumesSnapshotListTestJSON-237454856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-d3092285-7fd4-4c05-bbbe-f98719cf7261.35d4083a-3faa-4302-96f3-bebbc9beb4e3 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:06:37 devstack sudo[97904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-d3092285-7fd4-4c05-bbbe-f98719cf7261.35d4083a-3faa-4302-96f3-bebbc9beb4e3 Sep 07 10:06:37 devstack sudo[97904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:06:38 devstack sudo[97904]: pam_unix(sudo:session): session closed for user root Sep 07 10:06:38 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-5bcea253-d8cd-4597-af52-26538a01e345 tempest-VolumesSnapshotListTestJSON-237454856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-d3092285-7fd4-4c05-bbbe-f98719cf7261.35d4083a-3faa-4302-96f3-bebbc9beb4e3" returned: 0 in 0.623s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:06:38 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-5bcea253-d8cd-4597-af52-26538a01e345 tempest-VolumesSnapshotListTestJSON-237454856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-d3092285-7fd4-4c05-bbbe-f98719cf7261.35d4083a-3faa-4302-96f3-bebbc9beb4e3 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:06:38 devstack sudo[97913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-d3092285-7fd4-4c05-bbbe-f98719cf7261.35d4083a-3faa-4302-96f3-bebbc9beb4e3 Sep 07 10:06:38 devstack sudo[97913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:06:38 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [req-39a1bc08-2130-4cec-98bb-27bbdd72dd3f req-2caced40-42a4-49c4-9d69-11991df022c6 tempest-AttachVolumeTestJSON-1590815735 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:06:38 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [req-39a1bc08-2130-4cec-98bb-27bbdd72dd3f req-2caced40-42a4-49c4-9d69-11991df022c6 tempest-AttachVolumeTestJSON-1590815735 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:06:38 devstack sudo[97913]: pam_unix(sudo:session): session closed for user root Sep 07 10:06:38 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [req-39a1bc08-2130-4cec-98bb-27bbdd72dd3f req-2caced40-42a4-49c4-9d69-11991df022c6 tempest-AttachVolumeTestJSON-1590815735 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.023s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:06:38 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-5bcea253-d8cd-4597-af52-26538a01e345 tempest-VolumesSnapshotListTestJSON-237454856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-d3092285-7fd4-4c05-bbbe-f98719cf7261.35d4083a-3faa-4302-96f3-bebbc9beb4e3" returned: 0 in 0.427s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:06:38 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-5bcea253-d8cd-4597-af52-26538a01e345 tempest-VolumesSnapshotListTestJSON-237454856 None] Lock "cinder-quobyte-35d4083a-3faa-4302-96f3-bebbc9beb4e3" released by "_delete_snapshot" :: held 2.154s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:06:38 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-5bcea253-d8cd-4597-af52-26538a01e345 tempest-VolumesSnapshotListTestJSON-237454856 None] Lock "cinder-quobyte-d3092285-7fd4-4c05-bbbe-f98719cf7261" released by "delete_snapshot" :: held 2.197s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:06:38 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [req-39a1bc08-2130-4cec-98bb-27bbdd72dd3f req-2caced40-42a4-49c4-9d69-11991df022c6 tempest-AttachVolumeTestJSON-1590815735 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c', 'name': 'volume-9d26bcda-a1ec-41f1-94b5-ff6290430798', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ff6b3508-77bb-4d1c-98cc-2fd7f069a599', 'enforce_multipath': True} {{(pid=87515) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 07 10:06:38 devstack cinder-volume[87515]: INFO cinder.volume.manager [req-39a1bc08-2130-4cec-98bb-27bbdd72dd3f req-2caced40-42a4-49c4-9d69-11991df022c6 tempest-AttachVolumeTestJSON-1590815735 None] attachment_update completed successfully. Sep 07 10:06:38 devstack cinder-volume[87515]: DEBUG cinder.quota [None req-5bcea253-d8cd-4597-af52-26538a01e345 tempest-VolumesSnapshotListTestJSON-237454856 None] Created reservations ['a9a3fb97-673f-42d6-858c-bb6769d8eee4', '89d664f4-0fc4-41f5-8d8e-3630725f62bd', '55b29dae-e9f8-4395-bb20-19ecace8ef2f', 'e7997f8b-884b-4252-ab5a-ef2f98b52013'] {{(pid=87515) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:06:39 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-5bcea253-d8cd-4597-af52-26538a01e345 tempest-VolumesSnapshotListTestJSON-237454856 None] Delete snapshot completed successfully. Sep 07 10:06:39 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-5bcea253-d8cd-4597-af52-26538a01e345 tempest-VolumesSnapshotListTestJSON-237454856 None] Lock "cinder-35d4083a-3faa-4302-96f3-bebbc9beb4e3-delete_snapshot" released by "delete_snapshot" :: held 2.443s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:06:39 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-cb1f0018-fc1d-47b4-9d7b-f9cd27fd5291 tempest-VolumesSnapshotListTestJSON-237454856 None] Acquiring lock "cinder-37ea6c69-4d85-42c4-975e-14ebd6829a81-delete_snapshot" by "delete_snapshot" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:06:39 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-cb1f0018-fc1d-47b4-9d7b-f9cd27fd5291 tempest-VolumesSnapshotListTestJSON-237454856 None] Lock "cinder-37ea6c69-4d85-42c4-975e-14ebd6829a81-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:06:39 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-cb1f0018-fc1d-47b4-9d7b-f9cd27fd5291 tempest-VolumesSnapshotListTestJSON-237454856 None] Acquiring lock "cinder-quobyte-d3092285-7fd4-4c05-bbbe-f98719cf7261" by "delete_snapshot" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:06:39 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-cb1f0018-fc1d-47b4-9d7b-f9cd27fd5291 tempest-VolumesSnapshotListTestJSON-237454856 None] Lock "cinder-quobyte-d3092285-7fd4-4c05-bbbe-f98719cf7261" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:06:39 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-cb1f0018-fc1d-47b4-9d7b-f9cd27fd5291 tempest-VolumesSnapshotListTestJSON-237454856 None] Acquiring lock "cinder-quobyte-37ea6c69-4d85-42c4-975e-14ebd6829a81" by "_delete_snapshot" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:06:39 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-cb1f0018-fc1d-47b4-9d7b-f9cd27fd5291 tempest-VolumesSnapshotListTestJSON-237454856 None] Lock "cinder-quobyte-37ea6c69-4d85-42c4-975e-14ebd6829a81" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:06:39 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-cb1f0018-fc1d-47b4-9d7b-f9cd27fd5291 tempest-VolumesSnapshotListTestJSON-237454856 None] Deleting offline snapshot 37ea6c69-4d85-42c4-975e-14ebd6829a81 of volume d3092285-7fd4-4c05-bbbe-f98719cf7261 {{(pid=87515) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 10:06:39 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-cb1f0018-fc1d-47b4-9d7b-f9cd27fd5291 tempest-VolumesSnapshotListTestJSON-237454856 None] snapshot_file for this snap is: volume-d3092285-7fd4-4c05-bbbe-f98719cf7261.37ea6c69-4d85-42c4-975e-14ebd6829a81 {{(pid=87515) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 10:06:40 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[a36b1f53-54a5-4447-acff-a63e6b240668]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:06:40 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-cb1f0018-fc1d-47b4-9d7b-f9cd27fd5291 tempest-VolumesSnapshotListTestJSON-237454856 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-d3092285-7fd4-4c05-bbbe-f98719cf7261.37ea6c69-4d85-42c4-975e-14ebd6829a81 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:06:40 devstack sudo[98307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-d3092285-7fd4-4c05-bbbe-f98719cf7261.37ea6c69-4d85-42c4-975e-14ebd6829a81 Sep 07 10:06:40 devstack sudo[98307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:06:40 devstack sudo[98307]: pam_unix(sudo:session): session closed for user root Sep 07 10:06:40 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-cb1f0018-fc1d-47b4-9d7b-f9cd27fd5291 tempest-VolumesSnapshotListTestJSON-237454856 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-d3092285-7fd4-4c05-bbbe-f98719cf7261.37ea6c69-4d85-42c4-975e-14ebd6829a81" returned: 0 in 0.430s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:06:40 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-cb1f0018-fc1d-47b4-9d7b-f9cd27fd5291 tempest-VolumesSnapshotListTestJSON-237454856 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d3092285-7fd4-4c05-bbbe-f98719cf7261(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87515) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 10:06:40 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b8e33d1-5a13-48a1-881d-08ba8580a1b5]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:06:40 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-cb1f0018-fc1d-47b4-9d7b-f9cd27fd5291 tempest-VolumesSnapshotListTestJSON-237454856 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-d3092285-7fd4-4c05-bbbe-f98719cf7261 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:06:40 devstack sudo[98312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-d3092285-7fd4-4c05-bbbe-f98719cf7261 Sep 07 10:06:40 devstack sudo[98312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:06:40 devstack sudo[98312]: pam_unix(sudo:session): session closed for user root Sep 07 10:06:40 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-cb1f0018-fc1d-47b4-9d7b-f9cd27fd5291 tempest-VolumesSnapshotListTestJSON-237454856 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-d3092285-7fd4-4c05-bbbe-f98719cf7261" returned: 0 in 0.432s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:06:40 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-cb1f0018-fc1d-47b4-9d7b-f9cd27fd5291 tempest-VolumesSnapshotListTestJSON-237454856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-d3092285-7fd4-4c05-bbbe-f98719cf7261.37ea6c69-4d85-42c4-975e-14ebd6829a81 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:06:40 devstack sudo[98317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-d3092285-7fd4-4c05-bbbe-f98719cf7261.37ea6c69-4d85-42c4-975e-14ebd6829a81 Sep 07 10:06:40 devstack sudo[98317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:06:41 devstack sudo[98317]: pam_unix(sudo:session): session closed for user root Sep 07 10:06:41 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-cb1f0018-fc1d-47b4-9d7b-f9cd27fd5291 tempest-VolumesSnapshotListTestJSON-237454856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-d3092285-7fd4-4c05-bbbe-f98719cf7261.37ea6c69-4d85-42c4-975e-14ebd6829a81" returned: 0 in 0.619s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:06:41 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-cb1f0018-fc1d-47b4-9d7b-f9cd27fd5291 tempest-VolumesSnapshotListTestJSON-237454856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-d3092285-7fd4-4c05-bbbe-f98719cf7261.37ea6c69-4d85-42c4-975e-14ebd6829a81 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:06:41 devstack sudo[98322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-d3092285-7fd4-4c05-bbbe-f98719cf7261.37ea6c69-4d85-42c4-975e-14ebd6829a81 Sep 07 10:06:41 devstack sudo[98322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:06:41 devstack cinder-volume[87515]: DEBUG cinder.volume.flows.manager.create_volume [None req-7b1cd6a0-b6b4-4042-95be-6c572b41cc90 tempest-AttachVolumeTestJSON-1590815735 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 10:06:41 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-7b1cd6a0-b6b4-4042-95be-6c572b41cc90 tempest-AttachVolumeTestJSON-1590815735 None] Flow 'volume_create_manager' (fbca45e7-b467-42a2-8832-37648f603791) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:06:41 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-7b1cd6a0-b6b4-4042-95be-6c572b41cc90 tempest-AttachVolumeTestJSON-1590815735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee21bf43-2c2c-4005-bbad-a7cdb79058fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:06:41 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-7b1cd6a0-b6b4-4042-95be-6c572b41cc90 tempest-AttachVolumeTestJSON-1590815735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee21bf43-2c2c-4005-bbad-a7cdb79058fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:06:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1654372348',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3402059c-f50f-495d-b076-54595317dcd4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9e91b48f7db4cf18bf33a75a55d9962',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:06:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:06:42Z,use_quota=True,user_id='e7c670e0921542d08e3ffa09e69b6d6c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3a092cd-7947-4cbf-abff-4ba9567becf0),volume_type_id=f3a092cd-7947-4cbf-abff-4ba9567becf0)' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:06:41 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-7b1cd6a0-b6b4-4042-95be-6c572b41cc90 tempest-AttachVolumeTestJSON-1590815735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37f3fb1d-1007-4312-95b8-c688786bd07c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:06:41 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-7b1cd6a0-b6b4-4042-95be-6c572b41cc90 tempest-AttachVolumeTestJSON-1590815735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37f3fb1d-1007-4312-95b8-c688786bd07c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:06:41 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-7b1cd6a0-b6b4-4042-95be-6c572b41cc90 tempest-AttachVolumeTestJSON-1590815735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ca0e5ae-b7f3-44fd-af21-414e8538cca8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:06:41 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-7b1cd6a0-b6b4-4042-95be-6c572b41cc90 tempest-AttachVolumeTestJSON-1590815735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ca0e5ae-b7f3-44fd-af21-414e8538cca8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3402059c-f50f-495d-b076-54595317dcd4', 'volume_name': 'volume-3402059c-f50f-495d-b076-54595317dcd4', 'volume_size': 1}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:06:41 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-7b1cd6a0-b6b4-4042-95be-6c572b41cc90 tempest-AttachVolumeTestJSON-1590815735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70396e45-98a5-458e-9cbb-3b8426e21c76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:06:41 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-7b1cd6a0-b6b4-4042-95be-6c572b41cc90 tempest-AttachVolumeTestJSON-1590815735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70396e45-98a5-458e-9cbb-3b8426e21c76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:06:41 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-7b1cd6a0-b6b4-4042-95be-6c572b41cc90 tempest-AttachVolumeTestJSON-1590815735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f28dfeaf-8047-4370-aea8-ff7cf20a3f68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:06:41 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-7b1cd6a0-b6b4-4042-95be-6c572b41cc90 tempest-AttachVolumeTestJSON-1590815735 None] Volume 3402059c-f50f-495d-b076-54595317dcd4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3402059c-f50f-495d-b076-54595317dcd4', 'volume_size': 1} Sep 07 10:06:41 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-7b1cd6a0-b6b4-4042-95be-6c572b41cc90 tempest-AttachVolumeTestJSON-1590815735 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:06:41 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-7b1cd6a0-b6b4-4042-95be-6c572b41cc90 tempest-AttachVolumeTestJSON-1590815735 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:06:41 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-7b1cd6a0-b6b4-4042-95be-6c572b41cc90 tempest-AttachVolumeTestJSON-1590815735 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:06:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1654372348',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3402059c-f50f-495d-b076-54595317dcd4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9e91b48f7db4cf18bf33a75a55d9962',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:06:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:06:42Z,use_quota=True,user_id='e7c670e0921542d08e3ffa09e69b6d6c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3a092cd-7947-4cbf-abff-4ba9567becf0),volume_type_id=f3a092cd-7947-4cbf-abff-4ba9567becf0)}" {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 10:06:41 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-7b1cd6a0-b6b4-4042-95be-6c572b41cc90 tempest-AttachVolumeTestJSON-1590815735 None] Creating volume 3402059c-f50f-495d-b076-54595317dcd4 {{(pid=87515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 10:06:41 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-7b1cd6a0-b6b4-4042-95be-6c572b41cc90 tempest-AttachVolumeTestJSON-1590815735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:06:41 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-7b1cd6a0-b6b4-4042-95be-6c572b41cc90 tempest-AttachVolumeTestJSON-1590815735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:06:41 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-7b1cd6a0-b6b4-4042-95be-6c572b41cc90 tempest-AttachVolumeTestJSON-1590815735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:06:41 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-7b1cd6a0-b6b4-4042-95be-6c572b41cc90 tempest-AttachVolumeTestJSON-1590815735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:06:41 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-7b1cd6a0-b6b4-4042-95be-6c572b41cc90 tempest-AttachVolumeTestJSON-1590815735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:06:41 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-7b1cd6a0-b6b4-4042-95be-6c572b41cc90 tempest-AttachVolumeTestJSON-1590815735 None] Selected osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c as target Quobyte volume. {{(pid=87515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 10:06:41 devstack cinder-volume[87515]: INFO cinder.volume.drivers.remotefs [None req-7b1cd6a0-b6b4-4042-95be-6c572b41cc90 tempest-AttachVolumeTestJSON-1590815735 None] casted to osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c Sep 07 10:06:41 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-7b1cd6a0-b6b4-4042-95be-6c572b41cc90 tempest-AttachVolumeTestJSON-1590815735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-3402059c-f50f-495d-b076-54595317dcd4 1073741824 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:06:41 devstack sudo[98324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-3402059c-f50f-495d-b076-54595317dcd4 1073741824 Sep 07 10:06:41 devstack sudo[98324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:06:41 devstack sudo[98322]: pam_unix(sudo:session): session closed for user root Sep 07 10:06:41 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-cb1f0018-fc1d-47b4-9d7b-f9cd27fd5291 tempest-VolumesSnapshotListTestJSON-237454856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-d3092285-7fd4-4c05-bbbe-f98719cf7261.37ea6c69-4d85-42c4-975e-14ebd6829a81" returned: 0 in 0.347s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:06:41 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-cb1f0018-fc1d-47b4-9d7b-f9cd27fd5291 tempest-VolumesSnapshotListTestJSON-237454856 None] Lock "cinder-quobyte-37ea6c69-4d85-42c4-975e-14ebd6829a81" released by "_delete_snapshot" :: held 2.002s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:06:41 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-cb1f0018-fc1d-47b4-9d7b-f9cd27fd5291 tempest-VolumesSnapshotListTestJSON-237454856 None] Lock "cinder-quobyte-d3092285-7fd4-4c05-bbbe-f98719cf7261" released by "delete_snapshot" :: held 2.048s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:06:42 devstack cinder-volume[87515]: DEBUG cinder.quota [None req-cb1f0018-fc1d-47b4-9d7b-f9cd27fd5291 tempest-VolumesSnapshotListTestJSON-237454856 None] Created reservations ['36b7c292-f555-4fdb-a5ac-ab9d501a94ec', 'ea8ae841-ba99-47d6-b080-241ef250bc44', 'e755336d-791d-4735-8174-79e5b636bb00', '0a852991-5ac9-4a14-9318-f8cadb7fd4dd'] {{(pid=87515) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:06:42 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-cb1f0018-fc1d-47b4-9d7b-f9cd27fd5291 tempest-VolumesSnapshotListTestJSON-237454856 None] Delete snapshot completed successfully. Sep 07 10:06:42 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-cb1f0018-fc1d-47b4-9d7b-f9cd27fd5291 tempest-VolumesSnapshotListTestJSON-237454856 None] Lock "cinder-37ea6c69-4d85-42c4-975e-14ebd6829a81-delete_snapshot" released by "delete_snapshot" :: held 2.247s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:06:42 devstack sudo[98324]: pam_unix(sudo:session): session closed for user root Sep 07 10:06:42 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-7b1cd6a0-b6b4-4042-95be-6c572b41cc90 tempest-AttachVolumeTestJSON-1590815735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-3402059c-f50f-495d-b076-54595317dcd4 1073741824" returned: 0 in 0.578s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:06:42 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-7b1cd6a0-b6b4-4042-95be-6c572b41cc90 tempest-AttachVolumeTestJSON-1590815735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-3402059c-f50f-495d-b076-54595317dcd4 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:06:42 devstack sudo[98331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-3402059c-f50f-495d-b076-54595317dcd4 Sep 07 10:06:42 devstack sudo[98331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:06:42 devstack sudo[98331]: pam_unix(sudo:session): session closed for user root Sep 07 10:06:42 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-7b1cd6a0-b6b4-4042-95be-6c572b41cc90 tempest-AttachVolumeTestJSON-1590815735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-3402059c-f50f-495d-b076-54595317dcd4" returned: 0 in 0.420s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:06:42 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-7b1cd6a0-b6b4-4042-95be-6c572b41cc90 tempest-AttachVolumeTestJSON-1590815735 None] <== create_volume: return (1096ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'} {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 10:06:42 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-7b1cd6a0-b6b4-4042-95be-6c572b41cc90 tempest-AttachVolumeTestJSON-1590815735 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.100s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:06:42 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-7b1cd6a0-b6b4-4042-95be-6c572b41cc90 tempest-AttachVolumeTestJSON-1590815735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f28dfeaf-8047-4370-aea8-ff7cf20a3f68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3402059c-f50f-495d-b076-54595317dcd4', 'volume_size': 1}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:06:42 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-7b1cd6a0-b6b4-4042-95be-6c572b41cc90 tempest-AttachVolumeTestJSON-1590815735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6300fd72-fc7d-445f-8113-4ceea1cd0cee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:06:42 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-7b1cd6a0-b6b4-4042-95be-6c572b41cc90 tempest-AttachVolumeTestJSON-1590815735 None] Volume volume-3402059c-f50f-495d-b076-54595317dcd4 (3402059c-f50f-495d-b076-54595317dcd4): created successfully Sep 07 10:06:42 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-7b1cd6a0-b6b4-4042-95be-6c572b41cc90 tempest-AttachVolumeTestJSON-1590815735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6300fd72-fc7d-445f-8113-4ceea1cd0cee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:06:42 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-7b1cd6a0-b6b4-4042-95be-6c572b41cc90 tempest-AttachVolumeTestJSON-1590815735 None] Flow 'volume_create_manager' (fbca45e7-b467-42a2-8832-37648f603791) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:06:42 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-7b1cd6a0-b6b4-4042-95be-6c572b41cc90 tempest-AttachVolumeTestJSON-1590815735 None] Created volume successfully. Sep 07 10:06:43 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-51c5188c-79b1-4567-833c-1faeda800186 tempest-VolumesSnapshotListTestJSON-237454856 None] Acquiring lock "cinder-d3092285-7fd4-4c05-bbbe-f98719cf7261-delete_volume" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:06:43 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-51c5188c-79b1-4567-833c-1faeda800186 tempest-VolumesSnapshotListTestJSON-237454856 None] Lock "cinder-d3092285-7fd4-4c05-bbbe-f98719cf7261-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:06:43 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-51c5188c-79b1-4567-833c-1faeda800186 tempest-VolumesSnapshotListTestJSON-237454856 None] Acquiring lock "cinder-quobyte-d3092285-7fd4-4c05-bbbe-f98719cf7261" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:06:43 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-51c5188c-79b1-4567-833c-1faeda800186 tempest-VolumesSnapshotListTestJSON-237454856 None] Lock "cinder-quobyte-d3092285-7fd4-4c05-bbbe-f98719cf7261" acquired by "delete_volume" :: waited 0.021s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:06:43 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1a623c0-ee4d-408d-92f2-8d47b8c88754]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:06:43 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-51c5188c-79b1-4567-833c-1faeda800186 tempest-VolumesSnapshotListTestJSON-237454856 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-d3092285-7fd4-4c05-bbbe-f98719cf7261 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:06:43 devstack sudo[98334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-d3092285-7fd4-4c05-bbbe-f98719cf7261 Sep 07 10:06:43 devstack sudo[98334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:06:43 devstack sudo[98334]: pam_unix(sudo:session): session closed for user root Sep 07 10:06:43 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-51c5188c-79b1-4567-833c-1faeda800186 tempest-VolumesSnapshotListTestJSON-237454856 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-d3092285-7fd4-4c05-bbbe-f98719cf7261" returned: 0 in 0.429s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:06:43 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-51c5188c-79b1-4567-833c-1faeda800186 tempest-VolumesSnapshotListTestJSON-237454856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-d3092285-7fd4-4c05-bbbe-f98719cf7261 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:06:43 devstack sudo[98339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-d3092285-7fd4-4c05-bbbe-f98719cf7261 Sep 07 10:06:43 devstack sudo[98339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:06:44 devstack sudo[98339]: pam_unix(sudo:session): session closed for user root Sep 07 10:06:44 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-51c5188c-79b1-4567-833c-1faeda800186 tempest-VolumesSnapshotListTestJSON-237454856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-d3092285-7fd4-4c05-bbbe-f98719cf7261" returned: 0 in 0.438s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:06:44 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-51c5188c-79b1-4567-833c-1faeda800186 tempest-VolumesSnapshotListTestJSON-237454856 None] Lock "cinder-quobyte-d3092285-7fd4-4c05-bbbe-f98719cf7261" released by "delete_volume" :: held 0.954s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:06:44 devstack cinder-volume[87515]: DEBUG cinder.quota [None req-51c5188c-79b1-4567-833c-1faeda800186 tempest-VolumesSnapshotListTestJSON-237454856 None] Created reservations ['6b85d7b5-8e40-47ad-9ce1-fa3411033c3a', '96723be8-030d-442f-8f2e-b76dae2836de', '2419285d-7bdf-414b-b740-56302c36633a', '310f731e-75df-4224-88de-fe5b8e8c32d4'] {{(pid=87515) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:06:44 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-51c5188c-79b1-4567-833c-1faeda800186 tempest-VolumesSnapshotListTestJSON-237454856 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:06:44 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-51c5188c-79b1-4567-833c-1faeda800186 tempest-VolumesSnapshotListTestJSON-237454856 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:06:44 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-51c5188c-79b1-4567-833c-1faeda800186 tempest-VolumesSnapshotListTestJSON-237454856 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:06:44 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-51c5188c-79b1-4567-833c-1faeda800186 tempest-VolumesSnapshotListTestJSON-237454856 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:06:44 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-51c5188c-79b1-4567-833c-1faeda800186 tempest-VolumesSnapshotListTestJSON-237454856 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:06:44 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-51c5188c-79b1-4567-833c-1faeda800186 tempest-VolumesSnapshotListTestJSON-237454856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:06:44 devstack sudo[98353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a Sep 07 10:06:44 devstack sudo[98353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:06:44 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [req-500b0568-e0ae-4d27-90b1-1a136281f456 req-cb02b4cd-b245-4ca4-8808-818e9f32c6bc tempest-AttachVolumeTestJSON-1590815735 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:06:44 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [req-500b0568-e0ae-4d27-90b1-1a136281f456 req-cb02b4cd-b245-4ca4-8808-818e9f32c6bc tempest-AttachVolumeTestJSON-1590815735 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:06:44 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [req-500b0568-e0ae-4d27-90b1-1a136281f456 req-cb02b4cd-b245-4ca4-8808-818e9f32c6bc tempest-AttachVolumeTestJSON-1590815735 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.023s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:06:44 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [req-500b0568-e0ae-4d27-90b1-1a136281f456 req-cb02b4cd-b245-4ca4-8808-818e9f32c6bc tempest-AttachVolumeTestJSON-1590815735 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c', 'name': 'volume-3402059c-f50f-495d-b076-54595317dcd4', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'da58a2d8-a5cd-4806-bdd9-de12a00be8aa', 'enforce_multipath': True} {{(pid=87515) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 07 10:06:44 devstack sudo[98353]: pam_unix(sudo:session): session closed for user root Sep 07 10:06:44 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-51c5188c-79b1-4567-833c-1faeda800186 tempest-VolumesSnapshotListTestJSON-237454856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a" returned: 0 in 0.320s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:06:44 devstack cinder-volume[87515]: DEBUG cinder.manager [None req-51c5188c-79b1-4567-833c-1faeda800186 tempest-VolumesSnapshotListTestJSON-237454856 None] Notifying Schedulers of capabilities ... {{(pid=87515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:06:44 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-51c5188c-79b1-4567-833c-1faeda800186 tempest-VolumesSnapshotListTestJSON-237454856 None] Deleted volume successfully. Sep 07 10:06:44 devstack cinder-volume[87515]: INFO cinder.volume.manager [req-500b0568-e0ae-4d27-90b1-1a136281f456 req-cb02b4cd-b245-4ca4-8808-818e9f32c6bc tempest-AttachVolumeTestJSON-1590815735 None] attachment_update completed successfully. Sep 07 10:06:44 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-51c5188c-79b1-4567-833c-1faeda800186 tempest-VolumesSnapshotListTestJSON-237454856 None] Lock "cinder-d3092285-7fd4-4c05-bbbe-f98719cf7261-delete_volume" released by "delete_volume" :: held 1.663s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:06:47 devstack cinder-volume[87515]: INFO cinder.volume.manager [req-429c1a77-0eea-4529-9989-5281f11d91d4 req-80c6671c-8cb1-46c6-bdaa-2b8da67f5899 tempest-AttachVolumeTestJSON-1590815735 None] Terminate volume connection completed successfully. Sep 07 10:06:47 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [req-429c1a77-0eea-4529-9989-5281f11d91d4 req-80c6671c-8cb1-46c6-bdaa-2b8da67f5899 tempest-AttachVolumeTestJSON-1590815735 None] Deleting attachment ff6b3508-77bb-4d1c-98cc-2fd7f069a599. {{(pid=87515) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 07 10:06:49 devstack cinder-volume[87515]: INFO cinder.volume.manager [req-c357dd30-bde8-41df-b843-f1d5cc0e1939 req-39d347ab-92a9-497f-af9d-0787e15e809b tempest-AttachVolumeTestJSON-1590815735 None] Terminate volume connection completed successfully. Sep 07 10:06:49 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [req-c357dd30-bde8-41df-b843-f1d5cc0e1939 req-39d347ab-92a9-497f-af9d-0787e15e809b tempest-AttachVolumeTestJSON-1590815735 None] Deleting attachment da58a2d8-a5cd-4806-bdd9-de12a00be8aa. {{(pid=87515) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 07 10:06:53 devstack cinder-volume[87515]: DEBUG cinder.volume.flows.manager.create_volume [None req-738eb5cd-89a0-4e90-bedc-c37ff149f3cf tempest-VolumesSnapshotNegativeTestJSON-1342384825 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 10:06:53 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-738eb5cd-89a0-4e90-bedc-c37ff149f3cf tempest-VolumesSnapshotNegativeTestJSON-1342384825 None] Flow 'volume_create_manager' (a0d27d35-827c-4296-9fb6-278abae548a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:06:53 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-738eb5cd-89a0-4e90-bedc-c37ff149f3cf tempest-VolumesSnapshotNegativeTestJSON-1342384825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed05fe31-8219-4540-a690-f4eccaa4a443) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:06:53 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-738eb5cd-89a0-4e90-bedc-c37ff149f3cf tempest-VolumesSnapshotNegativeTestJSON-1342384825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed05fe31-8219-4540-a690-f4eccaa4a443) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:06:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1656878050',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b55aa11b-46de-4d0a-810b-e5970fc95e2f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a174ef738624f058fa5ed6560551bc5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:06:53Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:06:53Z,use_quota=True,user_id='59a2198be91f40a5abce73e4ee2ea5da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3a092cd-7947-4cbf-abff-4ba9567becf0),volume_type_id=f3a092cd-7947-4cbf-abff-4ba9567becf0)' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:06:53 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-738eb5cd-89a0-4e90-bedc-c37ff149f3cf tempest-VolumesSnapshotNegativeTestJSON-1342384825 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18077928-6fb3-4c24-9f97-5fff50f11f7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:06:53 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-738eb5cd-89a0-4e90-bedc-c37ff149f3cf tempest-VolumesSnapshotNegativeTestJSON-1342384825 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18077928-6fb3-4c24-9f97-5fff50f11f7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:06:53 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-738eb5cd-89a0-4e90-bedc-c37ff149f3cf tempest-VolumesSnapshotNegativeTestJSON-1342384825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14fea180-e0dd-4579-bd57-ee3391c6fe26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:06:53 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-738eb5cd-89a0-4e90-bedc-c37ff149f3cf tempest-VolumesSnapshotNegativeTestJSON-1342384825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14fea180-e0dd-4579-bd57-ee3391c6fe26) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b55aa11b-46de-4d0a-810b-e5970fc95e2f', 'volume_name': 'volume-b55aa11b-46de-4d0a-810b-e5970fc95e2f', 'volume_size': 2}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:06:53 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-738eb5cd-89a0-4e90-bedc-c37ff149f3cf tempest-VolumesSnapshotNegativeTestJSON-1342384825 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ff7f359-fbf8-45cc-a1ef-86d81e519d56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:06:53 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-738eb5cd-89a0-4e90-bedc-c37ff149f3cf tempest-VolumesSnapshotNegativeTestJSON-1342384825 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ff7f359-fbf8-45cc-a1ef-86d81e519d56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:06:53 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-738eb5cd-89a0-4e90-bedc-c37ff149f3cf tempest-VolumesSnapshotNegativeTestJSON-1342384825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e95268e0-ea53-48eb-9571-d69ceb0aab96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:06:53 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-738eb5cd-89a0-4e90-bedc-c37ff149f3cf tempest-VolumesSnapshotNegativeTestJSON-1342384825 None] Volume b55aa11b-46de-4d0a-810b-e5970fc95e2f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b55aa11b-46de-4d0a-810b-e5970fc95e2f', 'volume_size': 2} Sep 07 10:06:53 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-738eb5cd-89a0-4e90-bedc-c37ff149f3cf tempest-VolumesSnapshotNegativeTestJSON-1342384825 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:06:53 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-738eb5cd-89a0-4e90-bedc-c37ff149f3cf tempest-VolumesSnapshotNegativeTestJSON-1342384825 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:06:53 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-738eb5cd-89a0-4e90-bedc-c37ff149f3cf tempest-VolumesSnapshotNegativeTestJSON-1342384825 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:06:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1656878050',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b55aa11b-46de-4d0a-810b-e5970fc95e2f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a174ef738624f058fa5ed6560551bc5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:06:53Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:06:53Z,use_quota=True,user_id='59a2198be91f40a5abce73e4ee2ea5da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3a092cd-7947-4cbf-abff-4ba9567becf0),volume_type_id=f3a092cd-7947-4cbf-abff-4ba9567becf0)}" {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 10:06:53 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-738eb5cd-89a0-4e90-bedc-c37ff149f3cf tempest-VolumesSnapshotNegativeTestJSON-1342384825 None] Creating volume b55aa11b-46de-4d0a-810b-e5970fc95e2f {{(pid=87515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 10:06:53 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-738eb5cd-89a0-4e90-bedc-c37ff149f3cf tempest-VolumesSnapshotNegativeTestJSON-1342384825 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:06:53 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-738eb5cd-89a0-4e90-bedc-c37ff149f3cf tempest-VolumesSnapshotNegativeTestJSON-1342384825 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:06:53 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-738eb5cd-89a0-4e90-bedc-c37ff149f3cf tempest-VolumesSnapshotNegativeTestJSON-1342384825 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:06:53 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-738eb5cd-89a0-4e90-bedc-c37ff149f3cf tempest-VolumesSnapshotNegativeTestJSON-1342384825 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:06:53 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-738eb5cd-89a0-4e90-bedc-c37ff149f3cf tempest-VolumesSnapshotNegativeTestJSON-1342384825 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:06:53 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-738eb5cd-89a0-4e90-bedc-c37ff149f3cf tempest-VolumesSnapshotNegativeTestJSON-1342384825 None] Selected osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c as target Quobyte volume. {{(pid=87515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 10:06:53 devstack cinder-volume[87515]: INFO cinder.volume.drivers.remotefs [None req-738eb5cd-89a0-4e90-bedc-c37ff149f3cf tempest-VolumesSnapshotNegativeTestJSON-1342384825 None] casted to osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c Sep 07 10:06:53 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-738eb5cd-89a0-4e90-bedc-c37ff149f3cf tempest-VolumesSnapshotNegativeTestJSON-1342384825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-b55aa11b-46de-4d0a-810b-e5970fc95e2f 2147483648 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:06:53 devstack sudo[98417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-b55aa11b-46de-4d0a-810b-e5970fc95e2f 2147483648 Sep 07 10:06:53 devstack sudo[98417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:06:54 devstack sudo[98417]: pam_unix(sudo:session): session closed for user root Sep 07 10:06:54 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-738eb5cd-89a0-4e90-bedc-c37ff149f3cf tempest-VolumesSnapshotNegativeTestJSON-1342384825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-b55aa11b-46de-4d0a-810b-e5970fc95e2f 2147483648" returned: 0 in 0.735s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:06:54 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-738eb5cd-89a0-4e90-bedc-c37ff149f3cf tempest-VolumesSnapshotNegativeTestJSON-1342384825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-b55aa11b-46de-4d0a-810b-e5970fc95e2f {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:06:54 devstack sudo[98423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-b55aa11b-46de-4d0a-810b-e5970fc95e2f Sep 07 10:06:54 devstack sudo[98423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:06:54 devstack sudo[98423]: pam_unix(sudo:session): session closed for user root Sep 07 10:06:54 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-738eb5cd-89a0-4e90-bedc-c37ff149f3cf tempest-VolumesSnapshotNegativeTestJSON-1342384825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-b55aa11b-46de-4d0a-810b-e5970fc95e2f" returned: 0 in 0.343s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:06:54 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-738eb5cd-89a0-4e90-bedc-c37ff149f3cf tempest-VolumesSnapshotNegativeTestJSON-1342384825 None] <== create_volume: return (1213ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'} {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 10:06:54 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-738eb5cd-89a0-4e90-bedc-c37ff149f3cf tempest-VolumesSnapshotNegativeTestJSON-1342384825 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.216s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:06:54 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-738eb5cd-89a0-4e90-bedc-c37ff149f3cf tempest-VolumesSnapshotNegativeTestJSON-1342384825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e95268e0-ea53-48eb-9571-d69ceb0aab96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b55aa11b-46de-4d0a-810b-e5970fc95e2f', 'volume_size': 2}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:06:54 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-738eb5cd-89a0-4e90-bedc-c37ff149f3cf tempest-VolumesSnapshotNegativeTestJSON-1342384825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0003a030-7412-4392-b5b3-0d2b79a37893) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:06:54 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-738eb5cd-89a0-4e90-bedc-c37ff149f3cf tempest-VolumesSnapshotNegativeTestJSON-1342384825 None] Volume volume-b55aa11b-46de-4d0a-810b-e5970fc95e2f (b55aa11b-46de-4d0a-810b-e5970fc95e2f): created successfully Sep 07 10:06:55 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-738eb5cd-89a0-4e90-bedc-c37ff149f3cf tempest-VolumesSnapshotNegativeTestJSON-1342384825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0003a030-7412-4392-b5b3-0d2b79a37893) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:06:55 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-738eb5cd-89a0-4e90-bedc-c37ff149f3cf tempest-VolumesSnapshotNegativeTestJSON-1342384825 None] Flow 'volume_create_manager' (a0d27d35-827c-4296-9fb6-278abae548a3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:06:55 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-738eb5cd-89a0-4e90-bedc-c37ff149f3cf tempest-VolumesSnapshotNegativeTestJSON-1342384825 None] Created volume successfully. Sep 07 10:06:55 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-d35afabc-5c94-438e-9001-37020bb31bc4 tempest-VolumesSnapshotNegativeTestJSON-1342384825 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:06:55 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-d35afabc-5c94-438e-9001-37020bb31bc4 tempest-VolumesSnapshotNegativeTestJSON-1342384825 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:06:55 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-d35afabc-5c94-438e-9001-37020bb31bc4 tempest-VolumesSnapshotNegativeTestJSON-1342384825 None] Creating offline snapshot 9266e43c-3b3e-48cc-94b6-55940eac2b88 of volume b55aa11b-46de-4d0a-810b-e5970fc95e2f {{(pid=87515) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 10:06:56 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd02e4f9-9314-4938-964b-352790842156]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:06:56 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-d35afabc-5c94-438e-9001-37020bb31bc4 tempest-VolumesSnapshotNegativeTestJSON-1342384825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-b55aa11b-46de-4d0a-810b-e5970fc95e2f {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:06:56 devstack sudo[98428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-b55aa11b-46de-4d0a-810b-e5970fc95e2f Sep 07 10:06:56 devstack sudo[98428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:06:56 devstack sudo[98428]: pam_unix(sudo:session): session closed for user root Sep 07 10:06:56 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-d35afabc-5c94-438e-9001-37020bb31bc4 tempest-VolumesSnapshotNegativeTestJSON-1342384825 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-b55aa11b-46de-4d0a-810b-e5970fc95e2f" returned: 0 in 0.547s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:06:56 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-d35afabc-5c94-438e-9001-37020bb31bc4 tempest-VolumesSnapshotNegativeTestJSON-1342384825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-b55aa11b-46de-4d0a-810b-e5970fc95e2f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-b55aa11b-46de-4d0a-810b-e5970fc95e2f.9266e43c-3b3e-48cc-94b6-55940eac2b88 2G {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:06:56 devstack sudo[98434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-b55aa11b-46de-4d0a-810b-e5970fc95e2f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-b55aa11b-46de-4d0a-810b-e5970fc95e2f.9266e43c-3b3e-48cc-94b6-55940eac2b88 2G Sep 07 10:06:56 devstack sudo[98434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:06:57 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-ec5e7761-76fb-4d9e-9446-a5409cc05553 tempest-AttachVolumeTestJSON-1590815735 None] Acquiring lock "cinder-3402059c-f50f-495d-b076-54595317dcd4-delete_volume" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:06:57 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-ec5e7761-76fb-4d9e-9446-a5409cc05553 tempest-AttachVolumeTestJSON-1590815735 None] Lock "cinder-3402059c-f50f-495d-b076-54595317dcd4-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:06:57 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-ec5e7761-76fb-4d9e-9446-a5409cc05553 tempest-AttachVolumeTestJSON-1590815735 None] Acquiring lock "cinder-quobyte-3402059c-f50f-495d-b076-54595317dcd4" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:06:57 devstack sudo[98434]: pam_unix(sudo:session): session closed for user root Sep 07 10:06:57 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-d35afabc-5c94-438e-9001-37020bb31bc4 tempest-VolumesSnapshotNegativeTestJSON-1342384825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-b55aa11b-46de-4d0a-810b-e5970fc95e2f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-b55aa11b-46de-4d0a-810b-e5970fc95e2f.9266e43c-3b3e-48cc-94b6-55940eac2b88 2G" returned: 0 in 0.574s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:06:57 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-d35afabc-5c94-438e-9001-37020bb31bc4 tempest-VolumesSnapshotNegativeTestJSON-1342384825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b55aa11b-46de-4d0a-810b-e5970fc95e2f -F qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-b55aa11b-46de-4d0a-810b-e5970fc95e2f.9266e43c-3b3e-48cc-94b6-55940eac2b88 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:06:57 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-ec5e7761-76fb-4d9e-9446-a5409cc05553 tempest-AttachVolumeTestJSON-1590815735 None] Lock "cinder-quobyte-3402059c-f50f-495d-b076-54595317dcd4" acquired by "delete_volume" :: waited 0.046s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:06:57 devstack sudo[98440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b55aa11b-46de-4d0a-810b-e5970fc95e2f -F qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-b55aa11b-46de-4d0a-810b-e5970fc95e2f.9266e43c-3b3e-48cc-94b6-55940eac2b88 Sep 07 10:06:57 devstack sudo[98440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:06:57 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef50805d-245e-4b61-bd94-44c4133cdbc0]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:06:57 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-ec5e7761-76fb-4d9e-9446-a5409cc05553 tempest-AttachVolumeTestJSON-1590815735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-3402059c-f50f-495d-b076-54595317dcd4 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:06:57 devstack sudo[98442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-3402059c-f50f-495d-b076-54595317dcd4 Sep 07 10:06:57 devstack sudo[98442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:06:57 devstack sudo[98440]: pam_unix(sudo:session): session closed for user root Sep 07 10:06:57 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-d35afabc-5c94-438e-9001-37020bb31bc4 tempest-VolumesSnapshotNegativeTestJSON-1342384825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b55aa11b-46de-4d0a-810b-e5970fc95e2f -F qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-b55aa11b-46de-4d0a-810b-e5970fc95e2f.9266e43c-3b3e-48cc-94b6-55940eac2b88" returned: 0 in 0.382s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:06:57 devstack cinder-volume[87515]: WARNING cinder.volume.drivers.remotefs [None req-d35afabc-5c94-438e-9001-37020bb31bc4 tempest-VolumesSnapshotNegativeTestJSON-1342384825 None] /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-b55aa11b-46de-4d0a-810b-e5970fc95e2f.9266e43c-3b3e-48cc-94b6-55940eac2b88 is being set with open permissions: ugo+rw Sep 07 10:06:57 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-d35afabc-5c94-438e-9001-37020bb31bc4 tempest-VolumesSnapshotNegativeTestJSON-1342384825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-b55aa11b-46de-4d0a-810b-e5970fc95e2f.9266e43c-3b3e-48cc-94b6-55940eac2b88 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:06:57 devstack sudo[98447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-b55aa11b-46de-4d0a-810b-e5970fc95e2f.9266e43c-3b3e-48cc-94b6-55940eac2b88 Sep 07 10:06:57 devstack sudo[98447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:06:57 devstack sudo[98442]: pam_unix(sudo:session): session closed for user root Sep 07 10:06:57 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-ec5e7761-76fb-4d9e-9446-a5409cc05553 tempest-AttachVolumeTestJSON-1590815735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-3402059c-f50f-495d-b076-54595317dcd4" returned: 0 in 0.503s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:06:57 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-ec5e7761-76fb-4d9e-9446-a5409cc05553 tempest-AttachVolumeTestJSON-1590815735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-3402059c-f50f-495d-b076-54595317dcd4 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:06:57 devstack sudo[98453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-3402059c-f50f-495d-b076-54595317dcd4 Sep 07 10:06:57 devstack sudo[98453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:06:57 devstack sudo[98447]: pam_unix(sudo:session): session closed for user root Sep 07 10:06:57 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-d35afabc-5c94-438e-9001-37020bb31bc4 tempest-VolumesSnapshotNegativeTestJSON-1342384825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-b55aa11b-46de-4d0a-810b-e5970fc95e2f.9266e43c-3b3e-48cc-94b6-55940eac2b88" returned: 0 in 0.363s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:06:58 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-d35afabc-5c94-438e-9001-37020bb31bc4 tempest-VolumesSnapshotNegativeTestJSON-1342384825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-b55aa11b-46de-4d0a-810b-e5970fc95e2f.info {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:06:58 devstack sudo[98456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-b55aa11b-46de-4d0a-810b-e5970fc95e2f.info Sep 07 10:06:58 devstack sudo[98456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:06:58 devstack sudo[98453]: pam_unix(sudo:session): session closed for user root Sep 07 10:06:58 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-ec5e7761-76fb-4d9e-9446-a5409cc05553 tempest-AttachVolumeTestJSON-1590815735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-3402059c-f50f-495d-b076-54595317dcd4" returned: 0 in 0.505s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:06:58 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-ec5e7761-76fb-4d9e-9446-a5409cc05553 tempest-AttachVolumeTestJSON-1590815735 None] Lock "cinder-quobyte-3402059c-f50f-495d-b076-54595317dcd4" released by "delete_volume" :: held 1.080s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:06:58 devstack cinder-volume[87515]: DEBUG cinder.quota [None req-ec5e7761-76fb-4d9e-9446-a5409cc05553 tempest-AttachVolumeTestJSON-1590815735 None] Created reservations ['e7848c86-51e4-4713-a7fe-b5a7781061cb', '0cba17e5-e80c-4f15-9a02-6ac5d3e05e22', 'de888bd6-a5d0-4ed3-a53f-c34820acbeae', 'cb9225b1-ec71-4dcd-b496-867d6137b974'] {{(pid=87515) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:06:58 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-ec5e7761-76fb-4d9e-9446-a5409cc05553 tempest-AttachVolumeTestJSON-1590815735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:06:58 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-ec5e7761-76fb-4d9e-9446-a5409cc05553 tempest-AttachVolumeTestJSON-1590815735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:06:58 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-ec5e7761-76fb-4d9e-9446-a5409cc05553 tempest-AttachVolumeTestJSON-1590815735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:06:58 devstack sudo[98456]: pam_unix(sudo:session): session closed for user root Sep 07 10:06:58 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-ec5e7761-76fb-4d9e-9446-a5409cc05553 tempest-AttachVolumeTestJSON-1590815735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:06:58 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-ec5e7761-76fb-4d9e-9446-a5409cc05553 tempest-AttachVolumeTestJSON-1590815735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:06:58 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-ec5e7761-76fb-4d9e-9446-a5409cc05553 tempest-AttachVolumeTestJSON-1590815735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:06:58 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-d35afabc-5c94-438e-9001-37020bb31bc4 tempest-VolumesSnapshotNegativeTestJSON-1342384825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-b55aa11b-46de-4d0a-810b-e5970fc95e2f.info" returned: 0 in 0.440s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:06:58 devstack cinder-volume[87515]: WARNING cinder.volume.drivers.remotefs [None req-d35afabc-5c94-438e-9001-37020bb31bc4 tempest-VolumesSnapshotNegativeTestJSON-1342384825 None] /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-b55aa11b-46de-4d0a-810b-e5970fc95e2f.info is being set with open permissions: ugo+rw Sep 07 10:06:58 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-d35afabc-5c94-438e-9001-37020bb31bc4 tempest-VolumesSnapshotNegativeTestJSON-1342384825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-b55aa11b-46de-4d0a-810b-e5970fc95e2f.info {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:06:58 devstack sudo[98460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a Sep 07 10:06:58 devstack sudo[98460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:06:58 devstack sudo[98461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-b55aa11b-46de-4d0a-810b-e5970fc95e2f.info Sep 07 10:06:58 devstack sudo[98461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:06:58 devstack sudo[98460]: pam_unix(sudo:session): session closed for user root Sep 07 10:06:58 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-ec5e7761-76fb-4d9e-9446-a5409cc05553 tempest-AttachVolumeTestJSON-1590815735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a" returned: 0 in 0.329s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:06:58 devstack cinder-volume[87515]: DEBUG cinder.manager [None req-ec5e7761-76fb-4d9e-9446-a5409cc05553 tempest-AttachVolumeTestJSON-1590815735 None] Notifying Schedulers of capabilities ... {{(pid=87515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:06:58 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-ec5e7761-76fb-4d9e-9446-a5409cc05553 tempest-AttachVolumeTestJSON-1590815735 None] Deleted volume successfully. Sep 07 10:06:58 devstack sudo[98461]: pam_unix(sudo:session): session closed for user root Sep 07 10:06:58 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-d35afabc-5c94-438e-9001-37020bb31bc4 tempest-VolumesSnapshotNegativeTestJSON-1342384825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-b55aa11b-46de-4d0a-810b-e5970fc95e2f.info" returned: 0 in 0.340s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:06:58 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-d35afabc-5c94-438e-9001-37020bb31bc4 tempest-VolumesSnapshotNegativeTestJSON-1342384825 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.844s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:06:58 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-ec5e7761-76fb-4d9e-9446-a5409cc05553 tempest-AttachVolumeTestJSON-1590815735 None] Lock "cinder-3402059c-f50f-495d-b076-54595317dcd4-delete_volume" released by "delete_volume" :: held 1.788s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:06:58 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-d35afabc-5c94-438e-9001-37020bb31bc4 tempest-VolumesSnapshotNegativeTestJSON-1342384825 None] Create snapshot completed successfully Sep 07 10:06:59 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-d5c2a8aa-b2be-4564-aa5f-d0f0a1783770 tempest-VolumesSnapshotNegativeTestJSON-1342384825 None] Acquiring lock "cinder-9266e43c-3b3e-48cc-94b6-55940eac2b88-delete_snapshot" by "delete_snapshot" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:06:59 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-d5c2a8aa-b2be-4564-aa5f-d0f0a1783770 tempest-VolumesSnapshotNegativeTestJSON-1342384825 None] Lock "cinder-9266e43c-3b3e-48cc-94b6-55940eac2b88-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:06:59 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-d5c2a8aa-b2be-4564-aa5f-d0f0a1783770 tempest-VolumesSnapshotNegativeTestJSON-1342384825 None] Acquiring lock "cinder-quobyte-b55aa11b-46de-4d0a-810b-e5970fc95e2f" by "delete_snapshot" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:06:59 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-ac76fd1c-b8c0-4b1c-a615-f9dad2b20024 tempest-AttachVolumeTestJSON-1590815735 None] Acquiring lock "cinder-9d26bcda-a1ec-41f1-94b5-ff6290430798-delete_volume" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:06:59 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-ac76fd1c-b8c0-4b1c-a615-f9dad2b20024 tempest-AttachVolumeTestJSON-1590815735 None] Lock "cinder-9d26bcda-a1ec-41f1-94b5-ff6290430798-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:06:59 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-d5c2a8aa-b2be-4564-aa5f-d0f0a1783770 tempest-VolumesSnapshotNegativeTestJSON-1342384825 None] Lock "cinder-quobyte-b55aa11b-46de-4d0a-810b-e5970fc95e2f" acquired by "delete_snapshot" :: waited 0.083s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:06:59 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-d5c2a8aa-b2be-4564-aa5f-d0f0a1783770 tempest-VolumesSnapshotNegativeTestJSON-1342384825 None] Acquiring lock "cinder-quobyte-9266e43c-3b3e-48cc-94b6-55940eac2b88" by "_delete_snapshot" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:06:59 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-d5c2a8aa-b2be-4564-aa5f-d0f0a1783770 tempest-VolumesSnapshotNegativeTestJSON-1342384825 None] Lock "cinder-quobyte-9266e43c-3b3e-48cc-94b6-55940eac2b88" acquired by "_delete_snapshot" :: waited 0.052s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:06:59 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-d5c2a8aa-b2be-4564-aa5f-d0f0a1783770 tempest-VolumesSnapshotNegativeTestJSON-1342384825 None] Deleting offline snapshot 9266e43c-3b3e-48cc-94b6-55940eac2b88 of volume b55aa11b-46de-4d0a-810b-e5970fc95e2f {{(pid=87515) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 10:06:59 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-d5c2a8aa-b2be-4564-aa5f-d0f0a1783770 tempest-VolumesSnapshotNegativeTestJSON-1342384825 None] snapshot_file for this snap is: volume-b55aa11b-46de-4d0a-810b-e5970fc95e2f.9266e43c-3b3e-48cc-94b6-55940eac2b88 {{(pid=87515) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 10:06:59 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[96913e8e-66d4-434d-97e4-58f4e794b86b]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:06:59 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-d5c2a8aa-b2be-4564-aa5f-d0f0a1783770 tempest-VolumesSnapshotNegativeTestJSON-1342384825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-b55aa11b-46de-4d0a-810b-e5970fc95e2f.9266e43c-3b3e-48cc-94b6-55940eac2b88 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:06:59 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-ac76fd1c-b8c0-4b1c-a615-f9dad2b20024 tempest-AttachVolumeTestJSON-1590815735 None] Acquiring lock "cinder-quobyte-9d26bcda-a1ec-41f1-94b5-ff6290430798" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:06:59 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-ac76fd1c-b8c0-4b1c-a615-f9dad2b20024 tempest-AttachVolumeTestJSON-1590815735 None] Lock "cinder-quobyte-9d26bcda-a1ec-41f1-94b5-ff6290430798" acquired by "delete_volume" :: waited 0.025s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:06:59 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[1727c840-bc7d-4c9f-9b7a-f21d8f37e05d]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:06:59 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-ac76fd1c-b8c0-4b1c-a615-f9dad2b20024 tempest-AttachVolumeTestJSON-1590815735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-9d26bcda-a1ec-41f1-94b5-ff6290430798 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:06:59 devstack sudo[98467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-b55aa11b-46de-4d0a-810b-e5970fc95e2f.9266e43c-3b3e-48cc-94b6-55940eac2b88 Sep 07 10:06:59 devstack sudo[98467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:06:59 devstack sudo[98468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-9d26bcda-a1ec-41f1-94b5-ff6290430798 Sep 07 10:06:59 devstack sudo[98468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:07:00 devstack sudo[98467]: pam_unix(sudo:session): session closed for user root Sep 07 10:07:00 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-d5c2a8aa-b2be-4564-aa5f-d0f0a1783770 tempest-VolumesSnapshotNegativeTestJSON-1342384825 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-b55aa11b-46de-4d0a-810b-e5970fc95e2f.9266e43c-3b3e-48cc-94b6-55940eac2b88" returned: 0 in 0.510s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:07:00 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-d5c2a8aa-b2be-4564-aa5f-d0f0a1783770 tempest-VolumesSnapshotNegativeTestJSON-1342384825 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b55aa11b-46de-4d0a-810b-e5970fc95e2f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87515) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 10:07:00 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4751b77-ca4e-4662-90ee-e7e0849d052d]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:07:00 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-d5c2a8aa-b2be-4564-aa5f-d0f0a1783770 tempest-VolumesSnapshotNegativeTestJSON-1342384825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-b55aa11b-46de-4d0a-810b-e5970fc95e2f {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:07:00 devstack sudo[98468]: pam_unix(sudo:session): session closed for user root Sep 07 10:07:00 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-ac76fd1c-b8c0-4b1c-a615-f9dad2b20024 tempest-AttachVolumeTestJSON-1590815735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-9d26bcda-a1ec-41f1-94b5-ff6290430798" returned: 0 in 0.588s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:07:00 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-ac76fd1c-b8c0-4b1c-a615-f9dad2b20024 tempest-AttachVolumeTestJSON-1590815735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-9d26bcda-a1ec-41f1-94b5-ff6290430798 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:07:00 devstack sudo[98477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-b55aa11b-46de-4d0a-810b-e5970fc95e2f Sep 07 10:07:00 devstack sudo[98477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:07:00 devstack sudo[98479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-9d26bcda-a1ec-41f1-94b5-ff6290430798 Sep 07 10:07:00 devstack sudo[98479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:07:00 devstack sudo[98479]: pam_unix(sudo:session): session closed for user root Sep 07 10:07:00 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-ac76fd1c-b8c0-4b1c-a615-f9dad2b20024 tempest-AttachVolumeTestJSON-1590815735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-9d26bcda-a1ec-41f1-94b5-ff6290430798" returned: 0 in 0.375s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:07:00 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-ac76fd1c-b8c0-4b1c-a615-f9dad2b20024 tempest-AttachVolumeTestJSON-1590815735 None] Lock "cinder-quobyte-9d26bcda-a1ec-41f1-94b5-ff6290430798" released by "delete_volume" :: held 1.029s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:07:00 devstack sudo[98477]: pam_unix(sudo:session): session closed for user root Sep 07 10:07:00 devstack cinder-volume[87515]: DEBUG cinder.quota [None req-ac76fd1c-b8c0-4b1c-a615-f9dad2b20024 tempest-AttachVolumeTestJSON-1590815735 None] Created reservations ['952cb83c-d442-40ba-bc61-21e37a8570c7', '80d125b9-30dd-43d1-b050-f38f8c2c0158', '80f5e00e-f193-48f8-8ca9-4b1c5338e15c', 'c18cce55-a54d-4201-9548-c87e2372d43a'] {{(pid=87515) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:07:00 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-d5c2a8aa-b2be-4564-aa5f-d0f0a1783770 tempest-VolumesSnapshotNegativeTestJSON-1342384825 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-b55aa11b-46de-4d0a-810b-e5970fc95e2f" returned: 0 in 0.611s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:07:00 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-d5c2a8aa-b2be-4564-aa5f-d0f0a1783770 tempest-VolumesSnapshotNegativeTestJSON-1342384825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-b55aa11b-46de-4d0a-810b-e5970fc95e2f.9266e43c-3b3e-48cc-94b6-55940eac2b88 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:07:00 devstack sudo[98486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-b55aa11b-46de-4d0a-810b-e5970fc95e2f.9266e43c-3b3e-48cc-94b6-55940eac2b88 Sep 07 10:07:00 devstack sudo[98486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:07:00 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-ac76fd1c-b8c0-4b1c-a615-f9dad2b20024 tempest-AttachVolumeTestJSON-1590815735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:07:00 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-ac76fd1c-b8c0-4b1c-a615-f9dad2b20024 tempest-AttachVolumeTestJSON-1590815735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:07:00 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-ac76fd1c-b8c0-4b1c-a615-f9dad2b20024 tempest-AttachVolumeTestJSON-1590815735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:07:00 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-ac76fd1c-b8c0-4b1c-a615-f9dad2b20024 tempest-AttachVolumeTestJSON-1590815735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:07:00 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-ac76fd1c-b8c0-4b1c-a615-f9dad2b20024 tempest-AttachVolumeTestJSON-1590815735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:07:00 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-ac76fd1c-b8c0-4b1c-a615-f9dad2b20024 tempest-AttachVolumeTestJSON-1590815735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:07:00 devstack sudo[98488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a Sep 07 10:07:00 devstack sudo[98488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:07:01 devstack sudo[98486]: pam_unix(sudo:session): session closed for user root Sep 07 10:07:01 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-d5c2a8aa-b2be-4564-aa5f-d0f0a1783770 tempest-VolumesSnapshotNegativeTestJSON-1342384825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-b55aa11b-46de-4d0a-810b-e5970fc95e2f.9266e43c-3b3e-48cc-94b6-55940eac2b88" returned: 0 in 0.408s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:07:01 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-d5c2a8aa-b2be-4564-aa5f-d0f0a1783770 tempest-VolumesSnapshotNegativeTestJSON-1342384825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-b55aa11b-46de-4d0a-810b-e5970fc95e2f.9266e43c-3b3e-48cc-94b6-55940eac2b88 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:07:01 devstack sudo[98488]: pam_unix(sudo:session): session closed for user root Sep 07 10:07:01 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-ac76fd1c-b8c0-4b1c-a615-f9dad2b20024 tempest-AttachVolumeTestJSON-1590815735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a" returned: 0 in 0.325s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:07:01 devstack cinder-volume[87515]: DEBUG cinder.manager [None req-ac76fd1c-b8c0-4b1c-a615-f9dad2b20024 tempest-AttachVolumeTestJSON-1590815735 None] Notifying Schedulers of capabilities ... {{(pid=87515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:07:01 devstack sudo[98494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-b55aa11b-46de-4d0a-810b-e5970fc95e2f.9266e43c-3b3e-48cc-94b6-55940eac2b88 Sep 07 10:07:01 devstack sudo[98494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:07:01 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-ac76fd1c-b8c0-4b1c-a615-f9dad2b20024 tempest-AttachVolumeTestJSON-1590815735 None] Deleted volume successfully. Sep 07 10:07:01 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-ac76fd1c-b8c0-4b1c-a615-f9dad2b20024 tempest-AttachVolumeTestJSON-1590815735 None] Lock "cinder-9d26bcda-a1ec-41f1-94b5-ff6290430798-delete_volume" released by "delete_volume" :: held 1.765s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:07:01 devstack sudo[98494]: pam_unix(sudo:session): session closed for user root Sep 07 10:07:01 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-d5c2a8aa-b2be-4564-aa5f-d0f0a1783770 tempest-VolumesSnapshotNegativeTestJSON-1342384825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-b55aa11b-46de-4d0a-810b-e5970fc95e2f.9266e43c-3b3e-48cc-94b6-55940eac2b88" returned: 0 in 0.323s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:07:01 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-d5c2a8aa-b2be-4564-aa5f-d0f0a1783770 tempest-VolumesSnapshotNegativeTestJSON-1342384825 None] Lock "cinder-quobyte-9266e43c-3b3e-48cc-94b6-55940eac2b88" released by "_delete_snapshot" :: held 2.025s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:07:01 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-d5c2a8aa-b2be-4564-aa5f-d0f0a1783770 tempest-VolumesSnapshotNegativeTestJSON-1342384825 None] Lock "cinder-quobyte-b55aa11b-46de-4d0a-810b-e5970fc95e2f" released by "delete_snapshot" :: held 2.096s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:07:01 devstack cinder-volume[87515]: DEBUG cinder.quota [None req-d5c2a8aa-b2be-4564-aa5f-d0f0a1783770 tempest-VolumesSnapshotNegativeTestJSON-1342384825 None] Created reservations ['84e32a03-02a5-4017-92e6-6dff48ce7383', '345bf8c6-849c-4441-9025-72c1b149613e', 'b74bc2e7-517b-4f29-81b6-b9a53f51e94e', 'd1311af3-5387-4c7d-aaec-e0f8b747d148'] {{(pid=87515) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:07:01 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-d5c2a8aa-b2be-4564-aa5f-d0f0a1783770 tempest-VolumesSnapshotNegativeTestJSON-1342384825 None] Delete snapshot completed successfully. Sep 07 10:07:01 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-d5c2a8aa-b2be-4564-aa5f-d0f0a1783770 tempest-VolumesSnapshotNegativeTestJSON-1342384825 None] Lock "cinder-9266e43c-3b3e-48cc-94b6-55940eac2b88-delete_snapshot" released by "delete_snapshot" :: held 2.449s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:07:01 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-b43fa65f-c09f-42ed-af54-26e4798ed537 tempest-AttachVolumeTestJSON-1590815735 None] Acquiring lock "cinder-f3cbf7d0-c035-4334-a5d3-89d79ae3af8b-delete_volume" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:07:01 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-b43fa65f-c09f-42ed-af54-26e4798ed537 tempest-AttachVolumeTestJSON-1590815735 None] Lock "cinder-f3cbf7d0-c035-4334-a5d3-89d79ae3af8b-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:07:02 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-b43fa65f-c09f-42ed-af54-26e4798ed537 tempest-AttachVolumeTestJSON-1590815735 None] Acquiring lock "cinder-quobyte-f3cbf7d0-c035-4334-a5d3-89d79ae3af8b" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:07:02 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-b43fa65f-c09f-42ed-af54-26e4798ed537 tempest-AttachVolumeTestJSON-1590815735 None] Lock "cinder-quobyte-f3cbf7d0-c035-4334-a5d3-89d79ae3af8b" acquired by "delete_volume" :: waited 0.024s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:07:02 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5511a61-cb0b-4c12-8693-54222133b318]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:07:02 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-b43fa65f-c09f-42ed-af54-26e4798ed537 tempest-AttachVolumeTestJSON-1590815735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-f3cbf7d0-c035-4334-a5d3-89d79ae3af8b {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:07:02 devstack sudo[98497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-f3cbf7d0-c035-4334-a5d3-89d79ae3af8b Sep 07 10:07:02 devstack sudo[98497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:07:02 devstack sudo[98497]: pam_unix(sudo:session): session closed for user root Sep 07 10:07:02 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-b43fa65f-c09f-42ed-af54-26e4798ed537 tempest-AttachVolumeTestJSON-1590815735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-f3cbf7d0-c035-4334-a5d3-89d79ae3af8b" returned: 0 in 0.459s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:07:02 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-b43fa65f-c09f-42ed-af54-26e4798ed537 tempest-AttachVolumeTestJSON-1590815735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-f3cbf7d0-c035-4334-a5d3-89d79ae3af8b {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:07:02 devstack sudo[98504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-f3cbf7d0-c035-4334-a5d3-89d79ae3af8b Sep 07 10:07:02 devstack sudo[98504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:07:02 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-df63c8ca-6818-4fe9-a381-28b49c583f52 tempest-VolumesSnapshotNegativeTestJSON-1342384825 None] Acquiring lock "cinder-b55aa11b-46de-4d0a-810b-e5970fc95e2f-delete_volume" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:07:02 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-df63c8ca-6818-4fe9-a381-28b49c583f52 tempest-VolumesSnapshotNegativeTestJSON-1342384825 None] Lock "cinder-b55aa11b-46de-4d0a-810b-e5970fc95e2f-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:07:02 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-df63c8ca-6818-4fe9-a381-28b49c583f52 tempest-VolumesSnapshotNegativeTestJSON-1342384825 None] Acquiring lock "cinder-quobyte-b55aa11b-46de-4d0a-810b-e5970fc95e2f" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:07:02 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-df63c8ca-6818-4fe9-a381-28b49c583f52 tempest-VolumesSnapshotNegativeTestJSON-1342384825 None] Lock "cinder-quobyte-b55aa11b-46de-4d0a-810b-e5970fc95e2f" acquired by "delete_volume" :: waited 0.018s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:07:02 devstack sudo[98504]: pam_unix(sudo:session): session closed for user root Sep 07 10:07:02 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-b43fa65f-c09f-42ed-af54-26e4798ed537 tempest-AttachVolumeTestJSON-1590815735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-f3cbf7d0-c035-4334-a5d3-89d79ae3af8b" returned: 0 in 0.339s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:07:02 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ce3ae6a-0d8f-4385-a5f4-74db8adf3e1a]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:07:02 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-df63c8ca-6818-4fe9-a381-28b49c583f52 tempest-VolumesSnapshotNegativeTestJSON-1342384825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-b55aa11b-46de-4d0a-810b-e5970fc95e2f {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:07:02 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-b43fa65f-c09f-42ed-af54-26e4798ed537 tempest-AttachVolumeTestJSON-1590815735 None] Lock "cinder-quobyte-f3cbf7d0-c035-4334-a5d3-89d79ae3af8b" released by "delete_volume" :: held 0.865s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:07:02 devstack cinder-volume[87515]: DEBUG cinder.quota [None req-b43fa65f-c09f-42ed-af54-26e4798ed537 tempest-AttachVolumeTestJSON-1590815735 None] Created reservations ['60b12d71-e5d2-482f-8397-04c1e3b4e755', '7b74d781-1f55-4caa-908a-7d9a6f7df390', 'd2394c98-67b4-4e46-b34a-60ed7c785034', '4f00f24b-a324-4dc2-b361-92d70c38b4ec'] {{(pid=87515) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:07:03 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-b43fa65f-c09f-42ed-af54-26e4798ed537 tempest-AttachVolumeTestJSON-1590815735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:07:03 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-b43fa65f-c09f-42ed-af54-26e4798ed537 tempest-AttachVolumeTestJSON-1590815735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:07:03 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-b43fa65f-c09f-42ed-af54-26e4798ed537 tempest-AttachVolumeTestJSON-1590815735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:07:03 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-b43fa65f-c09f-42ed-af54-26e4798ed537 tempest-AttachVolumeTestJSON-1590815735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:07:03 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-b43fa65f-c09f-42ed-af54-26e4798ed537 tempest-AttachVolumeTestJSON-1590815735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:07:03 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-b43fa65f-c09f-42ed-af54-26e4798ed537 tempest-AttachVolumeTestJSON-1590815735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:07:03 devstack sudo[98508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a Sep 07 10:07:03 devstack sudo[98508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:07:03 devstack sudo[98507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-b55aa11b-46de-4d0a-810b-e5970fc95e2f Sep 07 10:07:03 devstack sudo[98507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:07:03 devstack sudo[98508]: pam_unix(sudo:session): session closed for user root Sep 07 10:07:03 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-b43fa65f-c09f-42ed-af54-26e4798ed537 tempest-AttachVolumeTestJSON-1590815735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a" returned: 0 in 0.277s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:07:03 devstack cinder-volume[87515]: DEBUG cinder.manager [None req-b43fa65f-c09f-42ed-af54-26e4798ed537 tempest-AttachVolumeTestJSON-1590815735 None] Notifying Schedulers of capabilities ... {{(pid=87515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:07:03 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-b43fa65f-c09f-42ed-af54-26e4798ed537 tempest-AttachVolumeTestJSON-1590815735 None] Deleted volume successfully. Sep 07 10:07:03 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-b43fa65f-c09f-42ed-af54-26e4798ed537 tempest-AttachVolumeTestJSON-1590815735 None] Lock "cinder-f3cbf7d0-c035-4334-a5d3-89d79ae3af8b-delete_volume" released by "delete_volume" :: held 1.449s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:07:03 devstack sudo[98507]: pam_unix(sudo:session): session closed for user root Sep 07 10:07:03 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-df63c8ca-6818-4fe9-a381-28b49c583f52 tempest-VolumesSnapshotNegativeTestJSON-1342384825 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-b55aa11b-46de-4d0a-810b-e5970fc95e2f" returned: 0 in 0.697s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:07:03 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-df63c8ca-6818-4fe9-a381-28b49c583f52 tempest-VolumesSnapshotNegativeTestJSON-1342384825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-b55aa11b-46de-4d0a-810b-e5970fc95e2f {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:07:03 devstack sudo[98515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-b55aa11b-46de-4d0a-810b-e5970fc95e2f Sep 07 10:07:03 devstack sudo[98515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:07:03 devstack sudo[98515]: pam_unix(sudo:session): session closed for user root Sep 07 10:07:03 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-df63c8ca-6818-4fe9-a381-28b49c583f52 tempest-VolumesSnapshotNegativeTestJSON-1342384825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-b55aa11b-46de-4d0a-810b-e5970fc95e2f" returned: 0 in 0.356s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:07:03 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-df63c8ca-6818-4fe9-a381-28b49c583f52 tempest-VolumesSnapshotNegativeTestJSON-1342384825 None] Lock "cinder-quobyte-b55aa11b-46de-4d0a-810b-e5970fc95e2f" released by "delete_volume" :: held 1.137s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:07:04 devstack cinder-volume[87515]: DEBUG cinder.quota [None req-df63c8ca-6818-4fe9-a381-28b49c583f52 tempest-VolumesSnapshotNegativeTestJSON-1342384825 None] Created reservations ['6fbd6e54-7edf-426a-bd14-d9d5bb8cffe6', '13d04aab-0431-4cef-ad1a-0a9564f06640', 'cd423196-dbcc-4611-b55e-fce99ce1df30', 'aefdb923-b880-4894-92a0-1bb0846747d4'] {{(pid=87515) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:07:04 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-df63c8ca-6818-4fe9-a381-28b49c583f52 tempest-VolumesSnapshotNegativeTestJSON-1342384825 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:07:04 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-df63c8ca-6818-4fe9-a381-28b49c583f52 tempest-VolumesSnapshotNegativeTestJSON-1342384825 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:07:04 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-df63c8ca-6818-4fe9-a381-28b49c583f52 tempest-VolumesSnapshotNegativeTestJSON-1342384825 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:07:04 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-df63c8ca-6818-4fe9-a381-28b49c583f52 tempest-VolumesSnapshotNegativeTestJSON-1342384825 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:07:04 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-df63c8ca-6818-4fe9-a381-28b49c583f52 tempest-VolumesSnapshotNegativeTestJSON-1342384825 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:07:04 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-df63c8ca-6818-4fe9-a381-28b49c583f52 tempest-VolumesSnapshotNegativeTestJSON-1342384825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:07:04 devstack sudo[98518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a Sep 07 10:07:04 devstack sudo[98518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:07:04 devstack sudo[98518]: pam_unix(sudo:session): session closed for user root Sep 07 10:07:04 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-df63c8ca-6818-4fe9-a381-28b49c583f52 tempest-VolumesSnapshotNegativeTestJSON-1342384825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a" returned: 0 in 0.401s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:07:04 devstack cinder-volume[87515]: DEBUG cinder.manager [None req-df63c8ca-6818-4fe9-a381-28b49c583f52 tempest-VolumesSnapshotNegativeTestJSON-1342384825 None] Notifying Schedulers of capabilities ... {{(pid=87515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:07:04 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-df63c8ca-6818-4fe9-a381-28b49c583f52 tempest-VolumesSnapshotNegativeTestJSON-1342384825 None] Deleted volume successfully. Sep 07 10:07:04 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-df63c8ca-6818-4fe9-a381-28b49c583f52 tempest-VolumesSnapshotNegativeTestJSON-1342384825 None] Lock "cinder-b55aa11b-46de-4d0a-810b-e5970fc95e2f-delete_volume" released by "delete_volume" :: held 1.845s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:07:04 devstack cinder-volume[87515]: DEBUG cinder.volume.flows.manager.create_volume [None req-fd748b11-faff-4798-8431-b7cdc11ca34c tempest-SnapshotsActionsTest-158812568 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 10:07:04 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-fd748b11-faff-4798-8431-b7cdc11ca34c tempest-SnapshotsActionsTest-158812568 None] Flow 'volume_create_manager' (4cc6cbbc-15fb-4cd5-a7ad-1f39b383a153) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:07:04 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-fd748b11-faff-4798-8431-b7cdc11ca34c tempest-SnapshotsActionsTest-158812568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5db0f13a-79e9-4636-a92d-c99de3f22a4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:07:04 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-fd748b11-faff-4798-8431-b7cdc11ca34c tempest-SnapshotsActionsTest-158812568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5db0f13a-79e9-4636-a92d-c99de3f22a4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:07:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-943186035',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=640722de-3f4c-4434-9712-126398038f41,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5288ebf4010d401bbc6b7ccd7c90da47',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:07:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:07:05Z,use_quota=True,user_id='2fb4e65913b142d28e688f935418092b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3a092cd-7947-4cbf-abff-4ba9567becf0),volume_type_id=f3a092cd-7947-4cbf-abff-4ba9567becf0)' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:07:04 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-fd748b11-faff-4798-8431-b7cdc11ca34c tempest-SnapshotsActionsTest-158812568 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3de806b-314b-4070-88b9-5914519078db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:07:04 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-fd748b11-faff-4798-8431-b7cdc11ca34c tempest-SnapshotsActionsTest-158812568 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3de806b-314b-4070-88b9-5914519078db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:07:04 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-fd748b11-faff-4798-8431-b7cdc11ca34c tempest-SnapshotsActionsTest-158812568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37ab1765-acc6-42da-bd3d-a6e6cbf4c49f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:07:04 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-fd748b11-faff-4798-8431-b7cdc11ca34c tempest-SnapshotsActionsTest-158812568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37ab1765-acc6-42da-bd3d-a6e6cbf4c49f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '640722de-3f4c-4434-9712-126398038f41', 'volume_name': 'volume-640722de-3f4c-4434-9712-126398038f41', 'volume_size': 1}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:07:04 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-fd748b11-faff-4798-8431-b7cdc11ca34c tempest-SnapshotsActionsTest-158812568 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c065e9b-4974-44f0-a77e-9f734eb8afbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:07:04 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-fd748b11-faff-4798-8431-b7cdc11ca34c tempest-SnapshotsActionsTest-158812568 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c065e9b-4974-44f0-a77e-9f734eb8afbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:07:04 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-fd748b11-faff-4798-8431-b7cdc11ca34c tempest-SnapshotsActionsTest-158812568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67d3302d-fee2-49c0-8b3a-db7324d408cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:07:04 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-fd748b11-faff-4798-8431-b7cdc11ca34c tempest-SnapshotsActionsTest-158812568 None] Volume 640722de-3f4c-4434-9712-126398038f41: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-640722de-3f4c-4434-9712-126398038f41', 'volume_size': 1} Sep 07 10:07:04 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-fd748b11-faff-4798-8431-b7cdc11ca34c tempest-SnapshotsActionsTest-158812568 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:07:04 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-fd748b11-faff-4798-8431-b7cdc11ca34c tempest-SnapshotsActionsTest-158812568 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:07:04 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-fd748b11-faff-4798-8431-b7cdc11ca34c tempest-SnapshotsActionsTest-158812568 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:07:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-943186035',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=640722de-3f4c-4434-9712-126398038f41,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5288ebf4010d401bbc6b7ccd7c90da47',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:07:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:07:05Z,use_quota=True,user_id='2fb4e65913b142d28e688f935418092b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3a092cd-7947-4cbf-abff-4ba9567becf0),volume_type_id=f3a092cd-7947-4cbf-abff-4ba9567becf0)}" {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 10:07:04 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-fd748b11-faff-4798-8431-b7cdc11ca34c tempest-SnapshotsActionsTest-158812568 None] Creating volume 640722de-3f4c-4434-9712-126398038f41 {{(pid=87515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 10:07:04 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-fd748b11-faff-4798-8431-b7cdc11ca34c tempest-SnapshotsActionsTest-158812568 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:07:04 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-fd748b11-faff-4798-8431-b7cdc11ca34c tempest-SnapshotsActionsTest-158812568 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:07:04 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-fd748b11-faff-4798-8431-b7cdc11ca34c tempest-SnapshotsActionsTest-158812568 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:07:05 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-fd748b11-faff-4798-8431-b7cdc11ca34c tempest-SnapshotsActionsTest-158812568 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:07:05 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-fd748b11-faff-4798-8431-b7cdc11ca34c tempest-SnapshotsActionsTest-158812568 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:07:05 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-fd748b11-faff-4798-8431-b7cdc11ca34c tempest-SnapshotsActionsTest-158812568 None] Selected osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c as target Quobyte volume. {{(pid=87515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 10:07:05 devstack cinder-volume[87515]: INFO cinder.volume.drivers.remotefs [None req-fd748b11-faff-4798-8431-b7cdc11ca34c tempest-SnapshotsActionsTest-158812568 None] casted to osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c Sep 07 10:07:05 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-fd748b11-faff-4798-8431-b7cdc11ca34c tempest-SnapshotsActionsTest-158812568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-640722de-3f4c-4434-9712-126398038f41 1073741824 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:07:05 devstack sudo[98521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-640722de-3f4c-4434-9712-126398038f41 1073741824 Sep 07 10:07:05 devstack sudo[98521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:07:05 devstack sudo[98521]: pam_unix(sudo:session): session closed for user root Sep 07 10:07:05 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-fd748b11-faff-4798-8431-b7cdc11ca34c tempest-SnapshotsActionsTest-158812568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-640722de-3f4c-4434-9712-126398038f41 1073741824" returned: 0 in 0.640s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:07:05 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-fd748b11-faff-4798-8431-b7cdc11ca34c tempest-SnapshotsActionsTest-158812568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-640722de-3f4c-4434-9712-126398038f41 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:07:05 devstack sudo[98529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-640722de-3f4c-4434-9712-126398038f41 Sep 07 10:07:05 devstack sudo[98529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:07:06 devstack sudo[98529]: pam_unix(sudo:session): session closed for user root Sep 07 10:07:06 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-fd748b11-faff-4798-8431-b7cdc11ca34c tempest-SnapshotsActionsTest-158812568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-640722de-3f4c-4434-9712-126398038f41" returned: 0 in 0.451s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:07:06 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-fd748b11-faff-4798-8431-b7cdc11ca34c tempest-SnapshotsActionsTest-158812568 None] <== create_volume: return (1162ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'} {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 10:07:06 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-fd748b11-faff-4798-8431-b7cdc11ca34c tempest-SnapshotsActionsTest-158812568 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.165s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:07:06 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-fd748b11-faff-4798-8431-b7cdc11ca34c tempest-SnapshotsActionsTest-158812568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67d3302d-fee2-49c0-8b3a-db7324d408cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-640722de-3f4c-4434-9712-126398038f41', 'volume_size': 1}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:07:06 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-fd748b11-faff-4798-8431-b7cdc11ca34c tempest-SnapshotsActionsTest-158812568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3726ed62-8215-40c3-a61d-1e3cef82a87a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:07:06 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-fd748b11-faff-4798-8431-b7cdc11ca34c tempest-SnapshotsActionsTest-158812568 None] Volume volume-640722de-3f4c-4434-9712-126398038f41 (640722de-3f4c-4434-9712-126398038f41): created successfully Sep 07 10:07:06 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-fd748b11-faff-4798-8431-b7cdc11ca34c tempest-SnapshotsActionsTest-158812568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3726ed62-8215-40c3-a61d-1e3cef82a87a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:07:06 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-fd748b11-faff-4798-8431-b7cdc11ca34c tempest-SnapshotsActionsTest-158812568 None] Flow 'volume_create_manager' (4cc6cbbc-15fb-4cd5-a7ad-1f39b383a153) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:07:06 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-fd748b11-faff-4798-8431-b7cdc11ca34c tempest-SnapshotsActionsTest-158812568 None] Created volume successfully. Sep 07 10:07:07 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-219ffd8b-c60c-4602-b3e2-49129ad22d38 tempest-SnapshotsActionsTest-158812568 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:07:07 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-219ffd8b-c60c-4602-b3e2-49129ad22d38 tempest-SnapshotsActionsTest-158812568 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:07:07 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-219ffd8b-c60c-4602-b3e2-49129ad22d38 tempest-SnapshotsActionsTest-158812568 None] Creating offline snapshot e31bfd3f-4446-4c21-a386-572c14dcfc9e of volume 640722de-3f4c-4434-9712-126398038f41 {{(pid=87515) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 10:07:07 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f0c3042-7dcf-4e32-b6b7-d1e2cb521980]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:07:07 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-219ffd8b-c60c-4602-b3e2-49129ad22d38 tempest-SnapshotsActionsTest-158812568 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-640722de-3f4c-4434-9712-126398038f41 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:07:07 devstack sudo[98532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-640722de-3f4c-4434-9712-126398038f41 Sep 07 10:07:07 devstack sudo[98532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:07:07 devstack sudo[98532]: pam_unix(sudo:session): session closed for user root Sep 07 10:07:07 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-219ffd8b-c60c-4602-b3e2-49129ad22d38 tempest-SnapshotsActionsTest-158812568 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-640722de-3f4c-4434-9712-126398038f41" returned: 0 in 0.421s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:07:07 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-219ffd8b-c60c-4602-b3e2-49129ad22d38 tempest-SnapshotsActionsTest-158812568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-640722de-3f4c-4434-9712-126398038f41,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-640722de-3f4c-4434-9712-126398038f41.e31bfd3f-4446-4c21-a386-572c14dcfc9e 1G {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:07:07 devstack sudo[98538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-640722de-3f4c-4434-9712-126398038f41,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-640722de-3f4c-4434-9712-126398038f41.e31bfd3f-4446-4c21-a386-572c14dcfc9e 1G Sep 07 10:07:07 devstack sudo[98538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:07:08 devstack sudo[98538]: pam_unix(sudo:session): session closed for user root Sep 07 10:07:08 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-219ffd8b-c60c-4602-b3e2-49129ad22d38 tempest-SnapshotsActionsTest-158812568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-640722de-3f4c-4434-9712-126398038f41,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-640722de-3f4c-4434-9712-126398038f41.e31bfd3f-4446-4c21-a386-572c14dcfc9e 1G" returned: 0 in 0.639s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:07:08 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-219ffd8b-c60c-4602-b3e2-49129ad22d38 tempest-SnapshotsActionsTest-158812568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-640722de-3f4c-4434-9712-126398038f41 -F qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-640722de-3f4c-4434-9712-126398038f41.e31bfd3f-4446-4c21-a386-572c14dcfc9e {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:07:08 devstack sudo[98544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-640722de-3f4c-4434-9712-126398038f41 -F qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-640722de-3f4c-4434-9712-126398038f41.e31bfd3f-4446-4c21-a386-572c14dcfc9e Sep 07 10:07:08 devstack sudo[98544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:07:08 devstack sudo[98544]: pam_unix(sudo:session): session closed for user root Sep 07 10:07:08 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-219ffd8b-c60c-4602-b3e2-49129ad22d38 tempest-SnapshotsActionsTest-158812568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-640722de-3f4c-4434-9712-126398038f41 -F qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-640722de-3f4c-4434-9712-126398038f41.e31bfd3f-4446-4c21-a386-572c14dcfc9e" returned: 0 in 0.410s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:07:08 devstack cinder-volume[87515]: WARNING cinder.volume.drivers.remotefs [None req-219ffd8b-c60c-4602-b3e2-49129ad22d38 tempest-SnapshotsActionsTest-158812568 None] /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-640722de-3f4c-4434-9712-126398038f41.e31bfd3f-4446-4c21-a386-572c14dcfc9e is being set with open permissions: ugo+rw Sep 07 10:07:08 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-219ffd8b-c60c-4602-b3e2-49129ad22d38 tempest-SnapshotsActionsTest-158812568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-640722de-3f4c-4434-9712-126398038f41.e31bfd3f-4446-4c21-a386-572c14dcfc9e {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:07:08 devstack sudo[98550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-640722de-3f4c-4434-9712-126398038f41.e31bfd3f-4446-4c21-a386-572c14dcfc9e Sep 07 10:07:08 devstack sudo[98550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:07:09 devstack sudo[98550]: pam_unix(sudo:session): session closed for user root Sep 07 10:07:09 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-219ffd8b-c60c-4602-b3e2-49129ad22d38 tempest-SnapshotsActionsTest-158812568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-640722de-3f4c-4434-9712-126398038f41.e31bfd3f-4446-4c21-a386-572c14dcfc9e" returned: 0 in 0.290s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:07:09 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-219ffd8b-c60c-4602-b3e2-49129ad22d38 tempest-SnapshotsActionsTest-158812568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-640722de-3f4c-4434-9712-126398038f41.info {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:07:09 devstack sudo[98553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-640722de-3f4c-4434-9712-126398038f41.info Sep 07 10:07:09 devstack sudo[98553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:07:09 devstack sudo[98553]: pam_unix(sudo:session): session closed for user root Sep 07 10:07:09 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-219ffd8b-c60c-4602-b3e2-49129ad22d38 tempest-SnapshotsActionsTest-158812568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-640722de-3f4c-4434-9712-126398038f41.info" returned: 0 in 0.443s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:07:09 devstack cinder-volume[87515]: WARNING cinder.volume.drivers.remotefs [None req-219ffd8b-c60c-4602-b3e2-49129ad22d38 tempest-SnapshotsActionsTest-158812568 None] /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-640722de-3f4c-4434-9712-126398038f41.info is being set with open permissions: ugo+rw Sep 07 10:07:09 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-219ffd8b-c60c-4602-b3e2-49129ad22d38 tempest-SnapshotsActionsTest-158812568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-640722de-3f4c-4434-9712-126398038f41.info {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:07:09 devstack sudo[98557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-640722de-3f4c-4434-9712-126398038f41.info Sep 07 10:07:09 devstack sudo[98557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:07:09 devstack sudo[98557]: pam_unix(sudo:session): session closed for user root Sep 07 10:07:09 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-219ffd8b-c60c-4602-b3e2-49129ad22d38 tempest-SnapshotsActionsTest-158812568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-640722de-3f4c-4434-9712-126398038f41.info" returned: 0 in 0.305s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:07:10 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-219ffd8b-c60c-4602-b3e2-49129ad22d38 tempest-SnapshotsActionsTest-158812568 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.656s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:07:10 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-219ffd8b-c60c-4602-b3e2-49129ad22d38 tempest-SnapshotsActionsTest-158812568 None] Create snapshot completed successfully Sep 07 10:07:11 devstack cinder-volume[87515]: DEBUG oslo_service.periodic_task [None req-cebd6a9d-3073-42a1-b65a-b38d444d85ed None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87515) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 10:07:11 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-cebd6a9d-3073-42a1-b65a-b38d444d85ed None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:07:11 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-cebd6a9d-3073-42a1-b65a-b38d444d85ed None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:07:11 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-cebd6a9d-3073-42a1-b65a-b38d444d85ed None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:07:11 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-cebd6a9d-3073-42a1-b65a-b38d444d85ed None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:07:11 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-cebd6a9d-3073-42a1-b65a-b38d444d85ed None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:07:11 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-cebd6a9d-3073-42a1-b65a-b38d444d85ed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:07:11 devstack sudo[98560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a Sep 07 10:07:11 devstack sudo[98560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:07:11 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-351ecb40-c5dd-4adf-adcb-fcc7943cb9f0 tempest-SnapshotsActionsTest-158812568 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:07:11 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-351ecb40-c5dd-4adf-adcb-fcc7943cb9f0 tempest-SnapshotsActionsTest-158812568 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:07:11 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-351ecb40-c5dd-4adf-adcb-fcc7943cb9f0 tempest-SnapshotsActionsTest-158812568 None] Creating offline snapshot 165c940b-6999-4eb6-a8a6-01a1d2ac139b of volume 640722de-3f4c-4434-9712-126398038f41 {{(pid=87515) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 10:07:11 devstack cinder-volume[87515]: DEBUG cinder.volume.flows.manager.create_volume [None req-6adad4a3-e58c-470c-a24a-8b5a029c56ae tempest-TestInstancesWithCinderVolumes-120733040 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 10:07:11 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-6adad4a3-e58c-470c-a24a-8b5a029c56ae tempest-TestInstancesWithCinderVolumes-120733040 None] Flow 'volume_create_manager' (b17dcb5b-96b9-429e-9c5f-e5fa3e652a9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:07:11 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-6adad4a3-e58c-470c-a24a-8b5a029c56ae tempest-TestInstancesWithCinderVolumes-120733040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e46e43fa-108e-4f2f-80c1-c1e06f5574e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:07:11 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5a13556-bb22-47b7-819b-d666ead7d675]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:07:11 devstack sudo[98560]: pam_unix(sudo:session): session closed for user root Sep 07 10:07:11 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-351ecb40-c5dd-4adf-adcb-fcc7943cb9f0 tempest-SnapshotsActionsTest-158812568 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-640722de-3f4c-4434-9712-126398038f41.e31bfd3f-4446-4c21-a386-572c14dcfc9e {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:07:11 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-cebd6a9d-3073-42a1-b65a-b38d444d85ed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a" returned: 0 in 0.384s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:07:11 devstack cinder-volume[87515]: DEBUG cinder.manager [None req-cebd6a9d-3073-42a1-b65a-b38d444d85ed None None] Notifying Schedulers of capabilities ... {{(pid=87515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:07:11 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-6adad4a3-e58c-470c-a24a-8b5a029c56ae tempest-TestInstancesWithCinderVolumes-120733040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e46e43fa-108e-4f2f-80c1-c1e06f5574e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:07:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-919186303',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b27dbd06-be27-4f26-9495-8ff98607c90b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e58e36387544e9bbe7359cb5d265361',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:07:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:07:12Z,use_quota=True,user_id='92b1206c699547f39f95f0f1b1b345ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8db6161-8d8a-468a-af6d-1f9fc786d0d3),volume_type_id=a8db6161-8d8a-468a-af6d-1f9fc786d0d3)' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:07:11 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-6adad4a3-e58c-470c-a24a-8b5a029c56ae tempest-TestInstancesWithCinderVolumes-120733040 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e1bb864-e598-42c4-a533-84dc0d5b9dfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:07:11 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-6adad4a3-e58c-470c-a24a-8b5a029c56ae tempest-TestInstancesWithCinderVolumes-120733040 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e1bb864-e598-42c4-a533-84dc0d5b9dfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:07:11 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-6adad4a3-e58c-470c-a24a-8b5a029c56ae tempest-TestInstancesWithCinderVolumes-120733040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a808ba8f-15f6-40ff-8f31-895aeada576f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:07:11 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-6adad4a3-e58c-470c-a24a-8b5a029c56ae tempest-TestInstancesWithCinderVolumes-120733040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a808ba8f-15f6-40ff-8f31-895aeada576f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b27dbd06-be27-4f26-9495-8ff98607c90b', 'volume_name': 'volume-b27dbd06-be27-4f26-9495-8ff98607c90b', 'volume_size': 1}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:07:11 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-6adad4a3-e58c-470c-a24a-8b5a029c56ae tempest-TestInstancesWithCinderVolumes-120733040 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0da1723-d7b1-4379-8207-07fc8d45170e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:07:11 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-6adad4a3-e58c-470c-a24a-8b5a029c56ae tempest-TestInstancesWithCinderVolumes-120733040 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0da1723-d7b1-4379-8207-07fc8d45170e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:07:11 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-6adad4a3-e58c-470c-a24a-8b5a029c56ae tempest-TestInstancesWithCinderVolumes-120733040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15cbfe08-525a-48ee-9f8a-931b28f21f38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:07:11 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-6adad4a3-e58c-470c-a24a-8b5a029c56ae tempest-TestInstancesWithCinderVolumes-120733040 None] Volume b27dbd06-be27-4f26-9495-8ff98607c90b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b27dbd06-be27-4f26-9495-8ff98607c90b', 'volume_size': 1} Sep 07 10:07:11 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-6adad4a3-e58c-470c-a24a-8b5a029c56ae tempest-TestInstancesWithCinderVolumes-120733040 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:07:11 devstack cinder-volume[87515]: DEBUG oslo_service.periodic_task [None req-cebd6a9d-3073-42a1-b65a-b38d444d85ed None None] Running periodic task VolumeManager._thread_info {{(pid=87515) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 10:07:11 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-cebd6a9d-3073-42a1-b65a-b38d444d85ed None None] thread count: 28 {{(pid=87515) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 07 10:07:11 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-cebd6a9d-3073-42a1-b65a-b38d444d85ed None None] thread info: [<_MainThread(MainThread, started 131647121809536)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87515) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 07 10:07:12 devstack cinder-volume[87515]: DEBUG cinder.volume.flows.manager.create_volume [None req-4f2553ba-dbda-40ce-9ec9-d52a950c950c tempest-TestInstancesWithCinderVolumes-120733040 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 10:07:12 devstack sudo[98563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-640722de-3f4c-4434-9712-126398038f41.e31bfd3f-4446-4c21-a386-572c14dcfc9e Sep 07 10:07:12 devstack sudo[98563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:07:12 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-4f2553ba-dbda-40ce-9ec9-d52a950c950c tempest-TestInstancesWithCinderVolumes-120733040 None] Flow 'volume_create_manager' (fc137398-987e-4882-a6bc-432d005460ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:07:12 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-4f2553ba-dbda-40ce-9ec9-d52a950c950c tempest-TestInstancesWithCinderVolumes-120733040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ca9c8b2-57f5-45e7-8403-143f0e583531) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:07:12 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-4f2553ba-dbda-40ce-9ec9-d52a950c950c tempest-TestInstancesWithCinderVolumes-120733040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ca9c8b2-57f5-45e7-8403-143f0e583531) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:07:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1206900344',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=223ab6a6-f55d-4061-9b05-219724845319,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e58e36387544e9bbe7359cb5d265361',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:07:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:07:12Z,use_quota=True,user_id='92b1206c699547f39f95f0f1b1b345ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73bd32aa-7073-4bf1-93bc-2212b1c548eb),volume_type_id=73bd32aa-7073-4bf1-93bc-2212b1c548eb)' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:07:12 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-4f2553ba-dbda-40ce-9ec9-d52a950c950c tempest-TestInstancesWithCinderVolumes-120733040 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (077670f9-fc59-4887-b76f-cfc46d89f0e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:07:12 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-4f2553ba-dbda-40ce-9ec9-d52a950c950c tempest-TestInstancesWithCinderVolumes-120733040 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (077670f9-fc59-4887-b76f-cfc46d89f0e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:07:12 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-4f2553ba-dbda-40ce-9ec9-d52a950c950c tempest-TestInstancesWithCinderVolumes-120733040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c889e999-7b31-4949-b090-633700394626) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:07:12 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-4f2553ba-dbda-40ce-9ec9-d52a950c950c tempest-TestInstancesWithCinderVolumes-120733040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c889e999-7b31-4949-b090-633700394626) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '223ab6a6-f55d-4061-9b05-219724845319', 'volume_name': 'volume-223ab6a6-f55d-4061-9b05-219724845319', 'volume_size': 1}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:07:12 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-4f2553ba-dbda-40ce-9ec9-d52a950c950c tempest-TestInstancesWithCinderVolumes-120733040 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cfeae681-c6e9-4a36-8227-94b59754ffbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:07:12 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-4f2553ba-dbda-40ce-9ec9-d52a950c950c tempest-TestInstancesWithCinderVolumes-120733040 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cfeae681-c6e9-4a36-8227-94b59754ffbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:07:12 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-4f2553ba-dbda-40ce-9ec9-d52a950c950c tempest-TestInstancesWithCinderVolumes-120733040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1fa2c29e-2fe0-4bdb-98ce-bc36ecf9e42c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:07:12 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-4f2553ba-dbda-40ce-9ec9-d52a950c950c tempest-TestInstancesWithCinderVolumes-120733040 None] Volume 223ab6a6-f55d-4061-9b05-219724845319: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-223ab6a6-f55d-4061-9b05-219724845319', 'volume_size': 1} Sep 07 10:07:12 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-4f2553ba-dbda-40ce-9ec9-d52a950c950c tempest-TestInstancesWithCinderVolumes-120733040 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:07:12 devstack sudo[98563]: pam_unix(sudo:session): session closed for user root Sep 07 10:07:12 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-351ecb40-c5dd-4adf-adcb-fcc7943cb9f0 tempest-SnapshotsActionsTest-158812568 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-640722de-3f4c-4434-9712-126398038f41.e31bfd3f-4446-4c21-a386-572c14dcfc9e" returned: 0 in 0.485s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:07:12 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-351ecb40-c5dd-4adf-adcb-fcc7943cb9f0 tempest-SnapshotsActionsTest-158812568 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-640722de-3f4c-4434-9712-126398038f41(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87515) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 10:07:12 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-351ecb40-c5dd-4adf-adcb-fcc7943cb9f0 tempest-SnapshotsActionsTest-158812568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-640722de-3f4c-4434-9712-126398038f41.e31bfd3f-4446-4c21-a386-572c14dcfc9e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-640722de-3f4c-4434-9712-126398038f41.165c940b-6999-4eb6-a8a6-01a1d2ac139b 1G {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:07:12 devstack sudo[98568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-640722de-3f4c-4434-9712-126398038f41.e31bfd3f-4446-4c21-a386-572c14dcfc9e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-640722de-3f4c-4434-9712-126398038f41.165c940b-6999-4eb6-a8a6-01a1d2ac139b 1G Sep 07 10:07:12 devstack sudo[98568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:07:12 devstack sudo[98568]: pam_unix(sudo:session): session closed for user root Sep 07 10:07:12 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-351ecb40-c5dd-4adf-adcb-fcc7943cb9f0 tempest-SnapshotsActionsTest-158812568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-640722de-3f4c-4434-9712-126398038f41.e31bfd3f-4446-4c21-a386-572c14dcfc9e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-640722de-3f4c-4434-9712-126398038f41.165c940b-6999-4eb6-a8a6-01a1d2ac139b 1G" returned: 0 in 0.582s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:07:12 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-351ecb40-c5dd-4adf-adcb-fcc7943cb9f0 tempest-SnapshotsActionsTest-158812568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-640722de-3f4c-4434-9712-126398038f41.e31bfd3f-4446-4c21-a386-572c14dcfc9e -F qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-640722de-3f4c-4434-9712-126398038f41.165c940b-6999-4eb6-a8a6-01a1d2ac139b {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:07:13 devstack sudo[98574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-640722de-3f4c-4434-9712-126398038f41.e31bfd3f-4446-4c21-a386-572c14dcfc9e -F qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-640722de-3f4c-4434-9712-126398038f41.165c940b-6999-4eb6-a8a6-01a1d2ac139b Sep 07 10:07:13 devstack sudo[98574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:07:13 devstack cinder-volume[87515]: DEBUG dbcounter [-] [87515] Writing DB stats cinder:SELECT=134,cinder:UPDATE=144,cinder:DELETE=11,cinder:INSERT=33 {{(pid=87515) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 10:07:13 devstack sudo[98574]: pam_unix(sudo:session): session closed for user root Sep 07 10:07:13 devstack cinder-volume[87515]: DEBUG cinder.volume.flows.manager.create_volume [None req-b218f0e2-9c39-4988-82dc-92c52eb1cdde tempest-TestInstancesWithCinderVolumes-120733040 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 10:07:13 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-b218f0e2-9c39-4988-82dc-92c52eb1cdde tempest-TestInstancesWithCinderVolumes-120733040 None] Flow 'volume_create_manager' (6c630b19-0296-4d5f-804f-cefa4815078a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:07:13 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-b218f0e2-9c39-4988-82dc-92c52eb1cdde tempest-TestInstancesWithCinderVolumes-120733040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb4121ae-1ce1-45f9-a858-4dd02b0db4e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:07:13 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-351ecb40-c5dd-4adf-adcb-fcc7943cb9f0 tempest-SnapshotsActionsTest-158812568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-640722de-3f4c-4434-9712-126398038f41.e31bfd3f-4446-4c21-a386-572c14dcfc9e -F qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-640722de-3f4c-4434-9712-126398038f41.165c940b-6999-4eb6-a8a6-01a1d2ac139b" returned: 0 in 0.505s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:07:13 devstack cinder-volume[87515]: WARNING cinder.volume.drivers.remotefs [None req-351ecb40-c5dd-4adf-adcb-fcc7943cb9f0 tempest-SnapshotsActionsTest-158812568 None] /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-640722de-3f4c-4434-9712-126398038f41.165c940b-6999-4eb6-a8a6-01a1d2ac139b is being set with open permissions: ugo+rw Sep 07 10:07:13 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-351ecb40-c5dd-4adf-adcb-fcc7943cb9f0 tempest-SnapshotsActionsTest-158812568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-640722de-3f4c-4434-9712-126398038f41.165c940b-6999-4eb6-a8a6-01a1d2ac139b {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:07:13 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-b218f0e2-9c39-4988-82dc-92c52eb1cdde tempest-TestInstancesWithCinderVolumes-120733040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb4121ae-1ce1-45f9-a858-4dd02b0db4e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:07:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1797218414',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5aa431e-9421-48c0-9d3c-bb472d9415af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e58e36387544e9bbe7359cb5d265361',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:07:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:07:13Z,use_quota=True,user_id='92b1206c699547f39f95f0f1b1b345ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcebd7f3-e620-4874-8742-cf78dd84193f),volume_type_id=fcebd7f3-e620-4874-8742-cf78dd84193f)' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:07:13 devstack sudo[98579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-640722de-3f4c-4434-9712-126398038f41.165c940b-6999-4eb6-a8a6-01a1d2ac139b Sep 07 10:07:13 devstack sudo[98579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:07:13 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-b218f0e2-9c39-4988-82dc-92c52eb1cdde tempest-TestInstancesWithCinderVolumes-120733040 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba877dde-d128-4d33-8806-91177386f2f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:07:13 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-b218f0e2-9c39-4988-82dc-92c52eb1cdde tempest-TestInstancesWithCinderVolumes-120733040 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba877dde-d128-4d33-8806-91177386f2f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:07:13 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-b218f0e2-9c39-4988-82dc-92c52eb1cdde tempest-TestInstancesWithCinderVolumes-120733040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e5c59ac-fc0b-4c5a-aa75-665c2ec28bb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:07:13 devstack cinder-volume[87515]: DEBUG cinder.image.glance [None req-b218f0e2-9c39-4988-82dc-92c52eb1cdde tempest-TestInstancesWithCinderVolumes-120733040 None] Creating Keystone auth plugin from conf {{(pid=87515) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 07 10:07:13 devstack sudo[98579]: pam_unix(sudo:session): session closed for user root Sep 07 10:07:13 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-351ecb40-c5dd-4adf-adcb-fcc7943cb9f0 tempest-SnapshotsActionsTest-158812568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-640722de-3f4c-4434-9712-126398038f41.165c940b-6999-4eb6-a8a6-01a1d2ac139b" returned: 0 in 0.288s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:07:13 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-351ecb40-c5dd-4adf-adcb-fcc7943cb9f0 tempest-SnapshotsActionsTest-158812568 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.140s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:07:13 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-6adad4a3-e58c-470c-a24a-8b5a029c56ae tempest-TestInstancesWithCinderVolumes-120733040 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.849s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:07:13 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-6adad4a3-e58c-470c-a24a-8b5a029c56ae tempest-TestInstancesWithCinderVolumes-120733040 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:07:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-919186303',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b27dbd06-be27-4f26-9495-8ff98607c90b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e58e36387544e9bbe7359cb5d265361',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:07:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:07:12Z,use_quota=True,user_id='92b1206c699547f39f95f0f1b1b345ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8db6161-8d8a-468a-af6d-1f9fc786d0d3),volume_type_id=a8db6161-8d8a-468a-af6d-1f9fc786d0d3)}" {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 10:07:13 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-6adad4a3-e58c-470c-a24a-8b5a029c56ae tempest-TestInstancesWithCinderVolumes-120733040 None] Creating volume b27dbd06-be27-4f26-9495-8ff98607c90b {{(pid=87515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 10:07:13 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-6adad4a3-e58c-470c-a24a-8b5a029c56ae tempest-TestInstancesWithCinderVolumes-120733040 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:07:13 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-6adad4a3-e58c-470c-a24a-8b5a029c56ae tempest-TestInstancesWithCinderVolumes-120733040 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:07:13 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-6adad4a3-e58c-470c-a24a-8b5a029c56ae tempest-TestInstancesWithCinderVolumes-120733040 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:07:13 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-6adad4a3-e58c-470c-a24a-8b5a029c56ae tempest-TestInstancesWithCinderVolumes-120733040 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:07:13 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-6adad4a3-e58c-470c-a24a-8b5a029c56ae tempest-TestInstancesWithCinderVolumes-120733040 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:07:13 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-6adad4a3-e58c-470c-a24a-8b5a029c56ae tempest-TestInstancesWithCinderVolumes-120733040 None] Selected osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c as target Quobyte volume. {{(pid=87515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 10:07:13 devstack cinder-volume[87515]: INFO cinder.volume.drivers.remotefs [None req-6adad4a3-e58c-470c-a24a-8b5a029c56ae tempest-TestInstancesWithCinderVolumes-120733040 None] casted to osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c Sep 07 10:07:13 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-6adad4a3-e58c-470c-a24a-8b5a029c56ae tempest-TestInstancesWithCinderVolumes-120733040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-b27dbd06-be27-4f26-9495-8ff98607c90b 1073741824 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:07:13 devstack sudo[98582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-b27dbd06-be27-4f26-9495-8ff98607c90b 1073741824 Sep 07 10:07:13 devstack sudo[98582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:07:13 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-351ecb40-c5dd-4adf-adcb-fcc7943cb9f0 tempest-SnapshotsActionsTest-158812568 None] Create snapshot completed successfully Sep 07 10:07:13 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-b218f0e2-9c39-4988-82dc-92c52eb1cdde tempest-TestInstancesWithCinderVolumes-120733040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e5c59ac-fc0b-4c5a-aa75-665c2ec28bb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'd5aa431e-9421-48c0-9d3c-bb472d9415af', 'volume_name': 'volume-d5aa431e-9421-48c0-9d3c-bb472d9415af', 'volume_size': 1, 'image_id': '7878cafb-138f-4fbd-9180-b9e60e3a9cba', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7878cafb-138f-4fbd-9180-b9e60e3a9cba', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--538428611', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '1e58e36387544e9bbe7359cb5d265361', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7878cafb-138f-4fbd-9180-b9e60e3a9cba', 'created_at': datetime.datetime(2026, 9, 7, 8, 7, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 7, 8, 7, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7878cafb-138f-4fbd-9180-b9e60e3a9cba/file', 'properties': {}}, 'image_service': }' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:07:14 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-b218f0e2-9c39-4988-82dc-92c52eb1cdde tempest-TestInstancesWithCinderVolumes-120733040 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a235f2e0-0abf-4a0b-9d4e-7b7308136c1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:07:14 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-b218f0e2-9c39-4988-82dc-92c52eb1cdde tempest-TestInstancesWithCinderVolumes-120733040 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a235f2e0-0abf-4a0b-9d4e-7b7308136c1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:07:14 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-b218f0e2-9c39-4988-82dc-92c52eb1cdde tempest-TestInstancesWithCinderVolumes-120733040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f878f3bf-8183-4788-b0d2-a21cfaec92a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:07:14 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-b218f0e2-9c39-4988-82dc-92c52eb1cdde tempest-TestInstancesWithCinderVolumes-120733040 None] Volume d5aa431e-9421-48c0-9d3c-bb472d9415af: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-d5aa431e-9421-48c0-9d3c-bb472d9415af', 'volume_size': 1, 'image_id': '7878cafb-138f-4fbd-9180-b9e60e3a9cba', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7878cafb-138f-4fbd-9180-b9e60e3a9cba', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--538428611', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '1e58e36387544e9bbe7359cb5d265361', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7878cafb-138f-4fbd-9180-b9e60e3a9cba', 'created_at': datetime.datetime(2026, 9, 7, 8, 7, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 7, 8, 7, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7878cafb-138f-4fbd-9180-b9e60e3a9cba/file', 'properties': {}}, 'image_service': } Sep 07 10:07:14 devstack cinder-volume[87515]: DEBUG cinder.volume.flows.manager.create_volume [None req-b218f0e2-9c39-4988-82dc-92c52eb1cdde tempest-TestInstancesWithCinderVolumes-120733040 None] Trying to clone d5aa431e-9421-48c0-9d3c-bb472d9415af from image 7878cafb-138f-4fbd-9180-b9e60e3a9cba at location (None, [{'url': 'file:///opt/stack/data/glance/images/7878cafb-138f-4fbd-9180-b9e60e3a9cba', 'metadata': {}}]). {{(pid=87515) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 07 10:07:14 devstack cinder-volume[87515]: DEBUG cinder.volume.flows.manager.create_volume [req-058aa519-32a4-4c8d-bb2c-54c1b998426f req-19f23131-d6ea-4ef7-bb33-6a2ee282e10e tempest-VolumesGetTestJSON-1412785037 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 10:07:14 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [req-058aa519-32a4-4c8d-bb2c-54c1b998426f req-19f23131-d6ea-4ef7-bb33-6a2ee282e10e tempest-VolumesGetTestJSON-1412785037 None] Flow 'volume_create_manager' (3ea1cfb3-749d-43b6-bc98-8367428632fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:07:14 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [req-058aa519-32a4-4c8d-bb2c-54c1b998426f req-19f23131-d6ea-4ef7-bb33-6a2ee282e10e tempest-VolumesGetTestJSON-1412785037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1acfe7c-aeea-4f38-9c6b-eb03d5de711d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:07:14 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [req-058aa519-32a4-4c8d-bb2c-54c1b998426f req-19f23131-d6ea-4ef7-bb33-6a2ee282e10e tempest-VolumesGetTestJSON-1412785037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1acfe7c-aeea-4f38-9c6b-eb03d5de711d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:07:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-140740198',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85c812e8-a235-4027-a1c5-cf33d1fe9cfc,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='dd60dd4833574b6488098eeed59e4334',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:07:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:07:14Z,use_quota=True,user_id='534dff16b3e240a59700f1dbdb49a945',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3a092cd-7947-4cbf-abff-4ba9567becf0),volume_type_id=f3a092cd-7947-4cbf-abff-4ba9567becf0)' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:07:14 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [req-058aa519-32a4-4c8d-bb2c-54c1b998426f req-19f23131-d6ea-4ef7-bb33-6a2ee282e10e tempest-VolumesGetTestJSON-1412785037 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (422d610d-c6ca-4922-b39b-f70a408253b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:07:14 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [req-058aa519-32a4-4c8d-bb2c-54c1b998426f req-19f23131-d6ea-4ef7-bb33-6a2ee282e10e tempest-VolumesGetTestJSON-1412785037 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (422d610d-c6ca-4922-b39b-f70a408253b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:07:14 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [req-058aa519-32a4-4c8d-bb2c-54c1b998426f req-19f23131-d6ea-4ef7-bb33-6a2ee282e10e tempest-VolumesGetTestJSON-1412785037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e3551bb-555b-46fc-9976-23a728c41915) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:07:14 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [req-058aa519-32a4-4c8d-bb2c-54c1b998426f req-19f23131-d6ea-4ef7-bb33-6a2ee282e10e tempest-VolumesGetTestJSON-1412785037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e3551bb-555b-46fc-9976-23a728c41915) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '85c812e8-a235-4027-a1c5-cf33d1fe9cfc', 'volume_name': 'volume-85c812e8-a235-4027-a1c5-cf33d1fe9cfc', 'volume_size': 1}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:07:14 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [req-058aa519-32a4-4c8d-bb2c-54c1b998426f req-19f23131-d6ea-4ef7-bb33-6a2ee282e10e tempest-VolumesGetTestJSON-1412785037 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c12ce5f5-5e98-4504-ab17-6b8331cae4bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:07:14 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [req-058aa519-32a4-4c8d-bb2c-54c1b998426f req-19f23131-d6ea-4ef7-bb33-6a2ee282e10e tempest-VolumesGetTestJSON-1412785037 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c12ce5f5-5e98-4504-ab17-6b8331cae4bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:07:14 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [req-058aa519-32a4-4c8d-bb2c-54c1b998426f req-19f23131-d6ea-4ef7-bb33-6a2ee282e10e tempest-VolumesGetTestJSON-1412785037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74790881-d0fb-4c23-a657-792256a2138b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:07:14 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [req-058aa519-32a4-4c8d-bb2c-54c1b998426f req-19f23131-d6ea-4ef7-bb33-6a2ee282e10e tempest-VolumesGetTestJSON-1412785037 None] Volume 85c812e8-a235-4027-a1c5-cf33d1fe9cfc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-85c812e8-a235-4027-a1c5-cf33d1fe9cfc', 'volume_size': 1} Sep 07 10:07:14 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [req-058aa519-32a4-4c8d-bb2c-54c1b998426f req-19f23131-d6ea-4ef7-bb33-6a2ee282e10e tempest-VolumesGetTestJSON-1412785037 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:07:14 devstack sudo[98582]: pam_unix(sudo:session): session closed for user root Sep 07 10:07:14 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-6adad4a3-e58c-470c-a24a-8b5a029c56ae tempest-TestInstancesWithCinderVolumes-120733040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-b27dbd06-be27-4f26-9495-8ff98607c90b 1073741824" returned: 0 in 0.605s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:07:14 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-6adad4a3-e58c-470c-a24a-8b5a029c56ae tempest-TestInstancesWithCinderVolumes-120733040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-b27dbd06-be27-4f26-9495-8ff98607c90b {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:07:14 devstack sudo[98588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-b27dbd06-be27-4f26-9495-8ff98607c90b Sep 07 10:07:14 devstack sudo[98588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:07:14 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-9c7753a5-da89-46e5-a9c3-01406e53c3ed tempest-SnapshotsActionsTest-800030130 None] Acquiring lock "cinder-165c940b-6999-4eb6-a8a6-01a1d2ac139b-delete_snapshot" by "delete_snapshot" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:07:14 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-9c7753a5-da89-46e5-a9c3-01406e53c3ed tempest-SnapshotsActionsTest-800030130 None] Lock "cinder-165c940b-6999-4eb6-a8a6-01a1d2ac139b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:07:14 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-9c7753a5-da89-46e5-a9c3-01406e53c3ed tempest-SnapshotsActionsTest-800030130 None] Acquiring lock "cinder-quobyte-640722de-3f4c-4434-9712-126398038f41" by "delete_snapshot" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:07:14 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-9c7753a5-da89-46e5-a9c3-01406e53c3ed tempest-SnapshotsActionsTest-800030130 None] Lock "cinder-quobyte-640722de-3f4c-4434-9712-126398038f41" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:07:14 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-9c7753a5-da89-46e5-a9c3-01406e53c3ed tempest-SnapshotsActionsTest-800030130 None] Acquiring lock "cinder-quobyte-165c940b-6999-4eb6-a8a6-01a1d2ac139b" by "_delete_snapshot" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:07:14 devstack sudo[98588]: pam_unix(sudo:session): session closed for user root Sep 07 10:07:14 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-6adad4a3-e58c-470c-a24a-8b5a029c56ae tempest-TestInstancesWithCinderVolumes-120733040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-b27dbd06-be27-4f26-9495-8ff98607c90b" returned: 0 in 0.308s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:07:14 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-6adad4a3-e58c-470c-a24a-8b5a029c56ae tempest-TestInstancesWithCinderVolumes-120733040 None] <== create_volume: return (969ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'} {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 10:07:14 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-6adad4a3-e58c-470c-a24a-8b5a029c56ae tempest-TestInstancesWithCinderVolumes-120733040 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.974s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:07:14 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-9c7753a5-da89-46e5-a9c3-01406e53c3ed tempest-SnapshotsActionsTest-800030130 None] Lock "cinder-quobyte-165c940b-6999-4eb6-a8a6-01a1d2ac139b" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:07:14 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-9c7753a5-da89-46e5-a9c3-01406e53c3ed tempest-SnapshotsActionsTest-800030130 None] Deleting offline snapshot 165c940b-6999-4eb6-a8a6-01a1d2ac139b of volume 640722de-3f4c-4434-9712-126398038f41 {{(pid=87515) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 10:07:14 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-9c7753a5-da89-46e5-a9c3-01406e53c3ed tempest-SnapshotsActionsTest-800030130 None] snapshot_file for this snap is: volume-640722de-3f4c-4434-9712-126398038f41.165c940b-6999-4eb6-a8a6-01a1d2ac139b {{(pid=87515) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 10:07:14 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-4f2553ba-dbda-40ce-9ec9-d52a950c950c tempest-TestInstancesWithCinderVolumes-120733040 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.668s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:07:14 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-4f2553ba-dbda-40ce-9ec9-d52a950c950c tempest-TestInstancesWithCinderVolumes-120733040 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:07:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1206900344',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=223ab6a6-f55d-4061-9b05-219724845319,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e58e36387544e9bbe7359cb5d265361',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:07:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:07:12Z,use_quota=True,user_id='92b1206c699547f39f95f0f1b1b345ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73bd32aa-7073-4bf1-93bc-2212b1c548eb),volume_type_id=73bd32aa-7073-4bf1-93bc-2212b1c548eb)}" {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 10:07:14 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-4f2553ba-dbda-40ce-9ec9-d52a950c950c tempest-TestInstancesWithCinderVolumes-120733040 None] Creating volume 223ab6a6-f55d-4061-9b05-219724845319 {{(pid=87515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 10:07:14 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-4f2553ba-dbda-40ce-9ec9-d52a950c950c tempest-TestInstancesWithCinderVolumes-120733040 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:07:14 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-4f2553ba-dbda-40ce-9ec9-d52a950c950c tempest-TestInstancesWithCinderVolumes-120733040 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:07:14 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-4f2553ba-dbda-40ce-9ec9-d52a950c950c tempest-TestInstancesWithCinderVolumes-120733040 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:07:14 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-4f2553ba-dbda-40ce-9ec9-d52a950c950c tempest-TestInstancesWithCinderVolumes-120733040 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:07:14 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-4f2553ba-dbda-40ce-9ec9-d52a950c950c tempest-TestInstancesWithCinderVolumes-120733040 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:07:14 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-4f2553ba-dbda-40ce-9ec9-d52a950c950c tempest-TestInstancesWithCinderVolumes-120733040 None] Selected osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c as target Quobyte volume. {{(pid=87515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 10:07:14 devstack cinder-volume[87515]: INFO cinder.volume.drivers.remotefs [None req-4f2553ba-dbda-40ce-9ec9-d52a950c950c tempest-TestInstancesWithCinderVolumes-120733040 None] casted to osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c Sep 07 10:07:14 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-4f2553ba-dbda-40ce-9ec9-d52a950c950c tempest-TestInstancesWithCinderVolumes-120733040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-223ab6a6-f55d-4061-9b05-219724845319 1073741824 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:07:14 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[aae6a6ad-6104-4535-a93b-cb6868165aaf]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:07:14 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-9c7753a5-da89-46e5-a9c3-01406e53c3ed tempest-SnapshotsActionsTest-800030130 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-640722de-3f4c-4434-9712-126398038f41.165c940b-6999-4eb6-a8a6-01a1d2ac139b {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:07:14 devstack sudo[98591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-223ab6a6-f55d-4061-9b05-219724845319 1073741824 Sep 07 10:07:14 devstack sudo[98591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:07:14 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-6adad4a3-e58c-470c-a24a-8b5a029c56ae tempest-TestInstancesWithCinderVolumes-120733040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15cbfe08-525a-48ee-9f8a-931b28f21f38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b27dbd06-be27-4f26-9495-8ff98607c90b', 'volume_size': 1}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:07:14 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-6adad4a3-e58c-470c-a24a-8b5a029c56ae tempest-TestInstancesWithCinderVolumes-120733040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6b71400-0218-4072-82d1-26738d0a8360) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:07:14 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-6adad4a3-e58c-470c-a24a-8b5a029c56ae tempest-TestInstancesWithCinderVolumes-120733040 None] Volume volume-b27dbd06-be27-4f26-9495-8ff98607c90b (b27dbd06-be27-4f26-9495-8ff98607c90b): created successfully Sep 07 10:07:14 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-6adad4a3-e58c-470c-a24a-8b5a029c56ae tempest-TestInstancesWithCinderVolumes-120733040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6b71400-0218-4072-82d1-26738d0a8360) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:07:14 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-6adad4a3-e58c-470c-a24a-8b5a029c56ae tempest-TestInstancesWithCinderVolumes-120733040 None] Flow 'volume_create_manager' (b17dcb5b-96b9-429e-9c5f-e5fa3e652a9c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:07:14 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-6adad4a3-e58c-470c-a24a-8b5a029c56ae tempest-TestInstancesWithCinderVolumes-120733040 None] Created volume successfully. Sep 07 10:07:14 devstack cinder-volume[87515]: DEBUG cinder.volume.flows.manager.create_volume [None req-0b46f7d0-d5da-4ad4-8d28-27176e2916cd tempest-VolumeAndVolumeTypeFromImageTest-1310657115 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 10:07:14 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-0b46f7d0-d5da-4ad4-8d28-27176e2916cd tempest-VolumeAndVolumeTypeFromImageTest-1310657115 None] Flow 'volume_create_manager' (3a9f0a16-3da1-4185-9b01-48a8dabbba25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:07:14 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-0b46f7d0-d5da-4ad4-8d28-27176e2916cd tempest-VolumeAndVolumeTypeFromImageTest-1310657115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2c07561-b796-4c03-9356-2a8a04a8a637) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:07:14 devstack sudo[98592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-640722de-3f4c-4434-9712-126398038f41.165c940b-6999-4eb6-a8a6-01a1d2ac139b Sep 07 10:07:14 devstack sudo[98592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:07:15 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-0b46f7d0-d5da-4ad4-8d28-27176e2916cd tempest-VolumeAndVolumeTypeFromImageTest-1310657115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2c07561-b796-4c03-9356-2a8a04a8a637) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:07:15Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8e40710-7e6b-406d-9965-e8844956f2d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b4564b22f8a47848f0852021541220a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:07:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:07:15Z,use_quota=True,user_id='8ece7eace17b4d81a8c83e8a1b10ca9e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(893d5b3e-0270-4e36-97aa-fcadbd97ceef),volume_type_id=893d5b3e-0270-4e36-97aa-fcadbd97ceef)' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:07:15 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-0b46f7d0-d5da-4ad4-8d28-27176e2916cd tempest-VolumeAndVolumeTypeFromImageTest-1310657115 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b35db0a9-63a9-4545-93c9-f5d30e4f2ce5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:07:15 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-0b46f7d0-d5da-4ad4-8d28-27176e2916cd tempest-VolumeAndVolumeTypeFromImageTest-1310657115 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b35db0a9-63a9-4545-93c9-f5d30e4f2ce5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:07:15 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-0b46f7d0-d5da-4ad4-8d28-27176e2916cd tempest-VolumeAndVolumeTypeFromImageTest-1310657115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4bee0bcc-42ef-45df-898d-b3f489ff0a98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:07:15 devstack cinder-volume[87515]: DEBUG cinder.image.glance [None req-0b46f7d0-d5da-4ad4-8d28-27176e2916cd tempest-VolumeAndVolumeTypeFromImageTest-1310657115 None] Creating Keystone auth plugin from conf {{(pid=87515) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 07 10:07:15 devstack sudo[98592]: pam_unix(sudo:session): session closed for user root Sep 07 10:07:15 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-9c7753a5-da89-46e5-a9c3-01406e53c3ed tempest-SnapshotsActionsTest-800030130 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-640722de-3f4c-4434-9712-126398038f41.165c940b-6999-4eb6-a8a6-01a1d2ac139b" returned: 0 in 0.433s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:07:15 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-9c7753a5-da89-46e5-a9c3-01406e53c3ed tempest-SnapshotsActionsTest-800030130 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-640722de-3f4c-4434-9712-126398038f41(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87515) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 10:07:15 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cb0fa52-fd34-4fe9-a083-b2e45f667204]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:07:15 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-9c7753a5-da89-46e5-a9c3-01406e53c3ed tempest-SnapshotsActionsTest-800030130 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-640722de-3f4c-4434-9712-126398038f41.e31bfd3f-4446-4c21-a386-572c14dcfc9e {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:07:15 devstack sudo[98591]: pam_unix(sudo:session): session closed for user root Sep 07 10:07:15 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-0b46f7d0-d5da-4ad4-8d28-27176e2916cd tempest-VolumeAndVolumeTypeFromImageTest-1310657115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4bee0bcc-42ef-45df-898d-b3f489ff0a98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'd8e40710-7e6b-406d-9965-e8844956f2d4', 'volume_name': 'volume-d8e40710-7e6b-406d-9965-e8844956f2d4', 'volume_size': 1, 'image_id': 'ba4cb054-c543-4fa1-85c0-52b1175b4f5e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ba4cb054-c543-4fa1-85c0-52b1175b4f5e', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'b8a27b08813b95dd144e686909515d1b', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '4b4564b22f8a47848f0852021541220a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'a4396f06f41b5467d8749c7729e138b6323de1780a9f8a2a3022df8b60f9b15633fa4e19a1a6b0f6c9d9c279592d59e7f4e55348b2dc1672eaf3b545fe016039', 'id': 'ba4cb054-c543-4fa1-85c0-52b1175b4f5e', 'created_at': datetime.datetime(2026, 9, 7, 8, 7, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 7, 8, 7, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ba4cb054-c543-4fa1-85c0-52b1175b4f5e/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:07:15 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-0b46f7d0-d5da-4ad4-8d28-27176e2916cd tempest-VolumeAndVolumeTypeFromImageTest-1310657115 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d59b734-6c8b-4528-a9f5-d3708cf20f19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:07:15 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-0b46f7d0-d5da-4ad4-8d28-27176e2916cd tempest-VolumeAndVolumeTypeFromImageTest-1310657115 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d59b734-6c8b-4528-a9f5-d3708cf20f19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:07:15 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-0b46f7d0-d5da-4ad4-8d28-27176e2916cd tempest-VolumeAndVolumeTypeFromImageTest-1310657115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5850feed-6a94-41f8-a0d7-6dd993fc8e54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:07:15 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-0b46f7d0-d5da-4ad4-8d28-27176e2916cd tempest-VolumeAndVolumeTypeFromImageTest-1310657115 None] Volume d8e40710-7e6b-406d-9965-e8844956f2d4: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-d8e40710-7e6b-406d-9965-e8844956f2d4', 'volume_size': 1, 'image_id': 'ba4cb054-c543-4fa1-85c0-52b1175b4f5e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ba4cb054-c543-4fa1-85c0-52b1175b4f5e', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'b8a27b08813b95dd144e686909515d1b', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '4b4564b22f8a47848f0852021541220a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'a4396f06f41b5467d8749c7729e138b6323de1780a9f8a2a3022df8b60f9b15633fa4e19a1a6b0f6c9d9c279592d59e7f4e55348b2dc1672eaf3b545fe016039', 'id': 'ba4cb054-c543-4fa1-85c0-52b1175b4f5e', 'created_at': datetime.datetime(2026, 9, 7, 8, 7, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 7, 8, 7, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ba4cb054-c543-4fa1-85c0-52b1175b4f5e/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Sep 07 10:07:15 devstack cinder-volume[87515]: DEBUG cinder.volume.flows.manager.create_volume [None req-0b46f7d0-d5da-4ad4-8d28-27176e2916cd tempest-VolumeAndVolumeTypeFromImageTest-1310657115 None] Trying to clone d8e40710-7e6b-406d-9965-e8844956f2d4 from image ba4cb054-c543-4fa1-85c0-52b1175b4f5e at location (None, [{'url': 'file:///opt/stack/data/glance/images/ba4cb054-c543-4fa1-85c0-52b1175b4f5e', 'metadata': {}}]). {{(pid=87515) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 07 10:07:15 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-4f2553ba-dbda-40ce-9ec9-d52a950c950c tempest-TestInstancesWithCinderVolumes-120733040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-223ab6a6-f55d-4061-9b05-219724845319 1073741824" returned: 0 in 0.549s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:07:15 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-4f2553ba-dbda-40ce-9ec9-d52a950c950c tempest-TestInstancesWithCinderVolumes-120733040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-223ab6a6-f55d-4061-9b05-219724845319 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:07:15 devstack sudo[98602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-640722de-3f4c-4434-9712-126398038f41.e31bfd3f-4446-4c21-a386-572c14dcfc9e Sep 07 10:07:15 devstack sudo[98602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:07:15 devstack sudo[98604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-223ab6a6-f55d-4061-9b05-219724845319 Sep 07 10:07:15 devstack sudo[98604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:07:15 devstack cinder-volume[87515]: DEBUG cinder.image.image_utils [None req-0b46f7d0-d5da-4ad4-8d28-27176e2916cd tempest-VolumeAndVolumeTypeFromImageTest-1310657115 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_ba4cb054-c543-4fa1-85c0-52b1175b4f5e_fdoc_lr2devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87515) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 07 10:07:15 devstack cinder-volume[87515]: INFO cinder.image.image_utils [None req-0b46f7d0-d5da-4ad4-8d28-27176e2916cd tempest-VolumeAndVolumeTypeFromImageTest-1310657115 None] Image download 0.00 MB at 0.00 MB/s Sep 07 10:07:15 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa737bfa-790f-47ac-acff-9e90b85eb73d]: (4, 'raw') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:07:15 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-0b46f7d0-d5da-4ad4-8d28-27176e2916cd tempest-VolumeAndVolumeTypeFromImageTest-1310657115 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ba4cb054-c543-4fa1-85c0-52b1175b4f5e_fdoc_lr2devstack@QuobyteHD {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:07:15 devstack sudo[98607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ba4cb054-c543-4fa1-85c0-52b1175b4f5e_fdoc_lr2devstack@QuobyteHD Sep 07 10:07:15 devstack sudo[98607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:07:15 devstack sudo[98602]: pam_unix(sudo:session): session closed for user root Sep 07 10:07:15 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-9c7753a5-da89-46e5-a9c3-01406e53c3ed tempest-SnapshotsActionsTest-800030130 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-640722de-3f4c-4434-9712-126398038f41.e31bfd3f-4446-4c21-a386-572c14dcfc9e" returned: 0 in 0.418s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:07:15 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-9c7753a5-da89-46e5-a9c3-01406e53c3ed tempest-SnapshotsActionsTest-800030130 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-640722de-3f4c-4434-9712-126398038f41(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87515) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 10:07:15 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-9c7753a5-da89-46e5-a9c3-01406e53c3ed tempest-SnapshotsActionsTest-800030130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-640722de-3f4c-4434-9712-126398038f41.165c940b-6999-4eb6-a8a6-01a1d2ac139b {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:07:15 devstack sudo[98604]: pam_unix(sudo:session): session closed for user root Sep 07 10:07:15 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-4f2553ba-dbda-40ce-9ec9-d52a950c950c tempest-TestInstancesWithCinderVolumes-120733040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-223ab6a6-f55d-4061-9b05-219724845319" returned: 0 in 0.312s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:07:15 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-4f2553ba-dbda-40ce-9ec9-d52a950c950c tempest-TestInstancesWithCinderVolumes-120733040 None] <== create_volume: return (926ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'} {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 10:07:15 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-4f2553ba-dbda-40ce-9ec9-d52a950c950c tempest-TestInstancesWithCinderVolumes-120733040 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.928s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:07:15 devstack sudo[98614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-640722de-3f4c-4434-9712-126398038f41.165c940b-6999-4eb6-a8a6-01a1d2ac139b Sep 07 10:07:15 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [req-058aa519-32a4-4c8d-bb2c-54c1b998426f req-19f23131-d6ea-4ef7-bb33-6a2ee282e10e tempest-VolumesGetTestJSON-1412785037 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.448s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:07:15 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [req-058aa519-32a4-4c8d-bb2c-54c1b998426f req-19f23131-d6ea-4ef7-bb33-6a2ee282e10e tempest-VolumesGetTestJSON-1412785037 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:07:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-140740198',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85c812e8-a235-4027-a1c5-cf33d1fe9cfc,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='dd60dd4833574b6488098eeed59e4334',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:07:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:07:14Z,use_quota=True,user_id='534dff16b3e240a59700f1dbdb49a945',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3a092cd-7947-4cbf-abff-4ba9567becf0),volume_type_id=f3a092cd-7947-4cbf-abff-4ba9567becf0)}" {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 10:07:15 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [req-058aa519-32a4-4c8d-bb2c-54c1b998426f req-19f23131-d6ea-4ef7-bb33-6a2ee282e10e tempest-VolumesGetTestJSON-1412785037 None] Creating volume 85c812e8-a235-4027-a1c5-cf33d1fe9cfc {{(pid=87515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 10:07:15 devstack sudo[98614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:07:15 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [req-058aa519-32a4-4c8d-bb2c-54c1b998426f req-19f23131-d6ea-4ef7-bb33-6a2ee282e10e tempest-VolumesGetTestJSON-1412785037 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:07:15 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [req-058aa519-32a4-4c8d-bb2c-54c1b998426f req-19f23131-d6ea-4ef7-bb33-6a2ee282e10e tempest-VolumesGetTestJSON-1412785037 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:07:15 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [req-058aa519-32a4-4c8d-bb2c-54c1b998426f req-19f23131-d6ea-4ef7-bb33-6a2ee282e10e tempest-VolumesGetTestJSON-1412785037 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:07:15 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [req-058aa519-32a4-4c8d-bb2c-54c1b998426f req-19f23131-d6ea-4ef7-bb33-6a2ee282e10e tempest-VolumesGetTestJSON-1412785037 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:07:15 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [req-058aa519-32a4-4c8d-bb2c-54c1b998426f req-19f23131-d6ea-4ef7-bb33-6a2ee282e10e tempest-VolumesGetTestJSON-1412785037 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:07:15 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [req-058aa519-32a4-4c8d-bb2c-54c1b998426f req-19f23131-d6ea-4ef7-bb33-6a2ee282e10e tempest-VolumesGetTestJSON-1412785037 None] Selected osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c as target Quobyte volume. {{(pid=87515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 10:07:15 devstack cinder-volume[87515]: INFO cinder.volume.drivers.remotefs [req-058aa519-32a4-4c8d-bb2c-54c1b998426f req-19f23131-d6ea-4ef7-bb33-6a2ee282e10e tempest-VolumesGetTestJSON-1412785037 None] casted to osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c Sep 07 10:07:15 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [req-058aa519-32a4-4c8d-bb2c-54c1b998426f req-19f23131-d6ea-4ef7-bb33-6a2ee282e10e tempest-VolumesGetTestJSON-1412785037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-85c812e8-a235-4027-a1c5-cf33d1fe9cfc 1073741824 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:07:15 devstack sudo[98616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-85c812e8-a235-4027-a1c5-cf33d1fe9cfc 1073741824 Sep 07 10:07:15 devstack sudo[98616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:07:15 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-4f2553ba-dbda-40ce-9ec9-d52a950c950c tempest-TestInstancesWithCinderVolumes-120733040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1fa2c29e-2fe0-4bdb-98ce-bc36ecf9e42c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-223ab6a6-f55d-4061-9b05-219724845319', 'volume_size': 1}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:07:15 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-4f2553ba-dbda-40ce-9ec9-d52a950c950c tempest-TestInstancesWithCinderVolumes-120733040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d096a85-1513-4c42-b420-e974339e2953) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:07:15 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-4f2553ba-dbda-40ce-9ec9-d52a950c950c tempest-TestInstancesWithCinderVolumes-120733040 None] Volume volume-223ab6a6-f55d-4061-9b05-219724845319 (223ab6a6-f55d-4061-9b05-219724845319): created successfully Sep 07 10:07:15 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-4f2553ba-dbda-40ce-9ec9-d52a950c950c tempest-TestInstancesWithCinderVolumes-120733040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d096a85-1513-4c42-b420-e974339e2953) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:07:15 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-4f2553ba-dbda-40ce-9ec9-d52a950c950c tempest-TestInstancesWithCinderVolumes-120733040 None] Flow 'volume_create_manager' (fc137398-987e-4882-a6bc-432d005460ba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:07:15 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-4f2553ba-dbda-40ce-9ec9-d52a950c950c tempest-TestInstancesWithCinderVolumes-120733040 None] Created volume successfully. Sep 07 10:07:15 devstack sudo[98607]: pam_unix(sudo:session): session closed for user root Sep 07 10:07:15 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-0b46f7d0-d5da-4ad4-8d28-27176e2916cd tempest-VolumeAndVolumeTypeFromImageTest-1310657115 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ba4cb054-c543-4fa1-85c0-52b1175b4f5e_fdoc_lr2devstack@QuobyteHD" returned: 0 in 0.435s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:07:15 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-0b46f7d0-d5da-4ad4-8d28-27176e2916cd tempest-VolumeAndVolumeTypeFromImageTest-1310657115 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ba4cb054-c543-4fa1-85c0-52b1175b4f5e_fdoc_lr2devstack@QuobyteHD {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:07:16 devstack sudo[98620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ba4cb054-c543-4fa1-85c0-52b1175b4f5e_fdoc_lr2devstack@QuobyteHD Sep 07 10:07:16 devstack sudo[98620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:07:16 devstack sudo[98614]: pam_unix(sudo:session): session closed for user root Sep 07 10:07:16 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-9c7753a5-da89-46e5-a9c3-01406e53c3ed tempest-SnapshotsActionsTest-800030130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-640722de-3f4c-4434-9712-126398038f41.165c940b-6999-4eb6-a8a6-01a1d2ac139b" returned: 0 in 0.464s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:07:16 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-9c7753a5-da89-46e5-a9c3-01406e53c3ed tempest-SnapshotsActionsTest-800030130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-640722de-3f4c-4434-9712-126398038f41.165c940b-6999-4eb6-a8a6-01a1d2ac139b {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:07:16 devstack sudo[98630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-640722de-3f4c-4434-9712-126398038f41.165c940b-6999-4eb6-a8a6-01a1d2ac139b Sep 07 10:07:16 devstack sudo[98630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:07:16 devstack sudo[98616]: pam_unix(sudo:session): session closed for user root Sep 07 10:07:16 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [req-058aa519-32a4-4c8d-bb2c-54c1b998426f req-19f23131-d6ea-4ef7-bb33-6a2ee282e10e tempest-VolumesGetTestJSON-1412785037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-85c812e8-a235-4027-a1c5-cf33d1fe9cfc 1073741824" returned: 0 in 0.482s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:07:16 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [req-058aa519-32a4-4c8d-bb2c-54c1b998426f req-19f23131-d6ea-4ef7-bb33-6a2ee282e10e tempest-VolumesGetTestJSON-1412785037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-85c812e8-a235-4027-a1c5-cf33d1fe9cfc {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:07:16 devstack sudo[98635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-85c812e8-a235-4027-a1c5-cf33d1fe9cfc Sep 07 10:07:16 devstack sudo[98635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:07:16 devstack sudo[98620]: pam_unix(sudo:session): session closed for user root Sep 07 10:07:16 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-0b46f7d0-d5da-4ad4-8d28-27176e2916cd tempest-VolumeAndVolumeTypeFromImageTest-1310657115 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ba4cb054-c543-4fa1-85c0-52b1175b4f5e_fdoc_lr2devstack@QuobyteHD" returned: 1 in 0.392s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:07:16 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-0b46f7d0-d5da-4ad4-8d28-27176e2916cd tempest-VolumeAndVolumeTypeFromImageTest-1310657115 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ba4cb054-c543-4fa1-85c0-52b1175b4f5e_fdoc_lr2devstack@QuobyteHD' failed. Not Retrying. {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 07 10:07:16 devstack cinder-volume[87515]: DEBUG cinder.image.image_utils [None req-0b46f7d0-d5da-4ad4-8d28-27176e2916cd tempest-VolumeAndVolumeTypeFromImageTest-1310657115 None] Temporary image ba4cb054-c543-4fa1-85c0-52b1175b4f5e is fetched for user 8ece7eace17b4d81a8c83e8a1b10ca9e. {{(pid=87515) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 07 10:07:16 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc87ea9c-d08d-4f2f-a1d5-bc292f4523d2]: (4, 'raw') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:07:16 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-0b46f7d0-d5da-4ad4-8d28-27176e2916cd tempest-VolumeAndVolumeTypeFromImageTest-1310657115 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ba4cb054-c543-4fa1-85c0-52b1175b4f5e_fdoc_lr2devstack@QuobyteHD {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:07:16 devstack sudo[98630]: pam_unix(sudo:session): session closed for user root Sep 07 10:07:16 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-9c7753a5-da89-46e5-a9c3-01406e53c3ed tempest-SnapshotsActionsTest-800030130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-640722de-3f4c-4434-9712-126398038f41.165c940b-6999-4eb6-a8a6-01a1d2ac139b" returned: 0 in 0.335s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:07:16 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-9c7753a5-da89-46e5-a9c3-01406e53c3ed tempest-SnapshotsActionsTest-800030130 None] Lock "cinder-quobyte-165c940b-6999-4eb6-a8a6-01a1d2ac139b" released by "_delete_snapshot" :: held 1.786s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:07:16 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-9c7753a5-da89-46e5-a9c3-01406e53c3ed tempest-SnapshotsActionsTest-800030130 None] Lock "cinder-quobyte-640722de-3f4c-4434-9712-126398038f41" released by "delete_snapshot" :: held 1.830s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:07:16 devstack sudo[98635]: pam_unix(sudo:session): session closed for user root Sep 07 10:07:16 devstack sudo[98638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ba4cb054-c543-4fa1-85c0-52b1175b4f5e_fdoc_lr2devstack@QuobyteHD Sep 07 10:07:16 devstack sudo[98638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:07:16 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [req-058aa519-32a4-4c8d-bb2c-54c1b998426f req-19f23131-d6ea-4ef7-bb33-6a2ee282e10e tempest-VolumesGetTestJSON-1412785037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-85c812e8-a235-4027-a1c5-cf33d1fe9cfc" returned: 0 in 0.341s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:07:16 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [req-058aa519-32a4-4c8d-bb2c-54c1b998426f req-19f23131-d6ea-4ef7-bb33-6a2ee282e10e tempest-VolumesGetTestJSON-1412785037 None] <== create_volume: return (892ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'} {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 10:07:16 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [req-058aa519-32a4-4c8d-bb2c-54c1b998426f req-19f23131-d6ea-4ef7-bb33-6a2ee282e10e tempest-VolumesGetTestJSON-1412785037 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.896s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:07:16 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [req-058aa519-32a4-4c8d-bb2c-54c1b998426f req-19f23131-d6ea-4ef7-bb33-6a2ee282e10e tempest-VolumesGetTestJSON-1412785037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74790881-d0fb-4c23-a657-792256a2138b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-85c812e8-a235-4027-a1c5-cf33d1fe9cfc', 'volume_size': 1}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:07:16 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [req-058aa519-32a4-4c8d-bb2c-54c1b998426f req-19f23131-d6ea-4ef7-bb33-6a2ee282e10e tempest-VolumesGetTestJSON-1412785037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0877311-40c3-41a3-a99f-91417fa9d24b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:07:16 devstack cinder-volume[87515]: DEBUG cinder.quota [None req-9c7753a5-da89-46e5-a9c3-01406e53c3ed tempest-SnapshotsActionsTest-800030130 None] Created reservations ['a93e6132-2453-45da-991d-d353e2b59eab', '35a5a606-621f-4589-881e-ffb369fbb1d8', '64cbb75b-fa95-4920-bc9d-dfe896ceb366', '98ce148b-33e3-4b22-ab4e-7c3d9e49a5a5'] {{(pid=87515) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:07:16 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [req-058aa519-32a4-4c8d-bb2c-54c1b998426f req-19f23131-d6ea-4ef7-bb33-6a2ee282e10e tempest-VolumesGetTestJSON-1412785037 None] Volume volume-85c812e8-a235-4027-a1c5-cf33d1fe9cfc (85c812e8-a235-4027-a1c5-cf33d1fe9cfc): created successfully Sep 07 10:07:16 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [req-058aa519-32a4-4c8d-bb2c-54c1b998426f req-19f23131-d6ea-4ef7-bb33-6a2ee282e10e tempest-VolumesGetTestJSON-1412785037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0877311-40c3-41a3-a99f-91417fa9d24b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:07:16 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [req-058aa519-32a4-4c8d-bb2c-54c1b998426f req-19f23131-d6ea-4ef7-bb33-6a2ee282e10e tempest-VolumesGetTestJSON-1412785037 None] Flow 'volume_create_manager' (3ea1cfb3-749d-43b6-bc98-8367428632fd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:07:16 devstack cinder-volume[87515]: INFO cinder.volume.manager [req-058aa519-32a4-4c8d-bb2c-54c1b998426f req-19f23131-d6ea-4ef7-bb33-6a2ee282e10e tempest-VolumesGetTestJSON-1412785037 None] Created volume successfully. Sep 07 10:07:16 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-9c7753a5-da89-46e5-a9c3-01406e53c3ed tempest-SnapshotsActionsTest-800030130 None] Delete snapshot completed successfully. Sep 07 10:07:16 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-9c7753a5-da89-46e5-a9c3-01406e53c3ed tempest-SnapshotsActionsTest-800030130 None] Lock "cinder-165c940b-6999-4eb6-a8a6-01a1d2ac139b-delete_snapshot" released by "delete_snapshot" :: held 2.051s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:07:16 devstack sudo[98638]: pam_unix(sudo:session): session closed for user root Sep 07 10:07:16 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-0b46f7d0-d5da-4ad4-8d28-27176e2916cd tempest-VolumeAndVolumeTypeFromImageTest-1310657115 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ba4cb054-c543-4fa1-85c0-52b1175b4f5e_fdoc_lr2devstack@QuobyteHD" returned: 0 in 0.401s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:07:16 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-0b46f7d0-d5da-4ad4-8d28-27176e2916cd tempest-VolumeAndVolumeTypeFromImageTest-1310657115 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ba4cb054-c543-4fa1-85c0-52b1175b4f5e_fdoc_lr2devstack@QuobyteHD {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:07:17 devstack sudo[98643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ba4cb054-c543-4fa1-85c0-52b1175b4f5e_fdoc_lr2devstack@QuobyteHD Sep 07 10:07:17 devstack sudo[98643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:07:17 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-67c86170-36f4-4482-b76a-1fd0c0ddc0df tempest-SnapshotsActionsTest-158812568 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:07:17 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-67c86170-36f4-4482-b76a-1fd0c0ddc0df tempest-SnapshotsActionsTest-158812568 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:07:17 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-67c86170-36f4-4482-b76a-1fd0c0ddc0df tempest-SnapshotsActionsTest-158812568 None] Creating offline snapshot 9ce3aa02-a88b-4a7d-9848-8b5041b62993 of volume 640722de-3f4c-4434-9712-126398038f41 {{(pid=87515) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 10:07:17 devstack sudo[98643]: pam_unix(sudo:session): session closed for user root Sep 07 10:07:17 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-0b46f7d0-d5da-4ad4-8d28-27176e2916cd tempest-VolumeAndVolumeTypeFromImageTest-1310657115 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ba4cb054-c543-4fa1-85c0-52b1175b4f5e_fdoc_lr2devstack@QuobyteHD" returned: 1 in 0.396s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:07:17 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-0b46f7d0-d5da-4ad4-8d28-27176e2916cd tempest-VolumeAndVolumeTypeFromImageTest-1310657115 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ba4cb054-c543-4fa1-85c0-52b1175b4f5e_fdoc_lr2devstack@QuobyteHD' failed. Not Retrying. {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 07 10:07:17 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-0b46f7d0-d5da-4ad4-8d28-27176e2916cd tempest-VolumeAndVolumeTypeFromImageTest-1310657115 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:07:17 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[adce31e6-2155-4b9f-8a98-44a5fa93fd4f]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:07:17 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-67c86170-36f4-4482-b76a-1fd0c0ddc0df tempest-SnapshotsActionsTest-158812568 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-640722de-3f4c-4434-9712-126398038f41.e31bfd3f-4446-4c21-a386-572c14dcfc9e {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:07:17 devstack sudo[98648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-640722de-3f4c-4434-9712-126398038f41.e31bfd3f-4446-4c21-a386-572c14dcfc9e Sep 07 10:07:17 devstack sudo[98648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:07:17 devstack sudo[98648]: pam_unix(sudo:session): session closed for user root Sep 07 10:07:17 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-67c86170-36f4-4482-b76a-1fd0c0ddc0df tempest-SnapshotsActionsTest-158812568 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-640722de-3f4c-4434-9712-126398038f41.e31bfd3f-4446-4c21-a386-572c14dcfc9e" returned: 0 in 0.377s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:07:17 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-67c86170-36f4-4482-b76a-1fd0c0ddc0df tempest-SnapshotsActionsTest-158812568 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-640722de-3f4c-4434-9712-126398038f41(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87515) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 10:07:17 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-67c86170-36f4-4482-b76a-1fd0c0ddc0df tempest-SnapshotsActionsTest-158812568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-640722de-3f4c-4434-9712-126398038f41.e31bfd3f-4446-4c21-a386-572c14dcfc9e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-640722de-3f4c-4434-9712-126398038f41.9ce3aa02-a88b-4a7d-9848-8b5041b62993 1G {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:07:17 devstack sudo[98653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-640722de-3f4c-4434-9712-126398038f41.e31bfd3f-4446-4c21-a386-572c14dcfc9e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-640722de-3f4c-4434-9712-126398038f41.9ce3aa02-a88b-4a7d-9848-8b5041b62993 1G Sep 07 10:07:17 devstack sudo[98653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:07:18 devstack cinder-volume[87515]: DEBUG cinder.coordination [req-b605ede4-9190-43c7-a06e-80473ad5427b req-f00f45b4-510c-4aa6-85a4-7a5d59983c05 tempest-VolumesGetTestJSON-1412785037 None] Acquiring lock "cinder-85c812e8-a235-4027-a1c5-cf33d1fe9cfc-delete_volume" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:07:18 devstack cinder-volume[87515]: DEBUG cinder.coordination [req-b605ede4-9190-43c7-a06e-80473ad5427b req-f00f45b4-510c-4aa6-85a4-7a5d59983c05 tempest-VolumesGetTestJSON-1412785037 None] Lock "cinder-85c812e8-a235-4027-a1c5-cf33d1fe9cfc-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:07:18 devstack cinder-volume[87515]: DEBUG cinder.coordination [req-b605ede4-9190-43c7-a06e-80473ad5427b req-f00f45b4-510c-4aa6-85a4-7a5d59983c05 tempest-VolumesGetTestJSON-1412785037 None] Acquiring lock "cinder-quobyte-85c812e8-a235-4027-a1c5-cf33d1fe9cfc" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:07:18 devstack cinder-volume[87515]: DEBUG cinder.coordination [req-b605ede4-9190-43c7-a06e-80473ad5427b req-f00f45b4-510c-4aa6-85a4-7a5d59983c05 tempest-VolumesGetTestJSON-1412785037 None] Lock "cinder-quobyte-85c812e8-a235-4027-a1c5-cf33d1fe9cfc" acquired by "delete_volume" :: waited 0.022s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:07:18 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[90da1b31-8977-49ab-beb7-f9852925f0e8]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:07:18 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [req-b605ede4-9190-43c7-a06e-80473ad5427b req-f00f45b4-510c-4aa6-85a4-7a5d59983c05 tempest-VolumesGetTestJSON-1412785037 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-85c812e8-a235-4027-a1c5-cf33d1fe9cfc {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:07:18 devstack sudo[98653]: pam_unix(sudo:session): session closed for user root Sep 07 10:07:18 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-67c86170-36f4-4482-b76a-1fd0c0ddc0df tempest-SnapshotsActionsTest-158812568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-640722de-3f4c-4434-9712-126398038f41.e31bfd3f-4446-4c21-a386-572c14dcfc9e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-640722de-3f4c-4434-9712-126398038f41.9ce3aa02-a88b-4a7d-9848-8b5041b62993 1G" returned: 0 in 0.499s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:07:18 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-67c86170-36f4-4482-b76a-1fd0c0ddc0df tempest-SnapshotsActionsTest-158812568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-640722de-3f4c-4434-9712-126398038f41.e31bfd3f-4446-4c21-a386-572c14dcfc9e -F qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-640722de-3f4c-4434-9712-126398038f41.9ce3aa02-a88b-4a7d-9848-8b5041b62993 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:07:18 devstack sudo[98660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-640722de-3f4c-4434-9712-126398038f41.e31bfd3f-4446-4c21-a386-572c14dcfc9e -F qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-640722de-3f4c-4434-9712-126398038f41.9ce3aa02-a88b-4a7d-9848-8b5041b62993 Sep 07 10:07:18 devstack sudo[98660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:07:18 devstack sudo[98659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-85c812e8-a235-4027-a1c5-cf33d1fe9cfc Sep 07 10:07:18 devstack sudo[98659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:07:18 devstack sudo[98659]: pam_unix(sudo:session): session closed for user root Sep 07 10:07:18 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [req-b605ede4-9190-43c7-a06e-80473ad5427b req-f00f45b4-510c-4aa6-85a4-7a5d59983c05 tempest-VolumesGetTestJSON-1412785037 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-85c812e8-a235-4027-a1c5-cf33d1fe9cfc" returned: 0 in 0.390s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:07:18 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [req-b605ede4-9190-43c7-a06e-80473ad5427b req-f00f45b4-510c-4aa6-85a4-7a5d59983c05 tempest-VolumesGetTestJSON-1412785037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-85c812e8-a235-4027-a1c5-cf33d1fe9cfc {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:07:18 devstack sudo[98660]: pam_unix(sudo:session): session closed for user root Sep 07 10:07:18 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-67c86170-36f4-4482-b76a-1fd0c0ddc0df tempest-SnapshotsActionsTest-158812568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-640722de-3f4c-4434-9712-126398038f41.e31bfd3f-4446-4c21-a386-572c14dcfc9e -F qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-640722de-3f4c-4434-9712-126398038f41.9ce3aa02-a88b-4a7d-9848-8b5041b62993" returned: 0 in 0.341s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:07:18 devstack cinder-volume[87515]: WARNING cinder.volume.drivers.remotefs [None req-67c86170-36f4-4482-b76a-1fd0c0ddc0df tempest-SnapshotsActionsTest-158812568 None] /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-640722de-3f4c-4434-9712-126398038f41.9ce3aa02-a88b-4a7d-9848-8b5041b62993 is being set with open permissions: ugo+rw Sep 07 10:07:18 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-67c86170-36f4-4482-b76a-1fd0c0ddc0df tempest-SnapshotsActionsTest-158812568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-640722de-3f4c-4434-9712-126398038f41.9ce3aa02-a88b-4a7d-9848-8b5041b62993 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:07:18 devstack sudo[98670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-85c812e8-a235-4027-a1c5-cf33d1fe9cfc Sep 07 10:07:18 devstack sudo[98670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:07:18 devstack sudo[98671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-640722de-3f4c-4434-9712-126398038f41.9ce3aa02-a88b-4a7d-9848-8b5041b62993 Sep 07 10:07:18 devstack sudo[98671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:07:18 devstack sudo[98670]: pam_unix(sudo:session): session closed for user root Sep 07 10:07:18 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [req-b605ede4-9190-43c7-a06e-80473ad5427b req-f00f45b4-510c-4aa6-85a4-7a5d59983c05 tempest-VolumesGetTestJSON-1412785037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-85c812e8-a235-4027-a1c5-cf33d1fe9cfc" returned: 0 in 0.252s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:07:18 devstack cinder-volume[87515]: DEBUG cinder.coordination [req-b605ede4-9190-43c7-a06e-80473ad5427b req-f00f45b4-510c-4aa6-85a4-7a5d59983c05 tempest-VolumesGetTestJSON-1412785037 None] Lock "cinder-quobyte-85c812e8-a235-4027-a1c5-cf33d1fe9cfc" released by "delete_volume" :: held 0.686s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:07:18 devstack sudo[98671]: pam_unix(sudo:session): session closed for user root Sep 07 10:07:18 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-67c86170-36f4-4482-b76a-1fd0c0ddc0df tempest-SnapshotsActionsTest-158812568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-640722de-3f4c-4434-9712-126398038f41.9ce3aa02-a88b-4a7d-9848-8b5041b62993" returned: 0 in 0.265s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:07:18 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-67c86170-36f4-4482-b76a-1fd0c0ddc0df tempest-SnapshotsActionsTest-158812568 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.582s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:07:18 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-0b46f7d0-d5da-4ad4-8d28-27176e2916cd tempest-VolumeAndVolumeTypeFromImageTest-1310657115 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.535s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:07:18 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-0b46f7d0-d5da-4ad4-8d28-27176e2916cd tempest-VolumeAndVolumeTypeFromImageTest-1310657115 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:07:15Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8e40710-7e6b-406d-9965-e8844956f2d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b4564b22f8a47848f0852021541220a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:07:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:07:15Z,use_quota=True,user_id='8ece7eace17b4d81a8c83e8a1b10ca9e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(893d5b3e-0270-4e36-97aa-fcadbd97ceef),volume_type_id=893d5b3e-0270-4e36-97aa-fcadbd97ceef)}" {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 10:07:18 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-0b46f7d0-d5da-4ad4-8d28-27176e2916cd tempest-VolumeAndVolumeTypeFromImageTest-1310657115 None] Creating volume d8e40710-7e6b-406d-9965-e8844956f2d4 {{(pid=87515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 10:07:18 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-0b46f7d0-d5da-4ad4-8d28-27176e2916cd tempest-VolumeAndVolumeTypeFromImageTest-1310657115 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:07:18 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-0b46f7d0-d5da-4ad4-8d28-27176e2916cd tempest-VolumeAndVolumeTypeFromImageTest-1310657115 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:07:18 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-0b46f7d0-d5da-4ad4-8d28-27176e2916cd tempest-VolumeAndVolumeTypeFromImageTest-1310657115 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:07:18 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-0b46f7d0-d5da-4ad4-8d28-27176e2916cd tempest-VolumeAndVolumeTypeFromImageTest-1310657115 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:07:18 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-0b46f7d0-d5da-4ad4-8d28-27176e2916cd tempest-VolumeAndVolumeTypeFromImageTest-1310657115 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:07:18 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-0b46f7d0-d5da-4ad4-8d28-27176e2916cd tempest-VolumeAndVolumeTypeFromImageTest-1310657115 None] Selected osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c as target Quobyte volume. {{(pid=87515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 10:07:18 devstack cinder-volume[87515]: INFO cinder.volume.drivers.remotefs [None req-0b46f7d0-d5da-4ad4-8d28-27176e2916cd tempest-VolumeAndVolumeTypeFromImageTest-1310657115 None] casted to osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c Sep 07 10:07:18 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-0b46f7d0-d5da-4ad4-8d28-27176e2916cd tempest-VolumeAndVolumeTypeFromImageTest-1310657115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-d8e40710-7e6b-406d-9965-e8844956f2d4 1073741824 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:07:18 devstack sudo[98677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-d8e40710-7e6b-406d-9965-e8844956f2d4 1073741824 Sep 07 10:07:18 devstack sudo[98677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:07:18 devstack cinder-volume[87515]: DEBUG cinder.image.image_utils [None req-b218f0e2-9c39-4988-82dc-92c52eb1cdde tempest-TestInstancesWithCinderVolumes-120733040 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_7878cafb-138f-4fbd-9180-b9e60e3a9cba_voxps7a5devstack@QuobyteHD, size 20.69 MB, duration 4.90 sec {{(pid=87515) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 07 10:07:18 devstack cinder-volume[87515]: INFO cinder.image.image_utils [None req-b218f0e2-9c39-4988-82dc-92c52eb1cdde tempest-TestInstancesWithCinderVolumes-120733040 None] Image download 20.69 MB at 4.22 MB/s Sep 07 10:07:18 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-67c86170-36f4-4482-b76a-1fd0c0ddc0df tempest-SnapshotsActionsTest-158812568 None] Create snapshot completed successfully Sep 07 10:07:18 devstack cinder-volume[87515]: DEBUG cinder.quota [req-b605ede4-9190-43c7-a06e-80473ad5427b req-f00f45b4-510c-4aa6-85a4-7a5d59983c05 tempest-VolumesGetTestJSON-1412785037 None] Created reservations ['3b334953-023e-4f7d-b9ae-c440f72c9c24', '7730cc80-cf12-46ae-949b-155636143315', '0a19ca4f-3ba5-475d-a576-34602cef09f6', '790a5b40-7ebb-4ee9-a589-112460ebef81'] {{(pid=87515) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:07:18 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ff058e1-bf29-4228-bc39-47f18c75d668]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:07:18 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-b218f0e2-9c39-4988-82dc-92c52eb1cdde tempest-TestInstancesWithCinderVolumes-120733040 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7878cafb-138f-4fbd-9180-b9e60e3a9cba_voxps7a5devstack@QuobyteHD {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:07:19 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [req-b605ede4-9190-43c7-a06e-80473ad5427b req-f00f45b4-510c-4aa6-85a4-7a5d59983c05 tempest-VolumesGetTestJSON-1412785037 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:07:19 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [req-b605ede4-9190-43c7-a06e-80473ad5427b req-f00f45b4-510c-4aa6-85a4-7a5d59983c05 tempest-VolumesGetTestJSON-1412785037 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:07:19 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [req-b605ede4-9190-43c7-a06e-80473ad5427b req-f00f45b4-510c-4aa6-85a4-7a5d59983c05 tempest-VolumesGetTestJSON-1412785037 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:07:19 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [req-b605ede4-9190-43c7-a06e-80473ad5427b req-f00f45b4-510c-4aa6-85a4-7a5d59983c05 tempest-VolumesGetTestJSON-1412785037 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:07:19 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [req-b605ede4-9190-43c7-a06e-80473ad5427b req-f00f45b4-510c-4aa6-85a4-7a5d59983c05 tempest-VolumesGetTestJSON-1412785037 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:07:19 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [req-b605ede4-9190-43c7-a06e-80473ad5427b req-f00f45b4-510c-4aa6-85a4-7a5d59983c05 tempest-VolumesGetTestJSON-1412785037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:07:19 devstack sudo[98680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a Sep 07 10:07:19 devstack sudo[98680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:07:19 devstack sudo[98679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7878cafb-138f-4fbd-9180-b9e60e3a9cba_voxps7a5devstack@QuobyteHD Sep 07 10:07:19 devstack sudo[98679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:07:19 devstack sudo[98680]: pam_unix(sudo:session): session closed for user root Sep 07 10:07:19 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [req-b605ede4-9190-43c7-a06e-80473ad5427b req-f00f45b4-510c-4aa6-85a4-7a5d59983c05 tempest-VolumesGetTestJSON-1412785037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a" returned: 0 in 0.313s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:07:19 devstack cinder-volume[87515]: DEBUG cinder.manager [req-b605ede4-9190-43c7-a06e-80473ad5427b req-f00f45b4-510c-4aa6-85a4-7a5d59983c05 tempest-VolumesGetTestJSON-1412785037 None] Notifying Schedulers of capabilities ... {{(pid=87515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:07:19 devstack cinder-volume[87515]: INFO cinder.volume.manager [req-b605ede4-9190-43c7-a06e-80473ad5427b req-f00f45b4-510c-4aa6-85a4-7a5d59983c05 tempest-VolumesGetTestJSON-1412785037 None] Deleted volume successfully. Sep 07 10:07:19 devstack cinder-volume[87515]: DEBUG cinder.coordination [req-b605ede4-9190-43c7-a06e-80473ad5427b req-f00f45b4-510c-4aa6-85a4-7a5d59983c05 tempest-VolumesGetTestJSON-1412785037 None] Lock "cinder-85c812e8-a235-4027-a1c5-cf33d1fe9cfc-delete_volume" released by "delete_volume" :: held 1.371s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:07:19 devstack sudo[98679]: pam_unix(sudo:session): session closed for user root Sep 07 10:07:19 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-b218f0e2-9c39-4988-82dc-92c52eb1cdde tempest-TestInstancesWithCinderVolumes-120733040 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7878cafb-138f-4fbd-9180-b9e60e3a9cba_voxps7a5devstack@QuobyteHD" returned: 0 in 0.438s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:07:19 devstack cinder-volume[87515]: DEBUG cinder.image.image_utils [None req-b218f0e2-9c39-4988-82dc-92c52eb1cdde tempest-TestInstancesWithCinderVolumes-120733040 None] Temporary image 7878cafb-138f-4fbd-9180-b9e60e3a9cba is fetched for user 92b1206c699547f39f95f0f1b1b345ff. {{(pid=87515) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 07 10:07:19 devstack sudo[98677]: pam_unix(sudo:session): session closed for user root Sep 07 10:07:19 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-0b46f7d0-d5da-4ad4-8d28-27176e2916cd tempest-VolumeAndVolumeTypeFromImageTest-1310657115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-d8e40710-7e6b-406d-9965-e8844956f2d4 1073741824" returned: 0 in 0.604s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:07:19 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[b614bd5c-50f5-4302-a6a3-35cb9bff1dae]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:07:19 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-b218f0e2-9c39-4988-82dc-92c52eb1cdde tempest-TestInstancesWithCinderVolumes-120733040 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7878cafb-138f-4fbd-9180-b9e60e3a9cba_voxps7a5devstack@QuobyteHD {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:07:19 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-0b46f7d0-d5da-4ad4-8d28-27176e2916cd tempest-VolumeAndVolumeTypeFromImageTest-1310657115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-d8e40710-7e6b-406d-9965-e8844956f2d4 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:07:19 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-46fb1698-27f9-4392-bb4b-c8f8a0d6abf9 tempest-SnapshotsActionsTest-800030130 None] Acquiring lock "cinder-9ce3aa02-a88b-4a7d-9848-8b5041b62993-delete_snapshot" by "delete_snapshot" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:07:19 devstack sudo[98725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-d8e40710-7e6b-406d-9965-e8844956f2d4 Sep 07 10:07:19 devstack sudo[98725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:07:19 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-46fb1698-27f9-4392-bb4b-c8f8a0d6abf9 tempest-SnapshotsActionsTest-800030130 None] Lock "cinder-9ce3aa02-a88b-4a7d-9848-8b5041b62993-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:07:19 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-46fb1698-27f9-4392-bb4b-c8f8a0d6abf9 tempest-SnapshotsActionsTest-800030130 None] Acquiring lock "cinder-quobyte-640722de-3f4c-4434-9712-126398038f41" by "delete_snapshot" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:07:19 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-46fb1698-27f9-4392-bb4b-c8f8a0d6abf9 tempest-SnapshotsActionsTest-800030130 None] Lock "cinder-quobyte-640722de-3f4c-4434-9712-126398038f41" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:07:19 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-46fb1698-27f9-4392-bb4b-c8f8a0d6abf9 tempest-SnapshotsActionsTest-800030130 None] Acquiring lock "cinder-quobyte-9ce3aa02-a88b-4a7d-9848-8b5041b62993" by "_delete_snapshot" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:07:19 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-46fb1698-27f9-4392-bb4b-c8f8a0d6abf9 tempest-SnapshotsActionsTest-800030130 None] Lock "cinder-quobyte-9ce3aa02-a88b-4a7d-9848-8b5041b62993" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:07:19 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-46fb1698-27f9-4392-bb4b-c8f8a0d6abf9 tempest-SnapshotsActionsTest-800030130 None] Deleting offline snapshot 9ce3aa02-a88b-4a7d-9848-8b5041b62993 of volume 640722de-3f4c-4434-9712-126398038f41 {{(pid=87515) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 10:07:19 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-46fb1698-27f9-4392-bb4b-c8f8a0d6abf9 tempest-SnapshotsActionsTest-800030130 None] snapshot_file for this snap is: volume-640722de-3f4c-4434-9712-126398038f41.9ce3aa02-a88b-4a7d-9848-8b5041b62993 {{(pid=87515) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 10:07:19 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fea7f81-da69-4639-9508-971853d0e1c6]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:07:19 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-46fb1698-27f9-4392-bb4b-c8f8a0d6abf9 tempest-SnapshotsActionsTest-800030130 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-640722de-3f4c-4434-9712-126398038f41.9ce3aa02-a88b-4a7d-9848-8b5041b62993 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:07:19 devstack sudo[98724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7878cafb-138f-4fbd-9180-b9e60e3a9cba_voxps7a5devstack@QuobyteHD Sep 07 10:07:19 devstack sudo[98724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:07:19 devstack sudo[98727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-640722de-3f4c-4434-9712-126398038f41.9ce3aa02-a88b-4a7d-9848-8b5041b62993 Sep 07 10:07:19 devstack sudo[98727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:07:19 devstack sudo[98725]: pam_unix(sudo:session): session closed for user root Sep 07 10:07:19 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-0b46f7d0-d5da-4ad4-8d28-27176e2916cd tempest-VolumeAndVolumeTypeFromImageTest-1310657115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-d8e40710-7e6b-406d-9965-e8844956f2d4" returned: 0 in 0.354s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:07:19 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-0b46f7d0-d5da-4ad4-8d28-27176e2916cd tempest-VolumeAndVolumeTypeFromImageTest-1310657115 None] <== create_volume: return (1081ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'} {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 10:07:19 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-0b46f7d0-d5da-4ad4-8d28-27176e2916cd tempest-VolumeAndVolumeTypeFromImageTest-1310657115 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.086s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:07:19 devstack cinder-volume[87515]: DEBUG cinder.volume.volume_utils [None req-0b46f7d0-d5da-4ad4-8d28-27176e2916cd tempest-VolumeAndVolumeTypeFromImageTest-1310657115 None] Attempting download of ba4cb054-c543-4fa1-85c0-52b1175b4f5e ((None, [{'url': 'file:///opt/stack/data/glance/images/ba4cb054-c543-4fa1-85c0-52b1175b4f5e', 'metadata': {}}])) to volume d8e40710-7e6b-406d-9965-e8844956f2d4. {{(pid=87515) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 07 10:07:20 devstack sudo[98724]: pam_unix(sudo:session): session closed for user root Sep 07 10:07:20 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-b218f0e2-9c39-4988-82dc-92c52eb1cdde tempest-TestInstancesWithCinderVolumes-120733040 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7878cafb-138f-4fbd-9180-b9e60e3a9cba_voxps7a5devstack@QuobyteHD" returned: 0 in 0.503s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:07:20 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-b218f0e2-9c39-4988-82dc-92c52eb1cdde tempest-TestInstancesWithCinderVolumes-120733040 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:07:20 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-b218f0e2-9c39-4988-82dc-92c52eb1cdde tempest-TestInstancesWithCinderVolumes-120733040 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:07:20 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-b218f0e2-9c39-4988-82dc-92c52eb1cdde tempest-TestInstancesWithCinderVolumes-120733040 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:07:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1797218414',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5aa431e-9421-48c0-9d3c-bb472d9415af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e58e36387544e9bbe7359cb5d265361',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:07:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:07:13Z,use_quota=True,user_id='92b1206c699547f39f95f0f1b1b345ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcebd7f3-e620-4874-8742-cf78dd84193f),volume_type_id=fcebd7f3-e620-4874-8742-cf78dd84193f)}" {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 10:07:20 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-b218f0e2-9c39-4988-82dc-92c52eb1cdde tempest-TestInstancesWithCinderVolumes-120733040 None] Creating volume d5aa431e-9421-48c0-9d3c-bb472d9415af {{(pid=87515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 10:07:20 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-b218f0e2-9c39-4988-82dc-92c52eb1cdde tempest-TestInstancesWithCinderVolumes-120733040 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:07:20 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-b218f0e2-9c39-4988-82dc-92c52eb1cdde tempest-TestInstancesWithCinderVolumes-120733040 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:07:20 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-b218f0e2-9c39-4988-82dc-92c52eb1cdde tempest-TestInstancesWithCinderVolumes-120733040 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:07:20 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-b218f0e2-9c39-4988-82dc-92c52eb1cdde tempest-TestInstancesWithCinderVolumes-120733040 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:07:20 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-b218f0e2-9c39-4988-82dc-92c52eb1cdde tempest-TestInstancesWithCinderVolumes-120733040 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:07:20 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-b218f0e2-9c39-4988-82dc-92c52eb1cdde tempest-TestInstancesWithCinderVolumes-120733040 None] Selected osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c as target Quobyte volume. {{(pid=87515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 10:07:20 devstack cinder-volume[87515]: INFO cinder.volume.drivers.remotefs [None req-b218f0e2-9c39-4988-82dc-92c52eb1cdde tempest-TestInstancesWithCinderVolumes-120733040 None] casted to osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c Sep 07 10:07:20 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-b218f0e2-9c39-4988-82dc-92c52eb1cdde tempest-TestInstancesWithCinderVolumes-120733040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-d5aa431e-9421-48c0-9d3c-bb472d9415af 1073741824 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:07:20 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c1759b9-60b6-4c8a-950a-24d58abeed7f]: (4, 'raw') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:07:20 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-0b46f7d0-d5da-4ad4-8d28-27176e2916cd tempest-VolumeAndVolumeTypeFromImageTest-1310657115 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ba4cb054-c543-4fa1-85c0-52b1175b4f5e_vhlgrj5n {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:07:20 devstack sudo[98736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-d5aa431e-9421-48c0-9d3c-bb472d9415af 1073741824 Sep 07 10:07:20 devstack sudo[98736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:07:20 devstack sudo[98727]: pam_unix(sudo:session): session closed for user root Sep 07 10:07:20 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-46fb1698-27f9-4392-bb4b-c8f8a0d6abf9 tempest-SnapshotsActionsTest-800030130 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-640722de-3f4c-4434-9712-126398038f41.9ce3aa02-a88b-4a7d-9848-8b5041b62993" returned: 0 in 0.443s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:07:20 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-46fb1698-27f9-4392-bb4b-c8f8a0d6abf9 tempest-SnapshotsActionsTest-800030130 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-640722de-3f4c-4434-9712-126398038f41(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87515) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 10:07:20 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e19c64c-2e21-479f-a24d-573337444434]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:07:20 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-46fb1698-27f9-4392-bb4b-c8f8a0d6abf9 tempest-SnapshotsActionsTest-800030130 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-640722de-3f4c-4434-9712-126398038f41.e31bfd3f-4446-4c21-a386-572c14dcfc9e {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:07:20 devstack sudo[98739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ba4cb054-c543-4fa1-85c0-52b1175b4f5e_vhlgrj5n Sep 07 10:07:20 devstack sudo[98739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:07:20 devstack sudo[98743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-640722de-3f4c-4434-9712-126398038f41.e31bfd3f-4446-4c21-a386-572c14dcfc9e Sep 07 10:07:20 devstack sudo[98743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:07:20 devstack sudo[98739]: pam_unix(sudo:session): session closed for user root Sep 07 10:07:20 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-0b46f7d0-d5da-4ad4-8d28-27176e2916cd tempest-VolumeAndVolumeTypeFromImageTest-1310657115 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ba4cb054-c543-4fa1-85c0-52b1175b4f5e_vhlgrj5n" returned: 0 in 0.449s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:07:20 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-0b46f7d0-d5da-4ad4-8d28-27176e2916cd tempest-VolumeAndVolumeTypeFromImageTest-1310657115 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ba4cb054-c543-4fa1-85c0-52b1175b4f5e_vhlgrj5n {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:07:20 devstack sudo[98743]: pam_unix(sudo:session): session closed for user root Sep 07 10:07:20 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-46fb1698-27f9-4392-bb4b-c8f8a0d6abf9 tempest-SnapshotsActionsTest-800030130 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-640722de-3f4c-4434-9712-126398038f41.e31bfd3f-4446-4c21-a386-572c14dcfc9e" returned: 0 in 0.467s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:07:20 devstack sudo[98736]: pam_unix(sudo:session): session closed for user root Sep 07 10:07:20 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-46fb1698-27f9-4392-bb4b-c8f8a0d6abf9 tempest-SnapshotsActionsTest-800030130 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-640722de-3f4c-4434-9712-126398038f41(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87515) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 10:07:20 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-46fb1698-27f9-4392-bb4b-c8f8a0d6abf9 tempest-SnapshotsActionsTest-800030130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-640722de-3f4c-4434-9712-126398038f41.9ce3aa02-a88b-4a7d-9848-8b5041b62993 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:07:20 devstack sudo[98752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ba4cb054-c543-4fa1-85c0-52b1175b4f5e_vhlgrj5n Sep 07 10:07:20 devstack sudo[98752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:07:20 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-b218f0e2-9c39-4988-82dc-92c52eb1cdde tempest-TestInstancesWithCinderVolumes-120733040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-d5aa431e-9421-48c0-9d3c-bb472d9415af 1073741824" returned: 0 in 0.640s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:07:20 devstack cinder-volume[87515]: DEBUG dbcounter [-] [87515] Writing DB stats cinder:UPDATE=175,cinder:SELECT=153,cinder:INSERT=47,cinder:DELETE=14 {{(pid=87515) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 10:07:20 devstack sudo[98756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-640722de-3f4c-4434-9712-126398038f41.9ce3aa02-a88b-4a7d-9848-8b5041b62993 Sep 07 10:07:20 devstack sudo[98756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:07:20 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-b218f0e2-9c39-4988-82dc-92c52eb1cdde tempest-TestInstancesWithCinderVolumes-120733040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-d5aa431e-9421-48c0-9d3c-bb472d9415af {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:07:20 devstack sudo[98759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-d5aa431e-9421-48c0-9d3c-bb472d9415af Sep 07 10:07:20 devstack sudo[98759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:07:20 devstack sudo[98752]: pam_unix(sudo:session): session closed for user root Sep 07 10:07:20 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-0b46f7d0-d5da-4ad4-8d28-27176e2916cd tempest-VolumeAndVolumeTypeFromImageTest-1310657115 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ba4cb054-c543-4fa1-85c0-52b1175b4f5e_vhlgrj5n" returned: 1 in 0.442s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:07:20 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-0b46f7d0-d5da-4ad4-8d28-27176e2916cd tempest-VolumeAndVolumeTypeFromImageTest-1310657115 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ba4cb054-c543-4fa1-85c0-52b1175b4f5e_vhlgrj5n' failed. Not Retrying. {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 07 10:07:20 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[95b88a7a-02cd-437c-86f8-c54c6bcddb14]: (4, 'raw') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:07:20 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-0b46f7d0-d5da-4ad4-8d28-27176e2916cd tempest-VolumeAndVolumeTypeFromImageTest-1310657115 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ba4cb054-c543-4fa1-85c0-52b1175b4f5e_fdoc_lr2devstack@QuobyteHD {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:07:21 devstack sudo[98759]: pam_unix(sudo:session): session closed for user root Sep 07 10:07:21 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-b218f0e2-9c39-4988-82dc-92c52eb1cdde tempest-TestInstancesWithCinderVolumes-120733040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-d5aa431e-9421-48c0-9d3c-bb472d9415af" returned: 0 in 0.339s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:07:21 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-b218f0e2-9c39-4988-82dc-92c52eb1cdde tempest-TestInstancesWithCinderVolumes-120733040 None] <== create_volume: return (1068ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'} {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 10:07:21 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-b218f0e2-9c39-4988-82dc-92c52eb1cdde tempest-TestInstancesWithCinderVolumes-120733040 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.073s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:07:21 devstack sudo[98765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ba4cb054-c543-4fa1-85c0-52b1175b4f5e_fdoc_lr2devstack@QuobyteHD Sep 07 10:07:21 devstack sudo[98765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:07:21 devstack cinder-volume[87515]: DEBUG cinder.volume.volume_utils [None req-b218f0e2-9c39-4988-82dc-92c52eb1cdde tempest-TestInstancesWithCinderVolumes-120733040 None] Attempting download of 7878cafb-138f-4fbd-9180-b9e60e3a9cba ((None, [{'url': 'file:///opt/stack/data/glance/images/7878cafb-138f-4fbd-9180-b9e60e3a9cba', 'metadata': {}}])) to volume d5aa431e-9421-48c0-9d3c-bb472d9415af. {{(pid=87515) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 07 10:07:21 devstack sudo[98756]: pam_unix(sudo:session): session closed for user root Sep 07 10:07:21 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-46fb1698-27f9-4392-bb4b-c8f8a0d6abf9 tempest-SnapshotsActionsTest-800030130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-640722de-3f4c-4434-9712-126398038f41.9ce3aa02-a88b-4a7d-9848-8b5041b62993" returned: 0 in 0.502s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:07:21 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-46fb1698-27f9-4392-bb4b-c8f8a0d6abf9 tempest-SnapshotsActionsTest-800030130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-640722de-3f4c-4434-9712-126398038f41.9ce3aa02-a88b-4a7d-9848-8b5041b62993 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:07:21 devstack sudo[98770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-640722de-3f4c-4434-9712-126398038f41.9ce3aa02-a88b-4a7d-9848-8b5041b62993 Sep 07 10:07:21 devstack sudo[98770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:07:21 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[b57ed2cd-7c3d-4b94-8bdf-fffc7ae4922f]: (4, 'raw') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:07:21 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-b218f0e2-9c39-4988-82dc-92c52eb1cdde tempest-TestInstancesWithCinderVolumes-120733040 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7878cafb-138f-4fbd-9180-b9e60e3a9cba_vwhm3o1s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:07:21 devstack sudo[98772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7878cafb-138f-4fbd-9180-b9e60e3a9cba_vwhm3o1s Sep 07 10:07:21 devstack sudo[98772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:07:21 devstack sudo[98765]: pam_unix(sudo:session): session closed for user root Sep 07 10:07:21 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-0b46f7d0-d5da-4ad4-8d28-27176e2916cd tempest-VolumeAndVolumeTypeFromImageTest-1310657115 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ba4cb054-c543-4fa1-85c0-52b1175b4f5e_fdoc_lr2devstack@QuobyteHD" returned: 0 in 0.488s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:07:21 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-0b46f7d0-d5da-4ad4-8d28-27176e2916cd tempest-VolumeAndVolumeTypeFromImageTest-1310657115 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ba4cb054-c543-4fa1-85c0-52b1175b4f5e_fdoc_lr2devstack@QuobyteHD {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:07:21 devstack sudo[98770]: pam_unix(sudo:session): session closed for user root Sep 07 10:07:21 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-46fb1698-27f9-4392-bb4b-c8f8a0d6abf9 tempest-SnapshotsActionsTest-800030130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-640722de-3f4c-4434-9712-126398038f41.9ce3aa02-a88b-4a7d-9848-8b5041b62993" returned: 0 in 0.353s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:07:21 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-46fb1698-27f9-4392-bb4b-c8f8a0d6abf9 tempest-SnapshotsActionsTest-800030130 None] Lock "cinder-quobyte-9ce3aa02-a88b-4a7d-9848-8b5041b62993" released by "_delete_snapshot" :: held 1.904s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:07:21 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-46fb1698-27f9-4392-bb4b-c8f8a0d6abf9 tempest-SnapshotsActionsTest-800030130 None] Lock "cinder-quobyte-640722de-3f4c-4434-9712-126398038f41" released by "delete_snapshot" :: held 1.942s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:07:21 devstack sudo[98777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ba4cb054-c543-4fa1-85c0-52b1175b4f5e_fdoc_lr2devstack@QuobyteHD Sep 07 10:07:21 devstack sudo[98777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:07:21 devstack sudo[98772]: pam_unix(sudo:session): session closed for user root Sep 07 10:07:21 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-b218f0e2-9c39-4988-82dc-92c52eb1cdde tempest-TestInstancesWithCinderVolumes-120733040 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7878cafb-138f-4fbd-9180-b9e60e3a9cba_vwhm3o1s" returned: 0 in 0.440s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:07:21 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-b218f0e2-9c39-4988-82dc-92c52eb1cdde tempest-TestInstancesWithCinderVolumes-120733040 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7878cafb-138f-4fbd-9180-b9e60e3a9cba_vwhm3o1s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:07:21 devstack cinder-volume[87515]: DEBUG cinder.quota [None req-46fb1698-27f9-4392-bb4b-c8f8a0d6abf9 tempest-SnapshotsActionsTest-800030130 None] Created reservations ['9d9d0a95-3645-4d9d-a77d-98404dc4c54a', '0e0fe74d-39c3-4772-90ad-fa74d604da6f', '6ed6acc7-1cb7-43a8-98e3-2fa9a680c8d7', '671e2d24-a46a-44a9-92cf-270b00413d74'] {{(pid=87515) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:07:21 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-46fb1698-27f9-4392-bb4b-c8f8a0d6abf9 tempest-SnapshotsActionsTest-800030130 None] Delete snapshot completed successfully. Sep 07 10:07:21 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-46fb1698-27f9-4392-bb4b-c8f8a0d6abf9 tempest-SnapshotsActionsTest-800030130 None] Lock "cinder-9ce3aa02-a88b-4a7d-9848-8b5041b62993-delete_snapshot" released by "delete_snapshot" :: held 2.169s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:07:21 devstack sudo[98781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7878cafb-138f-4fbd-9180-b9e60e3a9cba_vwhm3o1s Sep 07 10:07:21 devstack sudo[98781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:07:21 devstack sudo[98777]: pam_unix(sudo:session): session closed for user root Sep 07 10:07:21 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-0b46f7d0-d5da-4ad4-8d28-27176e2916cd tempest-VolumeAndVolumeTypeFromImageTest-1310657115 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ba4cb054-c543-4fa1-85c0-52b1175b4f5e_fdoc_lr2devstack@QuobyteHD" returned: 1 in 0.421s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:07:21 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-0b46f7d0-d5da-4ad4-8d28-27176e2916cd tempest-VolumeAndVolumeTypeFromImageTest-1310657115 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ba4cb054-c543-4fa1-85c0-52b1175b4f5e_fdoc_lr2devstack@QuobyteHD' failed. Not Retrying. {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 07 10:07:21 devstack cinder-volume[87515]: DEBUG cinder.image.image_utils [None req-0b46f7d0-d5da-4ad4-8d28-27176e2916cd tempest-VolumeAndVolumeTypeFromImageTest-1310657115 None] ba4cb054-c543-4fa1-85c0-52b1175b4f5e was raw, converting to qcow2 {{(pid=87515) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 07 10:07:21 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-0b46f7d0-d5da-4ad4-8d28-27176e2916cd tempest-VolumeAndVolumeTypeFromImageTest-1310657115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_ba4cb054-c543-4fa1-85c0-52b1175b4f5e_fdoc_lr2devstack@QuobyteHD /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-d8e40710-7e6b-406d-9965-e8844956f2d4 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:07:21 devstack sudo[98786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_ba4cb054-c543-4fa1-85c0-52b1175b4f5e_fdoc_lr2devstack@QuobyteHD /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-d8e40710-7e6b-406d-9965-e8844956f2d4 Sep 07 10:07:21 devstack sudo[98786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:07:22 devstack sudo[98781]: pam_unix(sudo:session): session closed for user root Sep 07 10:07:22 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-b218f0e2-9c39-4988-82dc-92c52eb1cdde tempest-TestInstancesWithCinderVolumes-120733040 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7878cafb-138f-4fbd-9180-b9e60e3a9cba_vwhm3o1s" returned: 1 in 0.340s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:07:22 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-b218f0e2-9c39-4988-82dc-92c52eb1cdde tempest-TestInstancesWithCinderVolumes-120733040 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7878cafb-138f-4fbd-9180-b9e60e3a9cba_vwhm3o1s' failed. Not Retrying. {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 07 10:07:22 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[3692c537-6c59-40e2-af4b-0a9a982b9e61]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:07:22 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-b218f0e2-9c39-4988-82dc-92c52eb1cdde tempest-TestInstancesWithCinderVolumes-120733040 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7878cafb-138f-4fbd-9180-b9e60e3a9cba_voxps7a5devstack@QuobyteHD {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:07:22 devstack sudo[98790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7878cafb-138f-4fbd-9180-b9e60e3a9cba_voxps7a5devstack@QuobyteHD Sep 07 10:07:22 devstack sudo[98790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:07:22 devstack sudo[98790]: pam_unix(sudo:session): session closed for user root Sep 07 10:07:22 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-b218f0e2-9c39-4988-82dc-92c52eb1cdde tempest-TestInstancesWithCinderVolumes-120733040 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7878cafb-138f-4fbd-9180-b9e60e3a9cba_voxps7a5devstack@QuobyteHD" returned: 0 in 0.366s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:07:22 devstack cinder-volume[87515]: DEBUG cinder.image.image_utils [None req-b218f0e2-9c39-4988-82dc-92c52eb1cdde tempest-TestInstancesWithCinderVolumes-120733040 None] 7878cafb-138f-4fbd-9180-b9e60e3a9cba was qcow2, converting to qcow2 {{(pid=87515) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 07 10:07:22 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-b218f0e2-9c39-4988-82dc-92c52eb1cdde tempest-TestInstancesWithCinderVolumes-120733040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7878cafb-138f-4fbd-9180-b9e60e3a9cba_voxps7a5devstack@QuobyteHD /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-d5aa431e-9421-48c0-9d3c-bb472d9415af {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:07:22 devstack sudo[98786]: pam_unix(sudo:session): session closed for user root Sep 07 10:07:22 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-0b46f7d0-d5da-4ad4-8d28-27176e2916cd tempest-VolumeAndVolumeTypeFromImageTest-1310657115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_ba4cb054-c543-4fa1-85c0-52b1175b4f5e_fdoc_lr2devstack@QuobyteHD /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-d8e40710-7e6b-406d-9965-e8844956f2d4" returned: 0 in 0.509s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:07:22 devstack cinder-volume[87515]: DEBUG cinder.image.image_utils [None req-0b46f7d0-d5da-4ad4-8d28-27176e2916cd tempest-VolumeAndVolumeTypeFromImageTest-1310657115 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_ba4cb054-c543-4fa1-85c0-52b1175b4f5e_fdoc_lr2devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-d8e40710-7e6b-406d-9965-e8844956f2d4 {{(pid=87515) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 07 10:07:22 devstack cinder-volume[87515]: INFO cinder.image.image_utils [None req-0b46f7d0-d5da-4ad4-8d28-27176e2916cd tempest-VolumeAndVolumeTypeFromImageTest-1310657115 None] Converted 0.00 MB image at 0.00 MB/s Sep 07 10:07:22 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-0b46f7d0-d5da-4ad4-8d28-27176e2916cd tempest-VolumeAndVolumeTypeFromImageTest-1310657115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-d8e40710-7e6b-406d-9965-e8844956f2d4 1G {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:07:22 devstack sudo[98799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7878cafb-138f-4fbd-9180-b9e60e3a9cba_voxps7a5devstack@QuobyteHD /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-d5aa431e-9421-48c0-9d3c-bb472d9415af Sep 07 10:07:22 devstack sudo[98799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:07:22 devstack sudo[98801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-d8e40710-7e6b-406d-9965-e8844956f2d4 1G Sep 07 10:07:22 devstack sudo[98801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:07:22 devstack sudo[98801]: pam_unix(sudo:session): session closed for user root Sep 07 10:07:22 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-0b46f7d0-d5da-4ad4-8d28-27176e2916cd tempest-VolumeAndVolumeTypeFromImageTest-1310657115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-d8e40710-7e6b-406d-9965-e8844956f2d4 1G" returned: 0 in 0.348s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:07:22 devstack cinder-volume[87515]: DEBUG cinder.volume.volume_utils [None req-0b46f7d0-d5da-4ad4-8d28-27176e2916cd tempest-VolumeAndVolumeTypeFromImageTest-1310657115 None] Downloaded image ba4cb054-c543-4fa1-85c0-52b1175b4f5e ((None, [{'url': 'file:///opt/stack/data/glance/images/ba4cb054-c543-4fa1-85c0-52b1175b4f5e', 'metadata': {}}])) to volume d8e40710-7e6b-406d-9965-e8844956f2d4 successfully. {{(pid=87515) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 07 10:07:22 devstack cinder-volume[87515]: DEBUG cinder.image.image_utils [None req-0b46f7d0-d5da-4ad4-8d28-27176e2916cd tempest-VolumeAndVolumeTypeFromImageTest-1310657115 None] Temporary image ba4cb054-c543-4fa1-85c0-52b1175b4f5e for user 8ece7eace17b4d81a8c83e8a1b10ca9e is deleted. {{(pid=87515) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 07 10:07:22 devstack cinder-volume[87515]: DEBUG cinder.volume.volume_utils [None req-0b46f7d0-d5da-4ad4-8d28-27176e2916cd tempest-VolumeAndVolumeTypeFromImageTest-1310657115 None] Marking volume d8e40710-7e6b-406d-9965-e8844956f2d4 as bootable. {{(pid=87515) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 07 10:07:22 devstack cinder-volume[87515]: DEBUG cinder.volume.flows.manager.create_volume [None req-0b46f7d0-d5da-4ad4-8d28-27176e2916cd tempest-VolumeAndVolumeTypeFromImageTest-1310657115 None] Copying metadata from image ba4cb054-c543-4fa1-85c0-52b1175b4f5e to d8e40710-7e6b-406d-9965-e8844956f2d4. {{(pid=87515) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 07 10:07:22 devstack cinder-volume[87515]: DEBUG cinder.volume.flows.manager.create_volume [None req-0b46f7d0-d5da-4ad4-8d28-27176e2916cd tempest-VolumeAndVolumeTypeFromImageTest-1310657115 None] Creating volume glance metadata for volume d8e40710-7e6b-406d-9965-e8844956f2d4 backed by image ba4cb054-c543-4fa1-85c0-52b1175b4f5e with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'ba4cb054-c543-4fa1-85c0-52b1175b4f5e', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'b8a27b08813b95dd144e686909515d1b', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87515) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 07 10:07:22 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-0b46f7d0-d5da-4ad4-8d28-27176e2916cd tempest-VolumeAndVolumeTypeFromImageTest-1310657115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5850feed-6a94-41f8-a0d7-6dd993fc8e54) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d8e40710-7e6b-406d-9965-e8844956f2d4', 'volume_size': 1, 'image_id': 'ba4cb054-c543-4fa1-85c0-52b1175b4f5e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ba4cb054-c543-4fa1-85c0-52b1175b4f5e', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'b8a27b08813b95dd144e686909515d1b', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '4b4564b22f8a47848f0852021541220a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'a4396f06f41b5467d8749c7729e138b6323de1780a9f8a2a3022df8b60f9b15633fa4e19a1a6b0f6c9d9c279592d59e7f4e55348b2dc1672eaf3b545fe016039', 'id': 'ba4cb054-c543-4fa1-85c0-52b1175b4f5e', 'created_at': datetime.datetime(2026, 9, 7, 8, 7, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 7, 8, 7, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ba4cb054-c543-4fa1-85c0-52b1175b4f5e/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:07:22 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-0b46f7d0-d5da-4ad4-8d28-27176e2916cd tempest-VolumeAndVolumeTypeFromImageTest-1310657115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd050fac-e193-42ff-bad8-4690f2c2e87e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:07:22 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-0b46f7d0-d5da-4ad4-8d28-27176e2916cd tempest-VolumeAndVolumeTypeFromImageTest-1310657115 None] Volume volume-d8e40710-7e6b-406d-9965-e8844956f2d4 (d8e40710-7e6b-406d-9965-e8844956f2d4): created successfully Sep 07 10:07:22 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-0b46f7d0-d5da-4ad4-8d28-27176e2916cd tempest-VolumeAndVolumeTypeFromImageTest-1310657115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd050fac-e193-42ff-bad8-4690f2c2e87e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:07:22 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-0b46f7d0-d5da-4ad4-8d28-27176e2916cd tempest-VolumeAndVolumeTypeFromImageTest-1310657115 None] Flow 'volume_create_manager' (3a9f0a16-3da1-4185-9b01-48a8dabbba25) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:07:22 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-0b46f7d0-d5da-4ad4-8d28-27176e2916cd tempest-VolumeAndVolumeTypeFromImageTest-1310657115 None] Created volume successfully. Sep 07 10:07:23 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-a1b511d6-e70b-4626-90a8-1b20d3a8e0dc tempest-SnapshotsActionsTest-158812568 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:07:23 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-a1b511d6-e70b-4626-90a8-1b20d3a8e0dc tempest-SnapshotsActionsTest-158812568 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:07:23 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-a1b511d6-e70b-4626-90a8-1b20d3a8e0dc tempest-SnapshotsActionsTest-158812568 None] Creating offline snapshot dbe0dffb-d615-4dd4-b160-41306fc420fb of volume 640722de-3f4c-4434-9712-126398038f41 {{(pid=87515) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 10:07:23 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bfeeb4f-b913-4337-a154-70138608d327]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:07:23 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-a1b511d6-e70b-4626-90a8-1b20d3a8e0dc tempest-SnapshotsActionsTest-158812568 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-640722de-3f4c-4434-9712-126398038f41.e31bfd3f-4446-4c21-a386-572c14dcfc9e {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:07:23 devstack sudo[98811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-640722de-3f4c-4434-9712-126398038f41.e31bfd3f-4446-4c21-a386-572c14dcfc9e Sep 07 10:07:23 devstack sudo[98811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:07:23 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-21b7e6c8-585f-44ba-aa07-e28bce10c299 tempest-VolumeAndVolumeTypeFromImageTest-1310657115 None] Acquiring lock "cinder-d8e40710-7e6b-406d-9965-e8844956f2d4-delete_volume" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:07:23 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-21b7e6c8-585f-44ba-aa07-e28bce10c299 tempest-VolumeAndVolumeTypeFromImageTest-1310657115 None] Lock "cinder-d8e40710-7e6b-406d-9965-e8844956f2d4-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:07:23 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-21b7e6c8-585f-44ba-aa07-e28bce10c299 tempest-VolumeAndVolumeTypeFromImageTest-1310657115 None] Acquiring lock "cinder-quobyte-d8e40710-7e6b-406d-9965-e8844956f2d4" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:07:23 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-21b7e6c8-585f-44ba-aa07-e28bce10c299 tempest-VolumeAndVolumeTypeFromImageTest-1310657115 None] Lock "cinder-quobyte-d8e40710-7e6b-406d-9965-e8844956f2d4" acquired by "delete_volume" :: waited 0.021s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:07:23 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[5749644a-b358-45cb-9809-0fff280cb21d]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:07:23 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-21b7e6c8-585f-44ba-aa07-e28bce10c299 tempest-VolumeAndVolumeTypeFromImageTest-1310657115 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-d8e40710-7e6b-406d-9965-e8844956f2d4 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:07:23 devstack sudo[98811]: pam_unix(sudo:session): session closed for user root Sep 07 10:07:23 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-a1b511d6-e70b-4626-90a8-1b20d3a8e0dc tempest-SnapshotsActionsTest-158812568 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-640722de-3f4c-4434-9712-126398038f41.e31bfd3f-4446-4c21-a386-572c14dcfc9e" returned: 0 in 0.564s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:07:23 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-a1b511d6-e70b-4626-90a8-1b20d3a8e0dc tempest-SnapshotsActionsTest-158812568 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-640722de-3f4c-4434-9712-126398038f41(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87515) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 10:07:23 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-a1b511d6-e70b-4626-90a8-1b20d3a8e0dc tempest-SnapshotsActionsTest-158812568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-640722de-3f4c-4434-9712-126398038f41.e31bfd3f-4446-4c21-a386-572c14dcfc9e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-640722de-3f4c-4434-9712-126398038f41.dbe0dffb-d615-4dd4-b160-41306fc420fb 1G {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:07:23 devstack sudo[98818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-640722de-3f4c-4434-9712-126398038f41.e31bfd3f-4446-4c21-a386-572c14dcfc9e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-640722de-3f4c-4434-9712-126398038f41.dbe0dffb-d615-4dd4-b160-41306fc420fb 1G Sep 07 10:07:23 devstack sudo[98818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:07:23 devstack sudo[98817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-d8e40710-7e6b-406d-9965-e8844956f2d4 Sep 07 10:07:23 devstack sudo[98817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:07:24 devstack sudo[98817]: pam_unix(sudo:session): session closed for user root Sep 07 10:07:24 devstack cinder-volume[87515]: DEBUG cinder.volume.flows.manager.create_volume [None req-eac42a83-4fa5-41ba-8282-9d404fbce209 tempest-VolumesTestJSON-633817380 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 10:07:24 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-eac42a83-4fa5-41ba-8282-9d404fbce209 tempest-VolumesTestJSON-633817380 None] Flow 'volume_create_manager' (8050685d-e02c-43bb-bf5b-7626ba663efd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:07:24 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-eac42a83-4fa5-41ba-8282-9d404fbce209 tempest-VolumesTestJSON-633817380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0debf279-738e-41ce-95f6-45f4419548f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:07:24 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-21b7e6c8-585f-44ba-aa07-e28bce10c299 tempest-VolumeAndVolumeTypeFromImageTest-1310657115 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-d8e40710-7e6b-406d-9965-e8844956f2d4" returned: 0 in 0.551s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:07:24 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-21b7e6c8-585f-44ba-aa07-e28bce10c299 tempest-VolumeAndVolumeTypeFromImageTest-1310657115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-d8e40710-7e6b-406d-9965-e8844956f2d4 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:07:24 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-eac42a83-4fa5-41ba-8282-9d404fbce209 tempest-VolumesTestJSON-633817380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0debf279-738e-41ce-95f6-45f4419548f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:07:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1255394212',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2edf2a65-4e72-4d02-924c-5ed367888599,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b233009e22cc40c4bcd26d5998b07d5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:07:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:07:24Z,use_quota=True,user_id='74d240e24cf84b98953c23080ffd7f43',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3a092cd-7947-4cbf-abff-4ba9567becf0),volume_type_id=f3a092cd-7947-4cbf-abff-4ba9567becf0)' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:07:24 devstack sudo[98828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-d8e40710-7e6b-406d-9965-e8844956f2d4 Sep 07 10:07:24 devstack sudo[98828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:07:24 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-eac42a83-4fa5-41ba-8282-9d404fbce209 tempest-VolumesTestJSON-633817380 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ce61a35-1f7f-4547-a4ae-b55943b8a2bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:07:24 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-eac42a83-4fa5-41ba-8282-9d404fbce209 tempest-VolumesTestJSON-633817380 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ce61a35-1f7f-4547-a4ae-b55943b8a2bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:07:24 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-eac42a83-4fa5-41ba-8282-9d404fbce209 tempest-VolumesTestJSON-633817380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c12bbb78-c4e2-447d-9dc7-1cef384ef466) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:07:24 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-eac42a83-4fa5-41ba-8282-9d404fbce209 tempest-VolumesTestJSON-633817380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c12bbb78-c4e2-447d-9dc7-1cef384ef466) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2edf2a65-4e72-4d02-924c-5ed367888599', 'volume_name': 'volume-2edf2a65-4e72-4d02-924c-5ed367888599', 'volume_size': 1}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:07:24 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-eac42a83-4fa5-41ba-8282-9d404fbce209 tempest-VolumesTestJSON-633817380 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77e4f084-1763-45e0-9656-5ae063685aef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:07:24 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-eac42a83-4fa5-41ba-8282-9d404fbce209 tempest-VolumesTestJSON-633817380 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77e4f084-1763-45e0-9656-5ae063685aef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:07:24 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-eac42a83-4fa5-41ba-8282-9d404fbce209 tempest-VolumesTestJSON-633817380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40d2ff0b-7a52-41e1-910f-80fe0b167138) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:07:24 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-eac42a83-4fa5-41ba-8282-9d404fbce209 tempest-VolumesTestJSON-633817380 None] Volume 2edf2a65-4e72-4d02-924c-5ed367888599: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2edf2a65-4e72-4d02-924c-5ed367888599', 'volume_size': 1} Sep 07 10:07:24 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-eac42a83-4fa5-41ba-8282-9d404fbce209 tempest-VolumesTestJSON-633817380 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:07:24 devstack sudo[98818]: pam_unix(sudo:session): session closed for user root Sep 07 10:07:24 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-a1b511d6-e70b-4626-90a8-1b20d3a8e0dc tempest-SnapshotsActionsTest-158812568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-640722de-3f4c-4434-9712-126398038f41.e31bfd3f-4446-4c21-a386-572c14dcfc9e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-640722de-3f4c-4434-9712-126398038f41.dbe0dffb-d615-4dd4-b160-41306fc420fb 1G" returned: 0 in 0.622s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:07:24 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-a1b511d6-e70b-4626-90a8-1b20d3a8e0dc tempest-SnapshotsActionsTest-158812568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-640722de-3f4c-4434-9712-126398038f41.e31bfd3f-4446-4c21-a386-572c14dcfc9e -F qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-640722de-3f4c-4434-9712-126398038f41.dbe0dffb-d615-4dd4-b160-41306fc420fb {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:07:24 devstack sudo[98830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-640722de-3f4c-4434-9712-126398038f41.e31bfd3f-4446-4c21-a386-572c14dcfc9e -F qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-640722de-3f4c-4434-9712-126398038f41.dbe0dffb-d615-4dd4-b160-41306fc420fb Sep 07 10:07:24 devstack sudo[98830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:07:24 devstack sudo[98799]: pam_unix(sudo:session): session closed for user root Sep 07 10:07:24 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-b218f0e2-9c39-4988-82dc-92c52eb1cdde tempest-TestInstancesWithCinderVolumes-120733040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7878cafb-138f-4fbd-9180-b9e60e3a9cba_voxps7a5devstack@QuobyteHD /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-d5aa431e-9421-48c0-9d3c-bb472d9415af" returned: 0 in 2.196s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:07:24 devstack cinder-volume[87515]: DEBUG cinder.image.image_utils [None req-b218f0e2-9c39-4988-82dc-92c52eb1cdde tempest-TestInstancesWithCinderVolumes-120733040 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_7878cafb-138f-4fbd-9180-b9e60e3a9cba_voxps7a5devstack@QuobyteHD, size 112.00 MB, duration 2.20 sec, destination /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-d5aa431e-9421-48c0-9d3c-bb472d9415af {{(pid=87515) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 07 10:07:24 devstack cinder-volume[87515]: INFO cinder.image.image_utils [None req-b218f0e2-9c39-4988-82dc-92c52eb1cdde tempest-TestInstancesWithCinderVolumes-120733040 None] Converted 112.00 MB image at 50.97 MB/s Sep 07 10:07:24 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-b218f0e2-9c39-4988-82dc-92c52eb1cdde tempest-TestInstancesWithCinderVolumes-120733040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-d5aa431e-9421-48c0-9d3c-bb472d9415af 1G {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:07:24 devstack sudo[98828]: pam_unix(sudo:session): session closed for user root Sep 07 10:07:24 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-21b7e6c8-585f-44ba-aa07-e28bce10c299 tempest-VolumeAndVolumeTypeFromImageTest-1310657115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-d8e40710-7e6b-406d-9965-e8844956f2d4" returned: 0 in 0.290s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:07:24 devstack sudo[98833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-d5aa431e-9421-48c0-9d3c-bb472d9415af 1G Sep 07 10:07:24 devstack sudo[98833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:07:24 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-21b7e6c8-585f-44ba-aa07-e28bce10c299 tempest-VolumeAndVolumeTypeFromImageTest-1310657115 None] Lock "cinder-quobyte-d8e40710-7e6b-406d-9965-e8844956f2d4" released by "delete_volume" :: held 0.898s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:07:24 devstack cinder-volume[87515]: WARNING cinder.quota [None req-21b7e6c8-585f-44ba-aa07-e28bce10c299 tempest-VolumeAndVolumeTypeFromImageTest-1310657115 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Sep 07 10:07:24 devstack cinder-volume[87515]: WARNING cinder.quota [None req-21b7e6c8-585f-44ba-aa07-e28bce10c299 tempest-VolumeAndVolumeTypeFromImageTest-1310657115 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Sep 07 10:07:24 devstack cinder-volume[87515]: DEBUG cinder.quota [None req-21b7e6c8-585f-44ba-aa07-e28bce10c299 tempest-VolumeAndVolumeTypeFromImageTest-1310657115 None] Created reservations ['f1869085-766b-4b4c-97b5-5467642d9fa7', 'e79fc1a0-d25e-4ee0-8adc-54adaf8dece2', '4d8bc0f2-8c22-4d8f-bdbf-50ed4af571bd', '7330c174-d43e-4394-87b4-34b860c92955'] {{(pid=87515) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:07:24 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-21b7e6c8-585f-44ba-aa07-e28bce10c299 tempest-VolumeAndVolumeTypeFromImageTest-1310657115 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:07:24 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-21b7e6c8-585f-44ba-aa07-e28bce10c299 tempest-VolumeAndVolumeTypeFromImageTest-1310657115 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:07:24 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-21b7e6c8-585f-44ba-aa07-e28bce10c299 tempest-VolumeAndVolumeTypeFromImageTest-1310657115 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:07:24 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-21b7e6c8-585f-44ba-aa07-e28bce10c299 tempest-VolumeAndVolumeTypeFromImageTest-1310657115 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:07:24 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-21b7e6c8-585f-44ba-aa07-e28bce10c299 tempest-VolumeAndVolumeTypeFromImageTest-1310657115 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:07:24 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-21b7e6c8-585f-44ba-aa07-e28bce10c299 tempest-VolumeAndVolumeTypeFromImageTest-1310657115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:07:24 devstack sudo[98841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a Sep 07 10:07:24 devstack sudo[98841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:07:24 devstack sudo[98830]: pam_unix(sudo:session): session closed for user root Sep 07 10:07:24 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-a1b511d6-e70b-4626-90a8-1b20d3a8e0dc tempest-SnapshotsActionsTest-158812568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-640722de-3f4c-4434-9712-126398038f41.e31bfd3f-4446-4c21-a386-572c14dcfc9e -F qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-640722de-3f4c-4434-9712-126398038f41.dbe0dffb-d615-4dd4-b160-41306fc420fb" returned: 0 in 0.343s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:07:24 devstack cinder-volume[87515]: WARNING cinder.volume.drivers.remotefs [None req-a1b511d6-e70b-4626-90a8-1b20d3a8e0dc tempest-SnapshotsActionsTest-158812568 None] /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-640722de-3f4c-4434-9712-126398038f41.dbe0dffb-d615-4dd4-b160-41306fc420fb is being set with open permissions: ugo+rw Sep 07 10:07:24 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-a1b511d6-e70b-4626-90a8-1b20d3a8e0dc tempest-SnapshotsActionsTest-158812568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-640722de-3f4c-4434-9712-126398038f41.dbe0dffb-d615-4dd4-b160-41306fc420fb {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:07:24 devstack sudo[98843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-640722de-3f4c-4434-9712-126398038f41.dbe0dffb-d615-4dd4-b160-41306fc420fb Sep 07 10:07:24 devstack sudo[98843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:07:25 devstack sudo[98833]: pam_unix(sudo:session): session closed for user root Sep 07 10:07:25 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-b218f0e2-9c39-4988-82dc-92c52eb1cdde tempest-TestInstancesWithCinderVolumes-120733040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-d5aa431e-9421-48c0-9d3c-bb472d9415af 1G" returned: 0 in 0.417s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:07:25 devstack cinder-volume[87515]: DEBUG cinder.volume.volume_utils [None req-b218f0e2-9c39-4988-82dc-92c52eb1cdde tempest-TestInstancesWithCinderVolumes-120733040 None] Downloaded image 7878cafb-138f-4fbd-9180-b9e60e3a9cba ((None, [{'url': 'file:///opt/stack/data/glance/images/7878cafb-138f-4fbd-9180-b9e60e3a9cba', 'metadata': {}}])) to volume d5aa431e-9421-48c0-9d3c-bb472d9415af successfully. {{(pid=87515) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 07 10:07:25 devstack cinder-volume[87515]: DEBUG cinder.image.image_utils [None req-b218f0e2-9c39-4988-82dc-92c52eb1cdde tempest-TestInstancesWithCinderVolumes-120733040 None] Temporary image 7878cafb-138f-4fbd-9180-b9e60e3a9cba for user 92b1206c699547f39f95f0f1b1b345ff is deleted. {{(pid=87515) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 07 10:07:25 devstack cinder-volume[87515]: DEBUG cinder.volume.volume_utils [None req-b218f0e2-9c39-4988-82dc-92c52eb1cdde tempest-TestInstancesWithCinderVolumes-120733040 None] Marking volume d5aa431e-9421-48c0-9d3c-bb472d9415af as bootable. {{(pid=87515) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 07 10:07:25 devstack cinder-volume[87515]: DEBUG cinder.volume.flows.manager.create_volume [None req-b218f0e2-9c39-4988-82dc-92c52eb1cdde tempest-TestInstancesWithCinderVolumes-120733040 None] Copying metadata from image 7878cafb-138f-4fbd-9180-b9e60e3a9cba to d5aa431e-9421-48c0-9d3c-bb472d9415af. {{(pid=87515) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 07 10:07:25 devstack cinder-volume[87515]: DEBUG cinder.volume.flows.manager.create_volume [None req-b218f0e2-9c39-4988-82dc-92c52eb1cdde tempest-TestInstancesWithCinderVolumes-120733040 None] Creating volume glance metadata for volume d5aa431e-9421-48c0-9d3c-bb472d9415af backed by image 7878cafb-138f-4fbd-9180-b9e60e3a9cba with: {'image_id': '7878cafb-138f-4fbd-9180-b9e60e3a9cba', 'image_name': 'tempest-scenario-img--538428611', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87515) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 07 10:07:25 devstack sudo[98841]: pam_unix(sudo:session): session closed for user root Sep 07 10:07:25 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-21b7e6c8-585f-44ba-aa07-e28bce10c299 tempest-VolumeAndVolumeTypeFromImageTest-1310657115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a" returned: 0 in 0.348s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:07:25 devstack cinder-volume[87515]: DEBUG cinder.manager [None req-21b7e6c8-585f-44ba-aa07-e28bce10c299 tempest-VolumeAndVolumeTypeFromImageTest-1310657115 None] Notifying Schedulers of capabilities ... {{(pid=87515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:07:25 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-21b7e6c8-585f-44ba-aa07-e28bce10c299 tempest-VolumeAndVolumeTypeFromImageTest-1310657115 None] Deleted volume successfully. Sep 07 10:07:25 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-b218f0e2-9c39-4988-82dc-92c52eb1cdde tempest-TestInstancesWithCinderVolumes-120733040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f878f3bf-8183-4788-b0d2-a21cfaec92a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d5aa431e-9421-48c0-9d3c-bb472d9415af', 'volume_size': 1, 'image_id': '7878cafb-138f-4fbd-9180-b9e60e3a9cba', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7878cafb-138f-4fbd-9180-b9e60e3a9cba', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--538428611', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '1e58e36387544e9bbe7359cb5d265361', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7878cafb-138f-4fbd-9180-b9e60e3a9cba', 'created_at': datetime.datetime(2026, 9, 7, 8, 7, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 7, 8, 7, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7878cafb-138f-4fbd-9180-b9e60e3a9cba/file', 'properties': {}}, 'image_service': }' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:07:25 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-b218f0e2-9c39-4988-82dc-92c52eb1cdde tempest-TestInstancesWithCinderVolumes-120733040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5bf3489a-1246-4411-851f-0df402ad5b6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:07:25 devstack sudo[98843]: pam_unix(sudo:session): session closed for user root Sep 07 10:07:25 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-a1b511d6-e70b-4626-90a8-1b20d3a8e0dc tempest-SnapshotsActionsTest-158812568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-640722de-3f4c-4434-9712-126398038f41.dbe0dffb-d615-4dd4-b160-41306fc420fb" returned: 0 in 0.349s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:07:25 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-b218f0e2-9c39-4988-82dc-92c52eb1cdde tempest-TestInstancesWithCinderVolumes-120733040 None] Volume volume-d5aa431e-9421-48c0-9d3c-bb472d9415af (d5aa431e-9421-48c0-9d3c-bb472d9415af): created successfully Sep 07 10:07:25 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-b218f0e2-9c39-4988-82dc-92c52eb1cdde tempest-TestInstancesWithCinderVolumes-120733040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5bf3489a-1246-4411-851f-0df402ad5b6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:07:25 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-b218f0e2-9c39-4988-82dc-92c52eb1cdde tempest-TestInstancesWithCinderVolumes-120733040 None] Flow 'volume_create_manager' (6c630b19-0296-4d5f-804f-cefa4815078a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:07:25 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-21b7e6c8-585f-44ba-aa07-e28bce10c299 tempest-VolumeAndVolumeTypeFromImageTest-1310657115 None] Lock "cinder-d8e40710-7e6b-406d-9965-e8844956f2d4-delete_volume" released by "delete_volume" :: held 1.562s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:07:25 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-a1b511d6-e70b-4626-90a8-1b20d3a8e0dc tempest-SnapshotsActionsTest-158812568 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.014s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:07:25 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-eac42a83-4fa5-41ba-8282-9d404fbce209 tempest-VolumesTestJSON-633817380 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.853s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:07:25 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-eac42a83-4fa5-41ba-8282-9d404fbce209 tempest-VolumesTestJSON-633817380 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:07:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1255394212',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2edf2a65-4e72-4d02-924c-5ed367888599,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b233009e22cc40c4bcd26d5998b07d5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:07:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:07:24Z,use_quota=True,user_id='74d240e24cf84b98953c23080ffd7f43',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3a092cd-7947-4cbf-abff-4ba9567becf0),volume_type_id=f3a092cd-7947-4cbf-abff-4ba9567becf0)}" {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 10:07:25 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-eac42a83-4fa5-41ba-8282-9d404fbce209 tempest-VolumesTestJSON-633817380 None] Creating volume 2edf2a65-4e72-4d02-924c-5ed367888599 {{(pid=87515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 10:07:25 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-eac42a83-4fa5-41ba-8282-9d404fbce209 tempest-VolumesTestJSON-633817380 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:07:25 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-eac42a83-4fa5-41ba-8282-9d404fbce209 tempest-VolumesTestJSON-633817380 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:07:25 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-eac42a83-4fa5-41ba-8282-9d404fbce209 tempest-VolumesTestJSON-633817380 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:07:25 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-eac42a83-4fa5-41ba-8282-9d404fbce209 tempest-VolumesTestJSON-633817380 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:07:25 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-eac42a83-4fa5-41ba-8282-9d404fbce209 tempest-VolumesTestJSON-633817380 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:07:25 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-eac42a83-4fa5-41ba-8282-9d404fbce209 tempest-VolumesTestJSON-633817380 None] Selected osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c as target Quobyte volume. {{(pid=87515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 10:07:25 devstack cinder-volume[87515]: INFO cinder.volume.drivers.remotefs [None req-eac42a83-4fa5-41ba-8282-9d404fbce209 tempest-VolumesTestJSON-633817380 None] casted to osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c Sep 07 10:07:25 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-eac42a83-4fa5-41ba-8282-9d404fbce209 tempest-VolumesTestJSON-633817380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-2edf2a65-4e72-4d02-924c-5ed367888599 1073741824 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:07:25 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-b218f0e2-9c39-4988-82dc-92c52eb1cdde tempest-TestInstancesWithCinderVolumes-120733040 None] Created volume successfully. Sep 07 10:07:25 devstack sudo[98850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-2edf2a65-4e72-4d02-924c-5ed367888599 1073741824 Sep 07 10:07:25 devstack sudo[98850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:07:25 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-a1b511d6-e70b-4626-90a8-1b20d3a8e0dc tempest-SnapshotsActionsTest-158812568 None] Create snapshot completed successfully Sep 07 10:07:25 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-4d4be805-a209-4239-b350-26ba641f9a1d tempest-SnapshotsActionsTest-800030130 None] Acquiring lock "cinder-dbe0dffb-d615-4dd4-b160-41306fc420fb-delete_snapshot" by "delete_snapshot" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:07:25 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-4d4be805-a209-4239-b350-26ba641f9a1d tempest-SnapshotsActionsTest-800030130 None] Lock "cinder-dbe0dffb-d615-4dd4-b160-41306fc420fb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:07:25 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-4d4be805-a209-4239-b350-26ba641f9a1d tempest-SnapshotsActionsTest-800030130 None] Acquiring lock "cinder-quobyte-640722de-3f4c-4434-9712-126398038f41" by "delete_snapshot" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:07:25 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-4d4be805-a209-4239-b350-26ba641f9a1d tempest-SnapshotsActionsTest-800030130 None] Lock "cinder-quobyte-640722de-3f4c-4434-9712-126398038f41" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:07:25 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-4d4be805-a209-4239-b350-26ba641f9a1d tempest-SnapshotsActionsTest-800030130 None] Acquiring lock "cinder-quobyte-dbe0dffb-d615-4dd4-b160-41306fc420fb" by "_delete_snapshot" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:07:25 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-4d4be805-a209-4239-b350-26ba641f9a1d tempest-SnapshotsActionsTest-800030130 None] Lock "cinder-quobyte-dbe0dffb-d615-4dd4-b160-41306fc420fb" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:07:25 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-4d4be805-a209-4239-b350-26ba641f9a1d tempest-SnapshotsActionsTest-800030130 None] Deleting offline snapshot dbe0dffb-d615-4dd4-b160-41306fc420fb of volume 640722de-3f4c-4434-9712-126398038f41 {{(pid=87515) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 10:07:25 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-4d4be805-a209-4239-b350-26ba641f9a1d tempest-SnapshotsActionsTest-800030130 None] snapshot_file for this snap is: volume-640722de-3f4c-4434-9712-126398038f41.dbe0dffb-d615-4dd4-b160-41306fc420fb {{(pid=87515) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 10:07:25 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b6ced01-c866-43e5-a22b-e86b73d4a03a]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:07:25 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-4d4be805-a209-4239-b350-26ba641f9a1d tempest-SnapshotsActionsTest-800030130 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-640722de-3f4c-4434-9712-126398038f41.dbe0dffb-d615-4dd4-b160-41306fc420fb {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:07:25 devstack sudo[98855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-640722de-3f4c-4434-9712-126398038f41.dbe0dffb-d615-4dd4-b160-41306fc420fb Sep 07 10:07:25 devstack sudo[98855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:07:25 devstack sudo[98850]: pam_unix(sudo:session): session closed for user root Sep 07 10:07:25 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-eac42a83-4fa5-41ba-8282-9d404fbce209 tempest-VolumesTestJSON-633817380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-2edf2a65-4e72-4d02-924c-5ed367888599 1073741824" returned: 0 in 0.566s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:07:25 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-eac42a83-4fa5-41ba-8282-9d404fbce209 tempest-VolumesTestJSON-633817380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-2edf2a65-4e72-4d02-924c-5ed367888599 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:07:25 devstack sudo[98858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-2edf2a65-4e72-4d02-924c-5ed367888599 Sep 07 10:07:25 devstack sudo[98858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:07:26 devstack sudo[98855]: pam_unix(sudo:session): session closed for user root Sep 07 10:07:26 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-4d4be805-a209-4239-b350-26ba641f9a1d tempest-SnapshotsActionsTest-800030130 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-640722de-3f4c-4434-9712-126398038f41.dbe0dffb-d615-4dd4-b160-41306fc420fb" returned: 0 in 0.389s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:07:26 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-4d4be805-a209-4239-b350-26ba641f9a1d tempest-SnapshotsActionsTest-800030130 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-640722de-3f4c-4434-9712-126398038f41(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87515) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 10:07:26 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[05e36c85-b1b7-4145-8e8c-22c76c2e59a8]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:07:26 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-4d4be805-a209-4239-b350-26ba641f9a1d tempest-SnapshotsActionsTest-800030130 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-640722de-3f4c-4434-9712-126398038f41.e31bfd3f-4446-4c21-a386-572c14dcfc9e {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:07:26 devstack sudo[98858]: pam_unix(sudo:session): session closed for user root Sep 07 10:07:26 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-eac42a83-4fa5-41ba-8282-9d404fbce209 tempest-VolumesTestJSON-633817380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-2edf2a65-4e72-4d02-924c-5ed367888599" returned: 0 in 0.278s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:07:26 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-eac42a83-4fa5-41ba-8282-9d404fbce209 tempest-VolumesTestJSON-633817380 None] <== create_volume: return (896ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'} {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 10:07:26 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-eac42a83-4fa5-41ba-8282-9d404fbce209 tempest-VolumesTestJSON-633817380 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.901s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:07:26 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-eac42a83-4fa5-41ba-8282-9d404fbce209 tempest-VolumesTestJSON-633817380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40d2ff0b-7a52-41e1-910f-80fe0b167138) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2edf2a65-4e72-4d02-924c-5ed367888599', 'volume_size': 1}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:07:26 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-eac42a83-4fa5-41ba-8282-9d404fbce209 tempest-VolumesTestJSON-633817380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dcae7f9e-e2b7-466e-9bde-4635ef7deba5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:07:26 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-eac42a83-4fa5-41ba-8282-9d404fbce209 tempest-VolumesTestJSON-633817380 None] Volume volume-2edf2a65-4e72-4d02-924c-5ed367888599 (2edf2a65-4e72-4d02-924c-5ed367888599): created successfully Sep 07 10:07:26 devstack sudo[98863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-640722de-3f4c-4434-9712-126398038f41.e31bfd3f-4446-4c21-a386-572c14dcfc9e Sep 07 10:07:26 devstack sudo[98863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:07:26 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-eac42a83-4fa5-41ba-8282-9d404fbce209 tempest-VolumesTestJSON-633817380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dcae7f9e-e2b7-466e-9bde-4635ef7deba5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:07:26 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-eac42a83-4fa5-41ba-8282-9d404fbce209 tempest-VolumesTestJSON-633817380 None] Flow 'volume_create_manager' (8050685d-e02c-43bb-bf5b-7626ba663efd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:07:26 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-eac42a83-4fa5-41ba-8282-9d404fbce209 tempest-VolumesTestJSON-633817380 None] Created volume successfully. Sep 07 10:07:26 devstack sudo[98863]: pam_unix(sudo:session): session closed for user root Sep 07 10:07:26 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-4d4be805-a209-4239-b350-26ba641f9a1d tempest-SnapshotsActionsTest-800030130 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-640722de-3f4c-4434-9712-126398038f41.e31bfd3f-4446-4c21-a386-572c14dcfc9e" returned: 0 in 0.522s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:07:26 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-4d4be805-a209-4239-b350-26ba641f9a1d tempest-SnapshotsActionsTest-800030130 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-640722de-3f4c-4434-9712-126398038f41(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87515) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 10:07:26 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-4d4be805-a209-4239-b350-26ba641f9a1d tempest-SnapshotsActionsTest-800030130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-640722de-3f4c-4434-9712-126398038f41.dbe0dffb-d615-4dd4-b160-41306fc420fb {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:07:26 devstack sudo[98869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-640722de-3f4c-4434-9712-126398038f41.dbe0dffb-d615-4dd4-b160-41306fc420fb Sep 07 10:07:26 devstack sudo[98869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:07:27 devstack cinder-volume[87515]: DEBUG cinder.volume.flows.manager.create_volume [None req-2291c5d1-9266-4dfc-83b7-67645d8675cc tempest-VolumesTestJSON-633817380 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 10:07:27 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-2291c5d1-9266-4dfc-83b7-67645d8675cc tempest-VolumesTestJSON-633817380 None] Flow 'volume_create_manager' (a76f9356-6170-498b-a7cc-a6dd9e69a977) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:07:27 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-2291c5d1-9266-4dfc-83b7-67645d8675cc tempest-VolumesTestJSON-633817380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b8e4e79-b2ba-412a-9768-d1270c161e53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:07:27 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-2291c5d1-9266-4dfc-83b7-67645d8675cc tempest-VolumesTestJSON-633817380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b8e4e79-b2ba-412a-9768-d1270c161e53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:07:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-287696962',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21809457-c5f6-4070-938c-bc5679cf8ad2,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b233009e22cc40c4bcd26d5998b07d5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:07:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:07:27Z,use_quota=True,user_id='74d240e24cf84b98953c23080ffd7f43',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3a092cd-7947-4cbf-abff-4ba9567becf0),volume_type_id=f3a092cd-7947-4cbf-abff-4ba9567becf0)' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:07:27 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-2291c5d1-9266-4dfc-83b7-67645d8675cc tempest-VolumesTestJSON-633817380 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (359531ae-058c-4949-b7a7-d7d7651b0c24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:07:27 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-2291c5d1-9266-4dfc-83b7-67645d8675cc tempest-VolumesTestJSON-633817380 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (359531ae-058c-4949-b7a7-d7d7651b0c24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:07:27 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-2291c5d1-9266-4dfc-83b7-67645d8675cc tempest-VolumesTestJSON-633817380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25dd6076-21f5-4c6d-8016-af5bdc93bb2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:07:27 devstack sudo[98869]: pam_unix(sudo:session): session closed for user root Sep 07 10:07:27 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-2291c5d1-9266-4dfc-83b7-67645d8675cc tempest-VolumesTestJSON-633817380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25dd6076-21f5-4c6d-8016-af5bdc93bb2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '21809457-c5f6-4070-938c-bc5679cf8ad2', 'volume_name': 'volume-21809457-c5f6-4070-938c-bc5679cf8ad2', 'volume_size': 1}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:07:27 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-2291c5d1-9266-4dfc-83b7-67645d8675cc tempest-VolumesTestJSON-633817380 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e3466d8-c662-4561-9e6f-ffc102f3051e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:07:27 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-2291c5d1-9266-4dfc-83b7-67645d8675cc tempest-VolumesTestJSON-633817380 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e3466d8-c662-4561-9e6f-ffc102f3051e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:07:27 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-2291c5d1-9266-4dfc-83b7-67645d8675cc tempest-VolumesTestJSON-633817380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5760b67e-9e0d-4cab-8306-9d0558a8670f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:07:27 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-2291c5d1-9266-4dfc-83b7-67645d8675cc tempest-VolumesTestJSON-633817380 None] Volume 21809457-c5f6-4070-938c-bc5679cf8ad2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-21809457-c5f6-4070-938c-bc5679cf8ad2', 'volume_size': 1} Sep 07 10:07:27 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-2291c5d1-9266-4dfc-83b7-67645d8675cc tempest-VolumesTestJSON-633817380 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:07:27 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-2291c5d1-9266-4dfc-83b7-67645d8675cc tempest-VolumesTestJSON-633817380 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:07:27 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-2291c5d1-9266-4dfc-83b7-67645d8675cc tempest-VolumesTestJSON-633817380 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:07:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-287696962',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21809457-c5f6-4070-938c-bc5679cf8ad2,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b233009e22cc40c4bcd26d5998b07d5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:07:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:07:27Z,use_quota=True,user_id='74d240e24cf84b98953c23080ffd7f43',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3a092cd-7947-4cbf-abff-4ba9567becf0),volume_type_id=f3a092cd-7947-4cbf-abff-4ba9567becf0)}" {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 10:07:27 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-2291c5d1-9266-4dfc-83b7-67645d8675cc tempest-VolumesTestJSON-633817380 None] Creating volume 21809457-c5f6-4070-938c-bc5679cf8ad2 {{(pid=87515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 10:07:27 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-2291c5d1-9266-4dfc-83b7-67645d8675cc tempest-VolumesTestJSON-633817380 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:07:27 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-2291c5d1-9266-4dfc-83b7-67645d8675cc tempest-VolumesTestJSON-633817380 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:07:27 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-2291c5d1-9266-4dfc-83b7-67645d8675cc tempest-VolumesTestJSON-633817380 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:07:27 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-2291c5d1-9266-4dfc-83b7-67645d8675cc tempest-VolumesTestJSON-633817380 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:07:27 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-2291c5d1-9266-4dfc-83b7-67645d8675cc tempest-VolumesTestJSON-633817380 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:07:27 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-2291c5d1-9266-4dfc-83b7-67645d8675cc tempest-VolumesTestJSON-633817380 None] Selected osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c as target Quobyte volume. {{(pid=87515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 10:07:27 devstack cinder-volume[87515]: INFO cinder.volume.drivers.remotefs [None req-2291c5d1-9266-4dfc-83b7-67645d8675cc tempest-VolumesTestJSON-633817380 None] casted to osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c Sep 07 10:07:27 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-2291c5d1-9266-4dfc-83b7-67645d8675cc tempest-VolumesTestJSON-633817380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-21809457-c5f6-4070-938c-bc5679cf8ad2 1073741824 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:07:27 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-4d4be805-a209-4239-b350-26ba641f9a1d tempest-SnapshotsActionsTest-800030130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-640722de-3f4c-4434-9712-126398038f41.dbe0dffb-d615-4dd4-b160-41306fc420fb" returned: 0 in 0.690s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:07:27 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-4d4be805-a209-4239-b350-26ba641f9a1d tempest-SnapshotsActionsTest-800030130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-640722de-3f4c-4434-9712-126398038f41.dbe0dffb-d615-4dd4-b160-41306fc420fb {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:07:27 devstack sudo[98876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-21809457-c5f6-4070-938c-bc5679cf8ad2 1073741824 Sep 07 10:07:27 devstack sudo[98876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:07:27 devstack sudo[98877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-640722de-3f4c-4434-9712-126398038f41.dbe0dffb-d615-4dd4-b160-41306fc420fb Sep 07 10:07:27 devstack sudo[98877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:07:27 devstack sudo[98877]: pam_unix(sudo:session): session closed for user root Sep 07 10:07:27 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-4d4be805-a209-4239-b350-26ba641f9a1d tempest-SnapshotsActionsTest-800030130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-640722de-3f4c-4434-9712-126398038f41.dbe0dffb-d615-4dd4-b160-41306fc420fb" returned: 0 in 0.353s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:07:27 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-4d4be805-a209-4239-b350-26ba641f9a1d tempest-SnapshotsActionsTest-800030130 None] Lock "cinder-quobyte-dbe0dffb-d615-4dd4-b160-41306fc420fb" released by "_delete_snapshot" :: held 2.093s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:07:27 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-4d4be805-a209-4239-b350-26ba641f9a1d tempest-SnapshotsActionsTest-800030130 None] Lock "cinder-quobyte-640722de-3f4c-4434-9712-126398038f41" released by "delete_snapshot" :: held 2.123s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:07:27 devstack cinder-volume[87515]: DEBUG cinder.quota [None req-4d4be805-a209-4239-b350-26ba641f9a1d tempest-SnapshotsActionsTest-800030130 None] Created reservations ['f8e16d3b-e487-4ca0-9e19-7326b07017eb', 'ddec256d-81d3-430c-b62c-b7b41ef2e53e', 'ec19e19f-9237-4ba9-894e-dfa71d5acc1e', '4211f652-dcd9-4309-b3c5-a90794562655'] {{(pid=87515) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:07:27 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-4d4be805-a209-4239-b350-26ba641f9a1d tempest-SnapshotsActionsTest-800030130 None] Delete snapshot completed successfully. Sep 07 10:07:27 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-4d4be805-a209-4239-b350-26ba641f9a1d tempest-SnapshotsActionsTest-800030130 None] Lock "cinder-dbe0dffb-d615-4dd4-b160-41306fc420fb-delete_snapshot" released by "delete_snapshot" :: held 2.360s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:07:27 devstack sudo[98876]: pam_unix(sudo:session): session closed for user root Sep 07 10:07:27 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-2291c5d1-9266-4dfc-83b7-67645d8675cc tempest-VolumesTestJSON-633817380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-21809457-c5f6-4070-938c-bc5679cf8ad2 1073741824" returned: 0 in 0.681s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:07:28 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-2291c5d1-9266-4dfc-83b7-67645d8675cc tempest-VolumesTestJSON-633817380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-21809457-c5f6-4070-938c-bc5679cf8ad2 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:07:28 devstack sudo[98887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-21809457-c5f6-4070-938c-bc5679cf8ad2 Sep 07 10:07:28 devstack sudo[98887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:07:28 devstack sudo[98887]: pam_unix(sudo:session): session closed for user root Sep 07 10:07:28 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-2291c5d1-9266-4dfc-83b7-67645d8675cc tempest-VolumesTestJSON-633817380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-21809457-c5f6-4070-938c-bc5679cf8ad2" returned: 0 in 0.312s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:07:28 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-2291c5d1-9266-4dfc-83b7-67645d8675cc tempest-VolumesTestJSON-633817380 None] <== create_volume: return (1055ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'} {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 10:07:28 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-2291c5d1-9266-4dfc-83b7-67645d8675cc tempest-VolumesTestJSON-633817380 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.061s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:07:28 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-2291c5d1-9266-4dfc-83b7-67645d8675cc tempest-VolumesTestJSON-633817380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5760b67e-9e0d-4cab-8306-9d0558a8670f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-21809457-c5f6-4070-938c-bc5679cf8ad2', 'volume_size': 1}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:07:28 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-2291c5d1-9266-4dfc-83b7-67645d8675cc tempest-VolumesTestJSON-633817380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c22ad6f3-272c-493a-aefd-09b9ec7cca62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:07:28 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-2291c5d1-9266-4dfc-83b7-67645d8675cc tempest-VolumesTestJSON-633817380 None] Volume volume-21809457-c5f6-4070-938c-bc5679cf8ad2 (21809457-c5f6-4070-938c-bc5679cf8ad2): created successfully Sep 07 10:07:28 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-2291c5d1-9266-4dfc-83b7-67645d8675cc tempest-VolumesTestJSON-633817380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c22ad6f3-272c-493a-aefd-09b9ec7cca62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:07:28 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-2291c5d1-9266-4dfc-83b7-67645d8675cc tempest-VolumesTestJSON-633817380 None] Flow 'volume_create_manager' (a76f9356-6170-498b-a7cc-a6dd9e69a977) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:07:28 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-2291c5d1-9266-4dfc-83b7-67645d8675cc tempest-VolumesTestJSON-633817380 None] Created volume successfully. Sep 07 10:07:29 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-81b64adb-acc6-4c1d-be5b-25d3621ebfef tempest-SnapshotsActionsTest-158812568 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:07:29 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-81b64adb-acc6-4c1d-be5b-25d3621ebfef tempest-SnapshotsActionsTest-158812568 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:07:29 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-81b64adb-acc6-4c1d-be5b-25d3621ebfef tempest-SnapshotsActionsTest-158812568 None] Creating offline snapshot c18138de-9f21-4d69-804a-7071c61988bd of volume 640722de-3f4c-4434-9712-126398038f41 {{(pid=87515) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 10:07:29 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[a67c0699-387d-4d84-b7dd-d1167893f2dc]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:07:29 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-81b64adb-acc6-4c1d-be5b-25d3621ebfef tempest-SnapshotsActionsTest-158812568 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-640722de-3f4c-4434-9712-126398038f41.e31bfd3f-4446-4c21-a386-572c14dcfc9e {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:07:29 devstack sudo[98891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-640722de-3f4c-4434-9712-126398038f41.e31bfd3f-4446-4c21-a386-572c14dcfc9e Sep 07 10:07:29 devstack sudo[98891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:07:30 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [req-93a43f16-20ab-47d5-a70a-2ccd318fedf7 req-3d9c347f-73e5-4d3b-8466-deff8e9ef4bc tempest-TestInstancesWithCinderVolumes-120733040 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:07:30 devstack sudo[98891]: pam_unix(sudo:session): session closed for user root Sep 07 10:07:30 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-81b64adb-acc6-4c1d-be5b-25d3621ebfef tempest-SnapshotsActionsTest-158812568 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-640722de-3f4c-4434-9712-126398038f41.e31bfd3f-4446-4c21-a386-572c14dcfc9e" returned: 0 in 0.669s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:07:30 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-81b64adb-acc6-4c1d-be5b-25d3621ebfef tempest-SnapshotsActionsTest-158812568 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-640722de-3f4c-4434-9712-126398038f41(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87515) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 10:07:30 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-81b64adb-acc6-4c1d-be5b-25d3621ebfef tempest-SnapshotsActionsTest-158812568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-640722de-3f4c-4434-9712-126398038f41.e31bfd3f-4446-4c21-a386-572c14dcfc9e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-640722de-3f4c-4434-9712-126398038f41.c18138de-9f21-4d69-804a-7071c61988bd 1G {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:07:30 devstack sudo[98904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-640722de-3f4c-4434-9712-126398038f41.e31bfd3f-4446-4c21-a386-572c14dcfc9e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-640722de-3f4c-4434-9712-126398038f41.c18138de-9f21-4d69-804a-7071c61988bd 1G Sep 07 10:07:30 devstack sudo[98904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:07:30 devstack cinder-volume[87515]: DEBUG cinder.volume.flows.manager.create_volume [None req-852acc53-5466-40cc-8d3f-97f9662d742e tempest-VolumesTestJSON-633817380 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 10:07:30 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-852acc53-5466-40cc-8d3f-97f9662d742e tempest-VolumesTestJSON-633817380 None] Flow 'volume_create_manager' (adb4f76e-0ac5-401d-b1c5-f86371371d56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:07:30 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-852acc53-5466-40cc-8d3f-97f9662d742e tempest-VolumesTestJSON-633817380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed449d1f-03f3-4112-a84e-d0ad872fac1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:07:30 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-852acc53-5466-40cc-8d3f-97f9662d742e tempest-VolumesTestJSON-633817380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed449d1f-03f3-4112-a84e-d0ad872fac1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:07:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1397615823',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c513dc16-3d26-4655-899a-278916271f71,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b233009e22cc40c4bcd26d5998b07d5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:07:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:07:30Z,use_quota=True,user_id='74d240e24cf84b98953c23080ffd7f43',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3a092cd-7947-4cbf-abff-4ba9567becf0),volume_type_id=f3a092cd-7947-4cbf-abff-4ba9567becf0)' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:07:30 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-852acc53-5466-40cc-8d3f-97f9662d742e tempest-VolumesTestJSON-633817380 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3286ebcd-bdb1-4bee-a7bb-7d07bcbbdd1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:07:30 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-852acc53-5466-40cc-8d3f-97f9662d742e tempest-VolumesTestJSON-633817380 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3286ebcd-bdb1-4bee-a7bb-7d07bcbbdd1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:07:30 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-852acc53-5466-40cc-8d3f-97f9662d742e tempest-VolumesTestJSON-633817380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (769ee5ad-2a51-45d4-b0e9-ce1a5993cd03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:07:30 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-852acc53-5466-40cc-8d3f-97f9662d742e tempest-VolumesTestJSON-633817380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (769ee5ad-2a51-45d4-b0e9-ce1a5993cd03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c513dc16-3d26-4655-899a-278916271f71', 'volume_name': 'volume-c513dc16-3d26-4655-899a-278916271f71', 'volume_size': 1}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:07:30 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-852acc53-5466-40cc-8d3f-97f9662d742e tempest-VolumesTestJSON-633817380 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a549ea87-ae0c-4dbb-88bd-652a6430a202) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:07:30 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-852acc53-5466-40cc-8d3f-97f9662d742e tempest-VolumesTestJSON-633817380 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a549ea87-ae0c-4dbb-88bd-652a6430a202) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:07:30 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-852acc53-5466-40cc-8d3f-97f9662d742e tempest-VolumesTestJSON-633817380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22a80522-2077-4bdc-a3ca-3395dca74cb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:07:30 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-852acc53-5466-40cc-8d3f-97f9662d742e tempest-VolumesTestJSON-633817380 None] Volume c513dc16-3d26-4655-899a-278916271f71: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c513dc16-3d26-4655-899a-278916271f71', 'volume_size': 1} Sep 07 10:07:30 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-852acc53-5466-40cc-8d3f-97f9662d742e tempest-VolumesTestJSON-633817380 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:07:30 devstack sudo[98904]: pam_unix(sudo:session): session closed for user root Sep 07 10:07:30 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-81b64adb-acc6-4c1d-be5b-25d3621ebfef tempest-SnapshotsActionsTest-158812568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-640722de-3f4c-4434-9712-126398038f41.e31bfd3f-4446-4c21-a386-572c14dcfc9e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-640722de-3f4c-4434-9712-126398038f41.c18138de-9f21-4d69-804a-7071c61988bd 1G" returned: 0 in 0.674s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:07:30 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-81b64adb-acc6-4c1d-be5b-25d3621ebfef tempest-SnapshotsActionsTest-158812568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-640722de-3f4c-4434-9712-126398038f41.e31bfd3f-4446-4c21-a386-572c14dcfc9e -F qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-640722de-3f4c-4434-9712-126398038f41.c18138de-9f21-4d69-804a-7071c61988bd {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:07:30 devstack sudo[98912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-640722de-3f4c-4434-9712-126398038f41.e31bfd3f-4446-4c21-a386-572c14dcfc9e -F qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-640722de-3f4c-4434-9712-126398038f41.c18138de-9f21-4d69-804a-7071c61988bd Sep 07 10:07:30 devstack sudo[98912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:07:31 devstack sudo[98912]: pam_unix(sudo:session): session closed for user root Sep 07 10:07:31 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-81b64adb-acc6-4c1d-be5b-25d3621ebfef tempest-SnapshotsActionsTest-158812568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-640722de-3f4c-4434-9712-126398038f41.e31bfd3f-4446-4c21-a386-572c14dcfc9e -F qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-640722de-3f4c-4434-9712-126398038f41.c18138de-9f21-4d69-804a-7071c61988bd" returned: 0 in 0.426s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:07:31 devstack cinder-volume[87515]: WARNING cinder.volume.drivers.remotefs [None req-81b64adb-acc6-4c1d-be5b-25d3621ebfef tempest-SnapshotsActionsTest-158812568 None] /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-640722de-3f4c-4434-9712-126398038f41.c18138de-9f21-4d69-804a-7071c61988bd is being set with open permissions: ugo+rw Sep 07 10:07:31 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-81b64adb-acc6-4c1d-be5b-25d3621ebfef tempest-SnapshotsActionsTest-158812568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-640722de-3f4c-4434-9712-126398038f41.c18138de-9f21-4d69-804a-7071c61988bd {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:07:31 devstack cinder-volume[87515]: DEBUG cinder.volume.flows.manager.create_volume [None req-19ed2228-e8ee-47dc-a491-3b3bc5d74076 tempest-CinderUnicodeTest-1998667154 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 10:07:31 devstack sudo[98918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-640722de-3f4c-4434-9712-126398038f41.c18138de-9f21-4d69-804a-7071c61988bd Sep 07 10:07:31 devstack sudo[98918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:07:31 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-19ed2228-e8ee-47dc-a491-3b3bc5d74076 tempest-CinderUnicodeTest-1998667154 None] Flow 'volume_create_manager' (8183226d-8dea-4210-bb68-a64174a14f55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:07:31 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-19ed2228-e8ee-47dc-a491-3b3bc5d74076 tempest-CinderUnicodeTest-1998667154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a477ba72-0413-446d-8308-6a5a50a7aa86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:07:31 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-19ed2228-e8ee-47dc-a491-3b3bc5d74076 tempest-CinderUnicodeTest-1998667154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a477ba72-0413-446d-8308-6a5a50a7aa86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:07:31Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3133c93-7ab2-4645-9c9d-ebd331f5a20a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd1a178bb8e04a41b1033dbeaaa6aee8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:07:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:07:31Z,use_quota=True,user_id='808fc806e47c4b3b9556aa08facc430d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3a092cd-7947-4cbf-abff-4ba9567becf0),volume_type_id=f3a092cd-7947-4cbf-abff-4ba9567becf0)' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:07:31 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-19ed2228-e8ee-47dc-a491-3b3bc5d74076 tempest-CinderUnicodeTest-1998667154 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f0d7f43-de4d-455d-a978-3bc712a73450) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:07:31 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-19ed2228-e8ee-47dc-a491-3b3bc5d74076 tempest-CinderUnicodeTest-1998667154 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f0d7f43-de4d-455d-a978-3bc712a73450) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:07:31 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-19ed2228-e8ee-47dc-a491-3b3bc5d74076 tempest-CinderUnicodeTest-1998667154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0bdf842-f957-4176-bc71-86a6491193b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:07:31 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-19ed2228-e8ee-47dc-a491-3b3bc5d74076 tempest-CinderUnicodeTest-1998667154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0bdf842-f957-4176-bc71-86a6491193b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b3133c93-7ab2-4645-9c9d-ebd331f5a20a', 'volume_name': 'volume-b3133c93-7ab2-4645-9c9d-ebd331f5a20a', 'volume_size': 1}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:07:31 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-19ed2228-e8ee-47dc-a491-3b3bc5d74076 tempest-CinderUnicodeTest-1998667154 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a3853f2-fb0f-4b67-8b1c-4cc14c71f62b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:07:31 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-19ed2228-e8ee-47dc-a491-3b3bc5d74076 tempest-CinderUnicodeTest-1998667154 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a3853f2-fb0f-4b67-8b1c-4cc14c71f62b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:07:31 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-19ed2228-e8ee-47dc-a491-3b3bc5d74076 tempest-CinderUnicodeTest-1998667154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec0bcedb-5b7a-40ce-918f-403b80c31066) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:07:31 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-19ed2228-e8ee-47dc-a491-3b3bc5d74076 tempest-CinderUnicodeTest-1998667154 None] Volume b3133c93-7ab2-4645-9c9d-ebd331f5a20a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b3133c93-7ab2-4645-9c9d-ebd331f5a20a', 'volume_size': 1} Sep 07 10:07:31 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-19ed2228-e8ee-47dc-a491-3b3bc5d74076 tempest-CinderUnicodeTest-1998667154 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:07:31 devstack sudo[98918]: pam_unix(sudo:session): session closed for user root Sep 07 10:07:31 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-81b64adb-acc6-4c1d-be5b-25d3621ebfef tempest-SnapshotsActionsTest-158812568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-640722de-3f4c-4434-9712-126398038f41.c18138de-9f21-4d69-804a-7071c61988bd" returned: 0 in 0.266s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:07:31 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-81b64adb-acc6-4c1d-be5b-25d3621ebfef tempest-SnapshotsActionsTest-158812568 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.186s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:07:31 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [req-93a43f16-20ab-47d5-a70a-2ccd318fedf7 req-3d9c347f-73e5-4d3b-8466-deff8e9ef4bc tempest-TestInstancesWithCinderVolumes-120733040 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.424s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:07:31 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [req-93a43f16-20ab-47d5-a70a-2ccd318fedf7 req-3d9c347f-73e5-4d3b-8466-deff8e9ef4bc tempest-TestInstancesWithCinderVolumes-120733040 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.022s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:07:31 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-852acc53-5466-40cc-8d3f-97f9662d742e tempest-VolumesTestJSON-633817380 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.110s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:07:31 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-852acc53-5466-40cc-8d3f-97f9662d742e tempest-VolumesTestJSON-633817380 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:07:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1397615823',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c513dc16-3d26-4655-899a-278916271f71,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b233009e22cc40c4bcd26d5998b07d5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:07:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:07:30Z,use_quota=True,user_id='74d240e24cf84b98953c23080ffd7f43',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3a092cd-7947-4cbf-abff-4ba9567becf0),volume_type_id=f3a092cd-7947-4cbf-abff-4ba9567becf0)}" {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 10:07:31 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-852acc53-5466-40cc-8d3f-97f9662d742e tempest-VolumesTestJSON-633817380 None] Creating volume c513dc16-3d26-4655-899a-278916271f71 {{(pid=87515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 10:07:31 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-852acc53-5466-40cc-8d3f-97f9662d742e tempest-VolumesTestJSON-633817380 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:07:31 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-852acc53-5466-40cc-8d3f-97f9662d742e tempest-VolumesTestJSON-633817380 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:07:31 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-852acc53-5466-40cc-8d3f-97f9662d742e tempest-VolumesTestJSON-633817380 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:07:31 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-852acc53-5466-40cc-8d3f-97f9662d742e tempest-VolumesTestJSON-633817380 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:07:31 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-852acc53-5466-40cc-8d3f-97f9662d742e tempest-VolumesTestJSON-633817380 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:07:31 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-852acc53-5466-40cc-8d3f-97f9662d742e tempest-VolumesTestJSON-633817380 None] Selected osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c as target Quobyte volume. {{(pid=87515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 10:07:31 devstack cinder-volume[87515]: INFO cinder.volume.drivers.remotefs [None req-852acc53-5466-40cc-8d3f-97f9662d742e tempest-VolumesTestJSON-633817380 None] casted to osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c Sep 07 10:07:31 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-852acc53-5466-40cc-8d3f-97f9662d742e tempest-VolumesTestJSON-633817380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-c513dc16-3d26-4655-899a-278916271f71 1073741824 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:07:31 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-81b64adb-acc6-4c1d-be5b-25d3621ebfef tempest-SnapshotsActionsTest-158812568 None] Create snapshot completed successfully Sep 07 10:07:31 devstack sudo[98921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-c513dc16-3d26-4655-899a-278916271f71 1073741824 Sep 07 10:07:31 devstack sudo[98921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:07:31 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [req-93a43f16-20ab-47d5-a70a-2ccd318fedf7 req-3d9c347f-73e5-4d3b-8466-deff8e9ef4bc tempest-TestInstancesWithCinderVolumes-120733040 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c', 'name': 'volume-d5aa431e-9421-48c0-9d3c-bb472d9415af', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1f4a0d17-4284-407a-94cb-6b16597b8d18', 'enforce_multipath': True} {{(pid=87515) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 07 10:07:31 devstack cinder-volume[87515]: INFO cinder.volume.manager [req-93a43f16-20ab-47d5-a70a-2ccd318fedf7 req-3d9c347f-73e5-4d3b-8466-deff8e9ef4bc tempest-TestInstancesWithCinderVolumes-120733040 None] attachment_update completed successfully. Sep 07 10:07:32 devstack sudo[98921]: pam_unix(sudo:session): session closed for user root Sep 07 10:07:32 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-852acc53-5466-40cc-8d3f-97f9662d742e tempest-VolumesTestJSON-633817380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-c513dc16-3d26-4655-899a-278916271f71 1073741824" returned: 0 in 0.608s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:07:32 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-852acc53-5466-40cc-8d3f-97f9662d742e tempest-VolumesTestJSON-633817380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-c513dc16-3d26-4655-899a-278916271f71 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:07:32 devstack sudo[98929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-c513dc16-3d26-4655-899a-278916271f71 Sep 07 10:07:32 devstack sudo[98929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:07:32 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-c0f90975-3816-4e78-8728-cd84263a1b31 tempest-SnapshotsActionsTest-800030130 None] Acquiring lock "cinder-c18138de-9f21-4d69-804a-7071c61988bd-delete_snapshot" by "delete_snapshot" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:07:32 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-c0f90975-3816-4e78-8728-cd84263a1b31 tempest-SnapshotsActionsTest-800030130 None] Lock "cinder-c18138de-9f21-4d69-804a-7071c61988bd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:07:32 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-c0f90975-3816-4e78-8728-cd84263a1b31 tempest-SnapshotsActionsTest-800030130 None] Acquiring lock "cinder-quobyte-640722de-3f4c-4434-9712-126398038f41" by "delete_snapshot" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:07:32 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-c0f90975-3816-4e78-8728-cd84263a1b31 tempest-SnapshotsActionsTest-800030130 None] Lock "cinder-quobyte-640722de-3f4c-4434-9712-126398038f41" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:07:32 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-c0f90975-3816-4e78-8728-cd84263a1b31 tempest-SnapshotsActionsTest-800030130 None] Acquiring lock "cinder-quobyte-c18138de-9f21-4d69-804a-7071c61988bd" by "_delete_snapshot" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:07:32 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-c0f90975-3816-4e78-8728-cd84263a1b31 tempest-SnapshotsActionsTest-800030130 None] Lock "cinder-quobyte-c18138de-9f21-4d69-804a-7071c61988bd" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:07:32 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-c0f90975-3816-4e78-8728-cd84263a1b31 tempest-SnapshotsActionsTest-800030130 None] Deleting offline snapshot c18138de-9f21-4d69-804a-7071c61988bd of volume 640722de-3f4c-4434-9712-126398038f41 {{(pid=87515) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 10:07:32 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-c0f90975-3816-4e78-8728-cd84263a1b31 tempest-SnapshotsActionsTest-800030130 None] snapshot_file for this snap is: volume-640722de-3f4c-4434-9712-126398038f41.c18138de-9f21-4d69-804a-7071c61988bd {{(pid=87515) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 10:07:32 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fdda484-95ea-4c49-b14c-5b621c133328]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:07:32 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-c0f90975-3816-4e78-8728-cd84263a1b31 tempest-SnapshotsActionsTest-800030130 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-640722de-3f4c-4434-9712-126398038f41.c18138de-9f21-4d69-804a-7071c61988bd {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:07:32 devstack sudo[98929]: pam_unix(sudo:session): session closed for user root Sep 07 10:07:32 devstack sudo[98931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-640722de-3f4c-4434-9712-126398038f41.c18138de-9f21-4d69-804a-7071c61988bd Sep 07 10:07:32 devstack sudo[98931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:07:32 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-852acc53-5466-40cc-8d3f-97f9662d742e tempest-VolumesTestJSON-633817380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-c513dc16-3d26-4655-899a-278916271f71" returned: 0 in 0.311s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:07:32 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-852acc53-5466-40cc-8d3f-97f9662d742e tempest-VolumesTestJSON-633817380 None] <== create_volume: return (1005ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'} {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 10:07:32 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-852acc53-5466-40cc-8d3f-97f9662d742e tempest-VolumesTestJSON-633817380 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.011s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:07:32 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-19ed2228-e8ee-47dc-a491-3b3bc5d74076 tempest-CinderUnicodeTest-1998667154 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.226s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:07:32 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-19ed2228-e8ee-47dc-a491-3b3bc5d74076 tempest-CinderUnicodeTest-1998667154 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:07:31Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3133c93-7ab2-4645-9c9d-ebd331f5a20a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd1a178bb8e04a41b1033dbeaaa6aee8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:07:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:07:31Z,use_quota=True,user_id='808fc806e47c4b3b9556aa08facc430d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3a092cd-7947-4cbf-abff-4ba9567becf0),volume_type_id=f3a092cd-7947-4cbf-abff-4ba9567becf0)}" {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 10:07:32 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-19ed2228-e8ee-47dc-a491-3b3bc5d74076 tempest-CinderUnicodeTest-1998667154 None] Creating volume b3133c93-7ab2-4645-9c9d-ebd331f5a20a {{(pid=87515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 10:07:32 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-19ed2228-e8ee-47dc-a491-3b3bc5d74076 tempest-CinderUnicodeTest-1998667154 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:07:32 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-19ed2228-e8ee-47dc-a491-3b3bc5d74076 tempest-CinderUnicodeTest-1998667154 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:07:32 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-19ed2228-e8ee-47dc-a491-3b3bc5d74076 tempest-CinderUnicodeTest-1998667154 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:07:32 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-19ed2228-e8ee-47dc-a491-3b3bc5d74076 tempest-CinderUnicodeTest-1998667154 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:07:32 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-19ed2228-e8ee-47dc-a491-3b3bc5d74076 tempest-CinderUnicodeTest-1998667154 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:07:32 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-19ed2228-e8ee-47dc-a491-3b3bc5d74076 tempest-CinderUnicodeTest-1998667154 None] Selected osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c as target Quobyte volume. {{(pid=87515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 10:07:32 devstack cinder-volume[87515]: INFO cinder.volume.drivers.remotefs [None req-19ed2228-e8ee-47dc-a491-3b3bc5d74076 tempest-CinderUnicodeTest-1998667154 None] casted to osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c Sep 07 10:07:32 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-19ed2228-e8ee-47dc-a491-3b3bc5d74076 tempest-CinderUnicodeTest-1998667154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-b3133c93-7ab2-4645-9c9d-ebd331f5a20a 1073741824 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:07:32 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-852acc53-5466-40cc-8d3f-97f9662d742e tempest-VolumesTestJSON-633817380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22a80522-2077-4bdc-a3ca-3395dca74cb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c513dc16-3d26-4655-899a-278916271f71', 'volume_size': 1}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:07:32 devstack sudo[98935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-b3133c93-7ab2-4645-9c9d-ebd331f5a20a 1073741824 Sep 07 10:07:32 devstack sudo[98935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:07:32 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-852acc53-5466-40cc-8d3f-97f9662d742e tempest-VolumesTestJSON-633817380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48db7202-c306-443d-a9ab-0278c83782ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:07:32 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-852acc53-5466-40cc-8d3f-97f9662d742e tempest-VolumesTestJSON-633817380 None] Volume volume-c513dc16-3d26-4655-899a-278916271f71 (c513dc16-3d26-4655-899a-278916271f71): created successfully Sep 07 10:07:32 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-852acc53-5466-40cc-8d3f-97f9662d742e tempest-VolumesTestJSON-633817380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48db7202-c306-443d-a9ab-0278c83782ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:07:32 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-852acc53-5466-40cc-8d3f-97f9662d742e tempest-VolumesTestJSON-633817380 None] Flow 'volume_create_manager' (adb4f76e-0ac5-401d-b1c5-f86371371d56) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:07:32 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-852acc53-5466-40cc-8d3f-97f9662d742e tempest-VolumesTestJSON-633817380 None] Created volume successfully. Sep 07 10:07:32 devstack sudo[98931]: pam_unix(sudo:session): session closed for user root Sep 07 10:07:32 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-c0f90975-3816-4e78-8728-cd84263a1b31 tempest-SnapshotsActionsTest-800030130 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-640722de-3f4c-4434-9712-126398038f41.c18138de-9f21-4d69-804a-7071c61988bd" returned: 0 in 0.497s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:07:32 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-c0f90975-3816-4e78-8728-cd84263a1b31 tempest-SnapshotsActionsTest-800030130 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-640722de-3f4c-4434-9712-126398038f41(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87515) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 10:07:32 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[02ac9aa3-f0c8-4056-a6d4-b88c989d5357]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:07:32 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-c0f90975-3816-4e78-8728-cd84263a1b31 tempest-SnapshotsActionsTest-800030130 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-640722de-3f4c-4434-9712-126398038f41.e31bfd3f-4446-4c21-a386-572c14dcfc9e {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:07:33 devstack sudo[99010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-640722de-3f4c-4434-9712-126398038f41.e31bfd3f-4446-4c21-a386-572c14dcfc9e Sep 07 10:07:33 devstack sudo[99010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:07:33 devstack sudo[98935]: pam_unix(sudo:session): session closed for user root Sep 07 10:07:33 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-19ed2228-e8ee-47dc-a491-3b3bc5d74076 tempest-CinderUnicodeTest-1998667154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-b3133c93-7ab2-4645-9c9d-ebd331f5a20a 1073741824" returned: 0 in 0.787s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:07:33 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-19ed2228-e8ee-47dc-a491-3b3bc5d74076 tempest-CinderUnicodeTest-1998667154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-b3133c93-7ab2-4645-9c9d-ebd331f5a20a {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:07:33 devstack sudo[99359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-b3133c93-7ab2-4645-9c9d-ebd331f5a20a Sep 07 10:07:33 devstack sudo[99359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:07:33 devstack sudo[99010]: pam_unix(sudo:session): session closed for user root Sep 07 10:07:33 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-c0f90975-3816-4e78-8728-cd84263a1b31 tempest-SnapshotsActionsTest-800030130 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-640722de-3f4c-4434-9712-126398038f41.e31bfd3f-4446-4c21-a386-572c14dcfc9e" returned: 0 in 0.775s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:07:33 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-c0f90975-3816-4e78-8728-cd84263a1b31 tempest-SnapshotsActionsTest-800030130 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-640722de-3f4c-4434-9712-126398038f41(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87515) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 10:07:33 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-c0f90975-3816-4e78-8728-cd84263a1b31 tempest-SnapshotsActionsTest-800030130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-640722de-3f4c-4434-9712-126398038f41.c18138de-9f21-4d69-804a-7071c61988bd {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:07:33 devstack sudo[99374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-640722de-3f4c-4434-9712-126398038f41.c18138de-9f21-4d69-804a-7071c61988bd Sep 07 10:07:33 devstack sudo[99374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:07:33 devstack sudo[99359]: pam_unix(sudo:session): session closed for user root Sep 07 10:07:33 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-19ed2228-e8ee-47dc-a491-3b3bc5d74076 tempest-CinderUnicodeTest-1998667154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-b3133c93-7ab2-4645-9c9d-ebd331f5a20a" returned: 0 in 0.374s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:07:33 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-19ed2228-e8ee-47dc-a491-3b3bc5d74076 tempest-CinderUnicodeTest-1998667154 None] <== create_volume: return (1288ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'} {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 10:07:33 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-19ed2228-e8ee-47dc-a491-3b3bc5d74076 tempest-CinderUnicodeTest-1998667154 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.296s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:07:33 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-19ed2228-e8ee-47dc-a491-3b3bc5d74076 tempest-CinderUnicodeTest-1998667154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec0bcedb-5b7a-40ce-918f-403b80c31066) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b3133c93-7ab2-4645-9c9d-ebd331f5a20a', 'volume_size': 1}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:07:33 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-19ed2228-e8ee-47dc-a491-3b3bc5d74076 tempest-CinderUnicodeTest-1998667154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b67da10-08a6-47bc-942b-1755411aeb12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:07:33 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-19ed2228-e8ee-47dc-a491-3b3bc5d74076 tempest-CinderUnicodeTest-1998667154 None] Volume volume-b3133c93-7ab2-4645-9c9d-ebd331f5a20a (b3133c93-7ab2-4645-9c9d-ebd331f5a20a): created successfully Sep 07 10:07:33 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-19ed2228-e8ee-47dc-a491-3b3bc5d74076 tempest-CinderUnicodeTest-1998667154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b67da10-08a6-47bc-942b-1755411aeb12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:07:33 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-19ed2228-e8ee-47dc-a491-3b3bc5d74076 tempest-CinderUnicodeTest-1998667154 None] Flow 'volume_create_manager' (8183226d-8dea-4210-bb68-a64174a14f55) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:07:33 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-19ed2228-e8ee-47dc-a491-3b3bc5d74076 tempest-CinderUnicodeTest-1998667154 None] Created volume successfully. Sep 07 10:07:34 devstack sudo[99374]: pam_unix(sudo:session): session closed for user root Sep 07 10:07:34 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-c0f90975-3816-4e78-8728-cd84263a1b31 tempest-SnapshotsActionsTest-800030130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-640722de-3f4c-4434-9712-126398038f41.c18138de-9f21-4d69-804a-7071c61988bd" returned: 0 in 0.607s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:07:34 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-c0f90975-3816-4e78-8728-cd84263a1b31 tempest-SnapshotsActionsTest-800030130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-640722de-3f4c-4434-9712-126398038f41.c18138de-9f21-4d69-804a-7071c61988bd {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:07:34 devstack sudo[99401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-640722de-3f4c-4434-9712-126398038f41.c18138de-9f21-4d69-804a-7071c61988bd Sep 07 10:07:34 devstack sudo[99401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:07:34 devstack sudo[99401]: pam_unix(sudo:session): session closed for user root Sep 07 10:07:34 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-c0f90975-3816-4e78-8728-cd84263a1b31 tempest-SnapshotsActionsTest-800030130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-640722de-3f4c-4434-9712-126398038f41.c18138de-9f21-4d69-804a-7071c61988bd" returned: 0 in 0.352s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:07:34 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-c0f90975-3816-4e78-8728-cd84263a1b31 tempest-SnapshotsActionsTest-800030130 None] Lock "cinder-quobyte-c18138de-9f21-4d69-804a-7071c61988bd" released by "_delete_snapshot" :: held 2.365s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:07:34 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-c0f90975-3816-4e78-8728-cd84263a1b31 tempest-SnapshotsActionsTest-800030130 None] Lock "cinder-quobyte-640722de-3f4c-4434-9712-126398038f41" released by "delete_snapshot" :: held 2.394s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:07:34 devstack cinder-volume[87515]: DEBUG cinder.quota [None req-c0f90975-3816-4e78-8728-cd84263a1b31 tempest-SnapshotsActionsTest-800030130 None] Created reservations ['0aea8921-36a8-4be3-9910-8b898f595f96', 'a553973b-0833-48e6-b092-bd658863af9d', '2341d4df-f942-4287-88ce-e05f508f3990', 'a4cb7041-0a3b-465a-8fb4-8a8c0b49c4a7'] {{(pid=87515) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:07:34 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-c0f90975-3816-4e78-8728-cd84263a1b31 tempest-SnapshotsActionsTest-800030130 None] Delete snapshot completed successfully. Sep 07 10:07:34 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-c0f90975-3816-4e78-8728-cd84263a1b31 tempest-SnapshotsActionsTest-800030130 None] Lock "cinder-c18138de-9f21-4d69-804a-7071c61988bd-delete_snapshot" released by "delete_snapshot" :: held 2.742s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:07:35 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-67999efa-b5f1-4785-bb16-181e70a25e82 tempest-VolumesTestJSON-633817380 None] Acquiring lock "cinder-c513dc16-3d26-4655-899a-278916271f71-delete_volume" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:07:35 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-67999efa-b5f1-4785-bb16-181e70a25e82 tempest-VolumesTestJSON-633817380 None] Lock "cinder-c513dc16-3d26-4655-899a-278916271f71-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:07:35 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-67999efa-b5f1-4785-bb16-181e70a25e82 tempest-VolumesTestJSON-633817380 None] Acquiring lock "cinder-quobyte-c513dc16-3d26-4655-899a-278916271f71" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:07:35 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-67999efa-b5f1-4785-bb16-181e70a25e82 tempest-VolumesTestJSON-633817380 None] Lock "cinder-quobyte-c513dc16-3d26-4655-899a-278916271f71" acquired by "delete_volume" :: waited 0.046s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:07:35 devstack cinder-volume[87515]: DEBUG cinder.volume.flows.manager.create_volume [None req-67ab2f9a-f116-4551-8836-e85a6fb1e910 tempest-CinderUnicodeTest-1998667154 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 10:07:35 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-67ab2f9a-f116-4551-8836-e85a6fb1e910 tempest-CinderUnicodeTest-1998667154 None] Flow 'volume_create_manager' (d8f0071a-f1c0-4c1b-9652-e48a65897f66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:07:35 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-67ab2f9a-f116-4551-8836-e85a6fb1e910 tempest-CinderUnicodeTest-1998667154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e289d96-25fc-4677-84f1-1b1fb710b389) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:07:35 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1121a42-ab51-425e-8fd9-214054bd6ff7]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:07:35 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-67999efa-b5f1-4785-bb16-181e70a25e82 tempest-VolumesTestJSON-633817380 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-c513dc16-3d26-4655-899a-278916271f71 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:07:35 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-67ab2f9a-f116-4551-8836-e85a6fb1e910 tempest-CinderUnicodeTest-1998667154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e289d96-25fc-4677-84f1-1b1fb710b389) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:07:35Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1550264426',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=518fe8d0-45f0-495e-bb8a-ed6f33c207cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd1a178bb8e04a41b1033dbeaaa6aee8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:07:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:07:35Z,use_quota=True,user_id='808fc806e47c4b3b9556aa08facc430d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3a092cd-7947-4cbf-abff-4ba9567becf0),volume_type_id=f3a092cd-7947-4cbf-abff-4ba9567becf0)' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:07:35 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-67ab2f9a-f116-4551-8836-e85a6fb1e910 tempest-CinderUnicodeTest-1998667154 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c8f196d-be3e-4386-b3f7-203530bea932) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:07:35 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-67ab2f9a-f116-4551-8836-e85a6fb1e910 tempest-CinderUnicodeTest-1998667154 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c8f196d-be3e-4386-b3f7-203530bea932) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:07:35 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-67ab2f9a-f116-4551-8836-e85a6fb1e910 tempest-CinderUnicodeTest-1998667154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a922f94-49ae-4c4f-9152-474bfe64fbbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:07:35 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-67ab2f9a-f116-4551-8836-e85a6fb1e910 tempest-CinderUnicodeTest-1998667154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a922f94-49ae-4c4f-9152-474bfe64fbbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '518fe8d0-45f0-495e-bb8a-ed6f33c207cc', 'volume_name': 'volume-518fe8d0-45f0-495e-bb8a-ed6f33c207cc', 'volume_size': 1}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:07:35 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-67ab2f9a-f116-4551-8836-e85a6fb1e910 tempest-CinderUnicodeTest-1998667154 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72c49f60-1812-48f6-b8d9-96f9e74d8439) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:07:35 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-67ab2f9a-f116-4551-8836-e85a6fb1e910 tempest-CinderUnicodeTest-1998667154 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72c49f60-1812-48f6-b8d9-96f9e74d8439) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:07:35 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-67ab2f9a-f116-4551-8836-e85a6fb1e910 tempest-CinderUnicodeTest-1998667154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92e86106-ee8d-45d0-bd8d-fb0fa6e40735) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:07:35 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-67ab2f9a-f116-4551-8836-e85a6fb1e910 tempest-CinderUnicodeTest-1998667154 None] Volume 518fe8d0-45f0-495e-bb8a-ed6f33c207cc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-518fe8d0-45f0-495e-bb8a-ed6f33c207cc', 'volume_size': 1} Sep 07 10:07:35 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-67ab2f9a-f116-4551-8836-e85a6fb1e910 tempest-CinderUnicodeTest-1998667154 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:07:35 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-67ab2f9a-f116-4551-8836-e85a6fb1e910 tempest-CinderUnicodeTest-1998667154 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:07:35 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-67ab2f9a-f116-4551-8836-e85a6fb1e910 tempest-CinderUnicodeTest-1998667154 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:07:35Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1550264426',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=518fe8d0-45f0-495e-bb8a-ed6f33c207cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd1a178bb8e04a41b1033dbeaaa6aee8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:07:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:07:35Z,use_quota=True,user_id='808fc806e47c4b3b9556aa08facc430d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3a092cd-7947-4cbf-abff-4ba9567becf0),volume_type_id=f3a092cd-7947-4cbf-abff-4ba9567becf0)}" {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 10:07:35 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-67ab2f9a-f116-4551-8836-e85a6fb1e910 tempest-CinderUnicodeTest-1998667154 None] Creating volume 518fe8d0-45f0-495e-bb8a-ed6f33c207cc {{(pid=87515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 10:07:35 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-67ab2f9a-f116-4551-8836-e85a6fb1e910 tempest-CinderUnicodeTest-1998667154 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:07:35 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-67ab2f9a-f116-4551-8836-e85a6fb1e910 tempest-CinderUnicodeTest-1998667154 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:07:35 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-67ab2f9a-f116-4551-8836-e85a6fb1e910 tempest-CinderUnicodeTest-1998667154 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:07:35 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-67ab2f9a-f116-4551-8836-e85a6fb1e910 tempest-CinderUnicodeTest-1998667154 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:07:35 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-67ab2f9a-f116-4551-8836-e85a6fb1e910 tempest-CinderUnicodeTest-1998667154 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:07:35 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-67ab2f9a-f116-4551-8836-e85a6fb1e910 tempest-CinderUnicodeTest-1998667154 None] Selected osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c as target Quobyte volume. {{(pid=87515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 10:07:35 devstack cinder-volume[87515]: INFO cinder.volume.drivers.remotefs [None req-67ab2f9a-f116-4551-8836-e85a6fb1e910 tempest-CinderUnicodeTest-1998667154 None] casted to osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c Sep 07 10:07:35 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-67ab2f9a-f116-4551-8836-e85a6fb1e910 tempest-CinderUnicodeTest-1998667154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-518fe8d0-45f0-495e-bb8a-ed6f33c207cc 1073741824 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:07:35 devstack sudo[99408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-518fe8d0-45f0-495e-bb8a-ed6f33c207cc 1073741824 Sep 07 10:07:35 devstack sudo[99408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:07:35 devstack sudo[99407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-c513dc16-3d26-4655-899a-278916271f71 Sep 07 10:07:35 devstack sudo[99407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:07:36 devstack sudo[99407]: pam_unix(sudo:session): session closed for user root Sep 07 10:07:36 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-67999efa-b5f1-4785-bb16-181e70a25e82 tempest-VolumesTestJSON-633817380 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-c513dc16-3d26-4655-899a-278916271f71" returned: 0 in 0.653s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:07:36 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-67999efa-b5f1-4785-bb16-181e70a25e82 tempest-VolumesTestJSON-633817380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-c513dc16-3d26-4655-899a-278916271f71 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:07:36 devstack sudo[99419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-c513dc16-3d26-4655-899a-278916271f71 Sep 07 10:07:36 devstack sudo[99419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:07:36 devstack sudo[99408]: pam_unix(sudo:session): session closed for user root Sep 07 10:07:36 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-67ab2f9a-f116-4551-8836-e85a6fb1e910 tempest-CinderUnicodeTest-1998667154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-518fe8d0-45f0-495e-bb8a-ed6f33c207cc 1073741824" returned: 0 in 0.617s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:07:36 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-67ab2f9a-f116-4551-8836-e85a6fb1e910 tempest-CinderUnicodeTest-1998667154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-518fe8d0-45f0-495e-bb8a-ed6f33c207cc {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:07:36 devstack sudo[99421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-518fe8d0-45f0-495e-bb8a-ed6f33c207cc Sep 07 10:07:36 devstack sudo[99421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:07:36 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-e9399ee9-1700-4786-94e4-a9e24afb2fa8 tempest-SnapshotsActionsTest-158812568 None] Acquiring lock "cinder-e31bfd3f-4446-4c21-a386-572c14dcfc9e-delete_snapshot" by "delete_snapshot" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:07:36 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-e9399ee9-1700-4786-94e4-a9e24afb2fa8 tempest-SnapshotsActionsTest-158812568 None] Lock "cinder-e31bfd3f-4446-4c21-a386-572c14dcfc9e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.044s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:07:36 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-e9399ee9-1700-4786-94e4-a9e24afb2fa8 tempest-SnapshotsActionsTest-158812568 None] Acquiring lock "cinder-quobyte-640722de-3f4c-4434-9712-126398038f41" by "delete_snapshot" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:07:36 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-e9399ee9-1700-4786-94e4-a9e24afb2fa8 tempest-SnapshotsActionsTest-158812568 None] Lock "cinder-quobyte-640722de-3f4c-4434-9712-126398038f41" acquired by "delete_snapshot" :: waited 0.036s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:07:36 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-e9399ee9-1700-4786-94e4-a9e24afb2fa8 tempest-SnapshotsActionsTest-158812568 None] Acquiring lock "cinder-quobyte-e31bfd3f-4446-4c21-a386-572c14dcfc9e" by "_delete_snapshot" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:07:36 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-e9399ee9-1700-4786-94e4-a9e24afb2fa8 tempest-SnapshotsActionsTest-158812568 None] Lock "cinder-quobyte-e31bfd3f-4446-4c21-a386-572c14dcfc9e" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:07:36 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-e9399ee9-1700-4786-94e4-a9e24afb2fa8 tempest-SnapshotsActionsTest-158812568 None] Deleting offline snapshot e31bfd3f-4446-4c21-a386-572c14dcfc9e of volume 640722de-3f4c-4434-9712-126398038f41 {{(pid=87515) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 10:07:36 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-e9399ee9-1700-4786-94e4-a9e24afb2fa8 tempest-SnapshotsActionsTest-158812568 None] snapshot_file for this snap is: volume-640722de-3f4c-4434-9712-126398038f41.e31bfd3f-4446-4c21-a386-572c14dcfc9e {{(pid=87515) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 10:07:36 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b81e563-42c8-4474-b7e2-e5444a6b86ce]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:07:36 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-e9399ee9-1700-4786-94e4-a9e24afb2fa8 tempest-SnapshotsActionsTest-158812568 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-640722de-3f4c-4434-9712-126398038f41.e31bfd3f-4446-4c21-a386-572c14dcfc9e {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:07:36 devstack sudo[99419]: pam_unix(sudo:session): session closed for user root Sep 07 10:07:36 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-67999efa-b5f1-4785-bb16-181e70a25e82 tempest-VolumesTestJSON-633817380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-c513dc16-3d26-4655-899a-278916271f71" returned: 0 in 0.487s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:07:36 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-67999efa-b5f1-4785-bb16-181e70a25e82 tempest-VolumesTestJSON-633817380 None] Lock "cinder-quobyte-c513dc16-3d26-4655-899a-278916271f71" released by "delete_volume" :: held 1.247s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:07:36 devstack sudo[99421]: pam_unix(sudo:session): session closed for user root Sep 07 10:07:36 devstack cinder-volume[87515]: DEBUG cinder.quota [None req-67999efa-b5f1-4785-bb16-181e70a25e82 tempest-VolumesTestJSON-633817380 None] Created reservations ['87d6a6a5-6d7b-43b8-bb29-cef8fe91ea65', '59fbb547-e519-42ea-ba98-be0d58162777', 'b318ba1b-4f13-426b-90cf-476215b543bc', '965ad3e6-6f70-4977-bf65-ee083571fb57'] {{(pid=87515) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:07:36 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-67ab2f9a-f116-4551-8836-e85a6fb1e910 tempest-CinderUnicodeTest-1998667154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-518fe8d0-45f0-495e-bb8a-ed6f33c207cc" returned: 0 in 0.515s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:07:36 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-67ab2f9a-f116-4551-8836-e85a6fb1e910 tempest-CinderUnicodeTest-1998667154 None] <== create_volume: return (1234ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'} {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 10:07:36 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-67ab2f9a-f116-4551-8836-e85a6fb1e910 tempest-CinderUnicodeTest-1998667154 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.238s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:07:36 devstack sudo[99424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-640722de-3f4c-4434-9712-126398038f41.e31bfd3f-4446-4c21-a386-572c14dcfc9e Sep 07 10:07:36 devstack sudo[99424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:07:36 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-67ab2f9a-f116-4551-8836-e85a6fb1e910 tempest-CinderUnicodeTest-1998667154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92e86106-ee8d-45d0-bd8d-fb0fa6e40735) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-518fe8d0-45f0-495e-bb8a-ed6f33c207cc', 'volume_size': 1}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:07:36 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-67ab2f9a-f116-4551-8836-e85a6fb1e910 tempest-CinderUnicodeTest-1998667154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76fa1ea1-e53c-4988-a304-4d9bd80128b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:07:36 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-67ab2f9a-f116-4551-8836-e85a6fb1e910 tempest-CinderUnicodeTest-1998667154 None] Volume volume-518fe8d0-45f0-495e-bb8a-ed6f33c207cc (518fe8d0-45f0-495e-bb8a-ed6f33c207cc): created successfully Sep 07 10:07:36 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-67ab2f9a-f116-4551-8836-e85a6fb1e910 tempest-CinderUnicodeTest-1998667154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76fa1ea1-e53c-4988-a304-4d9bd80128b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:07:36 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-67ab2f9a-f116-4551-8836-e85a6fb1e910 tempest-CinderUnicodeTest-1998667154 None] Flow 'volume_create_manager' (d8f0071a-f1c0-4c1b-9652-e48a65897f66) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:07:36 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-67ab2f9a-f116-4551-8836-e85a6fb1e910 tempest-CinderUnicodeTest-1998667154 None] Created volume successfully. Sep 07 10:07:36 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-67999efa-b5f1-4785-bb16-181e70a25e82 tempest-VolumesTestJSON-633817380 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:07:36 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-67999efa-b5f1-4785-bb16-181e70a25e82 tempest-VolumesTestJSON-633817380 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:07:36 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-67999efa-b5f1-4785-bb16-181e70a25e82 tempest-VolumesTestJSON-633817380 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:07:36 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-67999efa-b5f1-4785-bb16-181e70a25e82 tempest-VolumesTestJSON-633817380 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:07:36 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-67999efa-b5f1-4785-bb16-181e70a25e82 tempest-VolumesTestJSON-633817380 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:07:36 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-67999efa-b5f1-4785-bb16-181e70a25e82 tempest-VolumesTestJSON-633817380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:07:36 devstack sudo[99433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a Sep 07 10:07:36 devstack sudo[99433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:07:37 devstack sudo[99424]: pam_unix(sudo:session): session closed for user root Sep 07 10:07:37 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-e9399ee9-1700-4786-94e4-a9e24afb2fa8 tempest-SnapshotsActionsTest-158812568 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-640722de-3f4c-4434-9712-126398038f41.e31bfd3f-4446-4c21-a386-572c14dcfc9e" returned: 0 in 0.697s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:07:37 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-e9399ee9-1700-4786-94e4-a9e24afb2fa8 tempest-SnapshotsActionsTest-158812568 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-640722de-3f4c-4434-9712-126398038f41(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87515) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 10:07:37 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[b986cb39-1f7f-4524-b231-e7b61508f452]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:07:37 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-e9399ee9-1700-4786-94e4-a9e24afb2fa8 tempest-SnapshotsActionsTest-158812568 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-640722de-3f4c-4434-9712-126398038f41 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:07:37 devstack sudo[99433]: pam_unix(sudo:session): session closed for user root Sep 07 10:07:37 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-67999efa-b5f1-4785-bb16-181e70a25e82 tempest-VolumesTestJSON-633817380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a" returned: 0 in 0.386s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:07:37 devstack cinder-volume[87515]: DEBUG cinder.manager [None req-67999efa-b5f1-4785-bb16-181e70a25e82 tempest-VolumesTestJSON-633817380 None] Notifying Schedulers of capabilities ... {{(pid=87515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:07:37 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-67999efa-b5f1-4785-bb16-181e70a25e82 tempest-VolumesTestJSON-633817380 None] Deleted volume successfully. Sep 07 10:07:37 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-67999efa-b5f1-4785-bb16-181e70a25e82 tempest-VolumesTestJSON-633817380 None] Lock "cinder-c513dc16-3d26-4655-899a-278916271f71-delete_volume" released by "delete_volume" :: held 2.152s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:07:37 devstack sudo[99439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-640722de-3f4c-4434-9712-126398038f41 Sep 07 10:07:37 devstack sudo[99439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:07:37 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-2daeb0a1-4c5e-4e8b-b81b-28e43738e48f tempest-VolumesTestJSON-633817380 None] Acquiring lock "cinder-21809457-c5f6-4070-938c-bc5679cf8ad2-delete_volume" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:07:37 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-2daeb0a1-4c5e-4e8b-b81b-28e43738e48f tempest-VolumesTestJSON-633817380 None] Lock "cinder-21809457-c5f6-4070-938c-bc5679cf8ad2-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:07:37 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-2daeb0a1-4c5e-4e8b-b81b-28e43738e48f tempest-VolumesTestJSON-633817380 None] Acquiring lock "cinder-quobyte-21809457-c5f6-4070-938c-bc5679cf8ad2" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:07:37 devstack sudo[99439]: pam_unix(sudo:session): session closed for user root Sep 07 10:07:37 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-e9399ee9-1700-4786-94e4-a9e24afb2fa8 tempest-SnapshotsActionsTest-158812568 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-640722de-3f4c-4434-9712-126398038f41" returned: 0 in 0.621s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:07:37 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-e9399ee9-1700-4786-94e4-a9e24afb2fa8 tempest-SnapshotsActionsTest-158812568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-640722de-3f4c-4434-9712-126398038f41.e31bfd3f-4446-4c21-a386-572c14dcfc9e {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:07:37 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-2daeb0a1-4c5e-4e8b-b81b-28e43738e48f tempest-VolumesTestJSON-633817380 None] Lock "cinder-quobyte-21809457-c5f6-4070-938c-bc5679cf8ad2" acquired by "delete_volume" :: waited 0.062s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:07:37 devstack sudo[99444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-640722de-3f4c-4434-9712-126398038f41.e31bfd3f-4446-4c21-a386-572c14dcfc9e Sep 07 10:07:37 devstack sudo[99444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:07:37 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-cd4b60e3-2e8f-445c-8ac7-3d05bc912c9a tempest-CinderUnicodeTest-1998667154 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:07:37 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-cd4b60e3-2e8f-445c-8ac7-3d05bc912c9a tempest-CinderUnicodeTest-1998667154 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:07:37 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[7aee9d57-fce8-414a-bbbd-0f5ade7a6fb8]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:07:37 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-2daeb0a1-4c5e-4e8b-b81b-28e43738e48f tempest-VolumesTestJSON-633817380 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-21809457-c5f6-4070-938c-bc5679cf8ad2 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:07:37 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-cd4b60e3-2e8f-445c-8ac7-3d05bc912c9a tempest-CinderUnicodeTest-1998667154 None] Creating offline snapshot c18f5396-c5ee-4578-aee3-dc6e5a1548f5 of volume 518fe8d0-45f0-495e-bb8a-ed6f33c207cc {{(pid=87515) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 10:07:37 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[e979a5f2-c3e9-464c-96f9-243268234304]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:07:38 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-cd4b60e3-2e8f-445c-8ac7-3d05bc912c9a tempest-CinderUnicodeTest-1998667154 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-518fe8d0-45f0-495e-bb8a-ed6f33c207cc {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:07:38 devstack sudo[99446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-21809457-c5f6-4070-938c-bc5679cf8ad2 Sep 07 10:07:38 devstack sudo[99446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:07:38 devstack sudo[99447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-518fe8d0-45f0-495e-bb8a-ed6f33c207cc Sep 07 10:07:38 devstack sudo[99447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:07:38 devstack sudo[99446]: pam_unix(sudo:session): session closed for user root Sep 07 10:07:38 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-2daeb0a1-4c5e-4e8b-b81b-28e43738e48f tempest-VolumesTestJSON-633817380 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-21809457-c5f6-4070-938c-bc5679cf8ad2" returned: 0 in 0.578s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:07:38 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-2daeb0a1-4c5e-4e8b-b81b-28e43738e48f tempest-VolumesTestJSON-633817380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-21809457-c5f6-4070-938c-bc5679cf8ad2 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:07:38 devstack sudo[99457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-21809457-c5f6-4070-938c-bc5679cf8ad2 Sep 07 10:07:38 devstack sudo[99457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:07:38 devstack sudo[99444]: pam_unix(sudo:session): session closed for user root Sep 07 10:07:38 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-e9399ee9-1700-4786-94e4-a9e24afb2fa8 tempest-SnapshotsActionsTest-158812568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-640722de-3f4c-4434-9712-126398038f41.e31bfd3f-4446-4c21-a386-572c14dcfc9e" returned: 0 in 0.780s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:07:38 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-e9399ee9-1700-4786-94e4-a9e24afb2fa8 tempest-SnapshotsActionsTest-158812568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-640722de-3f4c-4434-9712-126398038f41.e31bfd3f-4446-4c21-a386-572c14dcfc9e {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:07:38 devstack sudo[99459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-640722de-3f4c-4434-9712-126398038f41.e31bfd3f-4446-4c21-a386-572c14dcfc9e Sep 07 10:07:38 devstack sudo[99459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:07:38 devstack sudo[99447]: pam_unix(sudo:session): session closed for user root Sep 07 10:07:38 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-cd4b60e3-2e8f-445c-8ac7-3d05bc912c9a tempest-CinderUnicodeTest-1998667154 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-518fe8d0-45f0-495e-bb8a-ed6f33c207cc" returned: 0 in 0.837s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:07:38 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-cd4b60e3-2e8f-445c-8ac7-3d05bc912c9a tempest-CinderUnicodeTest-1998667154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-518fe8d0-45f0-495e-bb8a-ed6f33c207cc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-518fe8d0-45f0-495e-bb8a-ed6f33c207cc.c18f5396-c5ee-4578-aee3-dc6e5a1548f5 1G {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:07:38 devstack sudo[99466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-518fe8d0-45f0-495e-bb8a-ed6f33c207cc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-518fe8d0-45f0-495e-bb8a-ed6f33c207cc.c18f5396-c5ee-4578-aee3-dc6e5a1548f5 1G Sep 07 10:07:38 devstack sudo[99466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:07:38 devstack sudo[99457]: pam_unix(sudo:session): session closed for user root Sep 07 10:07:38 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-2daeb0a1-4c5e-4e8b-b81b-28e43738e48f tempest-VolumesTestJSON-633817380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-21809457-c5f6-4070-938c-bc5679cf8ad2" returned: 0 in 0.452s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:07:38 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-2daeb0a1-4c5e-4e8b-b81b-28e43738e48f tempest-VolumesTestJSON-633817380 None] Lock "cinder-quobyte-21809457-c5f6-4070-938c-bc5679cf8ad2" released by "delete_volume" :: held 1.122s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:07:39 devstack cinder-volume[87515]: DEBUG cinder.quota [None req-2daeb0a1-4c5e-4e8b-b81b-28e43738e48f tempest-VolumesTestJSON-633817380 None] Created reservations ['1d44330d-51a6-4794-8e29-35943b61c536', '094e1cf2-9d51-458d-801d-1fd798e784a8', '66d3a373-3e50-4b39-a745-e4f5ca726f2f', 'cf26fe1a-6670-4ec4-b85f-04a6973b267d'] {{(pid=87515) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:07:39 devstack sudo[99459]: pam_unix(sudo:session): session closed for user root Sep 07 10:07:39 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-e9399ee9-1700-4786-94e4-a9e24afb2fa8 tempest-SnapshotsActionsTest-158812568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-640722de-3f4c-4434-9712-126398038f41.e31bfd3f-4446-4c21-a386-572c14dcfc9e" returned: 0 in 0.502s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:07:39 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-e9399ee9-1700-4786-94e4-a9e24afb2fa8 tempest-SnapshotsActionsTest-158812568 None] Lock "cinder-quobyte-e31bfd3f-4446-4c21-a386-572c14dcfc9e" released by "_delete_snapshot" :: held 2.835s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:07:39 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-e9399ee9-1700-4786-94e4-a9e24afb2fa8 tempest-SnapshotsActionsTest-158812568 None] Lock "cinder-quobyte-640722de-3f4c-4434-9712-126398038f41" released by "delete_snapshot" :: held 2.889s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:07:39 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-2daeb0a1-4c5e-4e8b-b81b-28e43738e48f tempest-VolumesTestJSON-633817380 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:07:39 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-2daeb0a1-4c5e-4e8b-b81b-28e43738e48f tempest-VolumesTestJSON-633817380 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:07:39 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-2daeb0a1-4c5e-4e8b-b81b-28e43738e48f tempest-VolumesTestJSON-633817380 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:07:39 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-2daeb0a1-4c5e-4e8b-b81b-28e43738e48f tempest-VolumesTestJSON-633817380 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:07:39 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-2daeb0a1-4c5e-4e8b-b81b-28e43738e48f tempest-VolumesTestJSON-633817380 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:07:39 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-2daeb0a1-4c5e-4e8b-b81b-28e43738e48f tempest-VolumesTestJSON-633817380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:07:39 devstack cinder-volume[87515]: DEBUG cinder.quota [None req-e9399ee9-1700-4786-94e4-a9e24afb2fa8 tempest-SnapshotsActionsTest-158812568 None] Created reservations ['4e5936b4-9fe3-4c11-8acd-ac8c7fb3454c', 'ea2dc6df-0527-4ca9-8940-f1dd0cddb981', '91669024-a8d9-4926-9ed5-9eb92ce63c5f', 'aceb8be5-5259-4f85-b3e5-fc3d68242bb2'] {{(pid=87515) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:07:39 devstack sudo[99472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a Sep 07 10:07:39 devstack sudo[99472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:07:39 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-e9399ee9-1700-4786-94e4-a9e24afb2fa8 tempest-SnapshotsActionsTest-158812568 None] Delete snapshot completed successfully. Sep 07 10:07:39 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-e9399ee9-1700-4786-94e4-a9e24afb2fa8 tempest-SnapshotsActionsTest-158812568 None] Lock "cinder-e31bfd3f-4446-4c21-a386-572c14dcfc9e-delete_snapshot" released by "delete_snapshot" :: held 3.138s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:07:39 devstack sudo[99466]: pam_unix(sudo:session): session closed for user root Sep 07 10:07:39 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-cd4b60e3-2e8f-445c-8ac7-3d05bc912c9a tempest-CinderUnicodeTest-1998667154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-518fe8d0-45f0-495e-bb8a-ed6f33c207cc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-518fe8d0-45f0-495e-bb8a-ed6f33c207cc.c18f5396-c5ee-4578-aee3-dc6e5a1548f5 1G" returned: 0 in 0.784s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:07:39 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-cd4b60e3-2e8f-445c-8ac7-3d05bc912c9a tempest-CinderUnicodeTest-1998667154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-518fe8d0-45f0-495e-bb8a-ed6f33c207cc -F qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-518fe8d0-45f0-495e-bb8a-ed6f33c207cc.c18f5396-c5ee-4578-aee3-dc6e5a1548f5 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:07:39 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-99b46302-e027-41c6-a5a8-7dee2774e2ef tempest-SnapshotsActionsTest-158812568 None] Acquiring lock "cinder-640722de-3f4c-4434-9712-126398038f41-delete_volume" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:07:39 devstack sudo[99475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-518fe8d0-45f0-495e-bb8a-ed6f33c207cc -F qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-518fe8d0-45f0-495e-bb8a-ed6f33c207cc.c18f5396-c5ee-4578-aee3-dc6e5a1548f5 Sep 07 10:07:39 devstack sudo[99475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:07:39 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-99b46302-e027-41c6-a5a8-7dee2774e2ef tempest-SnapshotsActionsTest-158812568 None] Lock "cinder-640722de-3f4c-4434-9712-126398038f41-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:07:39 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-99b46302-e027-41c6-a5a8-7dee2774e2ef tempest-SnapshotsActionsTest-158812568 None] Acquiring lock "cinder-quobyte-640722de-3f4c-4434-9712-126398038f41" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:07:39 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-99b46302-e027-41c6-a5a8-7dee2774e2ef tempest-SnapshotsActionsTest-158812568 None] Lock "cinder-quobyte-640722de-3f4c-4434-9712-126398038f41" acquired by "delete_volume" :: waited 0.039s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:07:39 devstack sudo[99472]: pam_unix(sudo:session): session closed for user root Sep 07 10:07:39 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-2daeb0a1-4c5e-4e8b-b81b-28e43738e48f tempest-VolumesTestJSON-633817380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a" returned: 0 in 0.607s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:07:39 devstack cinder-volume[87515]: DEBUG cinder.manager [None req-2daeb0a1-4c5e-4e8b-b81b-28e43738e48f tempest-VolumesTestJSON-633817380 None] Notifying Schedulers of capabilities ... {{(pid=87515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:07:39 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-2daeb0a1-4c5e-4e8b-b81b-28e43738e48f tempest-VolumesTestJSON-633817380 None] Deleted volume successfully. Sep 07 10:07:39 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b41d1e3-fca9-495f-9540-866f3270bbc1]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:07:39 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-99b46302-e027-41c6-a5a8-7dee2774e2ef tempest-SnapshotsActionsTest-158812568 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-640722de-3f4c-4434-9712-126398038f41 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:07:39 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-2daeb0a1-4c5e-4e8b-b81b-28e43738e48f tempest-VolumesTestJSON-633817380 None] Lock "cinder-21809457-c5f6-4070-938c-bc5679cf8ad2-delete_volume" released by "delete_volume" :: held 2.296s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:07:40 devstack sudo[99478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-640722de-3f4c-4434-9712-126398038f41 Sep 07 10:07:40 devstack sudo[99478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:07:40 devstack sudo[99475]: pam_unix(sudo:session): session closed for user root Sep 07 10:07:40 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-5f505a60-6df7-420c-a9b3-3bcef08263cc tempest-VolumesTestJSON-633817380 None] Acquiring lock "cinder-2edf2a65-4e72-4d02-924c-5ed367888599-delete_volume" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:07:40 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-cd4b60e3-2e8f-445c-8ac7-3d05bc912c9a tempest-CinderUnicodeTest-1998667154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-518fe8d0-45f0-495e-bb8a-ed6f33c207cc -F qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-518fe8d0-45f0-495e-bb8a-ed6f33c207cc.c18f5396-c5ee-4578-aee3-dc6e5a1548f5" returned: 0 in 0.589s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:07:40 devstack cinder-volume[87515]: WARNING cinder.volume.drivers.remotefs [None req-cd4b60e3-2e8f-445c-8ac7-3d05bc912c9a tempest-CinderUnicodeTest-1998667154 None] /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-518fe8d0-45f0-495e-bb8a-ed6f33c207cc.c18f5396-c5ee-4578-aee3-dc6e5a1548f5 is being set with open permissions: ugo+rw Sep 07 10:07:40 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-cd4b60e3-2e8f-445c-8ac7-3d05bc912c9a tempest-CinderUnicodeTest-1998667154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-518fe8d0-45f0-495e-bb8a-ed6f33c207cc.c18f5396-c5ee-4578-aee3-dc6e5a1548f5 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:07:40 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-5f505a60-6df7-420c-a9b3-3bcef08263cc tempest-VolumesTestJSON-633817380 None] Lock "cinder-2edf2a65-4e72-4d02-924c-5ed367888599-delete_volume" acquired by "delete_volume" :: waited 0.067s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:07:40 devstack sudo[99484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-518fe8d0-45f0-495e-bb8a-ed6f33c207cc.c18f5396-c5ee-4578-aee3-dc6e5a1548f5 Sep 07 10:07:40 devstack sudo[99484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:07:40 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-5f505a60-6df7-420c-a9b3-3bcef08263cc tempest-VolumesTestJSON-633817380 None] Acquiring lock "cinder-quobyte-2edf2a65-4e72-4d02-924c-5ed367888599" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:07:40 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-5f505a60-6df7-420c-a9b3-3bcef08263cc tempest-VolumesTestJSON-633817380 None] Lock "cinder-quobyte-2edf2a65-4e72-4d02-924c-5ed367888599" acquired by "delete_volume" :: waited 0.032s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:07:40 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c49b30a-626b-44bd-a731-05d9fdfdace2]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:07:40 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-5f505a60-6df7-420c-a9b3-3bcef08263cc tempest-VolumesTestJSON-633817380 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-2edf2a65-4e72-4d02-924c-5ed367888599 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:07:40 devstack sudo[99478]: pam_unix(sudo:session): session closed for user root Sep 07 10:07:40 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-99b46302-e027-41c6-a5a8-7dee2774e2ef tempest-SnapshotsActionsTest-158812568 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-640722de-3f4c-4434-9712-126398038f41" returned: 0 in 0.720s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:07:40 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-99b46302-e027-41c6-a5a8-7dee2774e2ef tempest-SnapshotsActionsTest-158812568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-640722de-3f4c-4434-9712-126398038f41 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:07:40 devstack sudo[99492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-640722de-3f4c-4434-9712-126398038f41 Sep 07 10:07:40 devstack sudo[99492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:07:40 devstack sudo[99484]: pam_unix(sudo:session): session closed for user root Sep 07 10:07:40 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-cd4b60e3-2e8f-445c-8ac7-3d05bc912c9a tempest-CinderUnicodeTest-1998667154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-518fe8d0-45f0-495e-bb8a-ed6f33c207cc.c18f5396-c5ee-4578-aee3-dc6e5a1548f5" returned: 0 in 0.487s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:07:40 devstack sudo[99488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-2edf2a65-4e72-4d02-924c-5ed367888599 Sep 07 10:07:40 devstack sudo[99488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:07:40 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-cd4b60e3-2e8f-445c-8ac7-3d05bc912c9a tempest-CinderUnicodeTest-1998667154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-518fe8d0-45f0-495e-bb8a-ed6f33c207cc.info {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:07:40 devstack sudo[99495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-518fe8d0-45f0-495e-bb8a-ed6f33c207cc.info Sep 07 10:07:40 devstack sudo[99495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:07:41 devstack sudo[99492]: pam_unix(sudo:session): session closed for user root Sep 07 10:07:41 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-99b46302-e027-41c6-a5a8-7dee2774e2ef tempest-SnapshotsActionsTest-158812568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-640722de-3f4c-4434-9712-126398038f41" returned: 0 in 0.393s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:07:41 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-99b46302-e027-41c6-a5a8-7dee2774e2ef tempest-SnapshotsActionsTest-158812568 None] Lock "cinder-quobyte-640722de-3f4c-4434-9712-126398038f41" released by "delete_volume" :: held 1.255s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:07:41 devstack sudo[99488]: pam_unix(sudo:session): session closed for user root Sep 07 10:07:41 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-5f505a60-6df7-420c-a9b3-3bcef08263cc tempest-VolumesTestJSON-633817380 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-2edf2a65-4e72-4d02-924c-5ed367888599" returned: 0 in 0.695s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:07:41 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-5f505a60-6df7-420c-a9b3-3bcef08263cc tempest-VolumesTestJSON-633817380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-2edf2a65-4e72-4d02-924c-5ed367888599 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:07:41 devstack cinder-volume[87515]: DEBUG cinder.quota [None req-99b46302-e027-41c6-a5a8-7dee2774e2ef tempest-SnapshotsActionsTest-158812568 None] Created reservations ['5eb74917-9def-4845-8468-f81aaad90fec', '5de3421e-63bf-46e0-9698-597d2361e41a', '9ba6441d-2abb-4028-99f2-9a66a9a02644', '3461b8ac-c752-4edd-9c54-328b6f2fa02b'] {{(pid=87515) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:07:41 devstack sudo[99501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-2edf2a65-4e72-4d02-924c-5ed367888599 Sep 07 10:07:41 devstack sudo[99501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:07:41 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-99b46302-e027-41c6-a5a8-7dee2774e2ef tempest-SnapshotsActionsTest-158812568 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:07:41 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-99b46302-e027-41c6-a5a8-7dee2774e2ef tempest-SnapshotsActionsTest-158812568 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.009s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:07:41 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-99b46302-e027-41c6-a5a8-7dee2774e2ef tempest-SnapshotsActionsTest-158812568 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:07:41 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-99b46302-e027-41c6-a5a8-7dee2774e2ef tempest-SnapshotsActionsTest-158812568 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:07:41 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-99b46302-e027-41c6-a5a8-7dee2774e2ef tempest-SnapshotsActionsTest-158812568 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:07:41 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-99b46302-e027-41c6-a5a8-7dee2774e2ef tempest-SnapshotsActionsTest-158812568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:07:41 devstack sudo[99495]: pam_unix(sudo:session): session closed for user root Sep 07 10:07:41 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-cd4b60e3-2e8f-445c-8ac7-3d05bc912c9a tempest-CinderUnicodeTest-1998667154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-518fe8d0-45f0-495e-bb8a-ed6f33c207cc.info" returned: 0 in 0.705s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:07:41 devstack sudo[99505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a Sep 07 10:07:41 devstack cinder-volume[87515]: WARNING cinder.volume.drivers.remotefs [None req-cd4b60e3-2e8f-445c-8ac7-3d05bc912c9a tempest-CinderUnicodeTest-1998667154 None] /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-518fe8d0-45f0-495e-bb8a-ed6f33c207cc.info is being set with open permissions: ugo+rw Sep 07 10:07:41 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-cd4b60e3-2e8f-445c-8ac7-3d05bc912c9a tempest-CinderUnicodeTest-1998667154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-518fe8d0-45f0-495e-bb8a-ed6f33c207cc.info {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:07:41 devstack sudo[99505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:07:41 devstack sudo[99507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-518fe8d0-45f0-495e-bb8a-ed6f33c207cc.info Sep 07 10:07:41 devstack sudo[99507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:07:41 devstack sudo[99501]: pam_unix(sudo:session): session closed for user root Sep 07 10:07:41 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-5f505a60-6df7-420c-a9b3-3bcef08263cc tempest-VolumesTestJSON-633817380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-2edf2a65-4e72-4d02-924c-5ed367888599" returned: 0 in 0.581s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:07:41 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-5f505a60-6df7-420c-a9b3-3bcef08263cc tempest-VolumesTestJSON-633817380 None] Lock "cinder-quobyte-2edf2a65-4e72-4d02-924c-5ed367888599" released by "delete_volume" :: held 1.398s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:07:41 devstack sudo[99505]: pam_unix(sudo:session): session closed for user root Sep 07 10:07:41 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-99b46302-e027-41c6-a5a8-7dee2774e2ef tempest-SnapshotsActionsTest-158812568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a" returned: 0 in 0.431s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:07:41 devstack cinder-volume[87515]: DEBUG cinder.manager [None req-99b46302-e027-41c6-a5a8-7dee2774e2ef tempest-SnapshotsActionsTest-158812568 None] Notifying Schedulers of capabilities ... {{(pid=87515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:07:41 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-99b46302-e027-41c6-a5a8-7dee2774e2ef tempest-SnapshotsActionsTest-158812568 None] Deleted volume successfully. Sep 07 10:07:41 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-99b46302-e027-41c6-a5a8-7dee2774e2ef tempest-SnapshotsActionsTest-158812568 None] Lock "cinder-640722de-3f4c-4434-9712-126398038f41-delete_volume" released by "delete_volume" :: held 2.199s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:07:41 devstack cinder-volume[87515]: DEBUG cinder.quota [None req-5f505a60-6df7-420c-a9b3-3bcef08263cc tempest-VolumesTestJSON-633817380 None] Created reservations ['a44d3a26-9c3b-4ec5-b1c9-d0b9e50c338f', 'ef379f78-b4a6-4b8a-be5e-2b006c5c0770', '53f741bb-a8dd-4d4e-afb2-41c753d98fee', 'ee08b28a-f3b5-4c58-9c72-238ba02165f2'] {{(pid=87515) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:07:41 devstack sudo[99507]: pam_unix(sudo:session): session closed for user root Sep 07 10:07:41 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-cd4b60e3-2e8f-445c-8ac7-3d05bc912c9a tempest-CinderUnicodeTest-1998667154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-518fe8d0-45f0-495e-bb8a-ed6f33c207cc.info" returned: 0 in 0.501s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:07:42 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-cd4b60e3-2e8f-445c-8ac7-3d05bc912c9a tempest-CinderUnicodeTest-1998667154 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.120s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:07:42 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-cd4b60e3-2e8f-445c-8ac7-3d05bc912c9a tempest-CinderUnicodeTest-1998667154 None] Create snapshot completed successfully Sep 07 10:07:42 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-5f505a60-6df7-420c-a9b3-3bcef08263cc tempest-VolumesTestJSON-633817380 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:07:42 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-5f505a60-6df7-420c-a9b3-3bcef08263cc tempest-VolumesTestJSON-633817380 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:07:42 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-5f505a60-6df7-420c-a9b3-3bcef08263cc tempest-VolumesTestJSON-633817380 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:07:42 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-5f505a60-6df7-420c-a9b3-3bcef08263cc tempest-VolumesTestJSON-633817380 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:07:42 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-5f505a60-6df7-420c-a9b3-3bcef08263cc tempest-VolumesTestJSON-633817380 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:07:42 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-5f505a60-6df7-420c-a9b3-3bcef08263cc tempest-VolumesTestJSON-633817380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:07:42 devstack sudo[99512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a Sep 07 10:07:42 devstack sudo[99512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:07:42 devstack sudo[99512]: pam_unix(sudo:session): session closed for user root Sep 07 10:07:42 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-5f505a60-6df7-420c-a9b3-3bcef08263cc tempest-VolumesTestJSON-633817380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a" returned: 0 in 0.444s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:07:42 devstack cinder-volume[87515]: DEBUG cinder.manager [None req-5f505a60-6df7-420c-a9b3-3bcef08263cc tempest-VolumesTestJSON-633817380 None] Notifying Schedulers of capabilities ... {{(pid=87515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:07:42 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-5f505a60-6df7-420c-a9b3-3bcef08263cc tempest-VolumesTestJSON-633817380 None] Deleted volume successfully. Sep 07 10:07:42 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-5f505a60-6df7-420c-a9b3-3bcef08263cc tempest-VolumesTestJSON-633817380 None] Lock "cinder-2edf2a65-4e72-4d02-924c-5ed367888599-delete_volume" released by "delete_volume" :: held 2.361s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:07:43 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-1786d645-52df-4748-8ac8-9cfc90144f9c tempest-CinderUnicodeTest-1998667154 None] Acquiring lock "cinder-c18f5396-c5ee-4578-aee3-dc6e5a1548f5-delete_snapshot" by "delete_snapshot" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:07:43 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-1786d645-52df-4748-8ac8-9cfc90144f9c tempest-CinderUnicodeTest-1998667154 None] Lock "cinder-c18f5396-c5ee-4578-aee3-dc6e5a1548f5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.040s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:07:43 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-1786d645-52df-4748-8ac8-9cfc90144f9c tempest-CinderUnicodeTest-1998667154 None] Acquiring lock "cinder-quobyte-518fe8d0-45f0-495e-bb8a-ed6f33c207cc" by "delete_snapshot" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:07:43 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-1786d645-52df-4748-8ac8-9cfc90144f9c tempest-CinderUnicodeTest-1998667154 None] Lock "cinder-quobyte-518fe8d0-45f0-495e-bb8a-ed6f33c207cc" acquired by "delete_snapshot" :: waited 0.040s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:07:43 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-1786d645-52df-4748-8ac8-9cfc90144f9c tempest-CinderUnicodeTest-1998667154 None] Acquiring lock "cinder-quobyte-c18f5396-c5ee-4578-aee3-dc6e5a1548f5" by "_delete_snapshot" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:07:43 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-1786d645-52df-4748-8ac8-9cfc90144f9c tempest-CinderUnicodeTest-1998667154 None] Lock "cinder-quobyte-c18f5396-c5ee-4578-aee3-dc6e5a1548f5" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:07:43 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-1786d645-52df-4748-8ac8-9cfc90144f9c tempest-CinderUnicodeTest-1998667154 None] Deleting offline snapshot c18f5396-c5ee-4578-aee3-dc6e5a1548f5 of volume 518fe8d0-45f0-495e-bb8a-ed6f33c207cc {{(pid=87515) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 10:07:43 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-1786d645-52df-4748-8ac8-9cfc90144f9c tempest-CinderUnicodeTest-1998667154 None] snapshot_file for this snap is: volume-518fe8d0-45f0-495e-bb8a-ed6f33c207cc.c18f5396-c5ee-4578-aee3-dc6e5a1548f5 {{(pid=87515) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 10:07:43 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb226917-0136-4bba-8f7a-18394f3aa43e]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:07:43 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-1786d645-52df-4748-8ac8-9cfc90144f9c tempest-CinderUnicodeTest-1998667154 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-518fe8d0-45f0-495e-bb8a-ed6f33c207cc.c18f5396-c5ee-4578-aee3-dc6e5a1548f5 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:07:43 devstack sudo[99515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-518fe8d0-45f0-495e-bb8a-ed6f33c207cc.c18f5396-c5ee-4578-aee3-dc6e5a1548f5 Sep 07 10:07:43 devstack sudo[99515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:07:44 devstack sudo[99515]: pam_unix(sudo:session): session closed for user root Sep 07 10:07:44 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-1786d645-52df-4748-8ac8-9cfc90144f9c tempest-CinderUnicodeTest-1998667154 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-518fe8d0-45f0-495e-bb8a-ed6f33c207cc.c18f5396-c5ee-4578-aee3-dc6e5a1548f5" returned: 0 in 0.609s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:07:44 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-1786d645-52df-4748-8ac8-9cfc90144f9c tempest-CinderUnicodeTest-1998667154 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-518fe8d0-45f0-495e-bb8a-ed6f33c207cc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87515) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 10:07:44 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[47dc56fb-368d-4e2a-9e6b-08f593375bec]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:07:44 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-1786d645-52df-4748-8ac8-9cfc90144f9c tempest-CinderUnicodeTest-1998667154 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-518fe8d0-45f0-495e-bb8a-ed6f33c207cc {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:07:44 devstack sudo[99520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-518fe8d0-45f0-495e-bb8a-ed6f33c207cc Sep 07 10:07:44 devstack sudo[99520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:07:44 devstack sudo[99520]: pam_unix(sudo:session): session closed for user root Sep 07 10:07:44 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-1786d645-52df-4748-8ac8-9cfc90144f9c tempest-CinderUnicodeTest-1998667154 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-518fe8d0-45f0-495e-bb8a-ed6f33c207cc" returned: 0 in 0.573s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:07:44 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-1786d645-52df-4748-8ac8-9cfc90144f9c tempest-CinderUnicodeTest-1998667154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-518fe8d0-45f0-495e-bb8a-ed6f33c207cc.c18f5396-c5ee-4578-aee3-dc6e5a1548f5 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:07:44 devstack sudo[99525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-518fe8d0-45f0-495e-bb8a-ed6f33c207cc.c18f5396-c5ee-4578-aee3-dc6e5a1548f5 Sep 07 10:07:44 devstack sudo[99525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:07:45 devstack sudo[99525]: pam_unix(sudo:session): session closed for user root Sep 07 10:07:45 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-1786d645-52df-4748-8ac8-9cfc90144f9c tempest-CinderUnicodeTest-1998667154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-518fe8d0-45f0-495e-bb8a-ed6f33c207cc.c18f5396-c5ee-4578-aee3-dc6e5a1548f5" returned: 0 in 0.531s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:07:45 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-1786d645-52df-4748-8ac8-9cfc90144f9c tempest-CinderUnicodeTest-1998667154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-518fe8d0-45f0-495e-bb8a-ed6f33c207cc.c18f5396-c5ee-4578-aee3-dc6e5a1548f5 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:07:45 devstack sudo[99531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-518fe8d0-45f0-495e-bb8a-ed6f33c207cc.c18f5396-c5ee-4578-aee3-dc6e5a1548f5 Sep 07 10:07:45 devstack sudo[99531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:07:45 devstack sudo[99531]: pam_unix(sudo:session): session closed for user root Sep 07 10:07:45 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-1786d645-52df-4748-8ac8-9cfc90144f9c tempest-CinderUnicodeTest-1998667154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-518fe8d0-45f0-495e-bb8a-ed6f33c207cc.c18f5396-c5ee-4578-aee3-dc6e5a1548f5" returned: 0 in 0.425s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:07:45 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-1786d645-52df-4748-8ac8-9cfc90144f9c tempest-CinderUnicodeTest-1998667154 None] Lock "cinder-quobyte-c18f5396-c5ee-4578-aee3-dc6e5a1548f5" released by "_delete_snapshot" :: held 2.364s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:07:45 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-1786d645-52df-4748-8ac8-9cfc90144f9c tempest-CinderUnicodeTest-1998667154 None] Lock "cinder-quobyte-518fe8d0-45f0-495e-bb8a-ed6f33c207cc" released by "delete_snapshot" :: held 2.416s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:07:45 devstack cinder-volume[87515]: DEBUG cinder.quota [None req-1786d645-52df-4748-8ac8-9cfc90144f9c tempest-CinderUnicodeTest-1998667154 None] Created reservations ['d95659b9-8dda-461f-84b6-88d66b382e53', 'b760ca52-c98d-4731-898b-ce6d69db8a61', 'f51789cc-ea2a-4f24-adef-1966bb0937c3', 'bad45e29-e4de-4ab3-bd83-0019b6ef859b'] {{(pid=87515) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:07:45 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-1786d645-52df-4748-8ac8-9cfc90144f9c tempest-CinderUnicodeTest-1998667154 None] Delete snapshot completed successfully. Sep 07 10:07:45 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-1786d645-52df-4748-8ac8-9cfc90144f9c tempest-CinderUnicodeTest-1998667154 None] Lock "cinder-c18f5396-c5ee-4578-aee3-dc6e5a1548f5-delete_snapshot" released by "delete_snapshot" :: held 2.689s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:07:46 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-c9a3f890-437f-48ac-a8a5-dcde4262cd0a tempest-CinderUnicodeTest-1998667154 None] Acquiring lock "cinder-518fe8d0-45f0-495e-bb8a-ed6f33c207cc-delete_volume" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:07:46 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-c9a3f890-437f-48ac-a8a5-dcde4262cd0a tempest-CinderUnicodeTest-1998667154 None] Lock "cinder-518fe8d0-45f0-495e-bb8a-ed6f33c207cc-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:07:46 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-c9a3f890-437f-48ac-a8a5-dcde4262cd0a tempest-CinderUnicodeTest-1998667154 None] Acquiring lock "cinder-quobyte-518fe8d0-45f0-495e-bb8a-ed6f33c207cc" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:07:46 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-c9a3f890-437f-48ac-a8a5-dcde4262cd0a tempest-CinderUnicodeTest-1998667154 None] Lock "cinder-quobyte-518fe8d0-45f0-495e-bb8a-ed6f33c207cc" acquired by "delete_volume" :: waited 0.033s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:07:46 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c5b100f-5940-4e54-a1a0-2a35ba4ac2f1]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:07:46 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-c9a3f890-437f-48ac-a8a5-dcde4262cd0a tempest-CinderUnicodeTest-1998667154 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-518fe8d0-45f0-495e-bb8a-ed6f33c207cc {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:07:47 devstack sudo[99534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-518fe8d0-45f0-495e-bb8a-ed6f33c207cc Sep 07 10:07:47 devstack sudo[99534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:07:47 devstack sudo[99534]: pam_unix(sudo:session): session closed for user root Sep 07 10:07:47 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-c9a3f890-437f-48ac-a8a5-dcde4262cd0a tempest-CinderUnicodeTest-1998667154 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-518fe8d0-45f0-495e-bb8a-ed6f33c207cc" returned: 0 in 0.719s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:07:47 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-c9a3f890-437f-48ac-a8a5-dcde4262cd0a tempest-CinderUnicodeTest-1998667154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-518fe8d0-45f0-495e-bb8a-ed6f33c207cc {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:07:47 devstack sudo[99540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-518fe8d0-45f0-495e-bb8a-ed6f33c207cc Sep 07 10:07:47 devstack sudo[99540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:07:48 devstack sudo[99540]: pam_unix(sudo:session): session closed for user root Sep 07 10:07:48 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-c9a3f890-437f-48ac-a8a5-dcde4262cd0a tempest-CinderUnicodeTest-1998667154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-518fe8d0-45f0-495e-bb8a-ed6f33c207cc" returned: 0 in 0.527s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:07:48 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-c9a3f890-437f-48ac-a8a5-dcde4262cd0a tempest-CinderUnicodeTest-1998667154 None] Lock "cinder-quobyte-518fe8d0-45f0-495e-bb8a-ed6f33c207cc" released by "delete_volume" :: held 1.350s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:07:48 devstack cinder-volume[87515]: DEBUG cinder.quota [None req-c9a3f890-437f-48ac-a8a5-dcde4262cd0a tempest-CinderUnicodeTest-1998667154 None] Created reservations ['1bf9d7ca-b8f9-4bd0-a3c0-aade48bbd176', 'ba9c758e-8f3f-4779-a0ab-5a29ab4b6d7d', 'df498857-e7f9-4fa7-9296-6b6d1b84d098', 'b745612d-dbb0-4cf4-a4b8-407fd8556d2c'] {{(pid=87515) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:07:48 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-c9a3f890-437f-48ac-a8a5-dcde4262cd0a tempest-CinderUnicodeTest-1998667154 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:07:48 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-c9a3f890-437f-48ac-a8a5-dcde4262cd0a tempest-CinderUnicodeTest-1998667154 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:07:48 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-c9a3f890-437f-48ac-a8a5-dcde4262cd0a tempest-CinderUnicodeTest-1998667154 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:07:48 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-c9a3f890-437f-48ac-a8a5-dcde4262cd0a tempest-CinderUnicodeTest-1998667154 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:07:48 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-c9a3f890-437f-48ac-a8a5-dcde4262cd0a tempest-CinderUnicodeTest-1998667154 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.040s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:07:48 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-c9a3f890-437f-48ac-a8a5-dcde4262cd0a tempest-CinderUnicodeTest-1998667154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:07:48 devstack sudo[99546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a Sep 07 10:07:48 devstack sudo[99546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:07:48 devstack sudo[99546]: pam_unix(sudo:session): session closed for user root Sep 07 10:07:48 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-c9a3f890-437f-48ac-a8a5-dcde4262cd0a tempest-CinderUnicodeTest-1998667154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a" returned: 0 in 0.408s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:07:48 devstack cinder-volume[87515]: DEBUG cinder.manager [None req-c9a3f890-437f-48ac-a8a5-dcde4262cd0a tempest-CinderUnicodeTest-1998667154 None] Notifying Schedulers of capabilities ... {{(pid=87515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:07:48 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-c9a3f890-437f-48ac-a8a5-dcde4262cd0a tempest-CinderUnicodeTest-1998667154 None] Deleted volume successfully. Sep 07 10:07:49 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-c9a3f890-437f-48ac-a8a5-dcde4262cd0a tempest-CinderUnicodeTest-1998667154 None] Lock "cinder-518fe8d0-45f0-495e-bb8a-ed6f33c207cc-delete_volume" released by "delete_volume" :: held 2.319s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:07:49 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-616a2f3e-48ac-4ecc-910a-cfe2f81993c9 tempest-CinderUnicodeTest-1998667154 None] Acquiring lock "cinder-b3133c93-7ab2-4645-9c9d-ebd331f5a20a-delete_volume" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:07:49 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-616a2f3e-48ac-4ecc-910a-cfe2f81993c9 tempest-CinderUnicodeTest-1998667154 None] Lock "cinder-b3133c93-7ab2-4645-9c9d-ebd331f5a20a-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:07:49 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-616a2f3e-48ac-4ecc-910a-cfe2f81993c9 tempest-CinderUnicodeTest-1998667154 None] Acquiring lock "cinder-quobyte-b3133c93-7ab2-4645-9c9d-ebd331f5a20a" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:07:49 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-616a2f3e-48ac-4ecc-910a-cfe2f81993c9 tempest-CinderUnicodeTest-1998667154 None] Lock "cinder-quobyte-b3133c93-7ab2-4645-9c9d-ebd331f5a20a" acquired by "delete_volume" :: waited 0.024s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:07:49 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[dab4aca0-b268-48d4-9ec8-4d82b5100596]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:07:49 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-616a2f3e-48ac-4ecc-910a-cfe2f81993c9 tempest-CinderUnicodeTest-1998667154 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-b3133c93-7ab2-4645-9c9d-ebd331f5a20a {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:07:49 devstack sudo[99550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-b3133c93-7ab2-4645-9c9d-ebd331f5a20a Sep 07 10:07:49 devstack sudo[99550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:07:49 devstack sudo[99550]: pam_unix(sudo:session): session closed for user root Sep 07 10:07:49 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-616a2f3e-48ac-4ecc-910a-cfe2f81993c9 tempest-CinderUnicodeTest-1998667154 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-b3133c93-7ab2-4645-9c9d-ebd331f5a20a" returned: 0 in 0.530s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:07:49 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-616a2f3e-48ac-4ecc-910a-cfe2f81993c9 tempest-CinderUnicodeTest-1998667154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-b3133c93-7ab2-4645-9c9d-ebd331f5a20a {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:07:49 devstack sudo[99556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-b3133c93-7ab2-4645-9c9d-ebd331f5a20a Sep 07 10:07:49 devstack sudo[99556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:07:50 devstack sudo[99556]: pam_unix(sudo:session): session closed for user root Sep 07 10:07:50 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-616a2f3e-48ac-4ecc-910a-cfe2f81993c9 tempest-CinderUnicodeTest-1998667154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-b3133c93-7ab2-4645-9c9d-ebd331f5a20a" returned: 0 in 0.450s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:07:50 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-4c116f37-378f-430a-bed9-52a341fc4374 tempest-BackendsCapabilitiesAdminTestsJSON-311714858 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.5995826721191, 'free_capacity_gb': 1773.5995826721191, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87515) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 07 10:07:50 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-616a2f3e-48ac-4ecc-910a-cfe2f81993c9 tempest-CinderUnicodeTest-1998667154 None] Lock "cinder-quobyte-b3133c93-7ab2-4645-9c9d-ebd331f5a20a" released by "delete_volume" :: held 1.066s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:07:50 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-3c1ec07a-ac17-4a43-9ba1-5adcef97283e tempest-BackendsCapabilitiesAdminTestsJSON-311714858 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.5995826721191, 'free_capacity_gb': 1773.5995826721191, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87515) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 07 10:07:50 devstack cinder-volume[87515]: DEBUG cinder.quota [None req-616a2f3e-48ac-4ecc-910a-cfe2f81993c9 tempest-CinderUnicodeTest-1998667154 None] Created reservations ['2e11e757-b319-4d13-91e5-c45cf30bc12d', 'cd74c8b3-cbd4-4a21-a09a-547d740132a3', '0e7702ad-dcb9-4514-ad4f-cc33fcaa5d67', 'a4ff22bf-886d-4281-b1bc-0e58ecd81408'] {{(pid=87515) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:07:50 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-616a2f3e-48ac-4ecc-910a-cfe2f81993c9 tempest-CinderUnicodeTest-1998667154 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:07:50 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-616a2f3e-48ac-4ecc-910a-cfe2f81993c9 tempest-CinderUnicodeTest-1998667154 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:07:50 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-616a2f3e-48ac-4ecc-910a-cfe2f81993c9 tempest-CinderUnicodeTest-1998667154 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:07:50 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-616a2f3e-48ac-4ecc-910a-cfe2f81993c9 tempest-CinderUnicodeTest-1998667154 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:07:50 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-616a2f3e-48ac-4ecc-910a-cfe2f81993c9 tempest-CinderUnicodeTest-1998667154 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:07:50 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-616a2f3e-48ac-4ecc-910a-cfe2f81993c9 tempest-CinderUnicodeTest-1998667154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:07:50 devstack sudo[99559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a Sep 07 10:07:50 devstack sudo[99559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:07:50 devstack sudo[99559]: pam_unix(sudo:session): session closed for user root Sep 07 10:07:50 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-616a2f3e-48ac-4ecc-910a-cfe2f81993c9 tempest-CinderUnicodeTest-1998667154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a" returned: 0 in 0.334s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:07:50 devstack cinder-volume[87515]: DEBUG cinder.manager [None req-616a2f3e-48ac-4ecc-910a-cfe2f81993c9 tempest-CinderUnicodeTest-1998667154 None] Notifying Schedulers of capabilities ... {{(pid=87515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:07:50 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-616a2f3e-48ac-4ecc-910a-cfe2f81993c9 tempest-CinderUnicodeTest-1998667154 None] Deleted volume successfully. Sep 07 10:07:50 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-616a2f3e-48ac-4ecc-910a-cfe2f81993c9 tempest-CinderUnicodeTest-1998667154 None] Lock "cinder-b3133c93-7ab2-4645-9c9d-ebd331f5a20a-delete_volume" released by "delete_volume" :: held 1.739s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:07:56 devstack cinder-volume[87515]: DEBUG cinder.volume.flows.manager.create_volume [None req-f1676ac6-7766-4845-bc89-f3180fbc2e61 tempest-ProjectReaderTests-244930375 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 10:07:56 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-f1676ac6-7766-4845-bc89-f3180fbc2e61 tempest-ProjectReaderTests-244930375 None] Flow 'volume_create_manager' (1d5fcb64-7d73-48cd-81d9-eca1a5759956) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:07:56 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-f1676ac6-7766-4845-bc89-f3180fbc2e61 tempest-ProjectReaderTests-244930375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c6df2b2-4b50-4cec-83d7-97ce309a7128) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:07:56 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-f1676ac6-7766-4845-bc89-f3180fbc2e61 tempest-ProjectReaderTests-244930375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c6df2b2-4b50-4cec-83d7-97ce309a7128) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:07:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1491932947',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d3cb0c7-b6af-435c-810b-2c0f42b47506,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d436ee0c299446ba5d34e69f1fb4ff7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:07:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:07:57Z,use_quota=True,user_id='ab024edd41614a568a8b0bae2eadd44e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3a092cd-7947-4cbf-abff-4ba9567becf0),volume_type_id=f3a092cd-7947-4cbf-abff-4ba9567becf0)' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:07:56 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-f1676ac6-7766-4845-bc89-f3180fbc2e61 tempest-ProjectReaderTests-244930375 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0789c7a-85bd-45a5-b6b2-56b7b207cdc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:07:56 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-f1676ac6-7766-4845-bc89-f3180fbc2e61 tempest-ProjectReaderTests-244930375 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0789c7a-85bd-45a5-b6b2-56b7b207cdc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:07:56 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-f1676ac6-7766-4845-bc89-f3180fbc2e61 tempest-ProjectReaderTests-244930375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1704f85a-1c3a-4684-a493-738279dbb31f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:07:56 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-f1676ac6-7766-4845-bc89-f3180fbc2e61 tempest-ProjectReaderTests-244930375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1704f85a-1c3a-4684-a493-738279dbb31f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6d3cb0c7-b6af-435c-810b-2c0f42b47506', 'volume_name': 'volume-6d3cb0c7-b6af-435c-810b-2c0f42b47506', 'volume_size': 1}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:07:56 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-f1676ac6-7766-4845-bc89-f3180fbc2e61 tempest-ProjectReaderTests-244930375 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71ba7770-7530-497b-8abc-7db8ad734ca2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:07:56 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-f1676ac6-7766-4845-bc89-f3180fbc2e61 tempest-ProjectReaderTests-244930375 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71ba7770-7530-497b-8abc-7db8ad734ca2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:07:56 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-f1676ac6-7766-4845-bc89-f3180fbc2e61 tempest-ProjectReaderTests-244930375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44e01f69-f57e-4cec-8a1b-ef78e8f405c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:07:56 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-f1676ac6-7766-4845-bc89-f3180fbc2e61 tempest-ProjectReaderTests-244930375 None] Volume 6d3cb0c7-b6af-435c-810b-2c0f42b47506: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6d3cb0c7-b6af-435c-810b-2c0f42b47506', 'volume_size': 1} Sep 07 10:07:56 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-f1676ac6-7766-4845-bc89-f3180fbc2e61 tempest-ProjectReaderTests-244930375 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:07:56 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-f1676ac6-7766-4845-bc89-f3180fbc2e61 tempest-ProjectReaderTests-244930375 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:07:56 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-f1676ac6-7766-4845-bc89-f3180fbc2e61 tempest-ProjectReaderTests-244930375 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:07:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1491932947',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d3cb0c7-b6af-435c-810b-2c0f42b47506,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d436ee0c299446ba5d34e69f1fb4ff7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:07:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:07:57Z,use_quota=True,user_id='ab024edd41614a568a8b0bae2eadd44e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3a092cd-7947-4cbf-abff-4ba9567becf0),volume_type_id=f3a092cd-7947-4cbf-abff-4ba9567becf0)}" {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 10:07:56 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-f1676ac6-7766-4845-bc89-f3180fbc2e61 tempest-ProjectReaderTests-244930375 None] Creating volume 6d3cb0c7-b6af-435c-810b-2c0f42b47506 {{(pid=87515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 10:07:56 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-f1676ac6-7766-4845-bc89-f3180fbc2e61 tempest-ProjectReaderTests-244930375 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:07:56 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-f1676ac6-7766-4845-bc89-f3180fbc2e61 tempest-ProjectReaderTests-244930375 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:07:56 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-f1676ac6-7766-4845-bc89-f3180fbc2e61 tempest-ProjectReaderTests-244930375 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:07:56 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-f1676ac6-7766-4845-bc89-f3180fbc2e61 tempest-ProjectReaderTests-244930375 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:07:56 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-f1676ac6-7766-4845-bc89-f3180fbc2e61 tempest-ProjectReaderTests-244930375 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:07:56 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-f1676ac6-7766-4845-bc89-f3180fbc2e61 tempest-ProjectReaderTests-244930375 None] Selected osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c as target Quobyte volume. {{(pid=87515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 10:07:56 devstack cinder-volume[87515]: INFO cinder.volume.drivers.remotefs [None req-f1676ac6-7766-4845-bc89-f3180fbc2e61 tempest-ProjectReaderTests-244930375 None] casted to osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c Sep 07 10:07:56 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-f1676ac6-7766-4845-bc89-f3180fbc2e61 tempest-ProjectReaderTests-244930375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-6d3cb0c7-b6af-435c-810b-2c0f42b47506 1073741824 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:07:56 devstack sudo[99600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-6d3cb0c7-b6af-435c-810b-2c0f42b47506 1073741824 Sep 07 10:07:56 devstack sudo[99600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:07:57 devstack sudo[99600]: pam_unix(sudo:session): session closed for user root Sep 07 10:07:57 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-f1676ac6-7766-4845-bc89-f3180fbc2e61 tempest-ProjectReaderTests-244930375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-6d3cb0c7-b6af-435c-810b-2c0f42b47506 1073741824" returned: 0 in 0.543s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:07:57 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-f1676ac6-7766-4845-bc89-f3180fbc2e61 tempest-ProjectReaderTests-244930375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-6d3cb0c7-b6af-435c-810b-2c0f42b47506 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:07:57 devstack sudo[99608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-6d3cb0c7-b6af-435c-810b-2c0f42b47506 Sep 07 10:07:57 devstack sudo[99608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:07:57 devstack sudo[99608]: pam_unix(sudo:session): session closed for user root Sep 07 10:07:57 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-f1676ac6-7766-4845-bc89-f3180fbc2e61 tempest-ProjectReaderTests-244930375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-6d3cb0c7-b6af-435c-810b-2c0f42b47506" returned: 0 in 0.293s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:07:57 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-f1676ac6-7766-4845-bc89-f3180fbc2e61 tempest-ProjectReaderTests-244930375 None] <== create_volume: return (946ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'} {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 10:07:57 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-f1676ac6-7766-4845-bc89-f3180fbc2e61 tempest-ProjectReaderTests-244930375 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.949s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:07:57 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-f1676ac6-7766-4845-bc89-f3180fbc2e61 tempest-ProjectReaderTests-244930375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44e01f69-f57e-4cec-8a1b-ef78e8f405c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6d3cb0c7-b6af-435c-810b-2c0f42b47506', 'volume_size': 1}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:07:57 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-f1676ac6-7766-4845-bc89-f3180fbc2e61 tempest-ProjectReaderTests-244930375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0262ad1-48dd-4c9b-b8fa-b0a4b8734291) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:07:57 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-f1676ac6-7766-4845-bc89-f3180fbc2e61 tempest-ProjectReaderTests-244930375 None] Volume volume-6d3cb0c7-b6af-435c-810b-2c0f42b47506 (6d3cb0c7-b6af-435c-810b-2c0f42b47506): created successfully Sep 07 10:07:57 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-f1676ac6-7766-4845-bc89-f3180fbc2e61 tempest-ProjectReaderTests-244930375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0262ad1-48dd-4c9b-b8fa-b0a4b8734291) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:07:57 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-f1676ac6-7766-4845-bc89-f3180fbc2e61 tempest-ProjectReaderTests-244930375 None] Flow 'volume_create_manager' (1d5fcb64-7d73-48cd-81d9-eca1a5759956) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:07:57 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-f1676ac6-7766-4845-bc89-f3180fbc2e61 tempest-ProjectReaderTests-244930375 None] Created volume successfully. Sep 07 10:07:58 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-51648af0-64f5-4831-a0c4-4df8d89030c7 tempest-GroupSnapshotsV319Test-2045935185 None] Group tempest-GroupSnapshotsV319Test-Group-318656759: creating Sep 07 10:07:58 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-51648af0-64f5-4831-a0c4-4df8d89030c7 tempest-GroupSnapshotsV319Test-2045935185 None] Group tempest-GroupSnapshotsV319Test-Group-318656759: created successfully Sep 07 10:07:58 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-51648af0-64f5-4831-a0c4-4df8d89030c7 tempest-GroupSnapshotsV319Test-2045935185 None] Create group completed successfully. Sep 07 10:07:59 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-e606fe35-8d08-4044-8720-50fc8cec38aa tempest-ProjectReaderTests-244930375 None] Acquiring lock "cinder-6d3cb0c7-b6af-435c-810b-2c0f42b47506-delete_volume" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:07:59 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-e606fe35-8d08-4044-8720-50fc8cec38aa tempest-ProjectReaderTests-244930375 None] Lock "cinder-6d3cb0c7-b6af-435c-810b-2c0f42b47506-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:07:59 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-e606fe35-8d08-4044-8720-50fc8cec38aa tempest-ProjectReaderTests-244930375 None] Acquiring lock "cinder-quobyte-6d3cb0c7-b6af-435c-810b-2c0f42b47506" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:07:59 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-e606fe35-8d08-4044-8720-50fc8cec38aa tempest-ProjectReaderTests-244930375 None] Lock "cinder-quobyte-6d3cb0c7-b6af-435c-810b-2c0f42b47506" acquired by "delete_volume" :: waited 0.023s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:07:59 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[be6c81e6-e365-486f-a128-3f38d8cfc97b]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:07:59 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-e606fe35-8d08-4044-8720-50fc8cec38aa tempest-ProjectReaderTests-244930375 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-6d3cb0c7-b6af-435c-810b-2c0f42b47506 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:07:59 devstack sudo[99612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-6d3cb0c7-b6af-435c-810b-2c0f42b47506 Sep 07 10:07:59 devstack sudo[99612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:07:59 devstack sudo[99612]: pam_unix(sudo:session): session closed for user root Sep 07 10:07:59 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-e606fe35-8d08-4044-8720-50fc8cec38aa tempest-ProjectReaderTests-244930375 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-6d3cb0c7-b6af-435c-810b-2c0f42b47506" returned: 0 in 0.397s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:07:59 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-e606fe35-8d08-4044-8720-50fc8cec38aa tempest-ProjectReaderTests-244930375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-6d3cb0c7-b6af-435c-810b-2c0f42b47506 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:07:59 devstack sudo[99617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-6d3cb0c7-b6af-435c-810b-2c0f42b47506 Sep 07 10:07:59 devstack sudo[99617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:07:59 devstack sudo[99617]: pam_unix(sudo:session): session closed for user root Sep 07 10:07:59 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-e606fe35-8d08-4044-8720-50fc8cec38aa tempest-ProjectReaderTests-244930375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-6d3cb0c7-b6af-435c-810b-2c0f42b47506" returned: 0 in 0.316s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:07:59 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-e606fe35-8d08-4044-8720-50fc8cec38aa tempest-ProjectReaderTests-244930375 None] Lock "cinder-quobyte-6d3cb0c7-b6af-435c-810b-2c0f42b47506" released by "delete_volume" :: held 0.764s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:08:00 devstack cinder-volume[87515]: DEBUG cinder.quota [None req-e606fe35-8d08-4044-8720-50fc8cec38aa tempest-ProjectReaderTests-244930375 None] Created reservations ['05bc20b7-3098-4b52-83ae-982c06acf21d', 'a0ad7024-52e3-4b8c-880e-bf8a12247358', '05498a47-4599-4cbb-a6ae-c77c329ef0fa', '84d3228c-b5f2-4514-9dae-f6f36cea8cc4'] {{(pid=87515) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:08:00 devstack cinder-volume[87515]: DEBUG cinder.volume.flows.manager.create_volume [None req-96e5577b-0b6e-4012-b188-ac2d5617cbf3 tempest-GroupSnapshotsV319Test-2045935185 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 10:08:00 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-96e5577b-0b6e-4012-b188-ac2d5617cbf3 tempest-GroupSnapshotsV319Test-2045935185 None] Flow 'volume_create_manager' (3c42879a-d2fc-4248-bb35-3455f7dea1dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:08:00 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-96e5577b-0b6e-4012-b188-ac2d5617cbf3 tempest-GroupSnapshotsV319Test-2045935185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f23fff4-60f4-4b01-aa28-4848da3a757f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:08:00 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-e606fe35-8d08-4044-8720-50fc8cec38aa tempest-ProjectReaderTests-244930375 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:08:00 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-e606fe35-8d08-4044-8720-50fc8cec38aa tempest-ProjectReaderTests-244930375 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:08:00 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-e606fe35-8d08-4044-8720-50fc8cec38aa tempest-ProjectReaderTests-244930375 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:08:00 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-e606fe35-8d08-4044-8720-50fc8cec38aa tempest-ProjectReaderTests-244930375 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:08:00 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-e606fe35-8d08-4044-8720-50fc8cec38aa tempest-ProjectReaderTests-244930375 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:08:00 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-e606fe35-8d08-4044-8720-50fc8cec38aa tempest-ProjectReaderTests-244930375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:08:00 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-96e5577b-0b6e-4012-b188-ac2d5617cbf3 tempest-GroupSnapshotsV319Test-2045935185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f23fff4-60f4-4b01-aa28-4848da3a757f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:08:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-124331966',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b527989f-061a-4780-97f0-75933aff68ec,host='devstack@QuobyteHD#QuobyteHD',id=e608178a-3df8-45f9-a240-211afe6d5457,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='065439f3e87e4d6b8f5519971b11f1a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:08:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:08:00Z,use_quota=True,user_id='eb5fe4e0b2e2415899ce3d6925d1db6b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35ff1c95-900e-43d9-a8c0-56f86a86f2e3),volume_type_id=35ff1c95-900e-43d9-a8c0-56f86a86f2e3)' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:08:00 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-96e5577b-0b6e-4012-b188-ac2d5617cbf3 tempest-GroupSnapshotsV319Test-2045935185 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73098e94-27c9-4796-8e77-cecb3035f2b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:08:00 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-96e5577b-0b6e-4012-b188-ac2d5617cbf3 tempest-GroupSnapshotsV319Test-2045935185 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73098e94-27c9-4796-8e77-cecb3035f2b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:08:00 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-96e5577b-0b6e-4012-b188-ac2d5617cbf3 tempest-GroupSnapshotsV319Test-2045935185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7cb5350f-f48c-46ab-b3c6-7be5b2fdd3cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:08:00 devstack sudo[99620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a Sep 07 10:08:00 devstack sudo[99620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:08:00 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-96e5577b-0b6e-4012-b188-ac2d5617cbf3 tempest-GroupSnapshotsV319Test-2045935185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7cb5350f-f48c-46ab-b3c6-7be5b2fdd3cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e608178a-3df8-45f9-a240-211afe6d5457', 'volume_name': 'volume-e608178a-3df8-45f9-a240-211afe6d5457', 'volume_size': 1}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:08:00 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-96e5577b-0b6e-4012-b188-ac2d5617cbf3 tempest-GroupSnapshotsV319Test-2045935185 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93d62a9f-793a-47a4-9659-71adef815e66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:08:00 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-96e5577b-0b6e-4012-b188-ac2d5617cbf3 tempest-GroupSnapshotsV319Test-2045935185 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93d62a9f-793a-47a4-9659-71adef815e66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:08:00 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-96e5577b-0b6e-4012-b188-ac2d5617cbf3 tempest-GroupSnapshotsV319Test-2045935185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b382036-f45a-4518-906f-40547a643151) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:08:00 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-96e5577b-0b6e-4012-b188-ac2d5617cbf3 tempest-GroupSnapshotsV319Test-2045935185 None] Volume e608178a-3df8-45f9-a240-211afe6d5457: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e608178a-3df8-45f9-a240-211afe6d5457', 'volume_size': 1} Sep 07 10:08:00 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-96e5577b-0b6e-4012-b188-ac2d5617cbf3 tempest-GroupSnapshotsV319Test-2045935185 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:08:00 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-96e5577b-0b6e-4012-b188-ac2d5617cbf3 tempest-GroupSnapshotsV319Test-2045935185 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:08:00 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-96e5577b-0b6e-4012-b188-ac2d5617cbf3 tempest-GroupSnapshotsV319Test-2045935185 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=b527989f-061a-4780-97f0-75933aff68ec,created_at=2026-09-07T08:08:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-124331966',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b527989f-061a-4780-97f0-75933aff68ec,host='devstack@QuobyteHD#QuobyteHD',id=e608178a-3df8-45f9-a240-211afe6d5457,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='065439f3e87e4d6b8f5519971b11f1a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:08:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:08:00Z,use_quota=True,user_id='eb5fe4e0b2e2415899ce3d6925d1db6b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35ff1c95-900e-43d9-a8c0-56f86a86f2e3),volume_type_id=35ff1c95-900e-43d9-a8c0-56f86a86f2e3)}" {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 10:08:00 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-96e5577b-0b6e-4012-b188-ac2d5617cbf3 tempest-GroupSnapshotsV319Test-2045935185 None] Creating volume e608178a-3df8-45f9-a240-211afe6d5457 {{(pid=87515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 10:08:00 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-96e5577b-0b6e-4012-b188-ac2d5617cbf3 tempest-GroupSnapshotsV319Test-2045935185 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:08:00 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-96e5577b-0b6e-4012-b188-ac2d5617cbf3 tempest-GroupSnapshotsV319Test-2045935185 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:08:00 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-96e5577b-0b6e-4012-b188-ac2d5617cbf3 tempest-GroupSnapshotsV319Test-2045935185 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:08:00 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-96e5577b-0b6e-4012-b188-ac2d5617cbf3 tempest-GroupSnapshotsV319Test-2045935185 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:08:00 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-96e5577b-0b6e-4012-b188-ac2d5617cbf3 tempest-GroupSnapshotsV319Test-2045935185 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:08:00 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-96e5577b-0b6e-4012-b188-ac2d5617cbf3 tempest-GroupSnapshotsV319Test-2045935185 None] Selected osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c as target Quobyte volume. {{(pid=87515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 10:08:00 devstack cinder-volume[87515]: INFO cinder.volume.drivers.remotefs [None req-96e5577b-0b6e-4012-b188-ac2d5617cbf3 tempest-GroupSnapshotsV319Test-2045935185 None] casted to osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c Sep 07 10:08:00 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-96e5577b-0b6e-4012-b188-ac2d5617cbf3 tempest-GroupSnapshotsV319Test-2045935185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-e608178a-3df8-45f9-a240-211afe6d5457 1073741824 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:08:00 devstack sudo[99622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-e608178a-3df8-45f9-a240-211afe6d5457 1073741824 Sep 07 10:08:00 devstack sudo[99622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:08:00 devstack sudo[99620]: pam_unix(sudo:session): session closed for user root Sep 07 10:08:00 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-e606fe35-8d08-4044-8720-50fc8cec38aa tempest-ProjectReaderTests-244930375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a" returned: 0 in 0.411s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:08:00 devstack cinder-volume[87515]: DEBUG cinder.manager [None req-e606fe35-8d08-4044-8720-50fc8cec38aa tempest-ProjectReaderTests-244930375 None] Notifying Schedulers of capabilities ... {{(pid=87515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:08:00 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-e606fe35-8d08-4044-8720-50fc8cec38aa tempest-ProjectReaderTests-244930375 None] Deleted volume successfully. Sep 07 10:08:00 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-e606fe35-8d08-4044-8720-50fc8cec38aa tempest-ProjectReaderTests-244930375 None] Lock "cinder-6d3cb0c7-b6af-435c-810b-2c0f42b47506-delete_volume" released by "delete_volume" :: held 1.616s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:08:00 devstack sudo[99622]: pam_unix(sudo:session): session closed for user root Sep 07 10:08:00 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-96e5577b-0b6e-4012-b188-ac2d5617cbf3 tempest-GroupSnapshotsV319Test-2045935185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-e608178a-3df8-45f9-a240-211afe6d5457 1073741824" returned: 0 in 0.635s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:08:01 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-96e5577b-0b6e-4012-b188-ac2d5617cbf3 tempest-GroupSnapshotsV319Test-2045935185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-e608178a-3df8-45f9-a240-211afe6d5457 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:08:01 devstack sudo[99629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-e608178a-3df8-45f9-a240-211afe6d5457 Sep 07 10:08:01 devstack sudo[99629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:08:01 devstack cinder-volume[87515]: DEBUG cinder.volume.flows.manager.create_volume [None req-cd66872d-4d2e-45df-95d1-9c90d36efa8e tempest-ProjectReaderTests-244930375 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 10:08:01 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-cd66872d-4d2e-45df-95d1-9c90d36efa8e tempest-ProjectReaderTests-244930375 None] Flow 'volume_create_manager' (ee47ff42-eb0b-42b7-b2c8-7ad0a47dc3bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:08:01 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-cd66872d-4d2e-45df-95d1-9c90d36efa8e tempest-ProjectReaderTests-244930375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b13166b-3733-487a-90fb-cc364646bb4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:08:01 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-cd66872d-4d2e-45df-95d1-9c90d36efa8e tempest-ProjectReaderTests-244930375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b13166b-3733-487a-90fb-cc364646bb4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:08:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-245318898',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=127808c7-e67b-44b1-9d1e-1945a216390e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d436ee0c299446ba5d34e69f1fb4ff7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:08:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:08:01Z,use_quota=True,user_id='ab024edd41614a568a8b0bae2eadd44e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3a092cd-7947-4cbf-abff-4ba9567becf0),volume_type_id=f3a092cd-7947-4cbf-abff-4ba9567becf0)' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:08:01 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-cd66872d-4d2e-45df-95d1-9c90d36efa8e tempest-ProjectReaderTests-244930375 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e59f77bf-0ab3-4c51-bae5-30d541f15a80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:08:01 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-cd66872d-4d2e-45df-95d1-9c90d36efa8e tempest-ProjectReaderTests-244930375 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e59f77bf-0ab3-4c51-bae5-30d541f15a80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:08:01 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-cd66872d-4d2e-45df-95d1-9c90d36efa8e tempest-ProjectReaderTests-244930375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d9ece1d-85ef-4564-9fcf-a2861ef4b336) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:08:01 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-cd66872d-4d2e-45df-95d1-9c90d36efa8e tempest-ProjectReaderTests-244930375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d9ece1d-85ef-4564-9fcf-a2861ef4b336) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '127808c7-e67b-44b1-9d1e-1945a216390e', 'volume_name': 'volume-127808c7-e67b-44b1-9d1e-1945a216390e', 'volume_size': 1}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:08:01 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-cd66872d-4d2e-45df-95d1-9c90d36efa8e tempest-ProjectReaderTests-244930375 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49067fb8-7103-446a-ab38-45c8d1e669e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:08:01 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-cd66872d-4d2e-45df-95d1-9c90d36efa8e tempest-ProjectReaderTests-244930375 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49067fb8-7103-446a-ab38-45c8d1e669e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:08:01 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-cd66872d-4d2e-45df-95d1-9c90d36efa8e tempest-ProjectReaderTests-244930375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c194f3f9-595b-42c0-9810-70ae648f72da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:08:01 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-cd66872d-4d2e-45df-95d1-9c90d36efa8e tempest-ProjectReaderTests-244930375 None] Volume 127808c7-e67b-44b1-9d1e-1945a216390e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-127808c7-e67b-44b1-9d1e-1945a216390e', 'volume_size': 1} Sep 07 10:08:01 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-cd66872d-4d2e-45df-95d1-9c90d36efa8e tempest-ProjectReaderTests-244930375 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:08:01 devstack sudo[99629]: pam_unix(sudo:session): session closed for user root Sep 07 10:08:01 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-96e5577b-0b6e-4012-b188-ac2d5617cbf3 tempest-GroupSnapshotsV319Test-2045935185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-e608178a-3df8-45f9-a240-211afe6d5457" returned: 0 in 0.309s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:08:01 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-96e5577b-0b6e-4012-b188-ac2d5617cbf3 tempest-GroupSnapshotsV319Test-2045935185 None] <== create_volume: return (1000ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'} {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 10:08:01 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-96e5577b-0b6e-4012-b188-ac2d5617cbf3 tempest-GroupSnapshotsV319Test-2045935185 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.002s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:08:01 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-cd66872d-4d2e-45df-95d1-9c90d36efa8e tempest-ProjectReaderTests-244930375 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.063s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:08:01 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-cd66872d-4d2e-45df-95d1-9c90d36efa8e tempest-ProjectReaderTests-244930375 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:08:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-245318898',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=127808c7-e67b-44b1-9d1e-1945a216390e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d436ee0c299446ba5d34e69f1fb4ff7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:08:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:08:01Z,use_quota=True,user_id='ab024edd41614a568a8b0bae2eadd44e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3a092cd-7947-4cbf-abff-4ba9567becf0),volume_type_id=f3a092cd-7947-4cbf-abff-4ba9567becf0)}" {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 10:08:01 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-cd66872d-4d2e-45df-95d1-9c90d36efa8e tempest-ProjectReaderTests-244930375 None] Creating volume 127808c7-e67b-44b1-9d1e-1945a216390e {{(pid=87515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 10:08:01 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-cd66872d-4d2e-45df-95d1-9c90d36efa8e tempest-ProjectReaderTests-244930375 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:08:01 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-cd66872d-4d2e-45df-95d1-9c90d36efa8e tempest-ProjectReaderTests-244930375 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:08:01 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-cd66872d-4d2e-45df-95d1-9c90d36efa8e tempest-ProjectReaderTests-244930375 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:08:01 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-cd66872d-4d2e-45df-95d1-9c90d36efa8e tempest-ProjectReaderTests-244930375 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:08:01 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-cd66872d-4d2e-45df-95d1-9c90d36efa8e tempest-ProjectReaderTests-244930375 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:08:01 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-cd66872d-4d2e-45df-95d1-9c90d36efa8e tempest-ProjectReaderTests-244930375 None] Selected osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c as target Quobyte volume. {{(pid=87515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 10:08:01 devstack cinder-volume[87515]: INFO cinder.volume.drivers.remotefs [None req-cd66872d-4d2e-45df-95d1-9c90d36efa8e tempest-ProjectReaderTests-244930375 None] casted to osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c Sep 07 10:08:01 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-cd66872d-4d2e-45df-95d1-9c90d36efa8e tempest-ProjectReaderTests-244930375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-127808c7-e67b-44b1-9d1e-1945a216390e 1073741824 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:08:01 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-96e5577b-0b6e-4012-b188-ac2d5617cbf3 tempest-GroupSnapshotsV319Test-2045935185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b382036-f45a-4518-906f-40547a643151) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e608178a-3df8-45f9-a240-211afe6d5457', 'volume_size': 1}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:08:01 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-96e5577b-0b6e-4012-b188-ac2d5617cbf3 tempest-GroupSnapshotsV319Test-2045935185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90688752-fb0c-4cfb-a5b2-fdaab18f24e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:08:01 devstack sudo[99632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-127808c7-e67b-44b1-9d1e-1945a216390e 1073741824 Sep 07 10:08:01 devstack sudo[99632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:08:01 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-96e5577b-0b6e-4012-b188-ac2d5617cbf3 tempest-GroupSnapshotsV319Test-2045935185 None] Volume volume-e608178a-3df8-45f9-a240-211afe6d5457 (e608178a-3df8-45f9-a240-211afe6d5457): created successfully Sep 07 10:08:01 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-96e5577b-0b6e-4012-b188-ac2d5617cbf3 tempest-GroupSnapshotsV319Test-2045935185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90688752-fb0c-4cfb-a5b2-fdaab18f24e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:08:01 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-96e5577b-0b6e-4012-b188-ac2d5617cbf3 tempest-GroupSnapshotsV319Test-2045935185 None] Flow 'volume_create_manager' (3c42879a-d2fc-4248-bb35-3455f7dea1dc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:08:01 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-96e5577b-0b6e-4012-b188-ac2d5617cbf3 tempest-GroupSnapshotsV319Test-2045935185 None] Created volume successfully. Sep 07 10:08:01 devstack sudo[99632]: pam_unix(sudo:session): session closed for user root Sep 07 10:08:01 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-cd66872d-4d2e-45df-95d1-9c90d36efa8e tempest-ProjectReaderTests-244930375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-127808c7-e67b-44b1-9d1e-1945a216390e 1073741824" returned: 0 in 0.522s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:08:01 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-cd66872d-4d2e-45df-95d1-9c90d36efa8e tempest-ProjectReaderTests-244930375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-127808c7-e67b-44b1-9d1e-1945a216390e {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:08:01 devstack sudo[99648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-127808c7-e67b-44b1-9d1e-1945a216390e Sep 07 10:08:01 devstack sudo[99648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:08:02 devstack sudo[99648]: pam_unix(sudo:session): session closed for user root Sep 07 10:08:02 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-cd66872d-4d2e-45df-95d1-9c90d36efa8e tempest-ProjectReaderTests-244930375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-127808c7-e67b-44b1-9d1e-1945a216390e" returned: 0 in 0.321s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:08:02 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-cd66872d-4d2e-45df-95d1-9c90d36efa8e tempest-ProjectReaderTests-244930375 None] <== create_volume: return (903ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'} {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 10:08:02 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-cd66872d-4d2e-45df-95d1-9c90d36efa8e tempest-ProjectReaderTests-244930375 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.907s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:08:02 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-cd66872d-4d2e-45df-95d1-9c90d36efa8e tempest-ProjectReaderTests-244930375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c194f3f9-595b-42c0-9810-70ae648f72da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-127808c7-e67b-44b1-9d1e-1945a216390e', 'volume_size': 1}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:08:02 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-cd66872d-4d2e-45df-95d1-9c90d36efa8e tempest-ProjectReaderTests-244930375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60a18378-21bc-49cb-84c2-b486d0289ec6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:08:02 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-cd66872d-4d2e-45df-95d1-9c90d36efa8e tempest-ProjectReaderTests-244930375 None] Volume volume-127808c7-e67b-44b1-9d1e-1945a216390e (127808c7-e67b-44b1-9d1e-1945a216390e): created successfully Sep 07 10:08:02 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-cd66872d-4d2e-45df-95d1-9c90d36efa8e tempest-ProjectReaderTests-244930375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60a18378-21bc-49cb-84c2-b486d0289ec6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:08:02 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-cd66872d-4d2e-45df-95d1-9c90d36efa8e tempest-ProjectReaderTests-244930375 None] Flow 'volume_create_manager' (ee47ff42-eb0b-42b7-b2c8-7ad0a47dc3bb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:08:02 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-cd66872d-4d2e-45df-95d1-9c90d36efa8e tempest-ProjectReaderTests-244930375 None] Created volume successfully. Sep 07 10:08:02 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-495c7e61-efae-4f41-a74e-2a2fe18a4216 tempest-GroupSnapshotsV319Test-2045935185 None] GroupSnapshot 28c06744-1fec-4aa3-867f-d208803b8345: creating. Sep 07 10:08:02 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-495c7e61-efae-4f41-a74e-2a2fe18a4216 tempest-GroupSnapshotsV319Test-2045935185 None] Group snapshot 28c06744-1fec-4aa3-867f-d208803b8345: creating. {{(pid=87515) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 07 10:08:02 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-495c7e61-efae-4f41-a74e-2a2fe18a4216 tempest-GroupSnapshotsV319Test-2045935185 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:08:02 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-495c7e61-efae-4f41-a74e-2a2fe18a4216 tempest-GroupSnapshotsV319Test-2045935185 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:08:02 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-495c7e61-efae-4f41-a74e-2a2fe18a4216 tempest-GroupSnapshotsV319Test-2045935185 None] Creating offline snapshot 5314363f-90a0-404b-a928-5b1637f1e698 of volume e608178a-3df8-45f9-a240-211afe6d5457 {{(pid=87515) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 10:08:03 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[37910da3-021d-46a7-a5f3-5b3de513a6f6]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:08:03 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-495c7e61-efae-4f41-a74e-2a2fe18a4216 tempest-GroupSnapshotsV319Test-2045935185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-e608178a-3df8-45f9-a240-211afe6d5457 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:08:03 devstack sudo[99651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-e608178a-3df8-45f9-a240-211afe6d5457 Sep 07 10:08:03 devstack sudo[99651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:08:03 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-b6970106-eaa6-4011-87ce-cf3ef86b98ed tempest-ProjectReaderTests-244930375 None] Acquiring lock "cinder-127808c7-e67b-44b1-9d1e-1945a216390e-delete_volume" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:08:03 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-b6970106-eaa6-4011-87ce-cf3ef86b98ed tempest-ProjectReaderTests-244930375 None] Lock "cinder-127808c7-e67b-44b1-9d1e-1945a216390e-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:08:03 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-b6970106-eaa6-4011-87ce-cf3ef86b98ed tempest-ProjectReaderTests-244930375 None] Acquiring lock "cinder-quobyte-127808c7-e67b-44b1-9d1e-1945a216390e" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:08:03 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-b6970106-eaa6-4011-87ce-cf3ef86b98ed tempest-ProjectReaderTests-244930375 None] Lock "cinder-quobyte-127808c7-e67b-44b1-9d1e-1945a216390e" acquired by "delete_volume" :: waited 0.016s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:08:03 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ad29f72-74ed-4b1b-9158-50768d3fb08b]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:08:03 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-b6970106-eaa6-4011-87ce-cf3ef86b98ed tempest-ProjectReaderTests-244930375 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-127808c7-e67b-44b1-9d1e-1945a216390e {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:08:03 devstack sudo[99651]: pam_unix(sudo:session): session closed for user root Sep 07 10:08:03 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-495c7e61-efae-4f41-a74e-2a2fe18a4216 tempest-GroupSnapshotsV319Test-2045935185 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-e608178a-3df8-45f9-a240-211afe6d5457" returned: 0 in 0.441s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:08:03 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-495c7e61-efae-4f41-a74e-2a2fe18a4216 tempest-GroupSnapshotsV319Test-2045935185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-e608178a-3df8-45f9-a240-211afe6d5457,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-e608178a-3df8-45f9-a240-211afe6d5457.5314363f-90a0-404b-a928-5b1637f1e698 1G {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:08:03 devstack sudo[99658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-e608178a-3df8-45f9-a240-211afe6d5457,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-e608178a-3df8-45f9-a240-211afe6d5457.5314363f-90a0-404b-a928-5b1637f1e698 1G Sep 07 10:08:03 devstack sudo[99658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:08:03 devstack sudo[99657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-127808c7-e67b-44b1-9d1e-1945a216390e Sep 07 10:08:03 devstack sudo[99657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:08:03 devstack sudo[99657]: pam_unix(sudo:session): session closed for user root Sep 07 10:08:03 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-b6970106-eaa6-4011-87ce-cf3ef86b98ed tempest-ProjectReaderTests-244930375 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-127808c7-e67b-44b1-9d1e-1945a216390e" returned: 0 in 0.456s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:08:03 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-b6970106-eaa6-4011-87ce-cf3ef86b98ed tempest-ProjectReaderTests-244930375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-127808c7-e67b-44b1-9d1e-1945a216390e {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:08:03 devstack sudo[99658]: pam_unix(sudo:session): session closed for user root Sep 07 10:08:03 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-495c7e61-efae-4f41-a74e-2a2fe18a4216 tempest-GroupSnapshotsV319Test-2045935185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-e608178a-3df8-45f9-a240-211afe6d5457,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-e608178a-3df8-45f9-a240-211afe6d5457.5314363f-90a0-404b-a928-5b1637f1e698 1G" returned: 0 in 0.456s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:08:03 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-495c7e61-efae-4f41-a74e-2a2fe18a4216 tempest-GroupSnapshotsV319Test-2045935185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e608178a-3df8-45f9-a240-211afe6d5457 -F qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-e608178a-3df8-45f9-a240-211afe6d5457.5314363f-90a0-404b-a928-5b1637f1e698 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:08:03 devstack sudo[99668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-127808c7-e67b-44b1-9d1e-1945a216390e Sep 07 10:08:03 devstack sudo[99668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:08:03 devstack sudo[99669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e608178a-3df8-45f9-a240-211afe6d5457 -F qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-e608178a-3df8-45f9-a240-211afe6d5457.5314363f-90a0-404b-a928-5b1637f1e698 Sep 07 10:08:03 devstack sudo[99669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:08:04 devstack sudo[99668]: pam_unix(sudo:session): session closed for user root Sep 07 10:08:04 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-b6970106-eaa6-4011-87ce-cf3ef86b98ed tempest-ProjectReaderTests-244930375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-127808c7-e67b-44b1-9d1e-1945a216390e" returned: 0 in 0.265s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:08:04 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-b6970106-eaa6-4011-87ce-cf3ef86b98ed tempest-ProjectReaderTests-244930375 None] Lock "cinder-quobyte-127808c7-e67b-44b1-9d1e-1945a216390e" released by "delete_volume" :: held 0.775s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:08:04 devstack cinder-volume[87515]: DEBUG cinder.quota [None req-b6970106-eaa6-4011-87ce-cf3ef86b98ed tempest-ProjectReaderTests-244930375 None] Created reservations ['fb7204cc-0132-4b9e-a730-ebc1cade1044', 'b2ffb6eb-2b63-4a63-bb07-97d45bece2fb', 'a35a3b19-ba72-4da6-b380-2449f205c3aa', 'ed0d830c-9620-4764-ac00-2d8116404ff4'] {{(pid=87515) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:08:04 devstack sudo[99669]: pam_unix(sudo:session): session closed for user root Sep 07 10:08:04 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-495c7e61-efae-4f41-a74e-2a2fe18a4216 tempest-GroupSnapshotsV319Test-2045935185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e608178a-3df8-45f9-a240-211afe6d5457 -F qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-e608178a-3df8-45f9-a240-211afe6d5457.5314363f-90a0-404b-a928-5b1637f1e698" returned: 0 in 0.365s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:08:04 devstack cinder-volume[87515]: WARNING cinder.volume.drivers.remotefs [None req-495c7e61-efae-4f41-a74e-2a2fe18a4216 tempest-GroupSnapshotsV319Test-2045935185 None] /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-e608178a-3df8-45f9-a240-211afe6d5457.5314363f-90a0-404b-a928-5b1637f1e698 is being set with open permissions: ugo+rw: NotImplementedError Sep 07 10:08:04 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-495c7e61-efae-4f41-a74e-2a2fe18a4216 tempest-GroupSnapshotsV319Test-2045935185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-e608178a-3df8-45f9-a240-211afe6d5457.5314363f-90a0-404b-a928-5b1637f1e698 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:08:04 devstack sudo[99677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-e608178a-3df8-45f9-a240-211afe6d5457.5314363f-90a0-404b-a928-5b1637f1e698 Sep 07 10:08:04 devstack sudo[99677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:08:04 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-b6970106-eaa6-4011-87ce-cf3ef86b98ed tempest-ProjectReaderTests-244930375 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:08:04 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-b6970106-eaa6-4011-87ce-cf3ef86b98ed tempest-ProjectReaderTests-244930375 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:08:04 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-b6970106-eaa6-4011-87ce-cf3ef86b98ed tempest-ProjectReaderTests-244930375 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:08:04 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-b6970106-eaa6-4011-87ce-cf3ef86b98ed tempest-ProjectReaderTests-244930375 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:08:04 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-b6970106-eaa6-4011-87ce-cf3ef86b98ed tempest-ProjectReaderTests-244930375 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:08:04 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-b6970106-eaa6-4011-87ce-cf3ef86b98ed tempest-ProjectReaderTests-244930375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:08:04 devstack sudo[99679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a Sep 07 10:08:04 devstack sudo[99679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:08:04 devstack sudo[99677]: pam_unix(sudo:session): session closed for user root Sep 07 10:08:04 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-495c7e61-efae-4f41-a74e-2a2fe18a4216 tempest-GroupSnapshotsV319Test-2045935185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-e608178a-3df8-45f9-a240-211afe6d5457.5314363f-90a0-404b-a928-5b1637f1e698" returned: 0 in 0.294s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:08:04 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-495c7e61-efae-4f41-a74e-2a2fe18a4216 tempest-GroupSnapshotsV319Test-2045935185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-e608178a-3df8-45f9-a240-211afe6d5457.info {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:08:04 devstack sudo[99679]: pam_unix(sudo:session): session closed for user root Sep 07 10:08:04 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-b6970106-eaa6-4011-87ce-cf3ef86b98ed tempest-ProjectReaderTests-244930375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a" returned: 0 in 0.286s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:08:04 devstack cinder-volume[87515]: DEBUG cinder.manager [None req-b6970106-eaa6-4011-87ce-cf3ef86b98ed tempest-ProjectReaderTests-244930375 None] Notifying Schedulers of capabilities ... {{(pid=87515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:08:04 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-b6970106-eaa6-4011-87ce-cf3ef86b98ed tempest-ProjectReaderTests-244930375 None] Deleted volume successfully. Sep 07 10:08:04 devstack sudo[99683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-e608178a-3df8-45f9-a240-211afe6d5457.info Sep 07 10:08:04 devstack sudo[99683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:08:04 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-b6970106-eaa6-4011-87ce-cf3ef86b98ed tempest-ProjectReaderTests-244930375 None] Lock "cinder-127808c7-e67b-44b1-9d1e-1945a216390e-delete_volume" released by "delete_volume" :: held 1.315s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:08:04 devstack sudo[99683]: pam_unix(sudo:session): session closed for user root Sep 07 10:08:04 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-495c7e61-efae-4f41-a74e-2a2fe18a4216 tempest-GroupSnapshotsV319Test-2045935185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-e608178a-3df8-45f9-a240-211afe6d5457.info" returned: 0 in 0.296s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:08:04 devstack cinder-volume[87515]: WARNING cinder.volume.drivers.remotefs [None req-495c7e61-efae-4f41-a74e-2a2fe18a4216 tempest-GroupSnapshotsV319Test-2045935185 None] /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-e608178a-3df8-45f9-a240-211afe6d5457.info is being set with open permissions: ugo+rw: NotImplementedError Sep 07 10:08:04 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-495c7e61-efae-4f41-a74e-2a2fe18a4216 tempest-GroupSnapshotsV319Test-2045935185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-e608178a-3df8-45f9-a240-211afe6d5457.info {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:08:04 devstack sudo[99686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-e608178a-3df8-45f9-a240-211afe6d5457.info Sep 07 10:08:04 devstack sudo[99686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:08:05 devstack sudo[99686]: pam_unix(sudo:session): session closed for user root Sep 07 10:08:05 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-495c7e61-efae-4f41-a74e-2a2fe18a4216 tempest-GroupSnapshotsV319Test-2045935185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-e608178a-3df8-45f9-a240-211afe6d5457.info" returned: 0 in 0.273s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:08:05 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-495c7e61-efae-4f41-a74e-2a2fe18a4216 tempest-GroupSnapshotsV319Test-2045935185 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.220s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:08:05 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-495c7e61-efae-4f41-a74e-2a2fe18a4216 tempest-GroupSnapshotsV319Test-2045935185 None] group_snapshot 28c06744-1fec-4aa3-867f-d208803b8345: created successfully Sep 07 10:08:06 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-9ef9a2ee-69ce-4077-a164-f46ba700223f tempest-GroupSnapshotsV319Test-2045935185 None] group_snapshot 28c06744-1fec-4aa3-867f-d208803b8345: deleting Sep 07 10:08:06 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-9ef9a2ee-69ce-4077-a164-f46ba700223f tempest-GroupSnapshotsV319Test-2045935185 None] group_snapshot 28c06744-1fec-4aa3-867f-d208803b8345: deleting {{(pid=87515) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 07 10:08:06 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-9ef9a2ee-69ce-4077-a164-f46ba700223f tempest-GroupSnapshotsV319Test-2045935185 None] Acquiring lock "cinder-quobyte-e608178a-3df8-45f9-a240-211afe6d5457" by "delete_snapshot" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:08:06 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-9ef9a2ee-69ce-4077-a164-f46ba700223f tempest-GroupSnapshotsV319Test-2045935185 None] Lock "cinder-quobyte-e608178a-3df8-45f9-a240-211afe6d5457" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:08:06 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-9ef9a2ee-69ce-4077-a164-f46ba700223f tempest-GroupSnapshotsV319Test-2045935185 None] Acquiring lock "cinder-quobyte-5314363f-90a0-404b-a928-5b1637f1e698" by "_delete_snapshot" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:08:06 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-9ef9a2ee-69ce-4077-a164-f46ba700223f tempest-GroupSnapshotsV319Test-2045935185 None] Lock "cinder-quobyte-5314363f-90a0-404b-a928-5b1637f1e698" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:08:06 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-9ef9a2ee-69ce-4077-a164-f46ba700223f tempest-GroupSnapshotsV319Test-2045935185 None] Deleting offline snapshot 5314363f-90a0-404b-a928-5b1637f1e698 of volume e608178a-3df8-45f9-a240-211afe6d5457 {{(pid=87515) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 10:08:06 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-9ef9a2ee-69ce-4077-a164-f46ba700223f tempest-GroupSnapshotsV319Test-2045935185 None] snapshot_file for this snap is: volume-e608178a-3df8-45f9-a240-211afe6d5457.5314363f-90a0-404b-a928-5b1637f1e698 {{(pid=87515) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 10:08:06 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[d848bb66-3c41-4843-abba-4640dc83bc5b]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:08:06 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-9ef9a2ee-69ce-4077-a164-f46ba700223f tempest-GroupSnapshotsV319Test-2045935185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-e608178a-3df8-45f9-a240-211afe6d5457.5314363f-90a0-404b-a928-5b1637f1e698 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:08:06 devstack sudo[99690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-e608178a-3df8-45f9-a240-211afe6d5457.5314363f-90a0-404b-a928-5b1637f1e698 Sep 07 10:08:06 devstack sudo[99690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:08:07 devstack sudo[99690]: pam_unix(sudo:session): session closed for user root Sep 07 10:08:07 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-9ef9a2ee-69ce-4077-a164-f46ba700223f tempest-GroupSnapshotsV319Test-2045935185 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-e608178a-3df8-45f9-a240-211afe6d5457.5314363f-90a0-404b-a928-5b1637f1e698" returned: 0 in 0.423s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:08:07 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-9ef9a2ee-69ce-4077-a164-f46ba700223f tempest-GroupSnapshotsV319Test-2045935185 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e608178a-3df8-45f9-a240-211afe6d5457(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87515) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 10:08:07 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[415d2f0c-be1f-44b1-ba99-115ea84ffdde]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:08:07 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-9ef9a2ee-69ce-4077-a164-f46ba700223f tempest-GroupSnapshotsV319Test-2045935185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-e608178a-3df8-45f9-a240-211afe6d5457 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:08:07 devstack sudo[99695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-e608178a-3df8-45f9-a240-211afe6d5457 Sep 07 10:08:07 devstack sudo[99695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:08:07 devstack sudo[99695]: pam_unix(sudo:session): session closed for user root Sep 07 10:08:07 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-9ef9a2ee-69ce-4077-a164-f46ba700223f tempest-GroupSnapshotsV319Test-2045935185 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-e608178a-3df8-45f9-a240-211afe6d5457" returned: 0 in 0.501s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:08:07 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-9ef9a2ee-69ce-4077-a164-f46ba700223f tempest-GroupSnapshotsV319Test-2045935185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-e608178a-3df8-45f9-a240-211afe6d5457.5314363f-90a0-404b-a928-5b1637f1e698 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:08:07 devstack sudo[99704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-e608178a-3df8-45f9-a240-211afe6d5457.5314363f-90a0-404b-a928-5b1637f1e698 Sep 07 10:08:07 devstack sudo[99704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:08:07 devstack cinder-volume[87515]: DEBUG cinder.volume.flows.manager.create_volume [None req-245bf9ef-94aa-4c02-9819-23503d1f2f3f tempest-VolumeRetypeWithoutMigrationTest-926975565 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 10:08:07 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-245bf9ef-94aa-4c02-9819-23503d1f2f3f tempest-VolumeRetypeWithoutMigrationTest-926975565 None] Flow 'volume_create_manager' (4be118e7-bcd6-479c-85f9-6cc4fd5b6a75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:08:07 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-245bf9ef-94aa-4c02-9819-23503d1f2f3f tempest-VolumeRetypeWithoutMigrationTest-926975565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (770a2f04-3ece-45b0-82fe-78922cd60675) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:08:07 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-245bf9ef-94aa-4c02-9819-23503d1f2f3f tempest-VolumeRetypeWithoutMigrationTest-926975565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (770a2f04-3ece-45b0-82fe-78922cd60675) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:08:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-479998500',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12e5473b-8540-414e-b09e-a7e21c545d70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='190b078fddc24450b6714960a813ca3f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:08:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:08:08Z,use_quota=True,user_id='66308f4d6a4e421eaff542dac3b52ede',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c8f496b-7f84-43b5-a292-696641f27c19),volume_type_id=0c8f496b-7f84-43b5-a292-696641f27c19)' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:08:07 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-245bf9ef-94aa-4c02-9819-23503d1f2f3f tempest-VolumeRetypeWithoutMigrationTest-926975565 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e7663a3-6049-49b9-a3ec-b07e7c18ec52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:08:07 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-245bf9ef-94aa-4c02-9819-23503d1f2f3f tempest-VolumeRetypeWithoutMigrationTest-926975565 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e7663a3-6049-49b9-a3ec-b07e7c18ec52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:08:07 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-245bf9ef-94aa-4c02-9819-23503d1f2f3f tempest-VolumeRetypeWithoutMigrationTest-926975565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12fd714c-b109-4be3-aa2e-92b7d9c2541c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:08:07 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-245bf9ef-94aa-4c02-9819-23503d1f2f3f tempest-VolumeRetypeWithoutMigrationTest-926975565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12fd714c-b109-4be3-aa2e-92b7d9c2541c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '12e5473b-8540-414e-b09e-a7e21c545d70', 'volume_name': 'volume-12e5473b-8540-414e-b09e-a7e21c545d70', 'volume_size': 1}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:08:07 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-245bf9ef-94aa-4c02-9819-23503d1f2f3f tempest-VolumeRetypeWithoutMigrationTest-926975565 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eca6152c-a401-4120-8006-5e8c4ef0e785) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:08:07 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-245bf9ef-94aa-4c02-9819-23503d1f2f3f tempest-VolumeRetypeWithoutMigrationTest-926975565 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eca6152c-a401-4120-8006-5e8c4ef0e785) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:08:07 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-245bf9ef-94aa-4c02-9819-23503d1f2f3f tempest-VolumeRetypeWithoutMigrationTest-926975565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e19129f-e3af-4895-b678-770275c40fff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:08:07 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-245bf9ef-94aa-4c02-9819-23503d1f2f3f tempest-VolumeRetypeWithoutMigrationTest-926975565 None] Volume 12e5473b-8540-414e-b09e-a7e21c545d70: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-12e5473b-8540-414e-b09e-a7e21c545d70', 'volume_size': 1} Sep 07 10:08:07 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-245bf9ef-94aa-4c02-9819-23503d1f2f3f tempest-VolumeRetypeWithoutMigrationTest-926975565 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:08:07 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-245bf9ef-94aa-4c02-9819-23503d1f2f3f tempest-VolumeRetypeWithoutMigrationTest-926975565 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:08:07 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-245bf9ef-94aa-4c02-9819-23503d1f2f3f tempest-VolumeRetypeWithoutMigrationTest-926975565 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:08:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-479998500',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12e5473b-8540-414e-b09e-a7e21c545d70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='190b078fddc24450b6714960a813ca3f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:08:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:08:08Z,use_quota=True,user_id='66308f4d6a4e421eaff542dac3b52ede',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c8f496b-7f84-43b5-a292-696641f27c19),volume_type_id=0c8f496b-7f84-43b5-a292-696641f27c19)}" {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 10:08:07 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-245bf9ef-94aa-4c02-9819-23503d1f2f3f tempest-VolumeRetypeWithoutMigrationTest-926975565 None] Creating volume 12e5473b-8540-414e-b09e-a7e21c545d70 {{(pid=87515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 10:08:07 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-245bf9ef-94aa-4c02-9819-23503d1f2f3f tempest-VolumeRetypeWithoutMigrationTest-926975565 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:08:07 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-245bf9ef-94aa-4c02-9819-23503d1f2f3f tempest-VolumeRetypeWithoutMigrationTest-926975565 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:08:07 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-245bf9ef-94aa-4c02-9819-23503d1f2f3f tempest-VolumeRetypeWithoutMigrationTest-926975565 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:08:07 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-245bf9ef-94aa-4c02-9819-23503d1f2f3f tempest-VolumeRetypeWithoutMigrationTest-926975565 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:08:07 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-245bf9ef-94aa-4c02-9819-23503d1f2f3f tempest-VolumeRetypeWithoutMigrationTest-926975565 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:08:07 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-245bf9ef-94aa-4c02-9819-23503d1f2f3f tempest-VolumeRetypeWithoutMigrationTest-926975565 None] Selected osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c as target Quobyte volume. {{(pid=87515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 10:08:07 devstack cinder-volume[87515]: INFO cinder.volume.drivers.remotefs [None req-245bf9ef-94aa-4c02-9819-23503d1f2f3f tempest-VolumeRetypeWithoutMigrationTest-926975565 None] casted to osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c Sep 07 10:08:07 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-245bf9ef-94aa-4c02-9819-23503d1f2f3f tempest-VolumeRetypeWithoutMigrationTest-926975565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-12e5473b-8540-414e-b09e-a7e21c545d70 1073741824 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:08:08 devstack sudo[99709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-12e5473b-8540-414e-b09e-a7e21c545d70 1073741824 Sep 07 10:08:08 devstack sudo[99709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:08:08 devstack sudo[99704]: pam_unix(sudo:session): session closed for user root Sep 07 10:08:08 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-9ef9a2ee-69ce-4077-a164-f46ba700223f tempest-GroupSnapshotsV319Test-2045935185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-e608178a-3df8-45f9-a240-211afe6d5457.5314363f-90a0-404b-a928-5b1637f1e698" returned: 0 in 0.542s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:08:08 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-9ef9a2ee-69ce-4077-a164-f46ba700223f tempest-GroupSnapshotsV319Test-2045935185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-e608178a-3df8-45f9-a240-211afe6d5457.5314363f-90a0-404b-a928-5b1637f1e698 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:08:08 devstack sudo[99714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-e608178a-3df8-45f9-a240-211afe6d5457.5314363f-90a0-404b-a928-5b1637f1e698 Sep 07 10:08:08 devstack sudo[99714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:08:08 devstack sudo[99714]: pam_unix(sudo:session): session closed for user root Sep 07 10:08:08 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-9ef9a2ee-69ce-4077-a164-f46ba700223f tempest-GroupSnapshotsV319Test-2045935185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-e608178a-3df8-45f9-a240-211afe6d5457.5314363f-90a0-404b-a928-5b1637f1e698" returned: 0 in 0.318s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:08:08 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-9ef9a2ee-69ce-4077-a164-f46ba700223f tempest-GroupSnapshotsV319Test-2045935185 None] Lock "cinder-quobyte-5314363f-90a0-404b-a928-5b1637f1e698" released by "_delete_snapshot" :: held 1.912s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:08:08 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-9ef9a2ee-69ce-4077-a164-f46ba700223f tempest-GroupSnapshotsV319Test-2045935185 None] Lock "cinder-quobyte-e608178a-3df8-45f9-a240-211afe6d5457" released by "delete_snapshot" :: held 1.939s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:08:08 devstack sudo[99709]: pam_unix(sudo:session): session closed for user root Sep 07 10:08:08 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-245bf9ef-94aa-4c02-9819-23503d1f2f3f tempest-VolumeRetypeWithoutMigrationTest-926975565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-12e5473b-8540-414e-b09e-a7e21c545d70 1073741824" returned: 0 in 0.681s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:08:08 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [req-376e501d-4b9c-4628-b884-6ce746ef2d5e req-b2a21d4b-c032-4906-9a0c-7ecb36b07ee7 tempest-TestInstancesWithCinderVolumes-120733040 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:08:08 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-245bf9ef-94aa-4c02-9819-23503d1f2f3f tempest-VolumeRetypeWithoutMigrationTest-926975565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-12e5473b-8540-414e-b09e-a7e21c545d70 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:08:08 devstack sudo[99730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-12e5473b-8540-414e-b09e-a7e21c545d70 Sep 07 10:08:08 devstack sudo[99730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:08:08 devstack cinder-volume[87515]: WARNING cinder.quota [None req-9ef9a2ee-69ce-4077-a164-f46ba700223f tempest-GroupSnapshotsV319Test-2045935185 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-2019900898 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-2019900898, it is now deprecated. Please use the default quota class for default quota. Sep 07 10:08:08 devstack cinder-volume[87515]: WARNING cinder.quota [None req-9ef9a2ee-69ce-4077-a164-f46ba700223f tempest-GroupSnapshotsV319Test-2045935185 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-2019900898 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-2019900898, it is now deprecated. Please use the default quota class for default quota. Sep 07 10:08:08 devstack cinder-volume[87515]: DEBUG cinder.quota [None req-9ef9a2ee-69ce-4077-a164-f46ba700223f tempest-GroupSnapshotsV319Test-2045935185 None] Created reservations ['b8b13187-eed1-4d2f-b918-ad566c679203', '28e0d70f-e066-4f89-8fa7-f0effe3ec7d8', 'd22e2e17-77b3-40a2-bd58-7cac24fe8764', '2e308f13-d388-460a-ad49-2347e181ad94'] {{(pid=87515) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:08:08 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-9ef9a2ee-69ce-4077-a164-f46ba700223f tempest-GroupSnapshotsV319Test-2045935185 None] group_snapshot 28c06744-1fec-4aa3-867f-d208803b8345: deleted successfully Sep 07 10:08:09 devstack sudo[99730]: pam_unix(sudo:session): session closed for user root Sep 07 10:08:09 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-245bf9ef-94aa-4c02-9819-23503d1f2f3f tempest-VolumeRetypeWithoutMigrationTest-926975565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-12e5473b-8540-414e-b09e-a7e21c545d70" returned: 0 in 0.298s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:08:09 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-245bf9ef-94aa-4c02-9819-23503d1f2f3f tempest-VolumeRetypeWithoutMigrationTest-926975565 None] <== create_volume: return (1048ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'} {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 10:08:09 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-245bf9ef-94aa-4c02-9819-23503d1f2f3f tempest-VolumeRetypeWithoutMigrationTest-926975565 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.050s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:08:09 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [req-376e501d-4b9c-4628-b884-6ce746ef2d5e req-b2a21d4b-c032-4906-9a0c-7ecb36b07ee7 tempest-TestInstancesWithCinderVolumes-120733040 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.315s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:08:09 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-245bf9ef-94aa-4c02-9819-23503d1f2f3f tempest-VolumeRetypeWithoutMigrationTest-926975565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e19129f-e3af-4895-b678-770275c40fff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-12e5473b-8540-414e-b09e-a7e21c545d70', 'volume_size': 1}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:08:09 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-245bf9ef-94aa-4c02-9819-23503d1f2f3f tempest-VolumeRetypeWithoutMigrationTest-926975565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9b2b46e-5093-4aca-a8a9-2b3aa8623ea1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:08:09 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [req-376e501d-4b9c-4628-b884-6ce746ef2d5e req-b2a21d4b-c032-4906-9a0c-7ecb36b07ee7 tempest-TestInstancesWithCinderVolumes-120733040 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.032s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:08:09 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-245bf9ef-94aa-4c02-9819-23503d1f2f3f tempest-VolumeRetypeWithoutMigrationTest-926975565 None] Volume volume-12e5473b-8540-414e-b09e-a7e21c545d70 (12e5473b-8540-414e-b09e-a7e21c545d70): created successfully Sep 07 10:08:09 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-245bf9ef-94aa-4c02-9819-23503d1f2f3f tempest-VolumeRetypeWithoutMigrationTest-926975565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9b2b46e-5093-4aca-a8a9-2b3aa8623ea1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:08:09 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-245bf9ef-94aa-4c02-9819-23503d1f2f3f tempest-VolumeRetypeWithoutMigrationTest-926975565 None] Flow 'volume_create_manager' (4be118e7-bcd6-479c-85f9-6cc4fd5b6a75) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:08:09 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-245bf9ef-94aa-4c02-9819-23503d1f2f3f tempest-VolumeRetypeWithoutMigrationTest-926975565 None] Created volume successfully. Sep 07 10:08:09 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [req-376e501d-4b9c-4628-b884-6ce746ef2d5e req-b2a21d4b-c032-4906-9a0c-7ecb36b07ee7 tempest-TestInstancesWithCinderVolumes-120733040 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c', 'name': 'volume-b27dbd06-be27-4f26-9495-8ff98607c90b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3b3980d9-b8f0-4a6a-b043-e5090bb37148', 'enforce_multipath': True} {{(pid=87515) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 07 10:08:09 devstack cinder-volume[87515]: INFO cinder.volume.manager [req-376e501d-4b9c-4628-b884-6ce746ef2d5e req-b2a21d4b-c032-4906-9a0c-7ecb36b07ee7 tempest-TestInstancesWithCinderVolumes-120733040 None] attachment_update completed successfully. Sep 07 10:08:09 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-273a6c19-4637-49ea-ab49-9ce1ac1e9424 tempest-GroupSnapshotsV319Test-2045935185 None] Acquiring lock "cinder-quobyte-e608178a-3df8-45f9-a240-211afe6d5457" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:08:09 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-273a6c19-4637-49ea-ab49-9ce1ac1e9424 tempest-GroupSnapshotsV319Test-2045935185 None] Lock "cinder-quobyte-e608178a-3df8-45f9-a240-211afe6d5457" acquired by "delete_volume" :: waited 0.031s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:08:09 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[40ae5481-3718-4ac2-a81d-c14edf33c736]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:08:09 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-273a6c19-4637-49ea-ab49-9ce1ac1e9424 tempest-GroupSnapshotsV319Test-2045935185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-e608178a-3df8-45f9-a240-211afe6d5457 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:08:09 devstack sudo[99736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-e608178a-3df8-45f9-a240-211afe6d5457 Sep 07 10:08:09 devstack sudo[99736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:08:09 devstack sudo[99736]: pam_unix(sudo:session): session closed for user root Sep 07 10:08:09 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-273a6c19-4637-49ea-ab49-9ce1ac1e9424 tempest-GroupSnapshotsV319Test-2045935185 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-e608178a-3df8-45f9-a240-211afe6d5457" returned: 0 in 0.511s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:08:09 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-273a6c19-4637-49ea-ab49-9ce1ac1e9424 tempest-GroupSnapshotsV319Test-2045935185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-e608178a-3df8-45f9-a240-211afe6d5457 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:08:10 devstack sudo[99741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-e608178a-3df8-45f9-a240-211afe6d5457 Sep 07 10:08:10 devstack sudo[99741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:08:10 devstack sudo[99741]: pam_unix(sudo:session): session closed for user root Sep 07 10:08:10 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-273a6c19-4637-49ea-ab49-9ce1ac1e9424 tempest-GroupSnapshotsV319Test-2045935185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-e608178a-3df8-45f9-a240-211afe6d5457" returned: 0 in 0.289s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:08:10 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-273a6c19-4637-49ea-ab49-9ce1ac1e9424 tempest-GroupSnapshotsV319Test-2045935185 None] Lock "cinder-quobyte-e608178a-3df8-45f9-a240-211afe6d5457" released by "delete_volume" :: held 0.917s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:08:10 devstack cinder-volume[87515]: DEBUG cinder.quota [None req-273a6c19-4637-49ea-ab49-9ce1ac1e9424 tempest-GroupSnapshotsV319Test-2045935185 None] Created reservations ['e35d4310-1f3d-42a4-9720-da60739d0b51'] {{(pid=87515) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:08:10 devstack cinder-volume[87515]: WARNING cinder.quota [None req-273a6c19-4637-49ea-ab49-9ce1ac1e9424 tempest-GroupSnapshotsV319Test-2045935185 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-2019900898 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-2019900898, it is now deprecated. Please use the default quota class for default quota. Sep 07 10:08:10 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-3fa644fe-92b3-4648-b1d4-a177556f3f70 tempest-VolumeRetypeWithoutMigrationTest-926975565 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:08:10 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-3fa644fe-92b3-4648-b1d4-a177556f3f70 tempest-VolumeRetypeWithoutMigrationTest-926975565 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:08:10 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-3fa644fe-92b3-4648-b1d4-a177556f3f70 tempest-VolumeRetypeWithoutMigrationTest-926975565 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:08:10 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-3fa644fe-92b3-4648-b1d4-a177556f3f70 tempest-VolumeRetypeWithoutMigrationTest-926975565 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:08:10 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-3fa644fe-92b3-4648-b1d4-a177556f3f70 tempest-VolumeRetypeWithoutMigrationTest-926975565 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:08:10 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-3fa644fe-92b3-4648-b1d4-a177556f3f70 tempest-VolumeRetypeWithoutMigrationTest-926975565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:08:10 devstack cinder-volume[87515]: DEBUG cinder.quota [None req-273a6c19-4637-49ea-ab49-9ce1ac1e9424 tempest-GroupSnapshotsV319Test-2045935185 None] Created reservations ['e12f1f6b-cece-47ed-9a4b-2b30348bde60', '39533ae6-2784-4571-abbb-b5bbbb2c7cf6', '057c4137-7c2c-4f8f-9a4c-5a392d583c93', '2b775164-304f-4b63-bbd6-75678dfc7359'] {{(pid=87515) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:08:10 devstack sudo[99744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a Sep 07 10:08:10 devstack sudo[99744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:08:10 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-273a6c19-4637-49ea-ab49-9ce1ac1e9424 tempest-GroupSnapshotsV319Test-2045935185 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:08:10 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-273a6c19-4637-49ea-ab49-9ce1ac1e9424 tempest-GroupSnapshotsV319Test-2045935185 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:08:10 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-273a6c19-4637-49ea-ab49-9ce1ac1e9424 tempest-GroupSnapshotsV319Test-2045935185 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:08:10 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-273a6c19-4637-49ea-ab49-9ce1ac1e9424 tempest-GroupSnapshotsV319Test-2045935185 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:08:10 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-273a6c19-4637-49ea-ab49-9ce1ac1e9424 tempest-GroupSnapshotsV319Test-2045935185 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:08:10 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-273a6c19-4637-49ea-ab49-9ce1ac1e9424 tempest-GroupSnapshotsV319Test-2045935185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:08:10 devstack sudo[99746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a Sep 07 10:08:10 devstack sudo[99746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:08:10 devstack sudo[99744]: pam_unix(sudo:session): session closed for user root Sep 07 10:08:10 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-3fa644fe-92b3-4648-b1d4-a177556f3f70 tempest-VolumeRetypeWithoutMigrationTest-926975565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a" returned: 0 in 0.430s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:08:10 devstack cinder-volume[87515]: DEBUG cinder.manager [None req-3fa644fe-92b3-4648-b1d4-a177556f3f70 tempest-VolumeRetypeWithoutMigrationTest-926975565 None] Notifying Schedulers of capabilities ... {{(pid=87515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:08:10 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-3fa644fe-92b3-4648-b1d4-a177556f3f70 tempest-VolumeRetypeWithoutMigrationTest-926975565 None] Retype volume completed successfully. Sep 07 10:08:10 devstack sudo[99746]: pam_unix(sudo:session): session closed for user root Sep 07 10:08:11 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-273a6c19-4637-49ea-ab49-9ce1ac1e9424 tempest-GroupSnapshotsV319Test-2045935185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a" returned: 0 in 0.323s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:08:11 devstack cinder-volume[87515]: DEBUG cinder.manager [None req-273a6c19-4637-49ea-ab49-9ce1ac1e9424 tempest-GroupSnapshotsV319Test-2045935185 None] Notifying Schedulers of capabilities ... {{(pid=87515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:08:11 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-273a6c19-4637-49ea-ab49-9ce1ac1e9424 tempest-GroupSnapshotsV319Test-2045935185 None] Delete group completed successfully. Sep 07 10:08:11 devstack cinder-volume[87515]: DEBUG oslo_service.periodic_task [None req-cebd6a9d-3073-42a1-b65a-b38d444d85ed None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87515) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 10:08:11 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-cebd6a9d-3073-42a1-b65a-b38d444d85ed None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:08:11 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-cebd6a9d-3073-42a1-b65a-b38d444d85ed None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:08:11 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-cebd6a9d-3073-42a1-b65a-b38d444d85ed None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:08:11 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-cebd6a9d-3073-42a1-b65a-b38d444d85ed None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:08:11 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-cebd6a9d-3073-42a1-b65a-b38d444d85ed None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:08:11 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-cebd6a9d-3073-42a1-b65a-b38d444d85ed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:08:11 devstack sudo[99759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a Sep 07 10:08:11 devstack sudo[99759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:08:11 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-094cb4c6-73e5-4ad3-9285-920b13ec27f3 tempest-VolumeRetypeWithoutMigrationTest-926975565 None] Acquiring lock "cinder-12e5473b-8540-414e-b09e-a7e21c545d70-delete_volume" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:08:11 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-094cb4c6-73e5-4ad3-9285-920b13ec27f3 tempest-VolumeRetypeWithoutMigrationTest-926975565 None] Lock "cinder-12e5473b-8540-414e-b09e-a7e21c545d70-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:08:11 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-094cb4c6-73e5-4ad3-9285-920b13ec27f3 tempest-VolumeRetypeWithoutMigrationTest-926975565 None] Acquiring lock "cinder-quobyte-12e5473b-8540-414e-b09e-a7e21c545d70" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:08:11 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-094cb4c6-73e5-4ad3-9285-920b13ec27f3 tempest-VolumeRetypeWithoutMigrationTest-926975565 None] Lock "cinder-quobyte-12e5473b-8540-414e-b09e-a7e21c545d70" acquired by "delete_volume" :: waited 0.020s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:08:11 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa27b1b6-fe9d-456d-960f-d43fd2a6406d]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:08:11 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-094cb4c6-73e5-4ad3-9285-920b13ec27f3 tempest-VolumeRetypeWithoutMigrationTest-926975565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-12e5473b-8540-414e-b09e-a7e21c545d70 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:08:11 devstack sudo[99759]: pam_unix(sudo:session): session closed for user root Sep 07 10:08:11 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-cebd6a9d-3073-42a1-b65a-b38d444d85ed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a" returned: 0 in 0.405s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:08:11 devstack cinder-volume[87515]: DEBUG cinder.manager [None req-cebd6a9d-3073-42a1-b65a-b38d444d85ed None None] Notifying Schedulers of capabilities ... {{(pid=87515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:08:11 devstack cinder-volume[87515]: DEBUG oslo_service.periodic_task [None req-cebd6a9d-3073-42a1-b65a-b38d444d85ed None None] Running periodic task VolumeManager._thread_info {{(pid=87515) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 10:08:11 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-cebd6a9d-3073-42a1-b65a-b38d444d85ed None None] thread count: 28 {{(pid=87515) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 07 10:08:11 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-cebd6a9d-3073-42a1-b65a-b38d444d85ed None None] thread info: [<_MainThread(MainThread, started 131647121809536)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87515) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 07 10:08:12 devstack sudo[99766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-12e5473b-8540-414e-b09e-a7e21c545d70 Sep 07 10:08:12 devstack sudo[99766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:08:12 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [req-89c575e9-df5f-4b18-bf01-cd7ff9d505b1 req-77982176-9eff-4c32-ad6a-65ea50157bb1 tempest-TestInstancesWithCinderVolumes-120733040 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:08:12 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [req-89c575e9-df5f-4b18-bf01-cd7ff9d505b1 req-77982176-9eff-4c32-ad6a-65ea50157bb1 tempest-TestInstancesWithCinderVolumes-120733040 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:08:12 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [req-89c575e9-df5f-4b18-bf01-cd7ff9d505b1 req-77982176-9eff-4c32-ad6a-65ea50157bb1 tempest-TestInstancesWithCinderVolumes-120733040 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:08:12 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [req-89c575e9-df5f-4b18-bf01-cd7ff9d505b1 req-77982176-9eff-4c32-ad6a-65ea50157bb1 tempest-TestInstancesWithCinderVolumes-120733040 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c', 'name': 'volume-223ab6a6-f55d-4061-9b05-219724845319', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7400d314-1bf1-424a-8980-d0f3f81e8746', 'enforce_multipath': True} {{(pid=87515) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 07 10:08:12 devstack cinder-volume[87515]: INFO cinder.volume.manager [req-89c575e9-df5f-4b18-bf01-cd7ff9d505b1 req-77982176-9eff-4c32-ad6a-65ea50157bb1 tempest-TestInstancesWithCinderVolumes-120733040 None] attachment_update completed successfully. Sep 07 10:08:12 devstack sudo[99766]: pam_unix(sudo:session): session closed for user root Sep 07 10:08:12 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-094cb4c6-73e5-4ad3-9285-920b13ec27f3 tempest-VolumeRetypeWithoutMigrationTest-926975565 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-12e5473b-8540-414e-b09e-a7e21c545d70" returned: 0 in 0.509s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:08:12 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-094cb4c6-73e5-4ad3-9285-920b13ec27f3 tempest-VolumeRetypeWithoutMigrationTest-926975565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-12e5473b-8540-414e-b09e-a7e21c545d70 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:08:12 devstack sudo[99777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-12e5473b-8540-414e-b09e-a7e21c545d70 Sep 07 10:08:12 devstack sudo[99777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:08:12 devstack sudo[99777]: pam_unix(sudo:session): session closed for user root Sep 07 10:08:12 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-094cb4c6-73e5-4ad3-9285-920b13ec27f3 tempest-VolumeRetypeWithoutMigrationTest-926975565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-12e5473b-8540-414e-b09e-a7e21c545d70" returned: 0 in 0.399s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:08:12 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-094cb4c6-73e5-4ad3-9285-920b13ec27f3 tempest-VolumeRetypeWithoutMigrationTest-926975565 None] Lock "cinder-quobyte-12e5473b-8540-414e-b09e-a7e21c545d70" released by "delete_volume" :: held 1.000s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:08:12 devstack cinder-volume[87515]: WARNING cinder.quota [None req-094cb4c6-73e5-4ad3-9285-920b13ec27f3 tempest-VolumeRetypeWithoutMigrationTest-926975565 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Sep 07 10:08:12 devstack cinder-volume[87515]: WARNING cinder.quota [None req-094cb4c6-73e5-4ad3-9285-920b13ec27f3 tempest-VolumeRetypeWithoutMigrationTest-926975565 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Sep 07 10:08:12 devstack cinder-volume[87515]: DEBUG cinder.quota [None req-094cb4c6-73e5-4ad3-9285-920b13ec27f3 tempest-VolumeRetypeWithoutMigrationTest-926975565 None] Created reservations ['ed572e9b-3ae6-471c-b039-9d6ff5ba94a8', '5f3d77ff-5438-44f2-8aad-b41e8f5fceed', '8c6cfc6f-8083-4856-9f23-312d705fe776', '6e49c7c0-9ffa-47ef-bdc3-69d9e3e4af5f'] {{(pid=87515) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:08:13 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-094cb4c6-73e5-4ad3-9285-920b13ec27f3 tempest-VolumeRetypeWithoutMigrationTest-926975565 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:08:13 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-094cb4c6-73e5-4ad3-9285-920b13ec27f3 tempest-VolumeRetypeWithoutMigrationTest-926975565 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:08:13 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-094cb4c6-73e5-4ad3-9285-920b13ec27f3 tempest-VolumeRetypeWithoutMigrationTest-926975565 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:08:13 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-094cb4c6-73e5-4ad3-9285-920b13ec27f3 tempest-VolumeRetypeWithoutMigrationTest-926975565 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:08:13 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-094cb4c6-73e5-4ad3-9285-920b13ec27f3 tempest-VolumeRetypeWithoutMigrationTest-926975565 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:08:13 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-094cb4c6-73e5-4ad3-9285-920b13ec27f3 tempest-VolumeRetypeWithoutMigrationTest-926975565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:08:13 devstack sudo[99780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a Sep 07 10:08:13 devstack sudo[99780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:08:13 devstack sudo[99780]: pam_unix(sudo:session): session closed for user root Sep 07 10:08:13 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-094cb4c6-73e5-4ad3-9285-920b13ec27f3 tempest-VolumeRetypeWithoutMigrationTest-926975565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a" returned: 0 in 0.283s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:08:13 devstack cinder-volume[87515]: DEBUG cinder.manager [None req-094cb4c6-73e5-4ad3-9285-920b13ec27f3 tempest-VolumeRetypeWithoutMigrationTest-926975565 None] Notifying Schedulers of capabilities ... {{(pid=87515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:08:13 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-094cb4c6-73e5-4ad3-9285-920b13ec27f3 tempest-VolumeRetypeWithoutMigrationTest-926975565 None] Deleted volume successfully. Sep 07 10:08:13 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-094cb4c6-73e5-4ad3-9285-920b13ec27f3 tempest-VolumeRetypeWithoutMigrationTest-926975565 None] Lock "cinder-12e5473b-8540-414e-b09e-a7e21c545d70-delete_volume" released by "delete_volume" :: held 1.600s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:08:18 devstack cinder-volume[87515]: DEBUG dbcounter [-] [87515] Writing DB stats cinder:SELECT=195,cinder:DELETE=11,cinder:UPDATE=192,cinder:INSERT=50 {{(pid=87515) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 10:08:18 devstack cinder-volume[87515]: INFO cinder.volume.manager [req-d9d9d47a-d0ba-442b-835d-16f676d42e75 req-2acab6c1-84c5-4f94-b183-55e5a9adcaa5 tempest-TestInstancesWithCinderVolumes-120733040 None] Terminate volume connection completed successfully. Sep 07 10:08:18 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [req-d9d9d47a-d0ba-442b-835d-16f676d42e75 req-2acab6c1-84c5-4f94-b183-55e5a9adcaa5 tempest-TestInstancesWithCinderVolumes-120733040 None] Deleting attachment 3b3980d9-b8f0-4a6a-b043-e5090bb37148. {{(pid=87515) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 07 10:08:19 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-e0e39b34-4d03-486b-9b50-dc21ff1c5853 tempest-TestInstancesWithCinderVolumes-120733040 None] Acquiring lock "cinder-b27dbd06-be27-4f26-9495-8ff98607c90b-delete_volume" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:08:19 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-e0e39b34-4d03-486b-9b50-dc21ff1c5853 tempest-TestInstancesWithCinderVolumes-120733040 None] Lock "cinder-b27dbd06-be27-4f26-9495-8ff98607c90b-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:08:19 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-e0e39b34-4d03-486b-9b50-dc21ff1c5853 tempest-TestInstancesWithCinderVolumes-120733040 None] Acquiring lock "cinder-quobyte-b27dbd06-be27-4f26-9495-8ff98607c90b" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:08:19 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-e0e39b34-4d03-486b-9b50-dc21ff1c5853 tempest-TestInstancesWithCinderVolumes-120733040 None] Lock "cinder-quobyte-b27dbd06-be27-4f26-9495-8ff98607c90b" acquired by "delete_volume" :: waited 0.018s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:08:19 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9e4af3f-e52d-441a-aa85-b63f3c579766]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:08:19 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-e0e39b34-4d03-486b-9b50-dc21ff1c5853 tempest-TestInstancesWithCinderVolumes-120733040 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-b27dbd06-be27-4f26-9495-8ff98607c90b {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:08:19 devstack sudo[99822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-b27dbd06-be27-4f26-9495-8ff98607c90b Sep 07 10:08:19 devstack sudo[99822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:08:20 devstack sudo[99822]: pam_unix(sudo:session): session closed for user root Sep 07 10:08:20 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-e0e39b34-4d03-486b-9b50-dc21ff1c5853 tempest-TestInstancesWithCinderVolumes-120733040 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-b27dbd06-be27-4f26-9495-8ff98607c90b" returned: 0 in 0.483s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:08:20 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-e0e39b34-4d03-486b-9b50-dc21ff1c5853 tempest-TestInstancesWithCinderVolumes-120733040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-b27dbd06-be27-4f26-9495-8ff98607c90b {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:08:20 devstack sudo[99827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-b27dbd06-be27-4f26-9495-8ff98607c90b Sep 07 10:08:20 devstack sudo[99827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:08:20 devstack sudo[99827]: pam_unix(sudo:session): session closed for user root Sep 07 10:08:20 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-e0e39b34-4d03-486b-9b50-dc21ff1c5853 tempest-TestInstancesWithCinderVolumes-120733040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-b27dbd06-be27-4f26-9495-8ff98607c90b" returned: 0 in 0.543s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:08:20 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-e0e39b34-4d03-486b-9b50-dc21ff1c5853 tempest-TestInstancesWithCinderVolumes-120733040 None] Lock "cinder-quobyte-b27dbd06-be27-4f26-9495-8ff98607c90b" released by "delete_volume" :: held 1.105s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:08:20 devstack cinder-volume[87515]: DEBUG dbcounter [-] [87515] Writing DB stats cinder:UPDATE=180,cinder:SELECT=153,cinder:INSERT=55,cinder:DELETE=16 {{(pid=87515) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 10:08:20 devstack cinder-volume[87515]: WARNING cinder.quota [None req-e0e39b34-4d03-486b-9b50-dc21ff1c5853 tempest-TestInstancesWithCinderVolumes-120733040 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-795746262-2119160929 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-795746262-2119160929, it is now deprecated. Please use the default quota class for default quota. Sep 07 10:08:20 devstack cinder-volume[87515]: WARNING cinder.quota [None req-e0e39b34-4d03-486b-9b50-dc21ff1c5853 tempest-TestInstancesWithCinderVolumes-120733040 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-795746262-2119160929 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-795746262-2119160929, it is now deprecated. Please use the default quota class for default quota. Sep 07 10:08:20 devstack cinder-volume[87515]: DEBUG cinder.quota [None req-e0e39b34-4d03-486b-9b50-dc21ff1c5853 tempest-TestInstancesWithCinderVolumes-120733040 None] Created reservations ['b9979135-f80d-45a9-895e-14750a23f70b', '7d192c2c-152a-4d69-b473-817b2b6cfc27', '21a5d698-df1a-4d08-8813-4a4b1de14256', '217a9d15-444c-484e-9206-6924cb0a683b'] {{(pid=87515) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:08:21 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-e0e39b34-4d03-486b-9b50-dc21ff1c5853 tempest-TestInstancesWithCinderVolumes-120733040 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:08:21 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-e0e39b34-4d03-486b-9b50-dc21ff1c5853 tempest-TestInstancesWithCinderVolumes-120733040 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:08:21 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-e0e39b34-4d03-486b-9b50-dc21ff1c5853 tempest-TestInstancesWithCinderVolumes-120733040 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:08:21 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-e0e39b34-4d03-486b-9b50-dc21ff1c5853 tempest-TestInstancesWithCinderVolumes-120733040 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:08:21 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-e0e39b34-4d03-486b-9b50-dc21ff1c5853 tempest-TestInstancesWithCinderVolumes-120733040 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:08:21 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-e0e39b34-4d03-486b-9b50-dc21ff1c5853 tempest-TestInstancesWithCinderVolumes-120733040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:08:21 devstack sudo[99864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a Sep 07 10:08:21 devstack sudo[99864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:08:21 devstack sudo[99864]: pam_unix(sudo:session): session closed for user root Sep 07 10:08:21 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-e0e39b34-4d03-486b-9b50-dc21ff1c5853 tempest-TestInstancesWithCinderVolumes-120733040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a" returned: 0 in 0.442s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:08:21 devstack cinder-volume[87515]: DEBUG cinder.manager [None req-e0e39b34-4d03-486b-9b50-dc21ff1c5853 tempest-TestInstancesWithCinderVolumes-120733040 None] Notifying Schedulers of capabilities ... {{(pid=87515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:08:21 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-e0e39b34-4d03-486b-9b50-dc21ff1c5853 tempest-TestInstancesWithCinderVolumes-120733040 None] Deleted volume successfully. Sep 07 10:08:21 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-e0e39b34-4d03-486b-9b50-dc21ff1c5853 tempest-TestInstancesWithCinderVolumes-120733040 None] Lock "cinder-b27dbd06-be27-4f26-9495-8ff98607c90b-delete_volume" released by "delete_volume" :: held 1.970s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:08:24 devstack cinder-volume[87515]: INFO cinder.volume.manager [req-a633f81c-cb27-4cb3-8946-4ba51ebbafc2 req-1a5b0cee-248c-4a5b-894a-6b575b0936f3 tempest-TestInstancesWithCinderVolumes-120733040 None] Terminate volume connection completed successfully. Sep 07 10:08:24 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [req-a633f81c-cb27-4cb3-8946-4ba51ebbafc2 req-1a5b0cee-248c-4a5b-894a-6b575b0936f3 tempest-TestInstancesWithCinderVolumes-120733040 None] Deleting attachment 7400d314-1bf1-424a-8980-d0f3f81e8746. {{(pid=87515) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 07 10:08:24 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-3fa64ab8-7663-4c0c-abd4-73d686dafcc2 tempest-GroupsTest-1231519480 None] Group tempest-Group1-289758351: creating Sep 07 10:08:24 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-3fa64ab8-7663-4c0c-abd4-73d686dafcc2 tempest-GroupsTest-1231519480 None] Group tempest-Group1-289758351: created successfully Sep 07 10:08:24 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-3fa64ab8-7663-4c0c-abd4-73d686dafcc2 tempest-GroupsTest-1231519480 None] Create group completed successfully. Sep 07 10:08:25 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-582e2888-7287-4289-93ee-d047782edc75 tempest-TestInstancesWithCinderVolumes-120733040 None] Acquiring lock "cinder-223ab6a6-f55d-4061-9b05-219724845319-delete_volume" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:08:25 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-582e2888-7287-4289-93ee-d047782edc75 tempest-TestInstancesWithCinderVolumes-120733040 None] Lock "cinder-223ab6a6-f55d-4061-9b05-219724845319-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:08:25 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-582e2888-7287-4289-93ee-d047782edc75 tempest-TestInstancesWithCinderVolumes-120733040 None] Acquiring lock "cinder-quobyte-223ab6a6-f55d-4061-9b05-219724845319" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:08:25 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-582e2888-7287-4289-93ee-d047782edc75 tempest-TestInstancesWithCinderVolumes-120733040 None] Lock "cinder-quobyte-223ab6a6-f55d-4061-9b05-219724845319" acquired by "delete_volume" :: waited 0.021s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:08:25 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae70a00b-8992-4b87-ac6b-6cd320a64ed2]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:08:25 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-582e2888-7287-4289-93ee-d047782edc75 tempest-TestInstancesWithCinderVolumes-120733040 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-223ab6a6-f55d-4061-9b05-219724845319 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:08:25 devstack sudo[99892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-223ab6a6-f55d-4061-9b05-219724845319 Sep 07 10:08:25 devstack sudo[99892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:08:25 devstack sudo[99892]: pam_unix(sudo:session): session closed for user root Sep 07 10:08:25 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-582e2888-7287-4289-93ee-d047782edc75 tempest-TestInstancesWithCinderVolumes-120733040 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-223ab6a6-f55d-4061-9b05-219724845319" returned: 0 in 0.576s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:08:25 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-582e2888-7287-4289-93ee-d047782edc75 tempest-TestInstancesWithCinderVolumes-120733040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-223ab6a6-f55d-4061-9b05-219724845319 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:08:25 devstack sudo[99897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-223ab6a6-f55d-4061-9b05-219724845319 Sep 07 10:08:25 devstack sudo[99897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:08:25 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-81e6c83d-35ca-4279-8a3a-9f039c86e616 tempest-GroupsTest-1231519480 None] Group tempest-Group2-1445245513: creating Sep 07 10:08:26 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-81e6c83d-35ca-4279-8a3a-9f039c86e616 tempest-GroupsTest-1231519480 None] Group tempest-Group2-1445245513: created successfully Sep 07 10:08:26 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-81e6c83d-35ca-4279-8a3a-9f039c86e616 tempest-GroupsTest-1231519480 None] Create group completed successfully. Sep 07 10:08:26 devstack sudo[99897]: pam_unix(sudo:session): session closed for user root Sep 07 10:08:26 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-582e2888-7287-4289-93ee-d047782edc75 tempest-TestInstancesWithCinderVolumes-120733040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-223ab6a6-f55d-4061-9b05-219724845319" returned: 0 in 0.349s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:08:26 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-582e2888-7287-4289-93ee-d047782edc75 tempest-TestInstancesWithCinderVolumes-120733040 None] Lock "cinder-quobyte-223ab6a6-f55d-4061-9b05-219724845319" released by "delete_volume" :: held 0.980s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:08:26 devstack cinder-volume[87515]: WARNING cinder.quota [None req-582e2888-7287-4289-93ee-d047782edc75 tempest-TestInstancesWithCinderVolumes-120733040 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1923503818-1082848626 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1923503818-1082848626, it is now deprecated. Please use the default quota class for default quota. Sep 07 10:08:26 devstack cinder-volume[87515]: WARNING cinder.quota [None req-582e2888-7287-4289-93ee-d047782edc75 tempest-TestInstancesWithCinderVolumes-120733040 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1923503818-1082848626 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1923503818-1082848626, it is now deprecated. Please use the default quota class for default quota. Sep 07 10:08:26 devstack cinder-volume[87515]: DEBUG cinder.quota [None req-582e2888-7287-4289-93ee-d047782edc75 tempest-TestInstancesWithCinderVolumes-120733040 None] Created reservations ['130c0188-6e27-41d1-b74c-635b8dc75b6d', '48f24e95-7b78-490d-b83f-792ed0f18353', 'da09f571-3523-4615-b886-da9d4fed891e', 'db32a587-0a90-4473-87f2-a4ef01ac2d55'] {{(pid=87515) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:08:26 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-582e2888-7287-4289-93ee-d047782edc75 tempest-TestInstancesWithCinderVolumes-120733040 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:08:26 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-582e2888-7287-4289-93ee-d047782edc75 tempest-TestInstancesWithCinderVolumes-120733040 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:08:26 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-582e2888-7287-4289-93ee-d047782edc75 tempest-TestInstancesWithCinderVolumes-120733040 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:08:26 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-582e2888-7287-4289-93ee-d047782edc75 tempest-TestInstancesWithCinderVolumes-120733040 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:08:26 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-582e2888-7287-4289-93ee-d047782edc75 tempest-TestInstancesWithCinderVolumes-120733040 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:08:26 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-582e2888-7287-4289-93ee-d047782edc75 tempest-TestInstancesWithCinderVolumes-120733040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:08:26 devstack sudo[99900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a Sep 07 10:08:26 devstack sudo[99900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:08:26 devstack sudo[99900]: pam_unix(sudo:session): session closed for user root Sep 07 10:08:26 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-582e2888-7287-4289-93ee-d047782edc75 tempest-TestInstancesWithCinderVolumes-120733040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a" returned: 0 in 0.303s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:08:26 devstack cinder-volume[87515]: DEBUG cinder.manager [None req-582e2888-7287-4289-93ee-d047782edc75 tempest-TestInstancesWithCinderVolumes-120733040 None] Notifying Schedulers of capabilities ... {{(pid=87515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:08:26 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-582e2888-7287-4289-93ee-d047782edc75 tempest-TestInstancesWithCinderVolumes-120733040 None] Deleted volume successfully. Sep 07 10:08:26 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-582e2888-7287-4289-93ee-d047782edc75 tempest-TestInstancesWithCinderVolumes-120733040 None] Lock "cinder-223ab6a6-f55d-4061-9b05-219724845319-delete_volume" released by "delete_volume" :: held 1.553s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:08:27 devstack cinder-volume[87515]: DEBUG cinder.volume.flows.manager.create_volume [None req-e3c9ffdc-20a1-4716-828d-d6544bb5a60e tempest-GroupsTest-1231519480 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 10:08:27 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-e3c9ffdc-20a1-4716-828d-d6544bb5a60e tempest-GroupsTest-1231519480 None] Flow 'volume_create_manager' (de9efdf9-a0ea-403e-b287-6fbe721d9f80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:08:27 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-e3c9ffdc-20a1-4716-828d-d6544bb5a60e tempest-GroupsTest-1231519480 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c6efba7-a19e-4bca-9903-fc1a96375f58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:08:27 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-e3c9ffdc-20a1-4716-828d-d6544bb5a60e tempest-GroupsTest-1231519480 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c6efba7-a19e-4bca-9903-fc1a96375f58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:08:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-477438494',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=59b72c7c-e80b-4996-ad30-247b3663ffd6,host='devstack@QuobyteHD#QuobyteHD',id=48cccf9c-5338-4e3c-97f5-30f7031ed87d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6943710d2c854f13ab9b46fe84661d96',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:08:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:08:28Z,use_quota=True,user_id='d5a292049b304554bcd6dfc16c601da8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7964c5c-473a-4105-a22b-6b0fc554860e),volume_type_id=d7964c5c-473a-4105-a22b-6b0fc554860e)' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:08:27 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-e3c9ffdc-20a1-4716-828d-d6544bb5a60e tempest-GroupsTest-1231519480 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (055b3c67-b7ac-462e-ae60-0db92bb16790) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:08:27 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-e3c9ffdc-20a1-4716-828d-d6544bb5a60e tempest-GroupsTest-1231519480 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (055b3c67-b7ac-462e-ae60-0db92bb16790) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:08:27 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-e3c9ffdc-20a1-4716-828d-d6544bb5a60e tempest-GroupsTest-1231519480 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9fa0d0c-14a8-4d08-b820-78cf11ce8105) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:08:27 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-e3c9ffdc-20a1-4716-828d-d6544bb5a60e tempest-GroupsTest-1231519480 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9fa0d0c-14a8-4d08-b820-78cf11ce8105) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '48cccf9c-5338-4e3c-97f5-30f7031ed87d', 'volume_name': 'volume-48cccf9c-5338-4e3c-97f5-30f7031ed87d', 'volume_size': 1}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:08:27 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-e3c9ffdc-20a1-4716-828d-d6544bb5a60e tempest-GroupsTest-1231519480 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9a5a13e-ce4b-41b0-91d1-e8998ab67204) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:08:27 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-e3c9ffdc-20a1-4716-828d-d6544bb5a60e tempest-GroupsTest-1231519480 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9a5a13e-ce4b-41b0-91d1-e8998ab67204) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:08:27 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-e3c9ffdc-20a1-4716-828d-d6544bb5a60e tempest-GroupsTest-1231519480 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40af25af-e221-4a5a-b3f6-39831f8d5f1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:08:27 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-e3c9ffdc-20a1-4716-828d-d6544bb5a60e tempest-GroupsTest-1231519480 None] Volume 48cccf9c-5338-4e3c-97f5-30f7031ed87d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-48cccf9c-5338-4e3c-97f5-30f7031ed87d', 'volume_size': 1} Sep 07 10:08:27 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-e3c9ffdc-20a1-4716-828d-d6544bb5a60e tempest-GroupsTest-1231519480 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:08:27 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-e3c9ffdc-20a1-4716-828d-d6544bb5a60e tempest-GroupsTest-1231519480 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:08:27 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-e3c9ffdc-20a1-4716-828d-d6544bb5a60e tempest-GroupsTest-1231519480 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=59b72c7c-e80b-4996-ad30-247b3663ffd6,created_at=2026-09-07T08:08:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-477438494',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=59b72c7c-e80b-4996-ad30-247b3663ffd6,host='devstack@QuobyteHD#QuobyteHD',id=48cccf9c-5338-4e3c-97f5-30f7031ed87d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6943710d2c854f13ab9b46fe84661d96',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:08:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:08:28Z,use_quota=True,user_id='d5a292049b304554bcd6dfc16c601da8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7964c5c-473a-4105-a22b-6b0fc554860e),volume_type_id=d7964c5c-473a-4105-a22b-6b0fc554860e)}" {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 10:08:27 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-e3c9ffdc-20a1-4716-828d-d6544bb5a60e tempest-GroupsTest-1231519480 None] Creating volume 48cccf9c-5338-4e3c-97f5-30f7031ed87d {{(pid=87515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 10:08:27 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-e3c9ffdc-20a1-4716-828d-d6544bb5a60e tempest-GroupsTest-1231519480 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:08:27 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-e3c9ffdc-20a1-4716-828d-d6544bb5a60e tempest-GroupsTest-1231519480 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:08:27 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-e3c9ffdc-20a1-4716-828d-d6544bb5a60e tempest-GroupsTest-1231519480 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:08:28 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-e3c9ffdc-20a1-4716-828d-d6544bb5a60e tempest-GroupsTest-1231519480 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:08:28 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-e3c9ffdc-20a1-4716-828d-d6544bb5a60e tempest-GroupsTest-1231519480 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:08:28 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-e3c9ffdc-20a1-4716-828d-d6544bb5a60e tempest-GroupsTest-1231519480 None] Selected osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c as target Quobyte volume. {{(pid=87515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 10:08:28 devstack cinder-volume[87515]: INFO cinder.volume.drivers.remotefs [None req-e3c9ffdc-20a1-4716-828d-d6544bb5a60e tempest-GroupsTest-1231519480 None] casted to osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c Sep 07 10:08:28 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-e3c9ffdc-20a1-4716-828d-d6544bb5a60e tempest-GroupsTest-1231519480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-48cccf9c-5338-4e3c-97f5-30f7031ed87d 1073741824 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:08:28 devstack sudo[99905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-48cccf9c-5338-4e3c-97f5-30f7031ed87d 1073741824 Sep 07 10:08:28 devstack sudo[99905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:08:28 devstack sudo[99905]: pam_unix(sudo:session): session closed for user root Sep 07 10:08:28 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-e3c9ffdc-20a1-4716-828d-d6544bb5a60e tempest-GroupsTest-1231519480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-48cccf9c-5338-4e3c-97f5-30f7031ed87d 1073741824" returned: 0 in 0.530s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:08:28 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-e3c9ffdc-20a1-4716-828d-d6544bb5a60e tempest-GroupsTest-1231519480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-48cccf9c-5338-4e3c-97f5-30f7031ed87d {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:08:28 devstack sudo[99911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-48cccf9c-5338-4e3c-97f5-30f7031ed87d Sep 07 10:08:28 devstack sudo[99911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:08:28 devstack sudo[99911]: pam_unix(sudo:session): session closed for user root Sep 07 10:08:28 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-e3c9ffdc-20a1-4716-828d-d6544bb5a60e tempest-GroupsTest-1231519480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-48cccf9c-5338-4e3c-97f5-30f7031ed87d" returned: 0 in 0.308s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:08:28 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-e3c9ffdc-20a1-4716-828d-d6544bb5a60e tempest-GroupsTest-1231519480 None] <== create_volume: return (899ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'} {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 10:08:28 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-e3c9ffdc-20a1-4716-828d-d6544bb5a60e tempest-GroupsTest-1231519480 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.901s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:08:28 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-e3c9ffdc-20a1-4716-828d-d6544bb5a60e tempest-GroupsTest-1231519480 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40af25af-e221-4a5a-b3f6-39831f8d5f1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-48cccf9c-5338-4e3c-97f5-30f7031ed87d', 'volume_size': 1}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:08:28 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-e3c9ffdc-20a1-4716-828d-d6544bb5a60e tempest-GroupsTest-1231519480 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (694728d8-da13-4a31-983a-70a382344860) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:08:28 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-e3c9ffdc-20a1-4716-828d-d6544bb5a60e tempest-GroupsTest-1231519480 None] Volume volume-48cccf9c-5338-4e3c-97f5-30f7031ed87d (48cccf9c-5338-4e3c-97f5-30f7031ed87d): created successfully Sep 07 10:08:28 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-e3c9ffdc-20a1-4716-828d-d6544bb5a60e tempest-GroupsTest-1231519480 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (694728d8-da13-4a31-983a-70a382344860) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:08:28 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-e3c9ffdc-20a1-4716-828d-d6544bb5a60e tempest-GroupsTest-1231519480 None] Flow 'volume_create_manager' (de9efdf9-a0ea-403e-b287-6fbe721d9f80) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:08:29 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-e3c9ffdc-20a1-4716-828d-d6544bb5a60e tempest-GroupsTest-1231519480 None] Created volume successfully. Sep 07 10:08:29 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-0cc1500d-81d2-4f30-8d71-ecc1f625d438 tempest-GroupsTest-1231519480 None] Acquiring lock "cinder-quobyte-48cccf9c-5338-4e3c-97f5-30f7031ed87d" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:08:29 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-0cc1500d-81d2-4f30-8d71-ecc1f625d438 tempest-GroupsTest-1231519480 None] Lock "cinder-quobyte-48cccf9c-5338-4e3c-97f5-30f7031ed87d" acquired by "delete_volume" :: waited 0.029s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:08:29 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[f75876f6-caa3-4ec3-a4db-e705084cd93b]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:08:29 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-0cc1500d-81d2-4f30-8d71-ecc1f625d438 tempest-GroupsTest-1231519480 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-48cccf9c-5338-4e3c-97f5-30f7031ed87d {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:08:30 devstack sudo[99915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-48cccf9c-5338-4e3c-97f5-30f7031ed87d Sep 07 10:08:30 devstack sudo[99915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:08:30 devstack sudo[99915]: pam_unix(sudo:session): session closed for user root Sep 07 10:08:30 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-0cc1500d-81d2-4f30-8d71-ecc1f625d438 tempest-GroupsTest-1231519480 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-48cccf9c-5338-4e3c-97f5-30f7031ed87d" returned: 0 in 0.457s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:08:30 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-0cc1500d-81d2-4f30-8d71-ecc1f625d438 tempest-GroupsTest-1231519480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-48cccf9c-5338-4e3c-97f5-30f7031ed87d {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:08:30 devstack sudo[99920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-48cccf9c-5338-4e3c-97f5-30f7031ed87d Sep 07 10:08:30 devstack sudo[99920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:08:30 devstack sudo[99920]: pam_unix(sudo:session): session closed for user root Sep 07 10:08:30 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-0cc1500d-81d2-4f30-8d71-ecc1f625d438 tempest-GroupsTest-1231519480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-48cccf9c-5338-4e3c-97f5-30f7031ed87d" returned: 0 in 0.329s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:08:30 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-0cc1500d-81d2-4f30-8d71-ecc1f625d438 tempest-GroupsTest-1231519480 None] Lock "cinder-quobyte-48cccf9c-5338-4e3c-97f5-30f7031ed87d" released by "delete_volume" :: held 0.873s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:08:30 devstack cinder-volume[87515]: DEBUG cinder.quota [None req-0cc1500d-81d2-4f30-8d71-ecc1f625d438 tempest-GroupsTest-1231519480 None] Created reservations ['590314ad-f587-4c3b-8af3-076c8d4a2472'] {{(pid=87515) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:08:31 devstack cinder-volume[87515]: WARNING cinder.quota [None req-0cc1500d-81d2-4f30-8d71-ecc1f625d438 tempest-GroupsTest-1231519480 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-499959479 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-499959479, it is now deprecated. Please use the default quota class for default quota. Sep 07 10:08:31 devstack cinder-volume[87515]: WARNING cinder.quota [None req-0cc1500d-81d2-4f30-8d71-ecc1f625d438 tempest-GroupsTest-1231519480 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-499959479 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-499959479, it is now deprecated. Please use the default quota class for default quota. Sep 07 10:08:31 devstack cinder-volume[87515]: DEBUG cinder.quota [None req-0cc1500d-81d2-4f30-8d71-ecc1f625d438 tempest-GroupsTest-1231519480 None] Created reservations ['95f6a46b-79c3-4f6c-b630-fa2faeea7085', '1de21add-0494-4d88-b2a6-d2c0f2666b91', '44696b2d-28d2-47a2-b759-1aa507e57df3', '13e1ae9d-c4f3-4492-90f2-cdc0b519e84e'] {{(pid=87515) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:08:31 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-0cc1500d-81d2-4f30-8d71-ecc1f625d438 tempest-GroupsTest-1231519480 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:08:31 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-0cc1500d-81d2-4f30-8d71-ecc1f625d438 tempest-GroupsTest-1231519480 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:08:31 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-0cc1500d-81d2-4f30-8d71-ecc1f625d438 tempest-GroupsTest-1231519480 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:08:31 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-0cc1500d-81d2-4f30-8d71-ecc1f625d438 tempest-GroupsTest-1231519480 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:08:31 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-0cc1500d-81d2-4f30-8d71-ecc1f625d438 tempest-GroupsTest-1231519480 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:08:31 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-0cc1500d-81d2-4f30-8d71-ecc1f625d438 tempest-GroupsTest-1231519480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:08:31 devstack sudo[99925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a Sep 07 10:08:31 devstack sudo[99925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:08:31 devstack sudo[99925]: pam_unix(sudo:session): session closed for user root Sep 07 10:08:31 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-0cc1500d-81d2-4f30-8d71-ecc1f625d438 tempest-GroupsTest-1231519480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a" returned: 0 in 0.584s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:08:31 devstack cinder-volume[87515]: DEBUG cinder.manager [None req-0cc1500d-81d2-4f30-8d71-ecc1f625d438 tempest-GroupsTest-1231519480 None] Notifying Schedulers of capabilities ... {{(pid=87515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:08:31 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-0cc1500d-81d2-4f30-8d71-ecc1f625d438 tempest-GroupsTest-1231519480 None] Delete group completed successfully. Sep 07 10:08:32 devstack cinder-volume[87515]: DEBUG cinder.quota [None req-1dd4957c-3303-40d7-b571-b24d0f05277b tempest-GroupsTest-1231519480 None] Created reservations ['86674a5c-3f98-48b1-95b9-c0cb2231fdcf'] {{(pid=87515) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:08:32 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-1dd4957c-3303-40d7-b571-b24d0f05277b tempest-GroupsTest-1231519480 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:08:32 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-1dd4957c-3303-40d7-b571-b24d0f05277b tempest-GroupsTest-1231519480 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:08:32 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-1dd4957c-3303-40d7-b571-b24d0f05277b tempest-GroupsTest-1231519480 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:08:32 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-1dd4957c-3303-40d7-b571-b24d0f05277b tempest-GroupsTest-1231519480 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:08:32 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-1dd4957c-3303-40d7-b571-b24d0f05277b tempest-GroupsTest-1231519480 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:08:32 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-1dd4957c-3303-40d7-b571-b24d0f05277b tempest-GroupsTest-1231519480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:08:32 devstack sudo[99949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a Sep 07 10:08:32 devstack sudo[99949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:08:32 devstack cinder-volume[87515]: DEBUG cinder.volume.flows.manager.create_volume [None req-4ef0ecde-f248-49fa-bbb2-a3a9f53a584f tempest-SnapshotDependencyTests-409813660 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 10:08:32 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-4ef0ecde-f248-49fa-bbb2-a3a9f53a584f tempest-SnapshotDependencyTests-409813660 None] Flow 'volume_create_manager' (6559b7fe-7c65-47fb-a514-8cf749099548) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:08:32 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-4ef0ecde-f248-49fa-bbb2-a3a9f53a584f tempest-SnapshotDependencyTests-409813660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77200771-527e-4320-9a84-1b2431ba2444) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:08:32 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-4ef0ecde-f248-49fa-bbb2-a3a9f53a584f tempest-SnapshotDependencyTests-409813660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77200771-527e-4320-9a84-1b2431ba2444) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:08:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-770080750',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c860cdd-44d8-405f-a42c-036e26b2ca36,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2c9f69f50b249928d6ba2bdc8acbc5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:08:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:08:33Z,use_quota=True,user_id='36d5dd757b354b63912bc320b88cf381',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3a092cd-7947-4cbf-abff-4ba9567becf0),volume_type_id=f3a092cd-7947-4cbf-abff-4ba9567becf0)' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:08:32 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-4ef0ecde-f248-49fa-bbb2-a3a9f53a584f tempest-SnapshotDependencyTests-409813660 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (873228b4-fa85-463d-acd6-8dfcbc28efa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:08:32 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-4ef0ecde-f248-49fa-bbb2-a3a9f53a584f tempest-SnapshotDependencyTests-409813660 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (873228b4-fa85-463d-acd6-8dfcbc28efa9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:08:32 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-4ef0ecde-f248-49fa-bbb2-a3a9f53a584f tempest-SnapshotDependencyTests-409813660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c42d2402-861e-4548-b74b-49d755d78294) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:08:32 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-4ef0ecde-f248-49fa-bbb2-a3a9f53a584f tempest-SnapshotDependencyTests-409813660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c42d2402-861e-4548-b74b-49d755d78294) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3c860cdd-44d8-405f-a42c-036e26b2ca36', 'volume_name': 'volume-3c860cdd-44d8-405f-a42c-036e26b2ca36', 'volume_size': 1}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:08:32 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-4ef0ecde-f248-49fa-bbb2-a3a9f53a584f tempest-SnapshotDependencyTests-409813660 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab36c0aa-bbdf-4ca0-a181-60ac35510e73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:08:32 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-4ef0ecde-f248-49fa-bbb2-a3a9f53a584f tempest-SnapshotDependencyTests-409813660 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab36c0aa-bbdf-4ca0-a181-60ac35510e73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:08:33 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-4ef0ecde-f248-49fa-bbb2-a3a9f53a584f tempest-SnapshotDependencyTests-409813660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e914a753-f701-4b0d-9a22-d6edf5d5b05a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:08:33 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-4ef0ecde-f248-49fa-bbb2-a3a9f53a584f tempest-SnapshotDependencyTests-409813660 None] Volume 3c860cdd-44d8-405f-a42c-036e26b2ca36: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3c860cdd-44d8-405f-a42c-036e26b2ca36', 'volume_size': 1} Sep 07 10:08:33 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-4ef0ecde-f248-49fa-bbb2-a3a9f53a584f tempest-SnapshotDependencyTests-409813660 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:08:33 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-4ef0ecde-f248-49fa-bbb2-a3a9f53a584f tempest-SnapshotDependencyTests-409813660 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:08:33 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-4ef0ecde-f248-49fa-bbb2-a3a9f53a584f tempest-SnapshotDependencyTests-409813660 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:08:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-770080750',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c860cdd-44d8-405f-a42c-036e26b2ca36,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2c9f69f50b249928d6ba2bdc8acbc5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:08:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:08:33Z,use_quota=True,user_id='36d5dd757b354b63912bc320b88cf381',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3a092cd-7947-4cbf-abff-4ba9567becf0),volume_type_id=f3a092cd-7947-4cbf-abff-4ba9567becf0)}" {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 10:08:33 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-4ef0ecde-f248-49fa-bbb2-a3a9f53a584f tempest-SnapshotDependencyTests-409813660 None] Creating volume 3c860cdd-44d8-405f-a42c-036e26b2ca36 {{(pid=87515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 10:08:33 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-4ef0ecde-f248-49fa-bbb2-a3a9f53a584f tempest-SnapshotDependencyTests-409813660 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:08:33 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-4ef0ecde-f248-49fa-bbb2-a3a9f53a584f tempest-SnapshotDependencyTests-409813660 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:08:33 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-4ef0ecde-f248-49fa-bbb2-a3a9f53a584f tempest-SnapshotDependencyTests-409813660 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:08:33 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-4ef0ecde-f248-49fa-bbb2-a3a9f53a584f tempest-SnapshotDependencyTests-409813660 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:08:33 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-4ef0ecde-f248-49fa-bbb2-a3a9f53a584f tempest-SnapshotDependencyTests-409813660 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:08:33 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-4ef0ecde-f248-49fa-bbb2-a3a9f53a584f tempest-SnapshotDependencyTests-409813660 None] Selected osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c as target Quobyte volume. {{(pid=87515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 10:08:33 devstack cinder-volume[87515]: INFO cinder.volume.drivers.remotefs [None req-4ef0ecde-f248-49fa-bbb2-a3a9f53a584f tempest-SnapshotDependencyTests-409813660 None] casted to osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c Sep 07 10:08:33 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-4ef0ecde-f248-49fa-bbb2-a3a9f53a584f tempest-SnapshotDependencyTests-409813660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-3c860cdd-44d8-405f-a42c-036e26b2ca36 1073741824 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:08:33 devstack sudo[99952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-3c860cdd-44d8-405f-a42c-036e26b2ca36 1073741824 Sep 07 10:08:33 devstack sudo[99952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:08:33 devstack sudo[99949]: pam_unix(sudo:session): session closed for user root Sep 07 10:08:33 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-1dd4957c-3303-40d7-b571-b24d0f05277b tempest-GroupsTest-1231519480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a" returned: 0 in 0.576s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:08:33 devstack cinder-volume[87515]: DEBUG cinder.manager [None req-1dd4957c-3303-40d7-b571-b24d0f05277b tempest-GroupsTest-1231519480 None] Notifying Schedulers of capabilities ... {{(pid=87515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:08:33 devstack cinder-volume[87515]: INFO cinder.volume.manager [req-bcdd82b4-89f9-41d3-9afe-b381ad401186 req-ad8aa1fc-8aa1-45df-9181-fd254664118d tempest-TestInstancesWithCinderVolumes-120733040 None] Terminate volume connection completed successfully. Sep 07 10:08:33 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [req-bcdd82b4-89f9-41d3-9afe-b381ad401186 req-ad8aa1fc-8aa1-45df-9181-fd254664118d tempest-TestInstancesWithCinderVolumes-120733040 None] Deleting attachment 1f4a0d17-4284-407a-94cb-6b16597b8d18. {{(pid=87515) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 07 10:08:33 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-1dd4957c-3303-40d7-b571-b24d0f05277b tempest-GroupsTest-1231519480 None] Delete group completed successfully. Sep 07 10:08:33 devstack sudo[99952]: pam_unix(sudo:session): session closed for user root Sep 07 10:08:33 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-4ef0ecde-f248-49fa-bbb2-a3a9f53a584f tempest-SnapshotDependencyTests-409813660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-3c860cdd-44d8-405f-a42c-036e26b2ca36 1073741824" returned: 0 in 0.792s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:08:33 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-4ef0ecde-f248-49fa-bbb2-a3a9f53a584f tempest-SnapshotDependencyTests-409813660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-3c860cdd-44d8-405f-a42c-036e26b2ca36 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:08:33 devstack sudo[99958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-3c860cdd-44d8-405f-a42c-036e26b2ca36 Sep 07 10:08:33 devstack sudo[99958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:08:34 devstack sudo[99958]: pam_unix(sudo:session): session closed for user root Sep 07 10:08:34 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-4ef0ecde-f248-49fa-bbb2-a3a9f53a584f tempest-SnapshotDependencyTests-409813660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-3c860cdd-44d8-405f-a42c-036e26b2ca36" returned: 0 in 0.436s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:08:34 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-4ef0ecde-f248-49fa-bbb2-a3a9f53a584f tempest-SnapshotDependencyTests-409813660 None] <== create_volume: return (1286ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'} {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 10:08:34 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-4ef0ecde-f248-49fa-bbb2-a3a9f53a584f tempest-SnapshotDependencyTests-409813660 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.289s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:08:34 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-4ef0ecde-f248-49fa-bbb2-a3a9f53a584f tempest-SnapshotDependencyTests-409813660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e914a753-f701-4b0d-9a22-d6edf5d5b05a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3c860cdd-44d8-405f-a42c-036e26b2ca36', 'volume_size': 1}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:08:34 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-4ef0ecde-f248-49fa-bbb2-a3a9f53a584f tempest-SnapshotDependencyTests-409813660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21249d38-cdc1-44d9-a2f0-d8e309c1e4ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:08:34 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-9667fc62-c52b-45ee-a777-b6a33f7e1b38 tempest-GroupsTest-1231519480 None] Group tempest-GroupsTest-Group-90872903: creating Sep 07 10:08:34 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-4ef0ecde-f248-49fa-bbb2-a3a9f53a584f tempest-SnapshotDependencyTests-409813660 None] Volume volume-3c860cdd-44d8-405f-a42c-036e26b2ca36 (3c860cdd-44d8-405f-a42c-036e26b2ca36): created successfully Sep 07 10:08:34 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-4ef0ecde-f248-49fa-bbb2-a3a9f53a584f tempest-SnapshotDependencyTests-409813660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21249d38-cdc1-44d9-a2f0-d8e309c1e4ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:08:34 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-4ef0ecde-f248-49fa-bbb2-a3a9f53a584f tempest-SnapshotDependencyTests-409813660 None] Flow 'volume_create_manager' (6559b7fe-7c65-47fb-a514-8cf749099548) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:08:34 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-4ef0ecde-f248-49fa-bbb2-a3a9f53a584f tempest-SnapshotDependencyTests-409813660 None] Created volume successfully. Sep 07 10:08:34 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-9667fc62-c52b-45ee-a777-b6a33f7e1b38 tempest-GroupsTest-1231519480 None] Group tempest-GroupsTest-Group-90872903: created successfully Sep 07 10:08:34 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-9667fc62-c52b-45ee-a777-b6a33f7e1b38 tempest-GroupsTest-1231519480 None] Create group completed successfully. Sep 07 10:08:34 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-56ec43af-6b17-49ba-a01c-773a30396825 tempest-TestInstancesWithCinderVolumes-120733040 None] Acquiring lock "cinder-d5aa431e-9421-48c0-9d3c-bb472d9415af-delete_volume" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:08:34 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-56ec43af-6b17-49ba-a01c-773a30396825 tempest-TestInstancesWithCinderVolumes-120733040 None] Lock "cinder-d5aa431e-9421-48c0-9d3c-bb472d9415af-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:08:34 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-56ec43af-6b17-49ba-a01c-773a30396825 tempest-TestInstancesWithCinderVolumes-120733040 None] Acquiring lock "cinder-quobyte-d5aa431e-9421-48c0-9d3c-bb472d9415af" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:08:34 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-56ec43af-6b17-49ba-a01c-773a30396825 tempest-TestInstancesWithCinderVolumes-120733040 None] Lock "cinder-quobyte-d5aa431e-9421-48c0-9d3c-bb472d9415af" acquired by "delete_volume" :: waited 0.024s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:08:34 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[76658fab-8b41-4d72-8f65-a50d2050c9a1]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:08:34 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-56ec43af-6b17-49ba-a01c-773a30396825 tempest-TestInstancesWithCinderVolumes-120733040 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-d5aa431e-9421-48c0-9d3c-bb472d9415af {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:08:34 devstack sudo[99961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-d5aa431e-9421-48c0-9d3c-bb472d9415af Sep 07 10:08:34 devstack sudo[99961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:08:35 devstack sudo[99961]: pam_unix(sudo:session): session closed for user root Sep 07 10:08:35 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-56ec43af-6b17-49ba-a01c-773a30396825 tempest-TestInstancesWithCinderVolumes-120733040 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-d5aa431e-9421-48c0-9d3c-bb472d9415af" returned: 0 in 0.423s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:08:35 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-56ec43af-6b17-49ba-a01c-773a30396825 tempest-TestInstancesWithCinderVolumes-120733040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-d5aa431e-9421-48c0-9d3c-bb472d9415af {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:08:35 devstack sudo[99966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-d5aa431e-9421-48c0-9d3c-bb472d9415af Sep 07 10:08:35 devstack sudo[99966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:08:35 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-f5b46153-1ceb-498c-91c1-544d6c6eb533 tempest-SnapshotDependencyTests-409813660 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:08:35 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-f5b46153-1ceb-498c-91c1-544d6c6eb533 tempest-SnapshotDependencyTests-409813660 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:08:35 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-f5b46153-1ceb-498c-91c1-544d6c6eb533 tempest-SnapshotDependencyTests-409813660 None] Creating offline snapshot 55f554d2-56f8-4aa9-9f08-9357a917298b of volume 3c860cdd-44d8-405f-a42c-036e26b2ca36 {{(pid=87515) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 10:08:35 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8c085a3-2647-4e64-88d2-353378222ab6]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:08:35 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-f5b46153-1ceb-498c-91c1-544d6c6eb533 tempest-SnapshotDependencyTests-409813660 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-3c860cdd-44d8-405f-a42c-036e26b2ca36 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:08:35 devstack sudo[99968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-3c860cdd-44d8-405f-a42c-036e26b2ca36 Sep 07 10:08:35 devstack sudo[99968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:08:35 devstack sudo[99966]: pam_unix(sudo:session): session closed for user root Sep 07 10:08:35 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-56ec43af-6b17-49ba-a01c-773a30396825 tempest-TestInstancesWithCinderVolumes-120733040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-d5aa431e-9421-48c0-9d3c-bb472d9415af" returned: 0 in 0.311s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:08:35 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-56ec43af-6b17-49ba-a01c-773a30396825 tempest-TestInstancesWithCinderVolumes-120733040 None] Lock "cinder-quobyte-d5aa431e-9421-48c0-9d3c-bb472d9415af" released by "delete_volume" :: held 0.797s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:08:35 devstack cinder-volume[87515]: WARNING cinder.quota [None req-56ec43af-6b17-49ba-a01c-773a30396825 tempest-TestInstancesWithCinderVolumes-120733040 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-279318106-877993645 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-279318106-877993645, it is now deprecated. Please use the default quota class for default quota. Sep 07 10:08:35 devstack cinder-volume[87515]: WARNING cinder.quota [None req-56ec43af-6b17-49ba-a01c-773a30396825 tempest-TestInstancesWithCinderVolumes-120733040 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-279318106-877993645 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-279318106-877993645, it is now deprecated. Please use the default quota class for default quota. Sep 07 10:08:35 devstack cinder-volume[87515]: DEBUG cinder.quota [None req-56ec43af-6b17-49ba-a01c-773a30396825 tempest-TestInstancesWithCinderVolumes-120733040 None] Created reservations ['55790cac-33a9-427f-be5a-c0b6abbc354d', 'bcdf15a9-e648-4840-84ea-6d62804f6df2', 'f87195e8-8f57-406a-a6ae-dfb16a0d5d16', 'fc9c190f-35e9-41e8-93f4-8031394ae3e3'] {{(pid=87515) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:08:35 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-56ec43af-6b17-49ba-a01c-773a30396825 tempest-TestInstancesWithCinderVolumes-120733040 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:08:35 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-56ec43af-6b17-49ba-a01c-773a30396825 tempest-TestInstancesWithCinderVolumes-120733040 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:08:35 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-56ec43af-6b17-49ba-a01c-773a30396825 tempest-TestInstancesWithCinderVolumes-120733040 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:08:35 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-56ec43af-6b17-49ba-a01c-773a30396825 tempest-TestInstancesWithCinderVolumes-120733040 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:08:35 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-56ec43af-6b17-49ba-a01c-773a30396825 tempest-TestInstancesWithCinderVolumes-120733040 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:08:35 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-56ec43af-6b17-49ba-a01c-773a30396825 tempest-TestInstancesWithCinderVolumes-120733040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:08:35 devstack sudo[99974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a Sep 07 10:08:35 devstack sudo[99974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:08:35 devstack sudo[99968]: pam_unix(sudo:session): session closed for user root Sep 07 10:08:35 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-f5b46153-1ceb-498c-91c1-544d6c6eb533 tempest-SnapshotDependencyTests-409813660 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-3c860cdd-44d8-405f-a42c-036e26b2ca36" returned: 0 in 0.513s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:08:35 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-f5b46153-1ceb-498c-91c1-544d6c6eb533 tempest-SnapshotDependencyTests-409813660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-3c860cdd-44d8-405f-a42c-036e26b2ca36,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-3c860cdd-44d8-405f-a42c-036e26b2ca36.55f554d2-56f8-4aa9-9f08-9357a917298b 1G {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:08:35 devstack sudo[99976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-3c860cdd-44d8-405f-a42c-036e26b2ca36,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-3c860cdd-44d8-405f-a42c-036e26b2ca36.55f554d2-56f8-4aa9-9f08-9357a917298b 1G Sep 07 10:08:35 devstack sudo[99976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:08:36 devstack sudo[99974]: pam_unix(sudo:session): session closed for user root Sep 07 10:08:36 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-56ec43af-6b17-49ba-a01c-773a30396825 tempest-TestInstancesWithCinderVolumes-120733040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a" returned: 0 in 0.405s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:08:36 devstack cinder-volume[87515]: DEBUG cinder.manager [None req-56ec43af-6b17-49ba-a01c-773a30396825 tempest-TestInstancesWithCinderVolumes-120733040 None] Notifying Schedulers of capabilities ... {{(pid=87515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:08:36 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-56ec43af-6b17-49ba-a01c-773a30396825 tempest-TestInstancesWithCinderVolumes-120733040 None] Deleted volume successfully. Sep 07 10:08:36 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-56ec43af-6b17-49ba-a01c-773a30396825 tempest-TestInstancesWithCinderVolumes-120733040 None] Lock "cinder-d5aa431e-9421-48c0-9d3c-bb472d9415af-delete_volume" released by "delete_volume" :: held 1.564s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:08:36 devstack cinder-volume[87515]: DEBUG cinder.volume.flows.manager.create_volume [None req-da6bf330-fd9e-475b-b823-4875746d6d9d tempest-GroupsTest-1231519480 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 10:08:36 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-da6bf330-fd9e-475b-b823-4875746d6d9d tempest-GroupsTest-1231519480 None] Flow 'volume_create_manager' (fdb92549-1114-41fd-bcd6-dc9b21a538e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:08:36 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-da6bf330-fd9e-475b-b823-4875746d6d9d tempest-GroupsTest-1231519480 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e23bcab-aa0b-4dcf-a3ad-1fc25e0571a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:08:36 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-da6bf330-fd9e-475b-b823-4875746d6d9d tempest-GroupsTest-1231519480 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e23bcab-aa0b-4dcf-a3ad-1fc25e0571a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:08:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1607478480',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a20e856e-72e6-4926-8114-5a3408507bad,host='devstack@QuobyteHD#QuobyteHD',id=6d060a2b-628f-4bad-ba44-efa6557985a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6943710d2c854f13ab9b46fe84661d96',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:08:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:08:36Z,use_quota=True,user_id='d5a292049b304554bcd6dfc16c601da8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f3085d2-7415-4173-902b-6791edf54c85),volume_type_id=7f3085d2-7415-4173-902b-6791edf54c85)' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:08:36 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-da6bf330-fd9e-475b-b823-4875746d6d9d tempest-GroupsTest-1231519480 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1795e21d-4298-464d-82d8-374e012e065a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:08:36 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-da6bf330-fd9e-475b-b823-4875746d6d9d tempest-GroupsTest-1231519480 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1795e21d-4298-464d-82d8-374e012e065a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:08:36 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-da6bf330-fd9e-475b-b823-4875746d6d9d tempest-GroupsTest-1231519480 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6cd2eb1d-39cf-455b-9854-9ff0e2771728) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:08:36 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-da6bf330-fd9e-475b-b823-4875746d6d9d tempest-GroupsTest-1231519480 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6cd2eb1d-39cf-455b-9854-9ff0e2771728) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6d060a2b-628f-4bad-ba44-efa6557985a4', 'volume_name': 'volume-6d060a2b-628f-4bad-ba44-efa6557985a4', 'volume_size': 1}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:08:36 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-da6bf330-fd9e-475b-b823-4875746d6d9d tempest-GroupsTest-1231519480 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65e5d374-e3f7-48f3-a0d7-0700b9b4e0dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:08:36 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-da6bf330-fd9e-475b-b823-4875746d6d9d tempest-GroupsTest-1231519480 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65e5d374-e3f7-48f3-a0d7-0700b9b4e0dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:08:36 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-da6bf330-fd9e-475b-b823-4875746d6d9d tempest-GroupsTest-1231519480 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c28c17e3-aa87-4ac3-a9a4-86f12b889964) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:08:36 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-da6bf330-fd9e-475b-b823-4875746d6d9d tempest-GroupsTest-1231519480 None] Volume 6d060a2b-628f-4bad-ba44-efa6557985a4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6d060a2b-628f-4bad-ba44-efa6557985a4', 'volume_size': 1} Sep 07 10:08:36 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-da6bf330-fd9e-475b-b823-4875746d6d9d tempest-GroupsTest-1231519480 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:08:36 devstack sudo[99976]: pam_unix(sudo:session): session closed for user root Sep 07 10:08:36 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-f5b46153-1ceb-498c-91c1-544d6c6eb533 tempest-SnapshotDependencyTests-409813660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-3c860cdd-44d8-405f-a42c-036e26b2ca36,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-3c860cdd-44d8-405f-a42c-036e26b2ca36.55f554d2-56f8-4aa9-9f08-9357a917298b 1G" returned: 0 in 0.697s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:08:36 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-f5b46153-1ceb-498c-91c1-544d6c6eb533 tempest-SnapshotDependencyTests-409813660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3c860cdd-44d8-405f-a42c-036e26b2ca36 -F qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-3c860cdd-44d8-405f-a42c-036e26b2ca36.55f554d2-56f8-4aa9-9f08-9357a917298b {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:08:36 devstack sudo[99983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3c860cdd-44d8-405f-a42c-036e26b2ca36 -F qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-3c860cdd-44d8-405f-a42c-036e26b2ca36.55f554d2-56f8-4aa9-9f08-9357a917298b Sep 07 10:08:36 devstack sudo[99983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:08:36 devstack sudo[99983]: pam_unix(sudo:session): session closed for user root Sep 07 10:08:36 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-f5b46153-1ceb-498c-91c1-544d6c6eb533 tempest-SnapshotDependencyTests-409813660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3c860cdd-44d8-405f-a42c-036e26b2ca36 -F qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-3c860cdd-44d8-405f-a42c-036e26b2ca36.55f554d2-56f8-4aa9-9f08-9357a917298b" returned: 0 in 0.366s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:08:36 devstack cinder-volume[87515]: WARNING cinder.volume.drivers.remotefs [None req-f5b46153-1ceb-498c-91c1-544d6c6eb533 tempest-SnapshotDependencyTests-409813660 None] /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-3c860cdd-44d8-405f-a42c-036e26b2ca36.55f554d2-56f8-4aa9-9f08-9357a917298b is being set with open permissions: ugo+rw Sep 07 10:08:36 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-f5b46153-1ceb-498c-91c1-544d6c6eb533 tempest-SnapshotDependencyTests-409813660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-3c860cdd-44d8-405f-a42c-036e26b2ca36.55f554d2-56f8-4aa9-9f08-9357a917298b {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:08:36 devstack sudo[99991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-3c860cdd-44d8-405f-a42c-036e26b2ca36.55f554d2-56f8-4aa9-9f08-9357a917298b Sep 07 10:08:36 devstack sudo[99991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:08:37 devstack sudo[99991]: pam_unix(sudo:session): session closed for user root Sep 07 10:08:37 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-f5b46153-1ceb-498c-91c1-544d6c6eb533 tempest-SnapshotDependencyTests-409813660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-3c860cdd-44d8-405f-a42c-036e26b2ca36.55f554d2-56f8-4aa9-9f08-9357a917298b" returned: 0 in 0.300s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:08:37 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-f5b46153-1ceb-498c-91c1-544d6c6eb533 tempest-SnapshotDependencyTests-409813660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-3c860cdd-44d8-405f-a42c-036e26b2ca36.info {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:08:37 devstack sudo[99997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-3c860cdd-44d8-405f-a42c-036e26b2ca36.info Sep 07 10:08:37 devstack sudo[99997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:08:37 devstack sudo[99997]: pam_unix(sudo:session): session closed for user root Sep 07 10:08:37 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-f5b46153-1ceb-498c-91c1-544d6c6eb533 tempest-SnapshotDependencyTests-409813660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-3c860cdd-44d8-405f-a42c-036e26b2ca36.info" returned: 0 in 0.295s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:08:37 devstack cinder-volume[87515]: WARNING cinder.volume.drivers.remotefs [None req-f5b46153-1ceb-498c-91c1-544d6c6eb533 tempest-SnapshotDependencyTests-409813660 None] /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-3c860cdd-44d8-405f-a42c-036e26b2ca36.info is being set with open permissions: ugo+rw Sep 07 10:08:37 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-f5b46153-1ceb-498c-91c1-544d6c6eb533 tempest-SnapshotDependencyTests-409813660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-3c860cdd-44d8-405f-a42c-036e26b2ca36.info {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:08:37 devstack sudo[100000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-3c860cdd-44d8-405f-a42c-036e26b2ca36.info Sep 07 10:08:37 devstack sudo[100000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:08:37 devstack sudo[100000]: pam_unix(sudo:session): session closed for user root Sep 07 10:08:37 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-f5b46153-1ceb-498c-91c1-544d6c6eb533 tempest-SnapshotDependencyTests-409813660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-3c860cdd-44d8-405f-a42c-036e26b2ca36.info" returned: 0 in 0.312s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:08:37 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-f5b46153-1ceb-498c-91c1-544d6c6eb533 tempest-SnapshotDependencyTests-409813660 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.593s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:08:37 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-da6bf330-fd9e-475b-b823-4875746d6d9d tempest-GroupsTest-1231519480 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.414s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:08:37 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-da6bf330-fd9e-475b-b823-4875746d6d9d tempest-GroupsTest-1231519480 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=a20e856e-72e6-4926-8114-5a3408507bad,created_at=2026-09-07T08:08:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1607478480',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a20e856e-72e6-4926-8114-5a3408507bad,host='devstack@QuobyteHD#QuobyteHD',id=6d060a2b-628f-4bad-ba44-efa6557985a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6943710d2c854f13ab9b46fe84661d96',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:08:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:08:36Z,use_quota=True,user_id='d5a292049b304554bcd6dfc16c601da8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f3085d2-7415-4173-902b-6791edf54c85),volume_type_id=7f3085d2-7415-4173-902b-6791edf54c85)}" {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 10:08:37 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-da6bf330-fd9e-475b-b823-4875746d6d9d tempest-GroupsTest-1231519480 None] Creating volume 6d060a2b-628f-4bad-ba44-efa6557985a4 {{(pid=87515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 10:08:37 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-da6bf330-fd9e-475b-b823-4875746d6d9d tempest-GroupsTest-1231519480 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:08:37 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-da6bf330-fd9e-475b-b823-4875746d6d9d tempest-GroupsTest-1231519480 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:08:37 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-da6bf330-fd9e-475b-b823-4875746d6d9d tempest-GroupsTest-1231519480 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:08:37 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-da6bf330-fd9e-475b-b823-4875746d6d9d tempest-GroupsTest-1231519480 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:08:37 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-da6bf330-fd9e-475b-b823-4875746d6d9d tempest-GroupsTest-1231519480 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:08:37 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-da6bf330-fd9e-475b-b823-4875746d6d9d tempest-GroupsTest-1231519480 None] Selected osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c as target Quobyte volume. {{(pid=87515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 10:08:37 devstack cinder-volume[87515]: INFO cinder.volume.drivers.remotefs [None req-da6bf330-fd9e-475b-b823-4875746d6d9d tempest-GroupsTest-1231519480 None] casted to osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c Sep 07 10:08:37 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-da6bf330-fd9e-475b-b823-4875746d6d9d tempest-GroupsTest-1231519480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-6d060a2b-628f-4bad-ba44-efa6557985a4 1073741824 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:08:37 devstack sudo[100003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-6d060a2b-628f-4bad-ba44-efa6557985a4 1073741824 Sep 07 10:08:37 devstack sudo[100003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:08:37 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-f5b46153-1ceb-498c-91c1-544d6c6eb533 tempest-SnapshotDependencyTests-409813660 None] Create snapshot completed successfully Sep 07 10:08:38 devstack sudo[100003]: pam_unix(sudo:session): session closed for user root Sep 07 10:08:38 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-da6bf330-fd9e-475b-b823-4875746d6d9d tempest-GroupsTest-1231519480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-6d060a2b-628f-4bad-ba44-efa6557985a4 1073741824" returned: 0 in 0.542s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:08:38 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-da6bf330-fd9e-475b-b823-4875746d6d9d tempest-GroupsTest-1231519480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-6d060a2b-628f-4bad-ba44-efa6557985a4 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:08:38 devstack sudo[100009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-6d060a2b-628f-4bad-ba44-efa6557985a4 Sep 07 10:08:38 devstack sudo[100009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:08:38 devstack cinder-volume[87515]: DEBUG cinder.volume.flows.manager.create_volume [None req-34ce511b-85ae-4aac-9c58-1590ae30d3df tempest-VolumeSnapshotQuotasNegativeTestJSON-1010112892 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 10:08:38 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-34ce511b-85ae-4aac-9c58-1590ae30d3df tempest-VolumeSnapshotQuotasNegativeTestJSON-1010112892 None] Flow 'volume_create_manager' (6bfe9545-cb9e-4afa-9e35-5268af7f64f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:08:38 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-34ce511b-85ae-4aac-9c58-1590ae30d3df tempest-VolumeSnapshotQuotasNegativeTestJSON-1010112892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9773bdc-020f-495b-94f3-9e40230c8401) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:08:38 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-34ce511b-85ae-4aac-9c58-1590ae30d3df tempest-VolumeSnapshotQuotasNegativeTestJSON-1010112892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9773bdc-020f-495b-94f3-9e40230c8401) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:08:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-685352625',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=199be463-3236-46da-9a96-ee31051efaad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0b19a6d47684667a96c831740562277',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:08:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:08:38Z,use_quota=True,user_id='5dce7b64f51347e390b8e6050c4933cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3a092cd-7947-4cbf-abff-4ba9567becf0),volume_type_id=f3a092cd-7947-4cbf-abff-4ba9567becf0)' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:08:38 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-34ce511b-85ae-4aac-9c58-1590ae30d3df tempest-VolumeSnapshotQuotasNegativeTestJSON-1010112892 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47c82b3b-d597-40dd-ba85-12b0a9656faa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:08:38 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-34ce511b-85ae-4aac-9c58-1590ae30d3df tempest-VolumeSnapshotQuotasNegativeTestJSON-1010112892 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47c82b3b-d597-40dd-ba85-12b0a9656faa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:08:38 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-34ce511b-85ae-4aac-9c58-1590ae30d3df tempest-VolumeSnapshotQuotasNegativeTestJSON-1010112892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01612b06-8547-482c-b996-d9346e7da6a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:08:38 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-34ce511b-85ae-4aac-9c58-1590ae30d3df tempest-VolumeSnapshotQuotasNegativeTestJSON-1010112892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01612b06-8547-482c-b996-d9346e7da6a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '199be463-3236-46da-9a96-ee31051efaad', 'volume_name': 'volume-199be463-3236-46da-9a96-ee31051efaad', 'volume_size': 1}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:08:38 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-34ce511b-85ae-4aac-9c58-1590ae30d3df tempest-VolumeSnapshotQuotasNegativeTestJSON-1010112892 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10474c19-6b9e-466a-b121-ab577a8d16eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:08:38 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-34ce511b-85ae-4aac-9c58-1590ae30d3df tempest-VolumeSnapshotQuotasNegativeTestJSON-1010112892 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10474c19-6b9e-466a-b121-ab577a8d16eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:08:38 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-34ce511b-85ae-4aac-9c58-1590ae30d3df tempest-VolumeSnapshotQuotasNegativeTestJSON-1010112892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01680250-5094-4ff0-962d-f0c86ea7a0bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:08:38 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-34ce511b-85ae-4aac-9c58-1590ae30d3df tempest-VolumeSnapshotQuotasNegativeTestJSON-1010112892 None] Volume 199be463-3236-46da-9a96-ee31051efaad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-199be463-3236-46da-9a96-ee31051efaad', 'volume_size': 1} Sep 07 10:08:38 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-34ce511b-85ae-4aac-9c58-1590ae30d3df tempest-VolumeSnapshotQuotasNegativeTestJSON-1010112892 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:08:38 devstack sudo[100009]: pam_unix(sudo:session): session closed for user root Sep 07 10:08:38 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-da6bf330-fd9e-475b-b823-4875746d6d9d tempest-GroupsTest-1231519480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-6d060a2b-628f-4bad-ba44-efa6557985a4" returned: 0 in 0.368s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:08:38 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-da6bf330-fd9e-475b-b823-4875746d6d9d tempest-GroupsTest-1231519480 None] <== create_volume: return (969ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'} {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 10:08:38 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-da6bf330-fd9e-475b-b823-4875746d6d9d tempest-GroupsTest-1231519480 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.975s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:08:38 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-34ce511b-85ae-4aac-9c58-1590ae30d3df tempest-VolumeSnapshotQuotasNegativeTestJSON-1010112892 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.203s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:08:38 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-34ce511b-85ae-4aac-9c58-1590ae30d3df tempest-VolumeSnapshotQuotasNegativeTestJSON-1010112892 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:08:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-685352625',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=199be463-3236-46da-9a96-ee31051efaad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0b19a6d47684667a96c831740562277',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:08:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:08:38Z,use_quota=True,user_id='5dce7b64f51347e390b8e6050c4933cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3a092cd-7947-4cbf-abff-4ba9567becf0),volume_type_id=f3a092cd-7947-4cbf-abff-4ba9567becf0)}" {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 10:08:38 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-34ce511b-85ae-4aac-9c58-1590ae30d3df tempest-VolumeSnapshotQuotasNegativeTestJSON-1010112892 None] Creating volume 199be463-3236-46da-9a96-ee31051efaad {{(pid=87515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 10:08:38 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-34ce511b-85ae-4aac-9c58-1590ae30d3df tempest-VolumeSnapshotQuotasNegativeTestJSON-1010112892 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:08:38 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-34ce511b-85ae-4aac-9c58-1590ae30d3df tempest-VolumeSnapshotQuotasNegativeTestJSON-1010112892 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:08:38 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-34ce511b-85ae-4aac-9c58-1590ae30d3df tempest-VolumeSnapshotQuotasNegativeTestJSON-1010112892 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:08:38 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-34ce511b-85ae-4aac-9c58-1590ae30d3df tempest-VolumeSnapshotQuotasNegativeTestJSON-1010112892 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:08:38 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-34ce511b-85ae-4aac-9c58-1590ae30d3df tempest-VolumeSnapshotQuotasNegativeTestJSON-1010112892 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:08:38 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-34ce511b-85ae-4aac-9c58-1590ae30d3df tempest-VolumeSnapshotQuotasNegativeTestJSON-1010112892 None] Selected osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c as target Quobyte volume. {{(pid=87515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 10:08:38 devstack cinder-volume[87515]: INFO cinder.volume.drivers.remotefs [None req-34ce511b-85ae-4aac-9c58-1590ae30d3df tempest-VolumeSnapshotQuotasNegativeTestJSON-1010112892 None] casted to osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c Sep 07 10:08:38 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-34ce511b-85ae-4aac-9c58-1590ae30d3df tempest-VolumeSnapshotQuotasNegativeTestJSON-1010112892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-199be463-3236-46da-9a96-ee31051efaad 1073741824 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:08:38 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-da6bf330-fd9e-475b-b823-4875746d6d9d tempest-GroupsTest-1231519480 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c28c17e3-aa87-4ac3-a9a4-86f12b889964) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6d060a2b-628f-4bad-ba44-efa6557985a4', 'volume_size': 1}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:08:38 devstack sudo[100013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-199be463-3236-46da-9a96-ee31051efaad 1073741824 Sep 07 10:08:38 devstack sudo[100013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:08:38 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-da6bf330-fd9e-475b-b823-4875746d6d9d tempest-GroupsTest-1231519480 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83681384-e33a-4949-bdfc-9adc4476a374) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:08:38 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-da6bf330-fd9e-475b-b823-4875746d6d9d tempest-GroupsTest-1231519480 None] Volume volume-6d060a2b-628f-4bad-ba44-efa6557985a4 (6d060a2b-628f-4bad-ba44-efa6557985a4): created successfully Sep 07 10:08:38 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-da6bf330-fd9e-475b-b823-4875746d6d9d tempest-GroupsTest-1231519480 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83681384-e33a-4949-bdfc-9adc4476a374) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:08:38 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-da6bf330-fd9e-475b-b823-4875746d6d9d tempest-GroupsTest-1231519480 None] Flow 'volume_create_manager' (fdb92549-1114-41fd-bcd6-dc9b21a538e6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:08:38 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-da6bf330-fd9e-475b-b823-4875746d6d9d tempest-GroupsTest-1231519480 None] Created volume successfully. Sep 07 10:08:39 devstack cinder-volume[87515]: DEBUG cinder.volume.flows.manager.create_volume [None req-3404c2b1-76c3-4a6b-b78a-002e9a83c5cf tempest-SnapshotDependencyTests-409813660 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 10:08:39 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-3404c2b1-76c3-4a6b-b78a-002e9a83c5cf tempest-SnapshotDependencyTests-409813660 None] Flow 'volume_create_manager' (8eeff9a4-eb41-404f-950c-2595a225fd08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:08:39 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-3404c2b1-76c3-4a6b-b78a-002e9a83c5cf tempest-SnapshotDependencyTests-409813660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b389079-871a-4367-b484-c743014b68a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:08:39 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-3404c2b1-76c3-4a6b-b78a-002e9a83c5cf tempest-SnapshotDependencyTests-409813660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b389079-871a-4367-b484-c743014b68a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:08:39Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=beb293d9-8b80-4e2e-8ff0-da1a4b7cc8c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2c9f69f50b249928d6ba2bdc8acbc5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:08:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=55f554d2-56f8-4aa9-9f08-9357a917298b,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:08:39Z,use_quota=True,user_id='36d5dd757b354b63912bc320b88cf381',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3a092cd-7947-4cbf-abff-4ba9567becf0),volume_type_id=f3a092cd-7947-4cbf-abff-4ba9567becf0)' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:08:39 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-3404c2b1-76c3-4a6b-b78a-002e9a83c5cf tempest-SnapshotDependencyTests-409813660 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d82161f1-99cc-4cc4-a5f4-9be7288da3f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:08:39 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-3404c2b1-76c3-4a6b-b78a-002e9a83c5cf tempest-SnapshotDependencyTests-409813660 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d82161f1-99cc-4cc4-a5f4-9be7288da3f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:08:39 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-3404c2b1-76c3-4a6b-b78a-002e9a83c5cf tempest-SnapshotDependencyTests-409813660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dea32fea-3913-4746-a50b-989e43e04530) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:08:39 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-3404c2b1-76c3-4a6b-b78a-002e9a83c5cf tempest-SnapshotDependencyTests-409813660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dea32fea-3913-4746-a50b-989e43e04530) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'beb293d9-8b80-4e2e-8ff0-da1a4b7cc8c4', 'volume_name': 'volume-beb293d9-8b80-4e2e-8ff0-da1a4b7cc8c4', 'volume_size': 1, 'snapshot_id': '55f554d2-56f8-4aa9-9f08-9357a917298b'}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:08:39 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-3404c2b1-76c3-4a6b-b78a-002e9a83c5cf tempest-SnapshotDependencyTests-409813660 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (890ab198-abc1-4de6-8d86-548bd9656cf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:08:39 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-3404c2b1-76c3-4a6b-b78a-002e9a83c5cf tempest-SnapshotDependencyTests-409813660 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (890ab198-abc1-4de6-8d86-548bd9656cf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:08:39 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-3404c2b1-76c3-4a6b-b78a-002e9a83c5cf tempest-SnapshotDependencyTests-409813660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (894a1951-4b4e-415f-a822-b281552768c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:08:39 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-3404c2b1-76c3-4a6b-b78a-002e9a83c5cf tempest-SnapshotDependencyTests-409813660 None] Volume beb293d9-8b80-4e2e-8ff0-da1a4b7cc8c4: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-beb293d9-8b80-4e2e-8ff0-da1a4b7cc8c4', 'volume_size': 1, 'snapshot_id': '55f554d2-56f8-4aa9-9f08-9357a917298b'} Sep 07 10:08:39 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-3404c2b1-76c3-4a6b-b78a-002e9a83c5cf tempest-SnapshotDependencyTests-409813660 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:08:39 devstack sudo[100013]: pam_unix(sudo:session): session closed for user root Sep 07 10:08:39 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-34ce511b-85ae-4aac-9c58-1590ae30d3df tempest-VolumeSnapshotQuotasNegativeTestJSON-1010112892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-199be463-3236-46da-9a96-ee31051efaad 1073741824" returned: 0 in 0.585s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:08:39 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-34ce511b-85ae-4aac-9c58-1590ae30d3df tempest-VolumeSnapshotQuotasNegativeTestJSON-1010112892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-199be463-3236-46da-9a96-ee31051efaad {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:08:39 devstack sudo[100020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-199be463-3236-46da-9a96-ee31051efaad Sep 07 10:08:39 devstack sudo[100020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:08:39 devstack sudo[100020]: pam_unix(sudo:session): session closed for user root Sep 07 10:08:39 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-34ce511b-85ae-4aac-9c58-1590ae30d3df tempest-VolumeSnapshotQuotasNegativeTestJSON-1010112892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-199be463-3236-46da-9a96-ee31051efaad" returned: 0 in 0.255s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:08:39 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-34ce511b-85ae-4aac-9c58-1590ae30d3df tempest-VolumeSnapshotQuotasNegativeTestJSON-1010112892 None] <== create_volume: return (880ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'} {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 10:08:39 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-34ce511b-85ae-4aac-9c58-1590ae30d3df tempest-VolumeSnapshotQuotasNegativeTestJSON-1010112892 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.885s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:08:39 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-3404c2b1-76c3-4a6b-b78a-002e9a83c5cf tempest-SnapshotDependencyTests-409813660 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.413s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:08:39 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-3404c2b1-76c3-4a6b-b78a-002e9a83c5cf tempest-SnapshotDependencyTests-409813660 None] Acquiring lock "cinder-quobyte-55f554d2-56f8-4aa9-9f08-9357a917298b-beb293d9-8b80-4e2e-8ff0-da1a4b7cc8c4" by "_create_volume_from_snapshot" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:08:39 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-34ce511b-85ae-4aac-9c58-1590ae30d3df tempest-VolumeSnapshotQuotasNegativeTestJSON-1010112892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01680250-5094-4ff0-962d-f0c86ea7a0bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-199be463-3236-46da-9a96-ee31051efaad', 'volume_size': 1}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:08:39 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-34ce511b-85ae-4aac-9c58-1590ae30d3df tempest-VolumeSnapshotQuotasNegativeTestJSON-1010112892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (555a6d9d-fe75-447e-bc72-198d644d68db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:08:39 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-3404c2b1-76c3-4a6b-b78a-002e9a83c5cf tempest-SnapshotDependencyTests-409813660 None] Lock "cinder-quobyte-55f554d2-56f8-4aa9-9f08-9357a917298b-beb293d9-8b80-4e2e-8ff0-da1a4b7cc8c4" acquired by "_create_volume_from_snapshot" :: waited 0.039s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:08:39 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-3404c2b1-76c3-4a6b-b78a-002e9a83c5cf tempest-SnapshotDependencyTests-409813660 None] Creating volume beb293d9-8b80-4e2e-8ff0-da1a4b7cc8c4 from snapshot 55f554d2-56f8-4aa9-9f08-9357a917298b {{(pid=87515) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 07 10:08:39 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-3404c2b1-76c3-4a6b-b78a-002e9a83c5cf tempest-SnapshotDependencyTests-409813660 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:08:39 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-3404c2b1-76c3-4a6b-b78a-002e9a83c5cf tempest-SnapshotDependencyTests-409813660 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:08:39 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-3404c2b1-76c3-4a6b-b78a-002e9a83c5cf tempest-SnapshotDependencyTests-409813660 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:08:39 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-3404c2b1-76c3-4a6b-b78a-002e9a83c5cf tempest-SnapshotDependencyTests-409813660 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:08:39 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-3404c2b1-76c3-4a6b-b78a-002e9a83c5cf tempest-SnapshotDependencyTests-409813660 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:08:39 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-3404c2b1-76c3-4a6b-b78a-002e9a83c5cf tempest-SnapshotDependencyTests-409813660 None] Selected osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c as target Quobyte volume. {{(pid=87515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 10:08:39 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-3404c2b1-76c3-4a6b-b78a-002e9a83c5cf tempest-SnapshotDependencyTests-409813660 None] Acquiring lock "cinder-quobyte-beb293d9-8b80-4e2e-8ff0-da1a4b7cc8c4" by "_copy_volume_from_snapshot" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:08:39 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-34ce511b-85ae-4aac-9c58-1590ae30d3df tempest-VolumeSnapshotQuotasNegativeTestJSON-1010112892 None] Volume volume-199be463-3236-46da-9a96-ee31051efaad (199be463-3236-46da-9a96-ee31051efaad): created successfully Sep 07 10:08:39 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-34ce511b-85ae-4aac-9c58-1590ae30d3df tempest-VolumeSnapshotQuotasNegativeTestJSON-1010112892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (555a6d9d-fe75-447e-bc72-198d644d68db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:08:39 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-34ce511b-85ae-4aac-9c58-1590ae30d3df tempest-VolumeSnapshotQuotasNegativeTestJSON-1010112892 None] Flow 'volume_create_manager' (6bfe9545-cb9e-4afa-9e35-5268af7f64f5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:08:39 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-3404c2b1-76c3-4a6b-b78a-002e9a83c5cf tempest-SnapshotDependencyTests-409813660 None] Lock "cinder-quobyte-beb293d9-8b80-4e2e-8ff0-da1a4b7cc8c4" acquired by "_copy_volume_from_snapshot" :: waited 0.042s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:08:39 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-3404c2b1-76c3-4a6b-b78a-002e9a83c5cf tempest-SnapshotDependencyTests-409813660 None] snapshot: 55f554d2-56f8-4aa9-9f08-9357a917298b, volume: beb293d9-8b80-4e2e-8ff0-da1a4b7cc8c4, {{(pid=87515) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 07 10:08:39 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-34ce511b-85ae-4aac-9c58-1590ae30d3df tempest-VolumeSnapshotQuotasNegativeTestJSON-1010112892 None] Created volume successfully. Sep 07 10:08:39 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-3404c2b1-76c3-4a6b-b78a-002e9a83c5cf tempest-SnapshotDependencyTests-409813660 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:08:39 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-3404c2b1-76c3-4a6b-b78a-002e9a83c5cf tempest-SnapshotDependencyTests-409813660 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:08:39 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-3404c2b1-76c3-4a6b-b78a-002e9a83c5cf tempest-SnapshotDependencyTests-409813660 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:08:39 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-3404c2b1-76c3-4a6b-b78a-002e9a83c5cf tempest-SnapshotDependencyTests-409813660 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:08:39 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-3404c2b1-76c3-4a6b-b78a-002e9a83c5cf tempest-SnapshotDependencyTests-409813660 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:08:39 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb91711f-6b90-4370-bcb0-53e5c1e48416]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:08:39 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-3404c2b1-76c3-4a6b-b78a-002e9a83c5cf tempest-SnapshotDependencyTests-409813660 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-3c860cdd-44d8-405f-a42c-036e26b2ca36.55f554d2-56f8-4aa9-9f08-9357a917298b {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:08:39 devstack sudo[100023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-3c860cdd-44d8-405f-a42c-036e26b2ca36.55f554d2-56f8-4aa9-9f08-9357a917298b Sep 07 10:08:39 devstack sudo[100023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:08:40 devstack sudo[100023]: pam_unix(sudo:session): session closed for user root Sep 07 10:08:40 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-3404c2b1-76c3-4a6b-b78a-002e9a83c5cf tempest-SnapshotDependencyTests-409813660 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-3c860cdd-44d8-405f-a42c-036e26b2ca36.55f554d2-56f8-4aa9-9f08-9357a917298b" returned: 0 in 0.382s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:08:40 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-3404c2b1-76c3-4a6b-b78a-002e9a83c5cf tempest-SnapshotDependencyTests-409813660 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3c860cdd-44d8-405f-a42c-036e26b2ca36(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87515) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 10:08:40 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[4aebdad2-ee59-4f51-b75f-580efbee8c08]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:08:40 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-3404c2b1-76c3-4a6b-b78a-002e9a83c5cf tempest-SnapshotDependencyTests-409813660 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-3c860cdd-44d8-405f-a42c-036e26b2ca36 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:08:40 devstack sudo[100028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-3c860cdd-44d8-405f-a42c-036e26b2ca36 Sep 07 10:08:40 devstack sudo[100028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:08:40 devstack cinder-volume[87515]: DEBUG cinder.volume.flows.manager.create_volume [None req-af74b5de-e97e-446c-ba3e-7ad6094ba2af tempest-GroupsTest-1231519480 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 10:08:40 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-af74b5de-e97e-446c-ba3e-7ad6094ba2af tempest-GroupsTest-1231519480 None] Flow 'volume_create_manager' (a013e835-a304-4773-94ef-7e9c11b2e33f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:08:40 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-af74b5de-e97e-446c-ba3e-7ad6094ba2af tempest-GroupsTest-1231519480 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db0e4d04-72b5-4771-933e-e106e8f43207) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:08:40 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-af74b5de-e97e-446c-ba3e-7ad6094ba2af tempest-GroupsTest-1231519480 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db0e4d04-72b5-4771-933e-e106e8f43207) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:08:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-659841806',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a20e856e-72e6-4926-8114-5a3408507bad,host='devstack@QuobyteHD#QuobyteHD',id=ab01132c-4fc0-46d1-b1b6-6020eba2fbbf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6943710d2c854f13ab9b46fe84661d96',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:08:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:08:40Z,use_quota=True,user_id='d5a292049b304554bcd6dfc16c601da8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f3085d2-7415-4173-902b-6791edf54c85),volume_type_id=7f3085d2-7415-4173-902b-6791edf54c85)' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:08:40 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-af74b5de-e97e-446c-ba3e-7ad6094ba2af tempest-GroupsTest-1231519480 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a04e0dc-dd42-44a4-a1e2-469ebd280aeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:08:40 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-af74b5de-e97e-446c-ba3e-7ad6094ba2af tempest-GroupsTest-1231519480 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a04e0dc-dd42-44a4-a1e2-469ebd280aeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:08:40 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-af74b5de-e97e-446c-ba3e-7ad6094ba2af tempest-GroupsTest-1231519480 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c33645d-e260-4b4e-9efc-54e89ce0fa48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:08:40 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-af74b5de-e97e-446c-ba3e-7ad6094ba2af tempest-GroupsTest-1231519480 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c33645d-e260-4b4e-9efc-54e89ce0fa48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ab01132c-4fc0-46d1-b1b6-6020eba2fbbf', 'volume_name': 'volume-ab01132c-4fc0-46d1-b1b6-6020eba2fbbf', 'volume_size': 1}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:08:40 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-af74b5de-e97e-446c-ba3e-7ad6094ba2af tempest-GroupsTest-1231519480 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc532679-c8c9-4087-8f45-ed3631fe8b69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:08:40 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-af74b5de-e97e-446c-ba3e-7ad6094ba2af tempest-GroupsTest-1231519480 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc532679-c8c9-4087-8f45-ed3631fe8b69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:08:40 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-af74b5de-e97e-446c-ba3e-7ad6094ba2af tempest-GroupsTest-1231519480 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ed96998-0c4e-42cf-914d-9fec05266e78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:08:40 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-af74b5de-e97e-446c-ba3e-7ad6094ba2af tempest-GroupsTest-1231519480 None] Volume ab01132c-4fc0-46d1-b1b6-6020eba2fbbf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ab01132c-4fc0-46d1-b1b6-6020eba2fbbf', 'volume_size': 1} Sep 07 10:08:40 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-af74b5de-e97e-446c-ba3e-7ad6094ba2af tempest-GroupsTest-1231519480 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:08:40 devstack sudo[100028]: pam_unix(sudo:session): session closed for user root Sep 07 10:08:40 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-3404c2b1-76c3-4a6b-b78a-002e9a83c5cf tempest-SnapshotDependencyTests-409813660 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-3c860cdd-44d8-405f-a42c-036e26b2ca36" returned: 0 in 0.492s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:08:40 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-3404c2b1-76c3-4a6b-b78a-002e9a83c5cf tempest-SnapshotDependencyTests-409813660 None] will copy from snapshot at /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-3c860cdd-44d8-405f-a42c-036e26b2ca36 {{(pid=87515) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 07 10:08:40 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-3404c2b1-76c3-4a6b-b78a-002e9a83c5cf tempest-SnapshotDependencyTests-409813660 None] Creating direct copy from snapshot {{(pid=87515) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 07 10:08:40 devstack cinder-volume[87515]: DEBUG cinder.utils [None req-3404c2b1-76c3-4a6b-b78a-002e9a83c5cf tempest-SnapshotDependencyTests-409813660 None] Path /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-beb293d9-8b80-4e2e-8ff0-da1a4b7cc8c4 not found in is_blk_device check {{(pid=87515) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 07 10:08:40 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-3404c2b1-76c3-4a6b-b78a-002e9a83c5cf tempest-SnapshotDependencyTests-409813660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-3c860cdd-44d8-405f-a42c-036e26b2ca36 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-beb293d9-8b80-4e2e-8ff0-da1a4b7cc8c4 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:08:40 devstack sudo[100034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-3c860cdd-44d8-405f-a42c-036e26b2ca36 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-beb293d9-8b80-4e2e-8ff0-da1a4b7cc8c4 Sep 07 10:08:40 devstack sudo[100034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:08:40 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-4783707f-228c-4572-a317-78c3f4cb0790 tempest-VolumeSnapshotQuotasNegativeTestJSON-1010112892 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:08:46 devstack sudo[100034]: pam_unix(sudo:session): session closed for user root Sep 07 10:08:46 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-3404c2b1-76c3-4a6b-b78a-002e9a83c5cf tempest-SnapshotDependencyTests-409813660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-3c860cdd-44d8-405f-a42c-036e26b2ca36 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-beb293d9-8b80-4e2e-8ff0-da1a4b7cc8c4" returned: 0 in 5.315s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:08:46 devstack cinder-volume[87515]: DEBUG cinder.image.image_utils [None req-3404c2b1-76c3-4a6b-b78a-002e9a83c5cf tempest-SnapshotDependencyTests-409813660 None] Image conversion details: src /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-3c860cdd-44d8-405f-a42c-036e26b2ca36, size 1024.00 MB, duration 5.32 sec, destination /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-beb293d9-8b80-4e2e-8ff0-da1a4b7cc8c4 {{(pid=87515) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 07 10:08:46 devstack cinder-volume[87515]: INFO cinder.image.image_utils [None req-3404c2b1-76c3-4a6b-b78a-002e9a83c5cf tempest-SnapshotDependencyTests-409813660 None] Converted 1024.00 MB image at 192.61 MB/s Sep 07 10:08:46 devstack cinder-volume[87515]: WARNING cinder.volume.drivers.remotefs [None req-3404c2b1-76c3-4a6b-b78a-002e9a83c5cf tempest-SnapshotDependencyTests-409813660 None] /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-beb293d9-8b80-4e2e-8ff0-da1a4b7cc8c4 is being set with open permissions: ugo+rw Sep 07 10:08:46 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-3404c2b1-76c3-4a6b-b78a-002e9a83c5cf tempest-SnapshotDependencyTests-409813660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-beb293d9-8b80-4e2e-8ff0-da1a4b7cc8c4 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:08:46 devstack sudo[100049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-beb293d9-8b80-4e2e-8ff0-da1a4b7cc8c4 Sep 07 10:08:46 devstack sudo[100049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:08:46 devstack sudo[100049]: pam_unix(sudo:session): session closed for user root Sep 07 10:08:46 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-3404c2b1-76c3-4a6b-b78a-002e9a83c5cf tempest-SnapshotDependencyTests-409813660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-beb293d9-8b80-4e2e-8ff0-da1a4b7cc8c4" returned: 0 in 0.253s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:08:46 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-3404c2b1-76c3-4a6b-b78a-002e9a83c5cf tempest-SnapshotDependencyTests-409813660 None] Lock "cinder-quobyte-beb293d9-8b80-4e2e-8ff0-da1a4b7cc8c4" released by "_copy_volume_from_snapshot" :: held 6.553s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:08:46 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-3404c2b1-76c3-4a6b-b78a-002e9a83c5cf tempest-SnapshotDependencyTests-409813660 None] Lock "cinder-quobyte-55f554d2-56f8-4aa9-9f08-9357a917298b-beb293d9-8b80-4e2e-8ff0-da1a4b7cc8c4" released by "_create_volume_from_snapshot" :: held 6.669s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:08:46 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-3404c2b1-76c3-4a6b-b78a-002e9a83c5cf tempest-SnapshotDependencyTests-409813660 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.710s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:08:46 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-af74b5de-e97e-446c-ba3e-7ad6094ba2af tempest-GroupsTest-1231519480 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.788s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:08:46 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-af74b5de-e97e-446c-ba3e-7ad6094ba2af tempest-GroupsTest-1231519480 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=a20e856e-72e6-4926-8114-5a3408507bad,created_at=2026-09-07T08:08:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-659841806',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a20e856e-72e6-4926-8114-5a3408507bad,host='devstack@QuobyteHD#QuobyteHD',id=ab01132c-4fc0-46d1-b1b6-6020eba2fbbf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6943710d2c854f13ab9b46fe84661d96',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:08:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:08:40Z,use_quota=True,user_id='d5a292049b304554bcd6dfc16c601da8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f3085d2-7415-4173-902b-6791edf54c85),volume_type_id=7f3085d2-7415-4173-902b-6791edf54c85)}" {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 10:08:46 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-af74b5de-e97e-446c-ba3e-7ad6094ba2af tempest-GroupsTest-1231519480 None] Creating volume ab01132c-4fc0-46d1-b1b6-6020eba2fbbf {{(pid=87515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 10:08:46 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-af74b5de-e97e-446c-ba3e-7ad6094ba2af tempest-GroupsTest-1231519480 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:08:46 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-af74b5de-e97e-446c-ba3e-7ad6094ba2af tempest-GroupsTest-1231519480 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:08:46 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-af74b5de-e97e-446c-ba3e-7ad6094ba2af tempest-GroupsTest-1231519480 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:08:46 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-af74b5de-e97e-446c-ba3e-7ad6094ba2af tempest-GroupsTest-1231519480 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:08:46 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-af74b5de-e97e-446c-ba3e-7ad6094ba2af tempest-GroupsTest-1231519480 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:08:46 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-af74b5de-e97e-446c-ba3e-7ad6094ba2af tempest-GroupsTest-1231519480 None] Selected osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c as target Quobyte volume. {{(pid=87515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 10:08:46 devstack cinder-volume[87515]: INFO cinder.volume.drivers.remotefs [None req-af74b5de-e97e-446c-ba3e-7ad6094ba2af tempest-GroupsTest-1231519480 None] casted to osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c Sep 07 10:08:46 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-af74b5de-e97e-446c-ba3e-7ad6094ba2af tempest-GroupsTest-1231519480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-ab01132c-4fc0-46d1-b1b6-6020eba2fbbf 1073741824 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:08:46 devstack sudo[100052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-ab01132c-4fc0-46d1-b1b6-6020eba2fbbf 1073741824 Sep 07 10:08:46 devstack sudo[100052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:08:46 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-3404c2b1-76c3-4a6b-b78a-002e9a83c5cf tempest-SnapshotDependencyTests-409813660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (894a1951-4b4e-415f-a822-b281552768c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-beb293d9-8b80-4e2e-8ff0-da1a4b7cc8c4', 'volume_size': 1, 'snapshot_id': '55f554d2-56f8-4aa9-9f08-9357a917298b'}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:08:46 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-3404c2b1-76c3-4a6b-b78a-002e9a83c5cf tempest-SnapshotDependencyTests-409813660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0c0f60b-f272-4018-acc2-48df590b3150) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:08:46 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-3404c2b1-76c3-4a6b-b78a-002e9a83c5cf tempest-SnapshotDependencyTests-409813660 None] Volume volume-beb293d9-8b80-4e2e-8ff0-da1a4b7cc8c4 (beb293d9-8b80-4e2e-8ff0-da1a4b7cc8c4): created successfully Sep 07 10:08:46 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-3404c2b1-76c3-4a6b-b78a-002e9a83c5cf tempest-SnapshotDependencyTests-409813660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0c0f60b-f272-4018-acc2-48df590b3150) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:08:46 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-3404c2b1-76c3-4a6b-b78a-002e9a83c5cf tempest-SnapshotDependencyTests-409813660 None] Flow 'volume_create_manager' (8eeff9a4-eb41-404f-950c-2595a225fd08) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:08:46 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-3404c2b1-76c3-4a6b-b78a-002e9a83c5cf tempest-SnapshotDependencyTests-409813660 None] Created volume successfully. Sep 07 10:08:46 devstack sudo[100052]: pam_unix(sudo:session): session closed for user root Sep 07 10:08:46 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-af74b5de-e97e-446c-ba3e-7ad6094ba2af tempest-GroupsTest-1231519480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-ab01132c-4fc0-46d1-b1b6-6020eba2fbbf 1073741824" returned: 0 in 0.451s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:08:46 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-af74b5de-e97e-446c-ba3e-7ad6094ba2af tempest-GroupsTest-1231519480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-ab01132c-4fc0-46d1-b1b6-6020eba2fbbf {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:08:46 devstack sudo[100058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-ab01132c-4fc0-46d1-b1b6-6020eba2fbbf Sep 07 10:08:46 devstack sudo[100058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:08:46 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-4f04ec3a-beaa-4bd9-aaf2-725c9fb9dd70 tempest-SnapshotDependencyTests-409813660 None] Acquiring lock "cinder-55f554d2-56f8-4aa9-9f08-9357a917298b-delete_snapshot" by "delete_snapshot" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:08:47 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-4f04ec3a-beaa-4bd9-aaf2-725c9fb9dd70 tempest-SnapshotDependencyTests-409813660 None] Lock "cinder-55f554d2-56f8-4aa9-9f08-9357a917298b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:08:47 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-4f04ec3a-beaa-4bd9-aaf2-725c9fb9dd70 tempest-SnapshotDependencyTests-409813660 None] Acquiring lock "cinder-quobyte-3c860cdd-44d8-405f-a42c-036e26b2ca36" by "delete_snapshot" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:08:47 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-4f04ec3a-beaa-4bd9-aaf2-725c9fb9dd70 tempest-SnapshotDependencyTests-409813660 None] Lock "cinder-quobyte-3c860cdd-44d8-405f-a42c-036e26b2ca36" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:08:47 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-4f04ec3a-beaa-4bd9-aaf2-725c9fb9dd70 tempest-SnapshotDependencyTests-409813660 None] Acquiring lock "cinder-quobyte-55f554d2-56f8-4aa9-9f08-9357a917298b" by "_delete_snapshot" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:08:47 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-4f04ec3a-beaa-4bd9-aaf2-725c9fb9dd70 tempest-SnapshotDependencyTests-409813660 None] Lock "cinder-quobyte-55f554d2-56f8-4aa9-9f08-9357a917298b" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:08:47 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-4f04ec3a-beaa-4bd9-aaf2-725c9fb9dd70 tempest-SnapshotDependencyTests-409813660 None] Deleting offline snapshot 55f554d2-56f8-4aa9-9f08-9357a917298b of volume 3c860cdd-44d8-405f-a42c-036e26b2ca36 {{(pid=87515) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 10:08:47 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-4f04ec3a-beaa-4bd9-aaf2-725c9fb9dd70 tempest-SnapshotDependencyTests-409813660 None] snapshot_file for this snap is: volume-3c860cdd-44d8-405f-a42c-036e26b2ca36.55f554d2-56f8-4aa9-9f08-9357a917298b {{(pid=87515) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 10:08:47 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[f50dfa6e-ca12-4b1f-9c69-111c20c4cbb7]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:08:47 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-4f04ec3a-beaa-4bd9-aaf2-725c9fb9dd70 tempest-SnapshotDependencyTests-409813660 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-3c860cdd-44d8-405f-a42c-036e26b2ca36.55f554d2-56f8-4aa9-9f08-9357a917298b {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:08:47 devstack sudo[100058]: pam_unix(sudo:session): session closed for user root Sep 07 10:08:47 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-af74b5de-e97e-446c-ba3e-7ad6094ba2af tempest-GroupsTest-1231519480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-ab01132c-4fc0-46d1-b1b6-6020eba2fbbf" returned: 0 in 0.342s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:08:47 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-af74b5de-e97e-446c-ba3e-7ad6094ba2af tempest-GroupsTest-1231519480 None] <== create_volume: return (840ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'} {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 10:08:47 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-af74b5de-e97e-446c-ba3e-7ad6094ba2af tempest-GroupsTest-1231519480 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.843s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:08:47 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-4783707f-228c-4572-a317-78c3f4cb0790 tempest-VolumeSnapshotQuotasNegativeTestJSON-1010112892 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 6.411s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:08:47 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-4783707f-228c-4572-a317-78c3f4cb0790 tempest-VolumeSnapshotQuotasNegativeTestJSON-1010112892 None] Creating offline snapshot c97f864e-2271-4dba-afd2-bb7ac76749dd of volume 199be463-3236-46da-9a96-ee31051efaad {{(pid=87515) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 10:08:47 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-af74b5de-e97e-446c-ba3e-7ad6094ba2af tempest-GroupsTest-1231519480 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ed96998-0c4e-42cf-914d-9fec05266e78) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ab01132c-4fc0-46d1-b1b6-6020eba2fbbf', 'volume_size': 1}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:08:47 devstack sudo[100060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-3c860cdd-44d8-405f-a42c-036e26b2ca36.55f554d2-56f8-4aa9-9f08-9357a917298b Sep 07 10:08:47 devstack sudo[100060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:08:47 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-af74b5de-e97e-446c-ba3e-7ad6094ba2af tempest-GroupsTest-1231519480 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7cf53c5-3346-44e7-a796-7211c023b9b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:08:47 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9abb837-bc2d-464f-93ef-0a8cf5ec064c]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:08:47 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-4783707f-228c-4572-a317-78c3f4cb0790 tempest-VolumeSnapshotQuotasNegativeTestJSON-1010112892 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-199be463-3236-46da-9a96-ee31051efaad {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:08:47 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-af74b5de-e97e-446c-ba3e-7ad6094ba2af tempest-GroupsTest-1231519480 None] Volume volume-ab01132c-4fc0-46d1-b1b6-6020eba2fbbf (ab01132c-4fc0-46d1-b1b6-6020eba2fbbf): created successfully Sep 07 10:08:47 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-af74b5de-e97e-446c-ba3e-7ad6094ba2af tempest-GroupsTest-1231519480 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7cf53c5-3346-44e7-a796-7211c023b9b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:08:47 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-af74b5de-e97e-446c-ba3e-7ad6094ba2af tempest-GroupsTest-1231519480 None] Flow 'volume_create_manager' (a013e835-a304-4773-94ef-7e9c11b2e33f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:08:47 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-af74b5de-e97e-446c-ba3e-7ad6094ba2af tempest-GroupsTest-1231519480 None] Created volume successfully. Sep 07 10:08:47 devstack sudo[100063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-199be463-3236-46da-9a96-ee31051efaad Sep 07 10:08:47 devstack sudo[100063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:08:47 devstack sudo[100060]: pam_unix(sudo:session): session closed for user root Sep 07 10:08:47 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-4f04ec3a-beaa-4bd9-aaf2-725c9fb9dd70 tempest-SnapshotDependencyTests-409813660 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-3c860cdd-44d8-405f-a42c-036e26b2ca36.55f554d2-56f8-4aa9-9f08-9357a917298b" returned: 0 in 0.403s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:08:47 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-4f04ec3a-beaa-4bd9-aaf2-725c9fb9dd70 tempest-SnapshotDependencyTests-409813660 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3c860cdd-44d8-405f-a42c-036e26b2ca36(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87515) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 10:08:47 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[323b5ab8-09cb-4161-b56a-81deddff49cb]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:08:47 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-4f04ec3a-beaa-4bd9-aaf2-725c9fb9dd70 tempest-SnapshotDependencyTests-409813660 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-3c860cdd-44d8-405f-a42c-036e26b2ca36 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:08:47 devstack sudo[100063]: pam_unix(sudo:session): session closed for user root Sep 07 10:08:47 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-4783707f-228c-4572-a317-78c3f4cb0790 tempest-VolumeSnapshotQuotasNegativeTestJSON-1010112892 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-199be463-3236-46da-9a96-ee31051efaad" returned: 0 in 0.378s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:08:47 devstack sudo[100068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-3c860cdd-44d8-405f-a42c-036e26b2ca36 Sep 07 10:08:47 devstack sudo[100068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:08:47 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-4783707f-228c-4572-a317-78c3f4cb0790 tempest-VolumeSnapshotQuotasNegativeTestJSON-1010112892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-199be463-3236-46da-9a96-ee31051efaad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-199be463-3236-46da-9a96-ee31051efaad.c97f864e-2271-4dba-afd2-bb7ac76749dd 1G {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:08:47 devstack sudo[100073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-199be463-3236-46da-9a96-ee31051efaad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-199be463-3236-46da-9a96-ee31051efaad.c97f864e-2271-4dba-afd2-bb7ac76749dd 1G Sep 07 10:08:47 devstack sudo[100073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:08:48 devstack sudo[100068]: pam_unix(sudo:session): session closed for user root Sep 07 10:08:48 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-4f04ec3a-beaa-4bd9-aaf2-725c9fb9dd70 tempest-SnapshotDependencyTests-409813660 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-3c860cdd-44d8-405f-a42c-036e26b2ca36" returned: 0 in 0.595s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:08:48 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-4f04ec3a-beaa-4bd9-aaf2-725c9fb9dd70 tempest-SnapshotDependencyTests-409813660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-3c860cdd-44d8-405f-a42c-036e26b2ca36.55f554d2-56f8-4aa9-9f08-9357a917298b {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:08:48 devstack sudo[100073]: pam_unix(sudo:session): session closed for user root Sep 07 10:08:48 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-4783707f-228c-4572-a317-78c3f4cb0790 tempest-VolumeSnapshotQuotasNegativeTestJSON-1010112892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-199be463-3236-46da-9a96-ee31051efaad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-199be463-3236-46da-9a96-ee31051efaad.c97f864e-2271-4dba-afd2-bb7ac76749dd 1G" returned: 0 in 0.515s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:08:48 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-4783707f-228c-4572-a317-78c3f4cb0790 tempest-VolumeSnapshotQuotasNegativeTestJSON-1010112892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-199be463-3236-46da-9a96-ee31051efaad -F qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-199be463-3236-46da-9a96-ee31051efaad.c97f864e-2271-4dba-afd2-bb7ac76749dd {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:08:48 devstack sudo[100082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-3c860cdd-44d8-405f-a42c-036e26b2ca36.55f554d2-56f8-4aa9-9f08-9357a917298b Sep 07 10:08:48 devstack sudo[100082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:08:48 devstack sudo[100084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-199be463-3236-46da-9a96-ee31051efaad -F qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-199be463-3236-46da-9a96-ee31051efaad.c97f864e-2271-4dba-afd2-bb7ac76749dd Sep 07 10:08:48 devstack sudo[100084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:08:48 devstack sudo[100084]: pam_unix(sudo:session): session closed for user root Sep 07 10:08:48 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-4783707f-228c-4572-a317-78c3f4cb0790 tempest-VolumeSnapshotQuotasNegativeTestJSON-1010112892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-199be463-3236-46da-9a96-ee31051efaad -F qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-199be463-3236-46da-9a96-ee31051efaad.c97f864e-2271-4dba-afd2-bb7ac76749dd" returned: 0 in 0.328s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:08:48 devstack cinder-volume[87515]: WARNING cinder.volume.drivers.remotefs [None req-4783707f-228c-4572-a317-78c3f4cb0790 tempest-VolumeSnapshotQuotasNegativeTestJSON-1010112892 None] /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-199be463-3236-46da-9a96-ee31051efaad.c97f864e-2271-4dba-afd2-bb7ac76749dd is being set with open permissions: ugo+rw Sep 07 10:08:48 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-4783707f-228c-4572-a317-78c3f4cb0790 tempest-VolumeSnapshotQuotasNegativeTestJSON-1010112892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-199be463-3236-46da-9a96-ee31051efaad.c97f864e-2271-4dba-afd2-bb7ac76749dd {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:08:48 devstack sudo[100093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-199be463-3236-46da-9a96-ee31051efaad.c97f864e-2271-4dba-afd2-bb7ac76749dd Sep 07 10:08:48 devstack sudo[100093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:08:48 devstack sudo[100082]: pam_unix(sudo:session): session closed for user root Sep 07 10:08:48 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-4f04ec3a-beaa-4bd9-aaf2-725c9fb9dd70 tempest-SnapshotDependencyTests-409813660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-3c860cdd-44d8-405f-a42c-036e26b2ca36.55f554d2-56f8-4aa9-9f08-9357a917298b" returned: 0 in 0.437s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:08:48 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-4f04ec3a-beaa-4bd9-aaf2-725c9fb9dd70 tempest-SnapshotDependencyTests-409813660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-3c860cdd-44d8-405f-a42c-036e26b2ca36.55f554d2-56f8-4aa9-9f08-9357a917298b {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:08:48 devstack sudo[100095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-3c860cdd-44d8-405f-a42c-036e26b2ca36.55f554d2-56f8-4aa9-9f08-9357a917298b Sep 07 10:08:48 devstack sudo[100095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:08:48 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-9930c273-ef69-4cc0-9023-5067510dcf17 tempest-GroupsTest-1231519480 None] Update group completed successfully. Sep 07 10:08:48 devstack sudo[100093]: pam_unix(sudo:session): session closed for user root Sep 07 10:08:48 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-4783707f-228c-4572-a317-78c3f4cb0790 tempest-VolumeSnapshotQuotasNegativeTestJSON-1010112892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-199be463-3236-46da-9a96-ee31051efaad.c97f864e-2271-4dba-afd2-bb7ac76749dd" returned: 0 in 0.294s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:08:48 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-4783707f-228c-4572-a317-78c3f4cb0790 tempest-VolumeSnapshotQuotasNegativeTestJSON-1010112892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-199be463-3236-46da-9a96-ee31051efaad.info {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:08:48 devstack sudo[100098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-199be463-3236-46da-9a96-ee31051efaad.info Sep 07 10:08:48 devstack sudo[100098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:08:48 devstack sudo[100095]: pam_unix(sudo:session): session closed for user root Sep 07 10:08:48 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-4f04ec3a-beaa-4bd9-aaf2-725c9fb9dd70 tempest-SnapshotDependencyTests-409813660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-3c860cdd-44d8-405f-a42c-036e26b2ca36.55f554d2-56f8-4aa9-9f08-9357a917298b" returned: 0 in 0.305s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:08:48 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-4f04ec3a-beaa-4bd9-aaf2-725c9fb9dd70 tempest-SnapshotDependencyTests-409813660 None] Lock "cinder-quobyte-55f554d2-56f8-4aa9-9f08-9357a917298b" released by "_delete_snapshot" :: held 1.862s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:08:48 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-4f04ec3a-beaa-4bd9-aaf2-725c9fb9dd70 tempest-SnapshotDependencyTests-409813660 None] Lock "cinder-quobyte-3c860cdd-44d8-405f-a42c-036e26b2ca36" released by "delete_snapshot" :: held 1.894s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:08:49 devstack cinder-volume[87515]: DEBUG cinder.quota [None req-4f04ec3a-beaa-4bd9-aaf2-725c9fb9dd70 tempest-SnapshotDependencyTests-409813660 None] Created reservations ['a8999c94-692b-4521-afc8-1a60ec5c7ed7', '860779e7-8c4c-4a7d-a752-8fcb897ab78f', '43f35fda-a7f7-4c82-a25a-1e9d3c633b71', 'c67bd1a3-28dc-42bd-a834-d3f323865dfa'] {{(pid=87515) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:08:49 devstack sudo[100098]: pam_unix(sudo:session): session closed for user root Sep 07 10:08:49 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-4783707f-228c-4572-a317-78c3f4cb0790 tempest-VolumeSnapshotQuotasNegativeTestJSON-1010112892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-199be463-3236-46da-9a96-ee31051efaad.info" returned: 0 in 0.261s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:08:49 devstack cinder-volume[87515]: WARNING cinder.volume.drivers.remotefs [None req-4783707f-228c-4572-a317-78c3f4cb0790 tempest-VolumeSnapshotQuotasNegativeTestJSON-1010112892 None] /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-199be463-3236-46da-9a96-ee31051efaad.info is being set with open permissions: ugo+rw Sep 07 10:08:49 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-4783707f-228c-4572-a317-78c3f4cb0790 tempest-VolumeSnapshotQuotasNegativeTestJSON-1010112892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-199be463-3236-46da-9a96-ee31051efaad.info {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:08:49 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-4f04ec3a-beaa-4bd9-aaf2-725c9fb9dd70 tempest-SnapshotDependencyTests-409813660 None] Delete snapshot completed successfully. Sep 07 10:08:49 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-4f04ec3a-beaa-4bd9-aaf2-725c9fb9dd70 tempest-SnapshotDependencyTests-409813660 None] Lock "cinder-55f554d2-56f8-4aa9-9f08-9357a917298b-delete_snapshot" released by "delete_snapshot" :: held 2.090s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:08:49 devstack sudo[100103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-199be463-3236-46da-9a96-ee31051efaad.info Sep 07 10:08:49 devstack sudo[100103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:08:49 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-efca5c26-511b-4d68-a28d-af81c6ffe72e tempest-SnapshotDependencyTests-409813660 None] Acquiring lock "cinder-3c860cdd-44d8-405f-a42c-036e26b2ca36-delete_volume" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:08:49 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-efca5c26-511b-4d68-a28d-af81c6ffe72e tempest-SnapshotDependencyTests-409813660 None] Lock "cinder-3c860cdd-44d8-405f-a42c-036e26b2ca36-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:08:49 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-efca5c26-511b-4d68-a28d-af81c6ffe72e tempest-SnapshotDependencyTests-409813660 None] Acquiring lock "cinder-quobyte-3c860cdd-44d8-405f-a42c-036e26b2ca36" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:08:49 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-efca5c26-511b-4d68-a28d-af81c6ffe72e tempest-SnapshotDependencyTests-409813660 None] Lock "cinder-quobyte-3c860cdd-44d8-405f-a42c-036e26b2ca36" acquired by "delete_volume" :: waited 0.019s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:08:49 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[17954f9e-bab7-45ec-baf8-53ce852b42b4]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:08:49 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-efca5c26-511b-4d68-a28d-af81c6ffe72e tempest-SnapshotDependencyTests-409813660 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-3c860cdd-44d8-405f-a42c-036e26b2ca36 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:08:49 devstack sudo[100103]: pam_unix(sudo:session): session closed for user root Sep 07 10:08:49 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-4783707f-228c-4572-a317-78c3f4cb0790 tempest-VolumeSnapshotQuotasNegativeTestJSON-1010112892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-199be463-3236-46da-9a96-ee31051efaad.info" returned: 0 in 0.315s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:08:49 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-4783707f-228c-4572-a317-78c3f4cb0790 tempest-VolumeSnapshotQuotasNegativeTestJSON-1010112892 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.216s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:08:49 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-4783707f-228c-4572-a317-78c3f4cb0790 tempest-VolumeSnapshotQuotasNegativeTestJSON-1010112892 None] Create snapshot completed successfully Sep 07 10:08:49 devstack sudo[100106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-3c860cdd-44d8-405f-a42c-036e26b2ca36 Sep 07 10:08:49 devstack sudo[100106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:08:49 devstack sudo[100106]: pam_unix(sudo:session): session closed for user root Sep 07 10:08:49 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-efca5c26-511b-4d68-a28d-af81c6ffe72e tempest-SnapshotDependencyTests-409813660 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-3c860cdd-44d8-405f-a42c-036e26b2ca36" returned: 0 in 0.448s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:08:49 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-efca5c26-511b-4d68-a28d-af81c6ffe72e tempest-SnapshotDependencyTests-409813660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-3c860cdd-44d8-405f-a42c-036e26b2ca36 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:08:49 devstack sudo[100112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-3c860cdd-44d8-405f-a42c-036e26b2ca36 Sep 07 10:08:49 devstack sudo[100112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:08:50 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-4c063c9e-c669-4986-8cd4-7cf09c1723a2 tempest-GroupsTest-1231519480 None] Update group completed successfully. Sep 07 10:08:50 devstack sudo[100112]: pam_unix(sudo:session): session closed for user root Sep 07 10:08:50 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-efca5c26-511b-4d68-a28d-af81c6ffe72e tempest-SnapshotDependencyTests-409813660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-3c860cdd-44d8-405f-a42c-036e26b2ca36" returned: 0 in 0.287s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:08:50 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-efca5c26-511b-4d68-a28d-af81c6ffe72e tempest-SnapshotDependencyTests-409813660 None] Lock "cinder-quobyte-3c860cdd-44d8-405f-a42c-036e26b2ca36" released by "delete_volume" :: held 0.807s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:08:50 devstack cinder-volume[87515]: DEBUG cinder.quota [None req-efca5c26-511b-4d68-a28d-af81c6ffe72e tempest-SnapshotDependencyTests-409813660 None] Created reservations ['e3b16cd8-44ad-456b-9e4f-455e5784541b', 'cad42953-8234-4fc4-ba2d-6e0ad9ecd9f7', 'aa6aa770-0276-4cb9-87c2-4e9699394ae9', '4de20be1-8d29-4b94-b8b7-dedc787478a0'] {{(pid=87515) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:08:50 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-efca5c26-511b-4d68-a28d-af81c6ffe72e tempest-SnapshotDependencyTests-409813660 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:08:50 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-efca5c26-511b-4d68-a28d-af81c6ffe72e tempest-SnapshotDependencyTests-409813660 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:08:50 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-efca5c26-511b-4d68-a28d-af81c6ffe72e tempest-SnapshotDependencyTests-409813660 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:08:50 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-efca5c26-511b-4d68-a28d-af81c6ffe72e tempest-SnapshotDependencyTests-409813660 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:08:50 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-efca5c26-511b-4d68-a28d-af81c6ffe72e tempest-SnapshotDependencyTests-409813660 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:08:50 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-efca5c26-511b-4d68-a28d-af81c6ffe72e tempest-SnapshotDependencyTests-409813660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:08:50 devstack sudo[100115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a Sep 07 10:08:50 devstack sudo[100115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:08:50 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-2bca4835-f9e8-4bcb-95c9-d37634a49da2 tempest-SnapshotDependencyTests-409813660 None] Acquiring lock "cinder-beb293d9-8b80-4e2e-8ff0-da1a4b7cc8c4-delete_volume" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:08:50 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-2bca4835-f9e8-4bcb-95c9-d37634a49da2 tempest-SnapshotDependencyTests-409813660 None] Lock "cinder-beb293d9-8b80-4e2e-8ff0-da1a4b7cc8c4-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:08:50 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-2bca4835-f9e8-4bcb-95c9-d37634a49da2 tempest-SnapshotDependencyTests-409813660 None] Acquiring lock "cinder-quobyte-beb293d9-8b80-4e2e-8ff0-da1a4b7cc8c4" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:08:50 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-2bca4835-f9e8-4bcb-95c9-d37634a49da2 tempest-SnapshotDependencyTests-409813660 None] Lock "cinder-quobyte-beb293d9-8b80-4e2e-8ff0-da1a4b7cc8c4" acquired by "delete_volume" :: waited 0.024s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:08:50 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dd51ce3-f94c-4212-b5c4-5d1a3634fd62]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:08:50 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-2bca4835-f9e8-4bcb-95c9-d37634a49da2 tempest-SnapshotDependencyTests-409813660 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-beb293d9-8b80-4e2e-8ff0-da1a4b7cc8c4 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:08:50 devstack sudo[100115]: pam_unix(sudo:session): session closed for user root Sep 07 10:08:50 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-efca5c26-511b-4d68-a28d-af81c6ffe72e tempest-SnapshotDependencyTests-409813660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a" returned: 0 in 0.348s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:08:50 devstack cinder-volume[87515]: DEBUG cinder.manager [None req-efca5c26-511b-4d68-a28d-af81c6ffe72e tempest-SnapshotDependencyTests-409813660 None] Notifying Schedulers of capabilities ... {{(pid=87515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:08:50 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-efca5c26-511b-4d68-a28d-af81c6ffe72e tempest-SnapshotDependencyTests-409813660 None] Deleted volume successfully. Sep 07 10:08:50 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-efca5c26-511b-4d68-a28d-af81c6ffe72e tempest-SnapshotDependencyTests-409813660 None] Lock "cinder-3c860cdd-44d8-405f-a42c-036e26b2ca36-delete_volume" released by "delete_volume" :: held 1.412s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:08:50 devstack sudo[100118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-beb293d9-8b80-4e2e-8ff0-da1a4b7cc8c4 Sep 07 10:08:50 devstack sudo[100118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:08:50 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-e3fd0eb4-375f-4b2b-8e3d-d86621805b06 tempest-VolumeSnapshotQuotasNegativeTestJSON-1010112892 None] Acquiring lock "cinder-c97f864e-2271-4dba-afd2-bb7ac76749dd-delete_snapshot" by "delete_snapshot" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:08:50 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-e3fd0eb4-375f-4b2b-8e3d-d86621805b06 tempest-VolumeSnapshotQuotasNegativeTestJSON-1010112892 None] Lock "cinder-c97f864e-2271-4dba-afd2-bb7ac76749dd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:08:50 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-e3fd0eb4-375f-4b2b-8e3d-d86621805b06 tempest-VolumeSnapshotQuotasNegativeTestJSON-1010112892 None] Acquiring lock "cinder-quobyte-199be463-3236-46da-9a96-ee31051efaad" by "delete_snapshot" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:08:50 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-e3fd0eb4-375f-4b2b-8e3d-d86621805b06 tempest-VolumeSnapshotQuotasNegativeTestJSON-1010112892 None] Lock "cinder-quobyte-199be463-3236-46da-9a96-ee31051efaad" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:08:50 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-e3fd0eb4-375f-4b2b-8e3d-d86621805b06 tempest-VolumeSnapshotQuotasNegativeTestJSON-1010112892 None] Acquiring lock "cinder-quobyte-c97f864e-2271-4dba-afd2-bb7ac76749dd" by "_delete_snapshot" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:08:50 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-e3fd0eb4-375f-4b2b-8e3d-d86621805b06 tempest-VolumeSnapshotQuotasNegativeTestJSON-1010112892 None] Lock "cinder-quobyte-c97f864e-2271-4dba-afd2-bb7ac76749dd" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:08:51 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-e3fd0eb4-375f-4b2b-8e3d-d86621805b06 tempest-VolumeSnapshotQuotasNegativeTestJSON-1010112892 None] Deleting offline snapshot c97f864e-2271-4dba-afd2-bb7ac76749dd of volume 199be463-3236-46da-9a96-ee31051efaad {{(pid=87515) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 10:08:51 devstack sudo[100118]: pam_unix(sudo:session): session closed for user root Sep 07 10:08:51 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-e3fd0eb4-375f-4b2b-8e3d-d86621805b06 tempest-VolumeSnapshotQuotasNegativeTestJSON-1010112892 None] snapshot_file for this snap is: volume-199be463-3236-46da-9a96-ee31051efaad.c97f864e-2271-4dba-afd2-bb7ac76749dd {{(pid=87515) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 10:08:51 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-2bca4835-f9e8-4bcb-95c9-d37634a49da2 tempest-SnapshotDependencyTests-409813660 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-beb293d9-8b80-4e2e-8ff0-da1a4b7cc8c4" returned: 0 in 0.465s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:08:51 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-2bca4835-f9e8-4bcb-95c9-d37634a49da2 tempest-SnapshotDependencyTests-409813660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-beb293d9-8b80-4e2e-8ff0-da1a4b7cc8c4 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:08:51 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[03275bb1-42dc-4630-8840-06b62371ad2f]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:08:51 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-e3fd0eb4-375f-4b2b-8e3d-d86621805b06 tempest-VolumeSnapshotQuotasNegativeTestJSON-1010112892 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-199be463-3236-46da-9a96-ee31051efaad.c97f864e-2271-4dba-afd2-bb7ac76749dd {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:08:51 devstack sudo[100123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-beb293d9-8b80-4e2e-8ff0-da1a4b7cc8c4 Sep 07 10:08:51 devstack sudo[100123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:08:51 devstack sudo[100124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-199be463-3236-46da-9a96-ee31051efaad.c97f864e-2271-4dba-afd2-bb7ac76749dd Sep 07 10:08:51 devstack sudo[100124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:08:51 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-2bca4835-f9e8-4bcb-95c9-d37634a49da2 tempest-SnapshotDependencyTests-409813660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-beb293d9-8b80-4e2e-8ff0-da1a4b7cc8c4" returned: 0 in 0.302s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:08:51 devstack sudo[100123]: pam_unix(sudo:session): session closed for user root Sep 07 10:08:51 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-2bca4835-f9e8-4bcb-95c9-d37634a49da2 tempest-SnapshotDependencyTests-409813660 None] Lock "cinder-quobyte-beb293d9-8b80-4e2e-8ff0-da1a4b7cc8c4" released by "delete_volume" :: held 0.823s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:08:51 devstack cinder-volume[87515]: DEBUG cinder.quota [None req-2bca4835-f9e8-4bcb-95c9-d37634a49da2 tempest-SnapshotDependencyTests-409813660 None] Created reservations ['42dfe2ae-2d03-47fa-860d-64f5b62f066c', '0e1666fe-63c5-4df7-acd4-137585c4c5a2', 'f5d5254f-0197-43e5-80ee-a90933aa8439', '0f3bd6e1-3452-433b-849f-f06a9c136ef7'] {{(pid=87515) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:08:51 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-2bca4835-f9e8-4bcb-95c9-d37634a49da2 tempest-SnapshotDependencyTests-409813660 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:08:51 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-2bca4835-f9e8-4bcb-95c9-d37634a49da2 tempest-SnapshotDependencyTests-409813660 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:08:51 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-2bca4835-f9e8-4bcb-95c9-d37634a49da2 tempest-SnapshotDependencyTests-409813660 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:08:51 devstack sudo[100124]: pam_unix(sudo:session): session closed for user root Sep 07 10:08:51 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-2bca4835-f9e8-4bcb-95c9-d37634a49da2 tempest-SnapshotDependencyTests-409813660 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:08:51 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-2bca4835-f9e8-4bcb-95c9-d37634a49da2 tempest-SnapshotDependencyTests-409813660 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:08:51 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-2bca4835-f9e8-4bcb-95c9-d37634a49da2 tempest-SnapshotDependencyTests-409813660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:08:51 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-e3fd0eb4-375f-4b2b-8e3d-d86621805b06 tempest-VolumeSnapshotQuotasNegativeTestJSON-1010112892 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-199be463-3236-46da-9a96-ee31051efaad.c97f864e-2271-4dba-afd2-bb7ac76749dd" returned: 0 in 0.546s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:08:51 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-e3fd0eb4-375f-4b2b-8e3d-d86621805b06 tempest-VolumeSnapshotQuotasNegativeTestJSON-1010112892 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-199be463-3236-46da-9a96-ee31051efaad(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87515) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 10:08:51 devstack sudo[100133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a Sep 07 10:08:51 devstack sudo[100133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:08:51 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1fe6102-28dd-459b-8d45-d36df4ce006c]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:08:51 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-e3fd0eb4-375f-4b2b-8e3d-d86621805b06 tempest-VolumeSnapshotQuotasNegativeTestJSON-1010112892 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-199be463-3236-46da-9a96-ee31051efaad {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:08:51 devstack sudo[100135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-199be463-3236-46da-9a96-ee31051efaad Sep 07 10:08:51 devstack sudo[100135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:08:51 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-0cb9fba8-c2d7-47a2-8ffb-598d15ff0d96 tempest-GroupsTest-1231519480 None] Acquiring lock "cinder-quobyte-6d060a2b-628f-4bad-ba44-efa6557985a4" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:08:51 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-0cb9fba8-c2d7-47a2-8ffb-598d15ff0d96 tempest-GroupsTest-1231519480 None] Lock "cinder-quobyte-6d060a2b-628f-4bad-ba44-efa6557985a4" acquired by "delete_volume" :: waited 0.029s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:08:51 devstack sudo[100133]: pam_unix(sudo:session): session closed for user root Sep 07 10:08:51 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8288440-2e79-49fc-8b26-5588c30d7fdc]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:08:51 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-0cb9fba8-c2d7-47a2-8ffb-598d15ff0d96 tempest-GroupsTest-1231519480 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-6d060a2b-628f-4bad-ba44-efa6557985a4 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:08:51 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-2bca4835-f9e8-4bcb-95c9-d37634a49da2 tempest-SnapshotDependencyTests-409813660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a" returned: 0 in 0.404s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:08:51 devstack cinder-volume[87515]: DEBUG cinder.manager [None req-2bca4835-f9e8-4bcb-95c9-d37634a49da2 tempest-SnapshotDependencyTests-409813660 None] Notifying Schedulers of capabilities ... {{(pid=87515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:08:52 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-2bca4835-f9e8-4bcb-95c9-d37634a49da2 tempest-SnapshotDependencyTests-409813660 None] Deleted volume successfully. Sep 07 10:08:52 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-2bca4835-f9e8-4bcb-95c9-d37634a49da2 tempest-SnapshotDependencyTests-409813660 None] Lock "cinder-beb293d9-8b80-4e2e-8ff0-da1a4b7cc8c4-delete_volume" released by "delete_volume" :: held 1.602s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:08:52 devstack sudo[100138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-6d060a2b-628f-4bad-ba44-efa6557985a4 Sep 07 10:08:52 devstack sudo[100138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:08:52 devstack sudo[100135]: pam_unix(sudo:session): session closed for user root Sep 07 10:08:52 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-e3fd0eb4-375f-4b2b-8e3d-d86621805b06 tempest-VolumeSnapshotQuotasNegativeTestJSON-1010112892 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-199be463-3236-46da-9a96-ee31051efaad" returned: 0 in 0.572s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:08:52 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-e3fd0eb4-375f-4b2b-8e3d-d86621805b06 tempest-VolumeSnapshotQuotasNegativeTestJSON-1010112892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-199be463-3236-46da-9a96-ee31051efaad.c97f864e-2271-4dba-afd2-bb7ac76749dd {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:08:52 devstack sudo[100144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-199be463-3236-46da-9a96-ee31051efaad.c97f864e-2271-4dba-afd2-bb7ac76749dd Sep 07 10:08:52 devstack sudo[100144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:08:52 devstack sudo[100138]: pam_unix(sudo:session): session closed for user root Sep 07 10:08:52 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-0cb9fba8-c2d7-47a2-8ffb-598d15ff0d96 tempest-GroupsTest-1231519480 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-6d060a2b-628f-4bad-ba44-efa6557985a4" returned: 0 in 0.487s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:08:52 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-0cb9fba8-c2d7-47a2-8ffb-598d15ff0d96 tempest-GroupsTest-1231519480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-6d060a2b-628f-4bad-ba44-efa6557985a4 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:08:52 devstack sudo[100151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-6d060a2b-628f-4bad-ba44-efa6557985a4 Sep 07 10:08:52 devstack sudo[100151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:08:52 devstack sudo[100144]: pam_unix(sudo:session): session closed for user root Sep 07 10:08:52 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-e3fd0eb4-375f-4b2b-8e3d-d86621805b06 tempest-VolumeSnapshotQuotasNegativeTestJSON-1010112892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-199be463-3236-46da-9a96-ee31051efaad.c97f864e-2271-4dba-afd2-bb7ac76749dd" returned: 0 in 0.451s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:08:52 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-e3fd0eb4-375f-4b2b-8e3d-d86621805b06 tempest-VolumeSnapshotQuotasNegativeTestJSON-1010112892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-199be463-3236-46da-9a96-ee31051efaad.c97f864e-2271-4dba-afd2-bb7ac76749dd {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:08:52 devstack sudo[100156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-199be463-3236-46da-9a96-ee31051efaad.c97f864e-2271-4dba-afd2-bb7ac76749dd Sep 07 10:08:52 devstack sudo[100156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:08:52 devstack sudo[100151]: pam_unix(sudo:session): session closed for user root Sep 07 10:08:52 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-0cb9fba8-c2d7-47a2-8ffb-598d15ff0d96 tempest-GroupsTest-1231519480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-6d060a2b-628f-4bad-ba44-efa6557985a4" returned: 0 in 0.386s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:08:52 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-0cb9fba8-c2d7-47a2-8ffb-598d15ff0d96 tempest-GroupsTest-1231519480 None] Lock "cinder-quobyte-6d060a2b-628f-4bad-ba44-efa6557985a4" released by "delete_volume" :: held 0.938s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:08:52 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-0cb9fba8-c2d7-47a2-8ffb-598d15ff0d96 tempest-GroupsTest-1231519480 None] Acquiring lock "cinder-quobyte-ab01132c-4fc0-46d1-b1b6-6020eba2fbbf" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:08:52 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-0cb9fba8-c2d7-47a2-8ffb-598d15ff0d96 tempest-GroupsTest-1231519480 None] Lock "cinder-quobyte-ab01132c-4fc0-46d1-b1b6-6020eba2fbbf" acquired by "delete_volume" :: waited 0.020s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:08:52 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[237725ef-44e8-43b3-a082-9c327225ed8b]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:08:52 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-0cb9fba8-c2d7-47a2-8ffb-598d15ff0d96 tempest-GroupsTest-1231519480 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-ab01132c-4fc0-46d1-b1b6-6020eba2fbbf {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:08:52 devstack sudo[100156]: pam_unix(sudo:session): session closed for user root Sep 07 10:08:53 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-e3fd0eb4-375f-4b2b-8e3d-d86621805b06 tempest-VolumeSnapshotQuotasNegativeTestJSON-1010112892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-199be463-3236-46da-9a96-ee31051efaad.c97f864e-2271-4dba-afd2-bb7ac76749dd" returned: 0 in 0.327s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:08:53 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-e3fd0eb4-375f-4b2b-8e3d-d86621805b06 tempest-VolumeSnapshotQuotasNegativeTestJSON-1010112892 None] Lock "cinder-quobyte-c97f864e-2271-4dba-afd2-bb7ac76749dd" released by "_delete_snapshot" :: held 2.063s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:08:53 devstack sudo[100159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-ab01132c-4fc0-46d1-b1b6-6020eba2fbbf Sep 07 10:08:53 devstack sudo[100159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:08:53 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-e3fd0eb4-375f-4b2b-8e3d-d86621805b06 tempest-VolumeSnapshotQuotasNegativeTestJSON-1010112892 None] Lock "cinder-quobyte-199be463-3236-46da-9a96-ee31051efaad" released by "delete_snapshot" :: held 2.106s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:08:53 devstack cinder-volume[87515]: DEBUG cinder.quota [None req-e3fd0eb4-375f-4b2b-8e3d-d86621805b06 tempest-VolumeSnapshotQuotasNegativeTestJSON-1010112892 None] Created reservations ['065bd778-66ab-4b38-a12d-c280c3d35dc3', '09e9c64d-3174-47ab-9f1c-ffdb490d181b', '214b2386-c564-4302-9f90-acba3dc61ddc', '4927a16b-55c4-41ae-a9e8-98a83a9bbf72'] {{(pid=87515) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:08:53 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-e3fd0eb4-375f-4b2b-8e3d-d86621805b06 tempest-VolumeSnapshotQuotasNegativeTestJSON-1010112892 None] Delete snapshot completed successfully. Sep 07 10:08:53 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-e3fd0eb4-375f-4b2b-8e3d-d86621805b06 tempest-VolumeSnapshotQuotasNegativeTestJSON-1010112892 None] Lock "cinder-c97f864e-2271-4dba-afd2-bb7ac76749dd-delete_snapshot" released by "delete_snapshot" :: held 2.313s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:08:53 devstack sudo[100159]: pam_unix(sudo:session): session closed for user root Sep 07 10:08:53 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-0cb9fba8-c2d7-47a2-8ffb-598d15ff0d96 tempest-GroupsTest-1231519480 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-ab01132c-4fc0-46d1-b1b6-6020eba2fbbf" returned: 0 in 0.493s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:08:53 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-0cb9fba8-c2d7-47a2-8ffb-598d15ff0d96 tempest-GroupsTest-1231519480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-ab01132c-4fc0-46d1-b1b6-6020eba2fbbf {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:08:53 devstack sudo[100165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-ab01132c-4fc0-46d1-b1b6-6020eba2fbbf Sep 07 10:08:53 devstack sudo[100165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:08:53 devstack sudo[100165]: pam_unix(sudo:session): session closed for user root Sep 07 10:08:53 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-0cb9fba8-c2d7-47a2-8ffb-598d15ff0d96 tempest-GroupsTest-1231519480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-ab01132c-4fc0-46d1-b1b6-6020eba2fbbf" returned: 0 in 0.314s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:08:53 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-0cb9fba8-c2d7-47a2-8ffb-598d15ff0d96 tempest-GroupsTest-1231519480 None] Lock "cinder-quobyte-ab01132c-4fc0-46d1-b1b6-6020eba2fbbf" released by "delete_volume" :: held 0.866s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:08:53 devstack cinder-volume[87515]: DEBUG cinder.quota [None req-0cb9fba8-c2d7-47a2-8ffb-598d15ff0d96 tempest-GroupsTest-1231519480 None] Created reservations ['3e18fe5c-1b6b-4df5-b5eb-d63a2995bfb9'] {{(pid=87515) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:08:53 devstack cinder-volume[87515]: WARNING cinder.quota [None req-0cb9fba8-c2d7-47a2-8ffb-598d15ff0d96 tempest-GroupsTest-1231519480 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-343384131 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-343384131, it is now deprecated. Please use the default quota class for default quota. Sep 07 10:08:53 devstack cinder-volume[87515]: WARNING cinder.quota [None req-0cb9fba8-c2d7-47a2-8ffb-598d15ff0d96 tempest-GroupsTest-1231519480 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-343384131 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-343384131, it is now deprecated. Please use the default quota class for default quota. Sep 07 10:08:53 devstack cinder-volume[87515]: DEBUG cinder.quota [None req-0cb9fba8-c2d7-47a2-8ffb-598d15ff0d96 tempest-GroupsTest-1231519480 None] Created reservations ['ae34541f-e0d4-44aa-a779-a5947a3a51ce', '5ed6eedd-627f-4907-b90b-1cb74fc8ed66', '57307a5b-6ab0-445f-8545-e5f5e995d089', 'e7453f8d-eec4-4fce-950a-159524560aca'] {{(pid=87515) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:08:54 devstack cinder-volume[87515]: DEBUG cinder.quota [None req-0cb9fba8-c2d7-47a2-8ffb-598d15ff0d96 tempest-GroupsTest-1231519480 None] Created reservations ['bdabf392-f2ce-4b41-a1f1-d88ebbaa5148', 'bb1ea200-4c45-4fb0-b62e-229c4712c25c', 'ba926b86-53c3-43e6-a432-9c6bb20b539b', '0a32466b-698c-402e-aaba-49a0b21c8edf'] {{(pid=87515) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:08:54 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-0cb9fba8-c2d7-47a2-8ffb-598d15ff0d96 tempest-GroupsTest-1231519480 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:08:54 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-0cb9fba8-c2d7-47a2-8ffb-598d15ff0d96 tempest-GroupsTest-1231519480 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:08:54 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-0cb9fba8-c2d7-47a2-8ffb-598d15ff0d96 tempest-GroupsTest-1231519480 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:08:54 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-0cb9fba8-c2d7-47a2-8ffb-598d15ff0d96 tempest-GroupsTest-1231519480 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:08:54 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-0cb9fba8-c2d7-47a2-8ffb-598d15ff0d96 tempest-GroupsTest-1231519480 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:08:54 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-0cb9fba8-c2d7-47a2-8ffb-598d15ff0d96 tempest-GroupsTest-1231519480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:08:54 devstack sudo[100169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a Sep 07 10:08:54 devstack sudo[100169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:08:54 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-5fea2991-41eb-4cff-b1c1-4f490c35eca4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1010112892 None] Acquiring lock "cinder-199be463-3236-46da-9a96-ee31051efaad-delete_volume" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:08:54 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-5fea2991-41eb-4cff-b1c1-4f490c35eca4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1010112892 None] Lock "cinder-199be463-3236-46da-9a96-ee31051efaad-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:08:54 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-5fea2991-41eb-4cff-b1c1-4f490c35eca4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1010112892 None] Acquiring lock "cinder-quobyte-199be463-3236-46da-9a96-ee31051efaad" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:08:54 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-5fea2991-41eb-4cff-b1c1-4f490c35eca4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1010112892 None] Lock "cinder-quobyte-199be463-3236-46da-9a96-ee31051efaad" acquired by "delete_volume" :: waited 0.034s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:08:54 devstack sudo[100169]: pam_unix(sudo:session): session closed for user root Sep 07 10:08:54 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-0cb9fba8-c2d7-47a2-8ffb-598d15ff0d96 tempest-GroupsTest-1231519480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a" returned: 0 in 0.462s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:08:54 devstack cinder-volume[87515]: DEBUG cinder.manager [None req-0cb9fba8-c2d7-47a2-8ffb-598d15ff0d96 tempest-GroupsTest-1231519480 None] Notifying Schedulers of capabilities ... {{(pid=87515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:08:54 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-0cb9fba8-c2d7-47a2-8ffb-598d15ff0d96 tempest-GroupsTest-1231519480 None] Delete group completed successfully. Sep 07 10:08:54 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a947bb1-f67c-4c41-b342-3775fab65c75]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:08:54 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-5fea2991-41eb-4cff-b1c1-4f490c35eca4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1010112892 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-199be463-3236-46da-9a96-ee31051efaad {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:08:54 devstack sudo[100172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-199be463-3236-46da-9a96-ee31051efaad Sep 07 10:08:54 devstack sudo[100172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:08:55 devstack sudo[100172]: pam_unix(sudo:session): session closed for user root Sep 07 10:08:55 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-5fea2991-41eb-4cff-b1c1-4f490c35eca4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1010112892 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-199be463-3236-46da-9a96-ee31051efaad" returned: 0 in 0.470s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:08:55 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-5fea2991-41eb-4cff-b1c1-4f490c35eca4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1010112892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-199be463-3236-46da-9a96-ee31051efaad {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:08:55 devstack sudo[100178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-199be463-3236-46da-9a96-ee31051efaad Sep 07 10:08:55 devstack sudo[100178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:08:55 devstack sudo[100178]: pam_unix(sudo:session): session closed for user root Sep 07 10:08:55 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-5fea2991-41eb-4cff-b1c1-4f490c35eca4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1010112892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-199be463-3236-46da-9a96-ee31051efaad" returned: 0 in 0.380s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:08:55 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-5fea2991-41eb-4cff-b1c1-4f490c35eca4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1010112892 None] Lock "cinder-quobyte-199be463-3236-46da-9a96-ee31051efaad" released by "delete_volume" :: held 0.955s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:08:55 devstack cinder-volume[87515]: DEBUG cinder.quota [None req-5fea2991-41eb-4cff-b1c1-4f490c35eca4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1010112892 None] Created reservations ['bf104314-714a-4f4f-bda8-6ef8980a471e', '2304e46a-3b04-47aa-a23e-4dbc5aad9858', '20a68073-72a2-4e1d-9884-7f4e3bf9bf3b', '7b97aad6-edd2-477e-892d-fc199ffb5d23'] {{(pid=87515) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:08:55 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-5fea2991-41eb-4cff-b1c1-4f490c35eca4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1010112892 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:08:55 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-5fea2991-41eb-4cff-b1c1-4f490c35eca4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1010112892 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:08:55 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-5fea2991-41eb-4cff-b1c1-4f490c35eca4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1010112892 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:08:55 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-5fea2991-41eb-4cff-b1c1-4f490c35eca4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1010112892 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:08:55 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-5fea2991-41eb-4cff-b1c1-4f490c35eca4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1010112892 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:08:55 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-5fea2991-41eb-4cff-b1c1-4f490c35eca4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1010112892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:08:55 devstack sudo[100181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a Sep 07 10:08:55 devstack sudo[100181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:08:55 devstack sudo[100181]: pam_unix(sudo:session): session closed for user root Sep 07 10:08:55 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-5fea2991-41eb-4cff-b1c1-4f490c35eca4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1010112892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a" returned: 0 in 0.253s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:08:55 devstack cinder-volume[87515]: DEBUG cinder.manager [None req-5fea2991-41eb-4cff-b1c1-4f490c35eca4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1010112892 None] Notifying Schedulers of capabilities ... {{(pid=87515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:08:55 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-5fea2991-41eb-4cff-b1c1-4f490c35eca4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1010112892 None] Deleted volume successfully. Sep 07 10:08:55 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-5fea2991-41eb-4cff-b1c1-4f490c35eca4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1010112892 None] Lock "cinder-199be463-3236-46da-9a96-ee31051efaad-delete_volume" released by "delete_volume" :: held 1.525s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:09:05 devstack cinder-volume[87515]: DEBUG dbcounter [-] [87515] Writing DB stats cinder:UPDATE=111,cinder:SELECT=93,cinder:DELETE=6,cinder:INSERT=22 {{(pid=87515) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 10:09:05 devstack cinder-volume[87515]: DEBUG dbcounter [-] [87515] Writing DB stats cinder:SELECT=102,cinder:INSERT=33,cinder:UPDATE=122,cinder:DELETE=8 {{(pid=87515) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 10:09:09 devstack cinder-volume[87515]: DEBUG cinder.volume.flows.manager.create_volume [None req-d664b76e-238d-49c1-97d5-5edf0dcbc165 tempest-VolumeQuotasAdminTestJSON-149200929 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 10:09:09 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-d664b76e-238d-49c1-97d5-5edf0dcbc165 tempest-VolumeQuotasAdminTestJSON-149200929 None] Flow 'volume_create_manager' (1485cb72-8cc4-44c1-a8fc-f6631754243f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:09:09 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-d664b76e-238d-49c1-97d5-5edf0dcbc165 tempest-VolumeQuotasAdminTestJSON-149200929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e344ff5-815b-4dcf-b7fd-afcdc3b829d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:09:09 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-d664b76e-238d-49c1-97d5-5edf0dcbc165 tempest-VolumeQuotasAdminTestJSON-149200929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e344ff5-815b-4dcf-b7fd-afcdc3b829d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:09:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-671079140',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26286a50-7086-4b09-8652-20016f78d8e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2af79c5d77c241db8704160016b48afa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:09:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:09:09Z,use_quota=True,user_id='924e11cea3b44a5a8ccc81fd7432dee5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3a092cd-7947-4cbf-abff-4ba9567becf0),volume_type_id=f3a092cd-7947-4cbf-abff-4ba9567becf0)' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:09:09 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-d664b76e-238d-49c1-97d5-5edf0dcbc165 tempest-VolumeQuotasAdminTestJSON-149200929 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77f23e53-8c93-4166-b6d2-2ddfadedac3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:09:09 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-d664b76e-238d-49c1-97d5-5edf0dcbc165 tempest-VolumeQuotasAdminTestJSON-149200929 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77f23e53-8c93-4166-b6d2-2ddfadedac3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:09:09 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-d664b76e-238d-49c1-97d5-5edf0dcbc165 tempest-VolumeQuotasAdminTestJSON-149200929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbe64ec9-baaa-4e47-a267-8ed9c9cead1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:09:09 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-d664b76e-238d-49c1-97d5-5edf0dcbc165 tempest-VolumeQuotasAdminTestJSON-149200929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbe64ec9-baaa-4e47-a267-8ed9c9cead1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '26286a50-7086-4b09-8652-20016f78d8e2', 'volume_name': 'volume-26286a50-7086-4b09-8652-20016f78d8e2', 'volume_size': 1}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:09:09 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-d664b76e-238d-49c1-97d5-5edf0dcbc165 tempest-VolumeQuotasAdminTestJSON-149200929 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b4687aa-6ff2-4e5a-8892-9b98e64ea1bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:09:09 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-d664b76e-238d-49c1-97d5-5edf0dcbc165 tempest-VolumeQuotasAdminTestJSON-149200929 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b4687aa-6ff2-4e5a-8892-9b98e64ea1bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:09:09 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-d664b76e-238d-49c1-97d5-5edf0dcbc165 tempest-VolumeQuotasAdminTestJSON-149200929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea92cda5-1660-49fb-8276-c8bfe8849425) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:09:09 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-d664b76e-238d-49c1-97d5-5edf0dcbc165 tempest-VolumeQuotasAdminTestJSON-149200929 None] Volume 26286a50-7086-4b09-8652-20016f78d8e2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-26286a50-7086-4b09-8652-20016f78d8e2', 'volume_size': 1} Sep 07 10:09:09 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-d664b76e-238d-49c1-97d5-5edf0dcbc165 tempest-VolumeQuotasAdminTestJSON-149200929 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:09:09 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-d664b76e-238d-49c1-97d5-5edf0dcbc165 tempest-VolumeQuotasAdminTestJSON-149200929 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:09:09 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-d664b76e-238d-49c1-97d5-5edf0dcbc165 tempest-VolumeQuotasAdminTestJSON-149200929 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:09:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-671079140',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26286a50-7086-4b09-8652-20016f78d8e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2af79c5d77c241db8704160016b48afa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:09:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:09:09Z,use_quota=True,user_id='924e11cea3b44a5a8ccc81fd7432dee5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3a092cd-7947-4cbf-abff-4ba9567becf0),volume_type_id=f3a092cd-7947-4cbf-abff-4ba9567becf0)}" {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 10:09:09 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-d664b76e-238d-49c1-97d5-5edf0dcbc165 tempest-VolumeQuotasAdminTestJSON-149200929 None] Creating volume 26286a50-7086-4b09-8652-20016f78d8e2 {{(pid=87515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 10:09:09 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-d664b76e-238d-49c1-97d5-5edf0dcbc165 tempest-VolumeQuotasAdminTestJSON-149200929 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:09:09 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-d664b76e-238d-49c1-97d5-5edf0dcbc165 tempest-VolumeQuotasAdminTestJSON-149200929 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:09:09 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-d664b76e-238d-49c1-97d5-5edf0dcbc165 tempest-VolumeQuotasAdminTestJSON-149200929 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:09:09 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-d664b76e-238d-49c1-97d5-5edf0dcbc165 tempest-VolumeQuotasAdminTestJSON-149200929 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:09:09 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-d664b76e-238d-49c1-97d5-5edf0dcbc165 tempest-VolumeQuotasAdminTestJSON-149200929 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:09:09 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-d664b76e-238d-49c1-97d5-5edf0dcbc165 tempest-VolumeQuotasAdminTestJSON-149200929 None] Selected osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c as target Quobyte volume. {{(pid=87515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 10:09:09 devstack cinder-volume[87515]: INFO cinder.volume.drivers.remotefs [None req-d664b76e-238d-49c1-97d5-5edf0dcbc165 tempest-VolumeQuotasAdminTestJSON-149200929 None] casted to osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c Sep 07 10:09:09 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-d664b76e-238d-49c1-97d5-5edf0dcbc165 tempest-VolumeQuotasAdminTestJSON-149200929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-26286a50-7086-4b09-8652-20016f78d8e2 1073741824 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:09:09 devstack sudo[100191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-26286a50-7086-4b09-8652-20016f78d8e2 1073741824 Sep 07 10:09:09 devstack sudo[100191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:09:10 devstack sudo[100191]: pam_unix(sudo:session): session closed for user root Sep 07 10:09:10 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-d664b76e-238d-49c1-97d5-5edf0dcbc165 tempest-VolumeQuotasAdminTestJSON-149200929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-26286a50-7086-4b09-8652-20016f78d8e2 1073741824" returned: 0 in 0.532s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:09:10 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-d664b76e-238d-49c1-97d5-5edf0dcbc165 tempest-VolumeQuotasAdminTestJSON-149200929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-26286a50-7086-4b09-8652-20016f78d8e2 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:09:10 devstack sudo[100197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-26286a50-7086-4b09-8652-20016f78d8e2 Sep 07 10:09:10 devstack sudo[100197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:09:10 devstack sudo[100197]: pam_unix(sudo:session): session closed for user root Sep 07 10:09:10 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-d664b76e-238d-49c1-97d5-5edf0dcbc165 tempest-VolumeQuotasAdminTestJSON-149200929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-26286a50-7086-4b09-8652-20016f78d8e2" returned: 0 in 0.280s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:09:10 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-d664b76e-238d-49c1-97d5-5edf0dcbc165 tempest-VolumeQuotasAdminTestJSON-149200929 None] <== create_volume: return (863ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'} {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 10:09:10 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-d664b76e-238d-49c1-97d5-5edf0dcbc165 tempest-VolumeQuotasAdminTestJSON-149200929 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.867s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:09:10 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-d664b76e-238d-49c1-97d5-5edf0dcbc165 tempest-VolumeQuotasAdminTestJSON-149200929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea92cda5-1660-49fb-8276-c8bfe8849425) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-26286a50-7086-4b09-8652-20016f78d8e2', 'volume_size': 1}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:09:10 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-d664b76e-238d-49c1-97d5-5edf0dcbc165 tempest-VolumeQuotasAdminTestJSON-149200929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b5aa0eb-4c2a-4eb9-84cb-a0b95f30be18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:09:10 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-d664b76e-238d-49c1-97d5-5edf0dcbc165 tempest-VolumeQuotasAdminTestJSON-149200929 None] Volume volume-26286a50-7086-4b09-8652-20016f78d8e2 (26286a50-7086-4b09-8652-20016f78d8e2): created successfully Sep 07 10:09:10 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-d664b76e-238d-49c1-97d5-5edf0dcbc165 tempest-VolumeQuotasAdminTestJSON-149200929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b5aa0eb-4c2a-4eb9-84cb-a0b95f30be18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:09:10 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-d664b76e-238d-49c1-97d5-5edf0dcbc165 tempest-VolumeQuotasAdminTestJSON-149200929 None] Flow 'volume_create_manager' (1485cb72-8cc4-44c1-a8fc-f6631754243f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:09:10 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-d664b76e-238d-49c1-97d5-5edf0dcbc165 tempest-VolumeQuotasAdminTestJSON-149200929 None] Created volume successfully. Sep 07 10:09:11 devstack cinder-volume[87515]: DEBUG oslo_service.periodic_task [None req-cebd6a9d-3073-42a1-b65a-b38d444d85ed None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87515) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 10:09:11 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-cebd6a9d-3073-42a1-b65a-b38d444d85ed None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:09:11 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-cebd6a9d-3073-42a1-b65a-b38d444d85ed None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:09:11 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-cebd6a9d-3073-42a1-b65a-b38d444d85ed None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:09:11 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-cebd6a9d-3073-42a1-b65a-b38d444d85ed None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:09:11 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-cebd6a9d-3073-42a1-b65a-b38d444d85ed None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:09:11 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-cebd6a9d-3073-42a1-b65a-b38d444d85ed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:09:11 devstack sudo[100200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a Sep 07 10:09:11 devstack sudo[100200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:09:11 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-da7bdcd8-4a45-418a-a121-a0239b90bf87 tempest-VolumeQuotasAdminTestJSON-149200929 None] Acquiring lock "cinder-26286a50-7086-4b09-8652-20016f78d8e2-delete_volume" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:09:11 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-da7bdcd8-4a45-418a-a121-a0239b90bf87 tempest-VolumeQuotasAdminTestJSON-149200929 None] Lock "cinder-26286a50-7086-4b09-8652-20016f78d8e2-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:09:11 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-da7bdcd8-4a45-418a-a121-a0239b90bf87 tempest-VolumeQuotasAdminTestJSON-149200929 None] Acquiring lock "cinder-quobyte-26286a50-7086-4b09-8652-20016f78d8e2" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:09:11 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-da7bdcd8-4a45-418a-a121-a0239b90bf87 tempest-VolumeQuotasAdminTestJSON-149200929 None] Lock "cinder-quobyte-26286a50-7086-4b09-8652-20016f78d8e2" acquired by "delete_volume" :: waited 0.032s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:09:11 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fb6ffb5-d931-4f39-901c-b6f5e5f4df06]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:09:11 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-da7bdcd8-4a45-418a-a121-a0239b90bf87 tempest-VolumeQuotasAdminTestJSON-149200929 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-26286a50-7086-4b09-8652-20016f78d8e2 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:09:11 devstack sudo[100200]: pam_unix(sudo:session): session closed for user root Sep 07 10:09:11 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-cebd6a9d-3073-42a1-b65a-b38d444d85ed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a" returned: 0 in 0.367s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:09:11 devstack cinder-volume[87515]: DEBUG cinder.manager [None req-cebd6a9d-3073-42a1-b65a-b38d444d85ed None None] Notifying Schedulers of capabilities ... {{(pid=87515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:09:11 devstack cinder-volume[87515]: DEBUG oslo_service.periodic_task [None req-cebd6a9d-3073-42a1-b65a-b38d444d85ed None None] Running periodic task VolumeManager._thread_info {{(pid=87515) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 10:09:11 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-cebd6a9d-3073-42a1-b65a-b38d444d85ed None None] thread count: 29 {{(pid=87515) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 07 10:09:11 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-cebd6a9d-3073-42a1-b65a-b38d444d85ed None None] thread info: [<_MainThread(MainThread, started 131647121809536)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87515) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 07 10:09:11 devstack sudo[100202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-26286a50-7086-4b09-8652-20016f78d8e2 Sep 07 10:09:11 devstack sudo[100202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:09:12 devstack sudo[100202]: pam_unix(sudo:session): session closed for user root Sep 07 10:09:12 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-da7bdcd8-4a45-418a-a121-a0239b90bf87 tempest-VolumeQuotasAdminTestJSON-149200929 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-26286a50-7086-4b09-8652-20016f78d8e2" returned: 0 in 0.471s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:09:12 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-da7bdcd8-4a45-418a-a121-a0239b90bf87 tempest-VolumeQuotasAdminTestJSON-149200929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-26286a50-7086-4b09-8652-20016f78d8e2 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:09:12 devstack sudo[100208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-26286a50-7086-4b09-8652-20016f78d8e2 Sep 07 10:09:12 devstack sudo[100208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:09:12 devstack sudo[100208]: pam_unix(sudo:session): session closed for user root Sep 07 10:09:12 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-da7bdcd8-4a45-418a-a121-a0239b90bf87 tempest-VolumeQuotasAdminTestJSON-149200929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-26286a50-7086-4b09-8652-20016f78d8e2" returned: 0 in 0.375s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:09:12 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-da7bdcd8-4a45-418a-a121-a0239b90bf87 tempest-VolumeQuotasAdminTestJSON-149200929 None] Lock "cinder-quobyte-26286a50-7086-4b09-8652-20016f78d8e2" released by "delete_volume" :: held 0.906s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:09:12 devstack cinder-volume[87515]: DEBUG cinder.quota [None req-da7bdcd8-4a45-418a-a121-a0239b90bf87 tempest-VolumeQuotasAdminTestJSON-149200929 None] Created reservations ['a6a42e12-410c-4ee3-9d01-5265e1dfe652', '534d771d-3c1a-4cf7-ad37-82b44a000b7e', '36844ec1-d8ae-4d07-bdf3-8e86e85336b1', 'c28bbe22-efa3-4fea-b1de-d565a10b6a45'] {{(pid=87515) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:09:12 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-da7bdcd8-4a45-418a-a121-a0239b90bf87 tempest-VolumeQuotasAdminTestJSON-149200929 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:09:12 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-da7bdcd8-4a45-418a-a121-a0239b90bf87 tempest-VolumeQuotasAdminTestJSON-149200929 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:09:12 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-da7bdcd8-4a45-418a-a121-a0239b90bf87 tempest-VolumeQuotasAdminTestJSON-149200929 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:09:12 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-da7bdcd8-4a45-418a-a121-a0239b90bf87 tempest-VolumeQuotasAdminTestJSON-149200929 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:09:12 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-da7bdcd8-4a45-418a-a121-a0239b90bf87 tempest-VolumeQuotasAdminTestJSON-149200929 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:09:12 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-da7bdcd8-4a45-418a-a121-a0239b90bf87 tempest-VolumeQuotasAdminTestJSON-149200929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:09:12 devstack sudo[100211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a Sep 07 10:09:12 devstack sudo[100211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:09:13 devstack sudo[100211]: pam_unix(sudo:session): session closed for user root Sep 07 10:09:13 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-da7bdcd8-4a45-418a-a121-a0239b90bf87 tempest-VolumeQuotasAdminTestJSON-149200929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a" returned: 0 in 0.313s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:09:13 devstack cinder-volume[87515]: DEBUG cinder.manager [None req-da7bdcd8-4a45-418a-a121-a0239b90bf87 tempest-VolumeQuotasAdminTestJSON-149200929 None] Notifying Schedulers of capabilities ... {{(pid=87515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:09:13 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-da7bdcd8-4a45-418a-a121-a0239b90bf87 tempest-VolumeQuotasAdminTestJSON-149200929 None] Deleted volume successfully. Sep 07 10:09:13 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-da7bdcd8-4a45-418a-a121-a0239b90bf87 tempest-VolumeQuotasAdminTestJSON-149200929 None] Lock "cinder-26286a50-7086-4b09-8652-20016f78d8e2-delete_volume" released by "delete_volume" :: held 1.557s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:09:13 devstack cinder-volume[87515]: DEBUG cinder.volume.flows.manager.create_volume [None req-77c395e9-531f-481c-8374-e258fa91910f tempest-VolumeQuotasAdminTestJSON-149200929 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 10:09:13 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-77c395e9-531f-481c-8374-e258fa91910f tempest-VolumeQuotasAdminTestJSON-149200929 None] Flow 'volume_create_manager' (4af9b07c-6e8f-4dc8-9bb7-60f266266b49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:09:13 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-77c395e9-531f-481c-8374-e258fa91910f tempest-VolumeQuotasAdminTestJSON-149200929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e22f8249-3e8e-4ea5-9cc8-26dc2a6c878c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:09:13 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-77c395e9-531f-481c-8374-e258fa91910f tempest-VolumeQuotasAdminTestJSON-149200929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e22f8249-3e8e-4ea5-9cc8-26dc2a6c878c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:09:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-585076779',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51c659c7-6396-4cb7-952c-d61619c10a82,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2af79c5d77c241db8704160016b48afa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:09:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:09:13Z,use_quota=True,user_id='924e11cea3b44a5a8ccc81fd7432dee5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3a092cd-7947-4cbf-abff-4ba9567becf0),volume_type_id=f3a092cd-7947-4cbf-abff-4ba9567becf0)' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:09:13 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-77c395e9-531f-481c-8374-e258fa91910f tempest-VolumeQuotasAdminTestJSON-149200929 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35e1d731-4c2e-4895-be70-81ff63e1f4f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:09:13 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-77c395e9-531f-481c-8374-e258fa91910f tempest-VolumeQuotasAdminTestJSON-149200929 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35e1d731-4c2e-4895-be70-81ff63e1f4f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:09:13 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-77c395e9-531f-481c-8374-e258fa91910f tempest-VolumeQuotasAdminTestJSON-149200929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab4f78b4-a77f-4684-b86d-4f8c7b17857d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:09:13 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-77c395e9-531f-481c-8374-e258fa91910f tempest-VolumeQuotasAdminTestJSON-149200929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab4f78b4-a77f-4684-b86d-4f8c7b17857d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '51c659c7-6396-4cb7-952c-d61619c10a82', 'volume_name': 'volume-51c659c7-6396-4cb7-952c-d61619c10a82', 'volume_size': 1}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:09:13 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-77c395e9-531f-481c-8374-e258fa91910f tempest-VolumeQuotasAdminTestJSON-149200929 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aeccfbb3-6b65-49b9-80e2-a2f7de3f5f9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:09:13 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-77c395e9-531f-481c-8374-e258fa91910f tempest-VolumeQuotasAdminTestJSON-149200929 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aeccfbb3-6b65-49b9-80e2-a2f7de3f5f9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:09:13 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-77c395e9-531f-481c-8374-e258fa91910f tempest-VolumeQuotasAdminTestJSON-149200929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd14e732-559d-4c43-859d-9d7bbc2ad94d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:09:13 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-77c395e9-531f-481c-8374-e258fa91910f tempest-VolumeQuotasAdminTestJSON-149200929 None] Volume 51c659c7-6396-4cb7-952c-d61619c10a82: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-51c659c7-6396-4cb7-952c-d61619c10a82', 'volume_size': 1} Sep 07 10:09:13 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-77c395e9-531f-481c-8374-e258fa91910f tempest-VolumeQuotasAdminTestJSON-149200929 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:09:13 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-77c395e9-531f-481c-8374-e258fa91910f tempest-VolumeQuotasAdminTestJSON-149200929 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:09:13 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-77c395e9-531f-481c-8374-e258fa91910f tempest-VolumeQuotasAdminTestJSON-149200929 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:09:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-585076779',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51c659c7-6396-4cb7-952c-d61619c10a82,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2af79c5d77c241db8704160016b48afa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:09:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:09:13Z,use_quota=True,user_id='924e11cea3b44a5a8ccc81fd7432dee5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3a092cd-7947-4cbf-abff-4ba9567becf0),volume_type_id=f3a092cd-7947-4cbf-abff-4ba9567becf0)}" {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 10:09:13 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-77c395e9-531f-481c-8374-e258fa91910f tempest-VolumeQuotasAdminTestJSON-149200929 None] Creating volume 51c659c7-6396-4cb7-952c-d61619c10a82 {{(pid=87515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 10:09:13 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-77c395e9-531f-481c-8374-e258fa91910f tempest-VolumeQuotasAdminTestJSON-149200929 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:09:13 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-77c395e9-531f-481c-8374-e258fa91910f tempest-VolumeQuotasAdminTestJSON-149200929 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:09:13 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-77c395e9-531f-481c-8374-e258fa91910f tempest-VolumeQuotasAdminTestJSON-149200929 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:09:13 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-77c395e9-531f-481c-8374-e258fa91910f tempest-VolumeQuotasAdminTestJSON-149200929 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:09:13 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-77c395e9-531f-481c-8374-e258fa91910f tempest-VolumeQuotasAdminTestJSON-149200929 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:09:13 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-77c395e9-531f-481c-8374-e258fa91910f tempest-VolumeQuotasAdminTestJSON-149200929 None] Selected osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c as target Quobyte volume. {{(pid=87515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 10:09:13 devstack cinder-volume[87515]: INFO cinder.volume.drivers.remotefs [None req-77c395e9-531f-481c-8374-e258fa91910f tempest-VolumeQuotasAdminTestJSON-149200929 None] casted to osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c Sep 07 10:09:13 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-77c395e9-531f-481c-8374-e258fa91910f tempest-VolumeQuotasAdminTestJSON-149200929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-51c659c7-6396-4cb7-952c-d61619c10a82 1073741824 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:09:13 devstack sudo[100214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-51c659c7-6396-4cb7-952c-d61619c10a82 1073741824 Sep 07 10:09:13 devstack sudo[100214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:09:14 devstack sudo[100214]: pam_unix(sudo:session): session closed for user root Sep 07 10:09:14 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-77c395e9-531f-481c-8374-e258fa91910f tempest-VolumeQuotasAdminTestJSON-149200929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-51c659c7-6396-4cb7-952c-d61619c10a82 1073741824" returned: 0 in 0.593s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:09:14 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-77c395e9-531f-481c-8374-e258fa91910f tempest-VolumeQuotasAdminTestJSON-149200929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-51c659c7-6396-4cb7-952c-d61619c10a82 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:09:14 devstack sudo[100220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-51c659c7-6396-4cb7-952c-d61619c10a82 Sep 07 10:09:14 devstack sudo[100220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:09:14 devstack sudo[100220]: pam_unix(sudo:session): session closed for user root Sep 07 10:09:14 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-77c395e9-531f-481c-8374-e258fa91910f tempest-VolumeQuotasAdminTestJSON-149200929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-51c659c7-6396-4cb7-952c-d61619c10a82" returned: 0 in 0.444s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:09:14 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-77c395e9-531f-481c-8374-e258fa91910f tempest-VolumeQuotasAdminTestJSON-149200929 None] <== create_volume: return (1099ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'} {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 10:09:14 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-77c395e9-531f-481c-8374-e258fa91910f tempest-VolumeQuotasAdminTestJSON-149200929 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.101s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:09:14 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-77c395e9-531f-481c-8374-e258fa91910f tempest-VolumeQuotasAdminTestJSON-149200929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd14e732-559d-4c43-859d-9d7bbc2ad94d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-51c659c7-6396-4cb7-952c-d61619c10a82', 'volume_size': 1}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:09:14 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-77c395e9-531f-481c-8374-e258fa91910f tempest-VolumeQuotasAdminTestJSON-149200929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (352881d9-e926-4ad6-9fc7-df08d32f0701) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:09:14 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-77c395e9-531f-481c-8374-e258fa91910f tempest-VolumeQuotasAdminTestJSON-149200929 None] Volume volume-51c659c7-6396-4cb7-952c-d61619c10a82 (51c659c7-6396-4cb7-952c-d61619c10a82): created successfully Sep 07 10:09:14 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-77c395e9-531f-481c-8374-e258fa91910f tempest-VolumeQuotasAdminTestJSON-149200929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (352881d9-e926-4ad6-9fc7-df08d32f0701) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:09:14 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-77c395e9-531f-481c-8374-e258fa91910f tempest-VolumeQuotasAdminTestJSON-149200929 None] Flow 'volume_create_manager' (4af9b07c-6e8f-4dc8-9bb7-60f266266b49) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:09:14 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-77c395e9-531f-481c-8374-e258fa91910f tempest-VolumeQuotasAdminTestJSON-149200929 None] Created volume successfully. Sep 07 10:09:16 devstack cinder-volume[87515]: DEBUG cinder.volume.flows.manager.create_volume [None req-54c52f6f-d655-4ebd-baee-6da892772620 tempest-AbsoluteLimitsTests-259747390 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 10:09:16 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-54c52f6f-d655-4ebd-baee-6da892772620 tempest-AbsoluteLimitsTests-259747390 None] Flow 'volume_create_manager' (e7c33360-8733-437e-9014-9d307c81b2c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:09:16 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-54c52f6f-d655-4ebd-baee-6da892772620 tempest-AbsoluteLimitsTests-259747390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (213a3580-8743-461c-bbb2-0eb584b9d486) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:09:16 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-54c52f6f-d655-4ebd-baee-6da892772620 tempest-AbsoluteLimitsTests-259747390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (213a3580-8743-461c-bbb2-0eb584b9d486) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:09:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-22157534',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4abed4b5-e18b-4526-acde-6d30764809d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9dd932c3a5e24a30b58b9f1a91c87991',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:09:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:09:16Z,use_quota=True,user_id='71ecb4e12c334a64be3dcfe2aead3583',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3a092cd-7947-4cbf-abff-4ba9567becf0),volume_type_id=f3a092cd-7947-4cbf-abff-4ba9567becf0)' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:09:16 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-54c52f6f-d655-4ebd-baee-6da892772620 tempest-AbsoluteLimitsTests-259747390 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23a28f8d-18e8-458d-891b-9353ae3664a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:09:16 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-54c52f6f-d655-4ebd-baee-6da892772620 tempest-AbsoluteLimitsTests-259747390 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23a28f8d-18e8-458d-891b-9353ae3664a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:09:16 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-54c52f6f-d655-4ebd-baee-6da892772620 tempest-AbsoluteLimitsTests-259747390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b515ef5-21a3-460b-82f9-ce3fd8114583) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:09:16 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-54c52f6f-d655-4ebd-baee-6da892772620 tempest-AbsoluteLimitsTests-259747390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b515ef5-21a3-460b-82f9-ce3fd8114583) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4abed4b5-e18b-4526-acde-6d30764809d3', 'volume_name': 'volume-4abed4b5-e18b-4526-acde-6d30764809d3', 'volume_size': 1}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:09:16 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-54c52f6f-d655-4ebd-baee-6da892772620 tempest-AbsoluteLimitsTests-259747390 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d4251aa-b896-4547-ba75-73e10a6d098c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:09:16 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-54c52f6f-d655-4ebd-baee-6da892772620 tempest-AbsoluteLimitsTests-259747390 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d4251aa-b896-4547-ba75-73e10a6d098c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:09:16 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-54c52f6f-d655-4ebd-baee-6da892772620 tempest-AbsoluteLimitsTests-259747390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f06ce708-40c4-402d-8094-67d1a18ec724) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:09:16 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-54c52f6f-d655-4ebd-baee-6da892772620 tempest-AbsoluteLimitsTests-259747390 None] Volume 4abed4b5-e18b-4526-acde-6d30764809d3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4abed4b5-e18b-4526-acde-6d30764809d3', 'volume_size': 1} Sep 07 10:09:16 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-54c52f6f-d655-4ebd-baee-6da892772620 tempest-AbsoluteLimitsTests-259747390 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:09:16 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-54c52f6f-d655-4ebd-baee-6da892772620 tempest-AbsoluteLimitsTests-259747390 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:09:16 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-54c52f6f-d655-4ebd-baee-6da892772620 tempest-AbsoluteLimitsTests-259747390 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:09:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-22157534',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4abed4b5-e18b-4526-acde-6d30764809d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9dd932c3a5e24a30b58b9f1a91c87991',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:09:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:09:16Z,use_quota=True,user_id='71ecb4e12c334a64be3dcfe2aead3583',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3a092cd-7947-4cbf-abff-4ba9567becf0),volume_type_id=f3a092cd-7947-4cbf-abff-4ba9567becf0)}" {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 10:09:16 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-54c52f6f-d655-4ebd-baee-6da892772620 tempest-AbsoluteLimitsTests-259747390 None] Creating volume 4abed4b5-e18b-4526-acde-6d30764809d3 {{(pid=87515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 10:09:16 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-54c52f6f-d655-4ebd-baee-6da892772620 tempest-AbsoluteLimitsTests-259747390 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:09:16 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-54c52f6f-d655-4ebd-baee-6da892772620 tempest-AbsoluteLimitsTests-259747390 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:09:16 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-54c52f6f-d655-4ebd-baee-6da892772620 tempest-AbsoluteLimitsTests-259747390 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:09:16 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-54c52f6f-d655-4ebd-baee-6da892772620 tempest-AbsoluteLimitsTests-259747390 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:09:16 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-54c52f6f-d655-4ebd-baee-6da892772620 tempest-AbsoluteLimitsTests-259747390 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:09:16 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-54c52f6f-d655-4ebd-baee-6da892772620 tempest-AbsoluteLimitsTests-259747390 None] Selected osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c as target Quobyte volume. {{(pid=87515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 10:09:16 devstack cinder-volume[87515]: INFO cinder.volume.drivers.remotefs [None req-54c52f6f-d655-4ebd-baee-6da892772620 tempest-AbsoluteLimitsTests-259747390 None] casted to osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c Sep 07 10:09:16 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-54c52f6f-d655-4ebd-baee-6da892772620 tempest-AbsoluteLimitsTests-259747390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-4abed4b5-e18b-4526-acde-6d30764809d3 1073741824 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:09:16 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-54e9cba3-41c5-4321-a93d-2c2b2e6bbf06 tempest-VolumeQuotasAdminTestJSON-828749800 None] Transfer volume completed successfully. Sep 07 10:09:16 devstack sudo[100224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-4abed4b5-e18b-4526-acde-6d30764809d3 1073741824 Sep 07 10:09:16 devstack sudo[100224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:09:17 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-61160ff6-2a85-4b0e-91f5-f0c36d8d7e90 tempest-VolumeQuotasAdminTestJSON-1721308836 None] Acquiring lock "cinder-51c659c7-6396-4cb7-952c-d61619c10a82-delete_volume" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:09:17 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-61160ff6-2a85-4b0e-91f5-f0c36d8d7e90 tempest-VolumeQuotasAdminTestJSON-1721308836 None] Lock "cinder-51c659c7-6396-4cb7-952c-d61619c10a82-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:09:17 devstack sudo[100224]: pam_unix(sudo:session): session closed for user root Sep 07 10:09:17 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-54c52f6f-d655-4ebd-baee-6da892772620 tempest-AbsoluteLimitsTests-259747390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-4abed4b5-e18b-4526-acde-6d30764809d3 1073741824" returned: 0 in 0.656s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:09:17 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-61160ff6-2a85-4b0e-91f5-f0c36d8d7e90 tempest-VolumeQuotasAdminTestJSON-1721308836 None] Acquiring lock "cinder-quobyte-51c659c7-6396-4cb7-952c-d61619c10a82" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:09:17 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-61160ff6-2a85-4b0e-91f5-f0c36d8d7e90 tempest-VolumeQuotasAdminTestJSON-1721308836 None] Lock "cinder-quobyte-51c659c7-6396-4cb7-952c-d61619c10a82" acquired by "delete_volume" :: waited 0.020s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:09:17 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-54c52f6f-d655-4ebd-baee-6da892772620 tempest-AbsoluteLimitsTests-259747390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-4abed4b5-e18b-4526-acde-6d30764809d3 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:09:17 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[77d051a4-1eec-47a1-94ad-b75061a37db9]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:09:17 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-61160ff6-2a85-4b0e-91f5-f0c36d8d7e90 tempest-VolumeQuotasAdminTestJSON-1721308836 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-51c659c7-6396-4cb7-952c-d61619c10a82 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:09:17 devstack sudo[100230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-4abed4b5-e18b-4526-acde-6d30764809d3 Sep 07 10:09:17 devstack sudo[100230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:09:17 devstack sudo[100231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-51c659c7-6396-4cb7-952c-d61619c10a82 Sep 07 10:09:17 devstack sudo[100231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:09:17 devstack sudo[100230]: pam_unix(sudo:session): session closed for user root Sep 07 10:09:17 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-54c52f6f-d655-4ebd-baee-6da892772620 tempest-AbsoluteLimitsTests-259747390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-4abed4b5-e18b-4526-acde-6d30764809d3" returned: 0 in 0.276s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:09:17 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-54c52f6f-d655-4ebd-baee-6da892772620 tempest-AbsoluteLimitsTests-259747390 None] <== create_volume: return (1017ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'} {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 10:09:17 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-54c52f6f-d655-4ebd-baee-6da892772620 tempest-AbsoluteLimitsTests-259747390 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.020s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:09:17 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-54c52f6f-d655-4ebd-baee-6da892772620 tempest-AbsoluteLimitsTests-259747390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f06ce708-40c4-402d-8094-67d1a18ec724) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4abed4b5-e18b-4526-acde-6d30764809d3', 'volume_size': 1}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:09:17 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-54c52f6f-d655-4ebd-baee-6da892772620 tempest-AbsoluteLimitsTests-259747390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (606a3888-2fc3-438a-8a40-2ce588a8ab61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:09:17 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-54c52f6f-d655-4ebd-baee-6da892772620 tempest-AbsoluteLimitsTests-259747390 None] Volume volume-4abed4b5-e18b-4526-acde-6d30764809d3 (4abed4b5-e18b-4526-acde-6d30764809d3): created successfully Sep 07 10:09:17 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-54c52f6f-d655-4ebd-baee-6da892772620 tempest-AbsoluteLimitsTests-259747390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (606a3888-2fc3-438a-8a40-2ce588a8ab61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:09:17 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-54c52f6f-d655-4ebd-baee-6da892772620 tempest-AbsoluteLimitsTests-259747390 None] Flow 'volume_create_manager' (e7c33360-8733-437e-9014-9d307c81b2c4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:09:17 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-54c52f6f-d655-4ebd-baee-6da892772620 tempest-AbsoluteLimitsTests-259747390 None] Created volume successfully. Sep 07 10:09:17 devstack sudo[100231]: pam_unix(sudo:session): session closed for user root Sep 07 10:09:17 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-61160ff6-2a85-4b0e-91f5-f0c36d8d7e90 tempest-VolumeQuotasAdminTestJSON-1721308836 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-51c659c7-6396-4cb7-952c-d61619c10a82" returned: 0 in 0.402s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:09:17 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-61160ff6-2a85-4b0e-91f5-f0c36d8d7e90 tempest-VolumeQuotasAdminTestJSON-1721308836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-51c659c7-6396-4cb7-952c-d61619c10a82 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:09:17 devstack sudo[100238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-51c659c7-6396-4cb7-952c-d61619c10a82 Sep 07 10:09:17 devstack sudo[100238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:09:17 devstack sudo[100238]: pam_unix(sudo:session): session closed for user root Sep 07 10:09:17 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-61160ff6-2a85-4b0e-91f5-f0c36d8d7e90 tempest-VolumeQuotasAdminTestJSON-1721308836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-51c659c7-6396-4cb7-952c-d61619c10a82" returned: 0 in 0.251s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:09:17 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-61160ff6-2a85-4b0e-91f5-f0c36d8d7e90 tempest-VolumeQuotasAdminTestJSON-1721308836 None] Lock "cinder-quobyte-51c659c7-6396-4cb7-952c-d61619c10a82" released by "delete_volume" :: held 0.716s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:09:17 devstack cinder-volume[87515]: DEBUG cinder.quota [None req-61160ff6-2a85-4b0e-91f5-f0c36d8d7e90 tempest-VolumeQuotasAdminTestJSON-1721308836 None] Created reservations ['976ee23c-0196-4ef3-8f2e-f3e17f276f9a', '6afe4d3b-11b3-4bb3-b818-01561faa48d1', '7da7628d-6672-4ff8-9e93-46b3c3d1af2d', '13d05337-a5de-4b12-9c60-e01afbb4ea69'] {{(pid=87515) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:09:18 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-61160ff6-2a85-4b0e-91f5-f0c36d8d7e90 tempest-VolumeQuotasAdminTestJSON-1721308836 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:09:18 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-61160ff6-2a85-4b0e-91f5-f0c36d8d7e90 tempest-VolumeQuotasAdminTestJSON-1721308836 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:09:18 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-61160ff6-2a85-4b0e-91f5-f0c36d8d7e90 tempest-VolumeQuotasAdminTestJSON-1721308836 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:09:18 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-61160ff6-2a85-4b0e-91f5-f0c36d8d7e90 tempest-VolumeQuotasAdminTestJSON-1721308836 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:09:18 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-61160ff6-2a85-4b0e-91f5-f0c36d8d7e90 tempest-VolumeQuotasAdminTestJSON-1721308836 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:09:18 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-61160ff6-2a85-4b0e-91f5-f0c36d8d7e90 tempest-VolumeQuotasAdminTestJSON-1721308836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:09:18 devstack sudo[100241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a Sep 07 10:09:18 devstack sudo[100241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:09:18 devstack sudo[100241]: pam_unix(sudo:session): session closed for user root Sep 07 10:09:18 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-61160ff6-2a85-4b0e-91f5-f0c36d8d7e90 tempest-VolumeQuotasAdminTestJSON-1721308836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a" returned: 0 in 0.272s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:09:18 devstack cinder-volume[87515]: DEBUG cinder.manager [None req-61160ff6-2a85-4b0e-91f5-f0c36d8d7e90 tempest-VolumeQuotasAdminTestJSON-1721308836 None] Notifying Schedulers of capabilities ... {{(pid=87515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:09:18 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-61160ff6-2a85-4b0e-91f5-f0c36d8d7e90 tempest-VolumeQuotasAdminTestJSON-1721308836 None] Deleted volume successfully. Sep 07 10:09:18 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-61160ff6-2a85-4b0e-91f5-f0c36d8d7e90 tempest-VolumeQuotasAdminTestJSON-1721308836 None] Lock "cinder-51c659c7-6396-4cb7-952c-d61619c10a82-delete_volume" released by "delete_volume" :: held 1.235s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:09:18 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-86bc617c-1950-40a1-89c0-6578a64fc8ed tempest-AbsoluteLimitsTests-259747390 None] Acquiring lock "cinder-4abed4b5-e18b-4526-acde-6d30764809d3-delete_volume" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:09:18 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-86bc617c-1950-40a1-89c0-6578a64fc8ed tempest-AbsoluteLimitsTests-259747390 None] Lock "cinder-4abed4b5-e18b-4526-acde-6d30764809d3-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:09:18 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-86bc617c-1950-40a1-89c0-6578a64fc8ed tempest-AbsoluteLimitsTests-259747390 None] Acquiring lock "cinder-quobyte-4abed4b5-e18b-4526-acde-6d30764809d3" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:09:18 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-86bc617c-1950-40a1-89c0-6578a64fc8ed tempest-AbsoluteLimitsTests-259747390 None] Lock "cinder-quobyte-4abed4b5-e18b-4526-acde-6d30764809d3" acquired by "delete_volume" :: waited 0.016s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:09:18 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[a67e5394-fe97-4eda-a9df-18150a930d90]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:09:18 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-86bc617c-1950-40a1-89c0-6578a64fc8ed tempest-AbsoluteLimitsTests-259747390 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-4abed4b5-e18b-4526-acde-6d30764809d3 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:09:18 devstack sudo[100244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-4abed4b5-e18b-4526-acde-6d30764809d3 Sep 07 10:09:18 devstack sudo[100244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:09:19 devstack sudo[100244]: pam_unix(sudo:session): session closed for user root Sep 07 10:09:19 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-86bc617c-1950-40a1-89c0-6578a64fc8ed tempest-AbsoluteLimitsTests-259747390 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-4abed4b5-e18b-4526-acde-6d30764809d3" returned: 0 in 0.398s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:09:19 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-86bc617c-1950-40a1-89c0-6578a64fc8ed tempest-AbsoluteLimitsTests-259747390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-4abed4b5-e18b-4526-acde-6d30764809d3 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:09:19 devstack sudo[100250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-4abed4b5-e18b-4526-acde-6d30764809d3 Sep 07 10:09:19 devstack sudo[100250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:09:19 devstack sudo[100250]: pam_unix(sudo:session): session closed for user root Sep 07 10:09:19 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-86bc617c-1950-40a1-89c0-6578a64fc8ed tempest-AbsoluteLimitsTests-259747390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-4abed4b5-e18b-4526-acde-6d30764809d3" returned: 0 in 0.267s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:09:19 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-86bc617c-1950-40a1-89c0-6578a64fc8ed tempest-AbsoluteLimitsTests-259747390 None] Lock "cinder-quobyte-4abed4b5-e18b-4526-acde-6d30764809d3" released by "delete_volume" :: held 0.719s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:09:19 devstack cinder-volume[87515]: DEBUG cinder.quota [None req-86bc617c-1950-40a1-89c0-6578a64fc8ed tempest-AbsoluteLimitsTests-259747390 None] Created reservations ['813fc9b2-4e85-4279-a132-80b69a63c44c', 'e96b9054-f75a-42cd-9401-cbf3222bff40', 'f3f930be-d759-46bb-b2bb-a06568b9db2b', '8797758c-f790-454b-afe2-103277e76291'] {{(pid=87515) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:09:19 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-86bc617c-1950-40a1-89c0-6578a64fc8ed tempest-AbsoluteLimitsTests-259747390 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:09:19 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-86bc617c-1950-40a1-89c0-6578a64fc8ed tempest-AbsoluteLimitsTests-259747390 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:09:19 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-86bc617c-1950-40a1-89c0-6578a64fc8ed tempest-AbsoluteLimitsTests-259747390 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:09:19 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-86bc617c-1950-40a1-89c0-6578a64fc8ed tempest-AbsoluteLimitsTests-259747390 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:09:19 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-86bc617c-1950-40a1-89c0-6578a64fc8ed tempest-AbsoluteLimitsTests-259747390 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:09:19 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-86bc617c-1950-40a1-89c0-6578a64fc8ed tempest-AbsoluteLimitsTests-259747390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:09:19 devstack sudo[100253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a Sep 07 10:09:19 devstack sudo[100253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:09:19 devstack sudo[100253]: pam_unix(sudo:session): session closed for user root Sep 07 10:09:19 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-86bc617c-1950-40a1-89c0-6578a64fc8ed tempest-AbsoluteLimitsTests-259747390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a" returned: 0 in 0.289s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:09:19 devstack cinder-volume[87515]: DEBUG cinder.manager [None req-86bc617c-1950-40a1-89c0-6578a64fc8ed tempest-AbsoluteLimitsTests-259747390 None] Notifying Schedulers of capabilities ... {{(pid=87515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:09:19 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-86bc617c-1950-40a1-89c0-6578a64fc8ed tempest-AbsoluteLimitsTests-259747390 None] Deleted volume successfully. Sep 07 10:09:19 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-86bc617c-1950-40a1-89c0-6578a64fc8ed tempest-AbsoluteLimitsTests-259747390 None] Lock "cinder-4abed4b5-e18b-4526-acde-6d30764809d3-delete_volume" released by "delete_volume" :: held 1.262s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:09:21 devstack cinder-volume[87515]: DEBUG cinder.volume.flows.manager.create_volume [None req-801f6a23-fe07-49ff-92e0-2df970933fbe tempest-TestServerVolumeAttachmentScenario-1829138586 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 10:09:21 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-801f6a23-fe07-49ff-92e0-2df970933fbe tempest-TestServerVolumeAttachmentScenario-1829138586 None] Flow 'volume_create_manager' (73e08666-b108-4ff3-9bc8-4d3fb1e06cad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:09:21 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-801f6a23-fe07-49ff-92e0-2df970933fbe tempest-TestServerVolumeAttachmentScenario-1829138586 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (939fbb37-b3da-4dba-892d-6327640f17b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:09:21 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-801f6a23-fe07-49ff-92e0-2df970933fbe tempest-TestServerVolumeAttachmentScenario-1829138586 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (939fbb37-b3da-4dba-892d-6327640f17b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:09:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1422797739',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec5ef6cb-bd26-4ec4-b3fc-061bdf60d1b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25bb78acf1d44ee8a290d96bd48fafec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:09:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:09:22Z,use_quota=True,user_id='ddfa3b83572a4e76b45425e0945d994a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3a092cd-7947-4cbf-abff-4ba9567becf0),volume_type_id=f3a092cd-7947-4cbf-abff-4ba9567becf0)' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:09:21 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-801f6a23-fe07-49ff-92e0-2df970933fbe tempest-TestServerVolumeAttachmentScenario-1829138586 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00191799-a35b-4d7a-8d7e-82c2033859a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:09:21 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-801f6a23-fe07-49ff-92e0-2df970933fbe tempest-TestServerVolumeAttachmentScenario-1829138586 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00191799-a35b-4d7a-8d7e-82c2033859a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:09:21 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-801f6a23-fe07-49ff-92e0-2df970933fbe tempest-TestServerVolumeAttachmentScenario-1829138586 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48a4adf4-da78-42b2-96a9-c5352a366a73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:09:21 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-801f6a23-fe07-49ff-92e0-2df970933fbe tempest-TestServerVolumeAttachmentScenario-1829138586 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48a4adf4-da78-42b2-96a9-c5352a366a73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ec5ef6cb-bd26-4ec4-b3fc-061bdf60d1b9', 'volume_name': 'volume-ec5ef6cb-bd26-4ec4-b3fc-061bdf60d1b9', 'volume_size': 1}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:09:21 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-801f6a23-fe07-49ff-92e0-2df970933fbe tempest-TestServerVolumeAttachmentScenario-1829138586 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da3dcc67-4712-47d6-b18d-d13196bdddcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:09:21 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-801f6a23-fe07-49ff-92e0-2df970933fbe tempest-TestServerVolumeAttachmentScenario-1829138586 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da3dcc67-4712-47d6-b18d-d13196bdddcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:09:21 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-801f6a23-fe07-49ff-92e0-2df970933fbe tempest-TestServerVolumeAttachmentScenario-1829138586 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aef120ec-f7f7-4c42-84ed-ece2bfd2af7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:09:21 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-801f6a23-fe07-49ff-92e0-2df970933fbe tempest-TestServerVolumeAttachmentScenario-1829138586 None] Volume ec5ef6cb-bd26-4ec4-b3fc-061bdf60d1b9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ec5ef6cb-bd26-4ec4-b3fc-061bdf60d1b9', 'volume_size': 1} Sep 07 10:09:21 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-801f6a23-fe07-49ff-92e0-2df970933fbe tempest-TestServerVolumeAttachmentScenario-1829138586 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:09:21 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-801f6a23-fe07-49ff-92e0-2df970933fbe tempest-TestServerVolumeAttachmentScenario-1829138586 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:09:21 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-801f6a23-fe07-49ff-92e0-2df970933fbe tempest-TestServerVolumeAttachmentScenario-1829138586 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:09:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1422797739',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec5ef6cb-bd26-4ec4-b3fc-061bdf60d1b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25bb78acf1d44ee8a290d96bd48fafec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:09:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:09:22Z,use_quota=True,user_id='ddfa3b83572a4e76b45425e0945d994a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3a092cd-7947-4cbf-abff-4ba9567becf0),volume_type_id=f3a092cd-7947-4cbf-abff-4ba9567becf0)}" {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 10:09:21 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-801f6a23-fe07-49ff-92e0-2df970933fbe tempest-TestServerVolumeAttachmentScenario-1829138586 None] Creating volume ec5ef6cb-bd26-4ec4-b3fc-061bdf60d1b9 {{(pid=87515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 10:09:21 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-801f6a23-fe07-49ff-92e0-2df970933fbe tempest-TestServerVolumeAttachmentScenario-1829138586 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:09:21 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-801f6a23-fe07-49ff-92e0-2df970933fbe tempest-TestServerVolumeAttachmentScenario-1829138586 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:09:21 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-801f6a23-fe07-49ff-92e0-2df970933fbe tempest-TestServerVolumeAttachmentScenario-1829138586 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:09:21 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-801f6a23-fe07-49ff-92e0-2df970933fbe tempest-TestServerVolumeAttachmentScenario-1829138586 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:09:21 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-801f6a23-fe07-49ff-92e0-2df970933fbe tempest-TestServerVolumeAttachmentScenario-1829138586 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:09:21 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-801f6a23-fe07-49ff-92e0-2df970933fbe tempest-TestServerVolumeAttachmentScenario-1829138586 None] Selected osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c as target Quobyte volume. {{(pid=87515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 10:09:21 devstack cinder-volume[87515]: INFO cinder.volume.drivers.remotefs [None req-801f6a23-fe07-49ff-92e0-2df970933fbe tempest-TestServerVolumeAttachmentScenario-1829138586 None] casted to osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c Sep 07 10:09:21 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-801f6a23-fe07-49ff-92e0-2df970933fbe tempest-TestServerVolumeAttachmentScenario-1829138586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-ec5ef6cb-bd26-4ec4-b3fc-061bdf60d1b9 1073741824 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:09:22 devstack sudo[100290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-ec5ef6cb-bd26-4ec4-b3fc-061bdf60d1b9 1073741824 Sep 07 10:09:22 devstack sudo[100290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:09:22 devstack cinder-volume[87515]: DEBUG cinder.volume.flows.manager.create_volume [None req-1784c51e-f637-404a-9f1b-195125a392da tempest-TestServerVolumeAttachmentScenario-1829138586 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 10:09:22 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-1784c51e-f637-404a-9f1b-195125a392da tempest-TestServerVolumeAttachmentScenario-1829138586 None] Flow 'volume_create_manager' (e7017a4f-b8c4-49ea-b0ee-c6590a74b1c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:09:22 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-1784c51e-f637-404a-9f1b-195125a392da tempest-TestServerVolumeAttachmentScenario-1829138586 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f1fee5e-9eed-4d84-a389-088d44c0d315) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:09:22 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-1784c51e-f637-404a-9f1b-195125a392da tempest-TestServerVolumeAttachmentScenario-1829138586 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f1fee5e-9eed-4d84-a389-088d44c0d315) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:09:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-931270616',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63322935-468a-400c-8a29-86201154a482,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25bb78acf1d44ee8a290d96bd48fafec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:09:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:09:22Z,use_quota=True,user_id='ddfa3b83572a4e76b45425e0945d994a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3a092cd-7947-4cbf-abff-4ba9567becf0),volume_type_id=f3a092cd-7947-4cbf-abff-4ba9567becf0)' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:09:22 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-1784c51e-f637-404a-9f1b-195125a392da tempest-TestServerVolumeAttachmentScenario-1829138586 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (993f751c-bb8d-48ff-867e-c6585c3ca5dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:09:22 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-1784c51e-f637-404a-9f1b-195125a392da tempest-TestServerVolumeAttachmentScenario-1829138586 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (993f751c-bb8d-48ff-867e-c6585c3ca5dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:09:22 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-1784c51e-f637-404a-9f1b-195125a392da tempest-TestServerVolumeAttachmentScenario-1829138586 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d25c903-9149-43b5-85c3-34962e16de36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:09:22 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-1784c51e-f637-404a-9f1b-195125a392da tempest-TestServerVolumeAttachmentScenario-1829138586 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d25c903-9149-43b5-85c3-34962e16de36) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '63322935-468a-400c-8a29-86201154a482', 'volume_name': 'volume-63322935-468a-400c-8a29-86201154a482', 'volume_size': 1}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:09:22 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-1784c51e-f637-404a-9f1b-195125a392da tempest-TestServerVolumeAttachmentScenario-1829138586 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50a3a012-f5a4-4f01-afd7-e50c2bb471cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:09:22 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-1784c51e-f637-404a-9f1b-195125a392da tempest-TestServerVolumeAttachmentScenario-1829138586 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50a3a012-f5a4-4f01-afd7-e50c2bb471cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:09:22 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-1784c51e-f637-404a-9f1b-195125a392da tempest-TestServerVolumeAttachmentScenario-1829138586 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f496266-c6c5-416d-8a91-7d9dbef6639a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:09:22 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-1784c51e-f637-404a-9f1b-195125a392da tempest-TestServerVolumeAttachmentScenario-1829138586 None] Volume 63322935-468a-400c-8a29-86201154a482: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-63322935-468a-400c-8a29-86201154a482', 'volume_size': 1} Sep 07 10:09:22 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-1784c51e-f637-404a-9f1b-195125a392da tempest-TestServerVolumeAttachmentScenario-1829138586 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:09:22 devstack sudo[100290]: pam_unix(sudo:session): session closed for user root Sep 07 10:09:22 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-801f6a23-fe07-49ff-92e0-2df970933fbe tempest-TestServerVolumeAttachmentScenario-1829138586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-ec5ef6cb-bd26-4ec4-b3fc-061bdf60d1b9 1073741824" returned: 0 in 0.890s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:09:22 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-801f6a23-fe07-49ff-92e0-2df970933fbe tempest-TestServerVolumeAttachmentScenario-1829138586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-ec5ef6cb-bd26-4ec4-b3fc-061bdf60d1b9 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:09:22 devstack sudo[100298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-ec5ef6cb-bd26-4ec4-b3fc-061bdf60d1b9 Sep 07 10:09:22 devstack sudo[100298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:09:23 devstack sudo[100298]: pam_unix(sudo:session): session closed for user root Sep 07 10:09:23 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-801f6a23-fe07-49ff-92e0-2df970933fbe tempest-TestServerVolumeAttachmentScenario-1829138586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-ec5ef6cb-bd26-4ec4-b3fc-061bdf60d1b9" returned: 0 in 0.327s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:09:23 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-801f6a23-fe07-49ff-92e0-2df970933fbe tempest-TestServerVolumeAttachmentScenario-1829138586 None] <== create_volume: return (1290ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'} {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 10:09:23 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-801f6a23-fe07-49ff-92e0-2df970933fbe tempest-TestServerVolumeAttachmentScenario-1829138586 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.293s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:09:23 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-1784c51e-f637-404a-9f1b-195125a392da tempest-TestServerVolumeAttachmentScenario-1829138586 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.510s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:09:23 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-1784c51e-f637-404a-9f1b-195125a392da tempest-TestServerVolumeAttachmentScenario-1829138586 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:09:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-931270616',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63322935-468a-400c-8a29-86201154a482,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25bb78acf1d44ee8a290d96bd48fafec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:09:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:09:22Z,use_quota=True,user_id='ddfa3b83572a4e76b45425e0945d994a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3a092cd-7947-4cbf-abff-4ba9567becf0),volume_type_id=f3a092cd-7947-4cbf-abff-4ba9567becf0)}" {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 10:09:23 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-1784c51e-f637-404a-9f1b-195125a392da tempest-TestServerVolumeAttachmentScenario-1829138586 None] Creating volume 63322935-468a-400c-8a29-86201154a482 {{(pid=87515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 10:09:23 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-1784c51e-f637-404a-9f1b-195125a392da tempest-TestServerVolumeAttachmentScenario-1829138586 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:09:23 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-1784c51e-f637-404a-9f1b-195125a392da tempest-TestServerVolumeAttachmentScenario-1829138586 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:09:23 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-1784c51e-f637-404a-9f1b-195125a392da tempest-TestServerVolumeAttachmentScenario-1829138586 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:09:23 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-1784c51e-f637-404a-9f1b-195125a392da tempest-TestServerVolumeAttachmentScenario-1829138586 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:09:23 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-1784c51e-f637-404a-9f1b-195125a392da tempest-TestServerVolumeAttachmentScenario-1829138586 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:09:23 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-1784c51e-f637-404a-9f1b-195125a392da tempest-TestServerVolumeAttachmentScenario-1829138586 None] Selected osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c as target Quobyte volume. {{(pid=87515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 10:09:23 devstack cinder-volume[87515]: INFO cinder.volume.drivers.remotefs [None req-1784c51e-f637-404a-9f1b-195125a392da tempest-TestServerVolumeAttachmentScenario-1829138586 None] casted to osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c Sep 07 10:09:23 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-1784c51e-f637-404a-9f1b-195125a392da tempest-TestServerVolumeAttachmentScenario-1829138586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-63322935-468a-400c-8a29-86201154a482 1073741824 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:09:23 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-801f6a23-fe07-49ff-92e0-2df970933fbe tempest-TestServerVolumeAttachmentScenario-1829138586 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aef120ec-f7f7-4c42-84ed-ece2bfd2af7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ec5ef6cb-bd26-4ec4-b3fc-061bdf60d1b9', 'volume_size': 1}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:09:23 devstack sudo[100301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-63322935-468a-400c-8a29-86201154a482 1073741824 Sep 07 10:09:23 devstack sudo[100301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:09:23 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-801f6a23-fe07-49ff-92e0-2df970933fbe tempest-TestServerVolumeAttachmentScenario-1829138586 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4f9397c-8dbe-45ce-8b49-5011bbe309c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:09:23 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-801f6a23-fe07-49ff-92e0-2df970933fbe tempest-TestServerVolumeAttachmentScenario-1829138586 None] Volume volume-ec5ef6cb-bd26-4ec4-b3fc-061bdf60d1b9 (ec5ef6cb-bd26-4ec4-b3fc-061bdf60d1b9): created successfully Sep 07 10:09:23 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-801f6a23-fe07-49ff-92e0-2df970933fbe tempest-TestServerVolumeAttachmentScenario-1829138586 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4f9397c-8dbe-45ce-8b49-5011bbe309c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:09:23 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-801f6a23-fe07-49ff-92e0-2df970933fbe tempest-TestServerVolumeAttachmentScenario-1829138586 None] Flow 'volume_create_manager' (73e08666-b108-4ff3-9bc8-4d3fb1e06cad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:09:23 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-801f6a23-fe07-49ff-92e0-2df970933fbe tempest-TestServerVolumeAttachmentScenario-1829138586 None] Created volume successfully. Sep 07 10:09:23 devstack sudo[100301]: pam_unix(sudo:session): session closed for user root Sep 07 10:09:23 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-1784c51e-f637-404a-9f1b-195125a392da tempest-TestServerVolumeAttachmentScenario-1829138586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-63322935-468a-400c-8a29-86201154a482 1073741824" returned: 0 in 0.599s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:09:23 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-1784c51e-f637-404a-9f1b-195125a392da tempest-TestServerVolumeAttachmentScenario-1829138586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-63322935-468a-400c-8a29-86201154a482 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:09:23 devstack sudo[100307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-63322935-468a-400c-8a29-86201154a482 Sep 07 10:09:23 devstack sudo[100307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:09:24 devstack sudo[100307]: pam_unix(sudo:session): session closed for user root Sep 07 10:09:24 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-1784c51e-f637-404a-9f1b-195125a392da tempest-TestServerVolumeAttachmentScenario-1829138586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-63322935-468a-400c-8a29-86201154a482" returned: 0 in 0.328s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:09:24 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-1784c51e-f637-404a-9f1b-195125a392da tempest-TestServerVolumeAttachmentScenario-1829138586 None] <== create_volume: return (987ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'} {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 10:09:24 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-1784c51e-f637-404a-9f1b-195125a392da tempest-TestServerVolumeAttachmentScenario-1829138586 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.993s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:09:24 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-1784c51e-f637-404a-9f1b-195125a392da tempest-TestServerVolumeAttachmentScenario-1829138586 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f496266-c6c5-416d-8a91-7d9dbef6639a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-63322935-468a-400c-8a29-86201154a482', 'volume_size': 1}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:09:24 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-1784c51e-f637-404a-9f1b-195125a392da tempest-TestServerVolumeAttachmentScenario-1829138586 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2d08e32-dabe-4d80-a627-abb8babb2e8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:09:24 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-1784c51e-f637-404a-9f1b-195125a392da tempest-TestServerVolumeAttachmentScenario-1829138586 None] Volume volume-63322935-468a-400c-8a29-86201154a482 (63322935-468a-400c-8a29-86201154a482): created successfully Sep 07 10:09:24 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-1784c51e-f637-404a-9f1b-195125a392da tempest-TestServerVolumeAttachmentScenario-1829138586 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2d08e32-dabe-4d80-a627-abb8babb2e8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:09:24 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-1784c51e-f637-404a-9f1b-195125a392da tempest-TestServerVolumeAttachmentScenario-1829138586 None] Flow 'volume_create_manager' (e7017a4f-b8c4-49ea-b0ee-c6590a74b1c8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:09:24 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-1784c51e-f637-404a-9f1b-195125a392da tempest-TestServerVolumeAttachmentScenario-1829138586 None] Created volume successfully. Sep 07 10:09:28 devstack cinder-volume[87515]: DEBUG cinder.volume.flows.manager.create_volume [None req-d076784f-52f1-4997-b4e4-dad685616231 tempest-VolumesTransfersV357Test-436549971 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 10:09:28 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-d076784f-52f1-4997-b4e4-dad685616231 tempest-VolumesTransfersV357Test-436549971 None] Flow 'volume_create_manager' (f91ed04d-89d6-4df5-b0c6-9bf886ce57c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:09:28 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-d076784f-52f1-4997-b4e4-dad685616231 tempest-VolumesTransfersV357Test-436549971 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a822f7e9-0c89-4412-bf46-b8cde3c942cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:09:28 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-d076784f-52f1-4997-b4e4-dad685616231 tempest-VolumesTransfersV357Test-436549971 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a822f7e9-0c89-4412-bf46-b8cde3c942cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:09:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-630886663',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0db4c760-3cc7-4031-9a0c-32867d9e2528,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80ba1954b6c546f3b986592ca3986251',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:09:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:09:28Z,use_quota=True,user_id='d9fc507c57c34f999b2f35a4cf9987ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3a092cd-7947-4cbf-abff-4ba9567becf0),volume_type_id=f3a092cd-7947-4cbf-abff-4ba9567becf0)' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:09:28 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-d076784f-52f1-4997-b4e4-dad685616231 tempest-VolumesTransfersV357Test-436549971 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8123666-fecc-44c8-bf4f-76849a4d36d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:09:28 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-d076784f-52f1-4997-b4e4-dad685616231 tempest-VolumesTransfersV357Test-436549971 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8123666-fecc-44c8-bf4f-76849a4d36d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:09:28 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-d076784f-52f1-4997-b4e4-dad685616231 tempest-VolumesTransfersV357Test-436549971 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43c792ed-9ed9-4652-9ff6-bdd94d3144c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:09:28 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-d076784f-52f1-4997-b4e4-dad685616231 tempest-VolumesTransfersV357Test-436549971 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43c792ed-9ed9-4652-9ff6-bdd94d3144c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0db4c760-3cc7-4031-9a0c-32867d9e2528', 'volume_name': 'volume-0db4c760-3cc7-4031-9a0c-32867d9e2528', 'volume_size': 1}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:09:28 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-d076784f-52f1-4997-b4e4-dad685616231 tempest-VolumesTransfersV357Test-436549971 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f60071a8-a041-4fd1-a954-ac6ac2269de8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:09:28 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-d076784f-52f1-4997-b4e4-dad685616231 tempest-VolumesTransfersV357Test-436549971 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f60071a8-a041-4fd1-a954-ac6ac2269de8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:09:28 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-d076784f-52f1-4997-b4e4-dad685616231 tempest-VolumesTransfersV357Test-436549971 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4bb7204-b8a9-4c5d-a440-fcd56da874c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:09:28 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-d076784f-52f1-4997-b4e4-dad685616231 tempest-VolumesTransfersV357Test-436549971 None] Volume 0db4c760-3cc7-4031-9a0c-32867d9e2528: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0db4c760-3cc7-4031-9a0c-32867d9e2528', 'volume_size': 1} Sep 07 10:09:28 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-d076784f-52f1-4997-b4e4-dad685616231 tempest-VolumesTransfersV357Test-436549971 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:09:28 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-d076784f-52f1-4997-b4e4-dad685616231 tempest-VolumesTransfersV357Test-436549971 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:09:28 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-d076784f-52f1-4997-b4e4-dad685616231 tempest-VolumesTransfersV357Test-436549971 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:09:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-630886663',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0db4c760-3cc7-4031-9a0c-32867d9e2528,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80ba1954b6c546f3b986592ca3986251',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:09:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:09:28Z,use_quota=True,user_id='d9fc507c57c34f999b2f35a4cf9987ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3a092cd-7947-4cbf-abff-4ba9567becf0),volume_type_id=f3a092cd-7947-4cbf-abff-4ba9567becf0)}" {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 10:09:28 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-d076784f-52f1-4997-b4e4-dad685616231 tempest-VolumesTransfersV357Test-436549971 None] Creating volume 0db4c760-3cc7-4031-9a0c-32867d9e2528 {{(pid=87515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 10:09:28 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-d076784f-52f1-4997-b4e4-dad685616231 tempest-VolumesTransfersV357Test-436549971 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:09:28 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-d076784f-52f1-4997-b4e4-dad685616231 tempest-VolumesTransfersV357Test-436549971 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:09:28 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-d076784f-52f1-4997-b4e4-dad685616231 tempest-VolumesTransfersV357Test-436549971 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:09:28 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-d076784f-52f1-4997-b4e4-dad685616231 tempest-VolumesTransfersV357Test-436549971 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:09:28 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-d076784f-52f1-4997-b4e4-dad685616231 tempest-VolumesTransfersV357Test-436549971 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:09:28 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-d076784f-52f1-4997-b4e4-dad685616231 tempest-VolumesTransfersV357Test-436549971 None] Selected osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c as target Quobyte volume. {{(pid=87515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 10:09:28 devstack cinder-volume[87515]: INFO cinder.volume.drivers.remotefs [None req-d076784f-52f1-4997-b4e4-dad685616231 tempest-VolumesTransfersV357Test-436549971 None] casted to osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c Sep 07 10:09:28 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-d076784f-52f1-4997-b4e4-dad685616231 tempest-VolumesTransfersV357Test-436549971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-0db4c760-3cc7-4031-9a0c-32867d9e2528 1073741824 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:09:28 devstack sudo[100317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-0db4c760-3cc7-4031-9a0c-32867d9e2528 1073741824 Sep 07 10:09:28 devstack sudo[100317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:09:28 devstack cinder-volume[87515]: DEBUG cinder.volume.flows.manager.create_volume [None req-91475dd2-d356-4861-8d36-62a23010cb1d tempest-VolumesServicesTestJSON-1631223889 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 10:09:28 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-91475dd2-d356-4861-8d36-62a23010cb1d tempest-VolumesServicesTestJSON-1631223889 None] Flow 'volume_create_manager' (5245cd63-e308-40e4-8bfe-2b1f2b62d07e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:09:28 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-91475dd2-d356-4861-8d36-62a23010cb1d tempest-VolumesServicesTestJSON-1631223889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8565c39d-bee0-4cd8-9bab-b5fd83f9b296) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:09:28 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-91475dd2-d356-4861-8d36-62a23010cb1d tempest-VolumesServicesTestJSON-1631223889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8565c39d-bee0-4cd8-9bab-b5fd83f9b296) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:09:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-960508639',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af2825a6-e528-4e49-a4cd-b962ab3fc9d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0039f0a0eb44703846e8773294799fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:09:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:09:29Z,use_quota=True,user_id='f20e4e0348754ebaa5888b7962d04dc5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3a092cd-7947-4cbf-abff-4ba9567becf0),volume_type_id=f3a092cd-7947-4cbf-abff-4ba9567becf0)' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:09:28 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-91475dd2-d356-4861-8d36-62a23010cb1d tempest-VolumesServicesTestJSON-1631223889 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09c2737f-ab1b-4b53-8bcc-643687d340fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:09:28 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-91475dd2-d356-4861-8d36-62a23010cb1d tempest-VolumesServicesTestJSON-1631223889 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09c2737f-ab1b-4b53-8bcc-643687d340fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:09:28 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-91475dd2-d356-4861-8d36-62a23010cb1d tempest-VolumesServicesTestJSON-1631223889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07786f66-3262-4f16-9198-e601302c6bc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:09:28 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-91475dd2-d356-4861-8d36-62a23010cb1d tempest-VolumesServicesTestJSON-1631223889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07786f66-3262-4f16-9198-e601302c6bc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'af2825a6-e528-4e49-a4cd-b962ab3fc9d2', 'volume_name': 'volume-af2825a6-e528-4e49-a4cd-b962ab3fc9d2', 'volume_size': 1}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:09:28 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-91475dd2-d356-4861-8d36-62a23010cb1d tempest-VolumesServicesTestJSON-1631223889 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e786086c-095b-438e-ac9c-344c6bc66248) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:09:28 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-91475dd2-d356-4861-8d36-62a23010cb1d tempest-VolumesServicesTestJSON-1631223889 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e786086c-095b-438e-ac9c-344c6bc66248) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:09:28 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-91475dd2-d356-4861-8d36-62a23010cb1d tempest-VolumesServicesTestJSON-1631223889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46a1e84d-a523-4b8e-833f-f50fc0e6a552) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:09:28 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-91475dd2-d356-4861-8d36-62a23010cb1d tempest-VolumesServicesTestJSON-1631223889 None] Volume af2825a6-e528-4e49-a4cd-b962ab3fc9d2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-af2825a6-e528-4e49-a4cd-b962ab3fc9d2', 'volume_size': 1} Sep 07 10:09:28 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-91475dd2-d356-4861-8d36-62a23010cb1d tempest-VolumesServicesTestJSON-1631223889 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:09:29 devstack sudo[100317]: pam_unix(sudo:session): session closed for user root Sep 07 10:09:29 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-d076784f-52f1-4997-b4e4-dad685616231 tempest-VolumesTransfersV357Test-436549971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-0db4c760-3cc7-4031-9a0c-32867d9e2528 1073741824" returned: 0 in 0.606s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:09:29 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-d076784f-52f1-4997-b4e4-dad685616231 tempest-VolumesTransfersV357Test-436549971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-0db4c760-3cc7-4031-9a0c-32867d9e2528 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:09:29 devstack sudo[100336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-0db4c760-3cc7-4031-9a0c-32867d9e2528 Sep 07 10:09:29 devstack sudo[100336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:09:29 devstack sudo[100336]: pam_unix(sudo:session): session closed for user root Sep 07 10:09:29 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-d076784f-52f1-4997-b4e4-dad685616231 tempest-VolumesTransfersV357Test-436549971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-0db4c760-3cc7-4031-9a0c-32867d9e2528" returned: 0 in 0.254s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:09:29 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-d076784f-52f1-4997-b4e4-dad685616231 tempest-VolumesTransfersV357Test-436549971 None] <== create_volume: return (913ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'} {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 10:09:29 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-d076784f-52f1-4997-b4e4-dad685616231 tempest-VolumesTransfersV357Test-436549971 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.916s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:09:29 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-91475dd2-d356-4861-8d36-62a23010cb1d tempest-VolumesServicesTestJSON-1631223889 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.754s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:09:29 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-91475dd2-d356-4861-8d36-62a23010cb1d tempest-VolumesServicesTestJSON-1631223889 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:09:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-960508639',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af2825a6-e528-4e49-a4cd-b962ab3fc9d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0039f0a0eb44703846e8773294799fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:09:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:09:29Z,use_quota=True,user_id='f20e4e0348754ebaa5888b7962d04dc5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3a092cd-7947-4cbf-abff-4ba9567becf0),volume_type_id=f3a092cd-7947-4cbf-abff-4ba9567becf0)}" {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 10:09:29 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-91475dd2-d356-4861-8d36-62a23010cb1d tempest-VolumesServicesTestJSON-1631223889 None] Creating volume af2825a6-e528-4e49-a4cd-b962ab3fc9d2 {{(pid=87515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 10:09:29 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-91475dd2-d356-4861-8d36-62a23010cb1d tempest-VolumesServicesTestJSON-1631223889 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:09:29 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-91475dd2-d356-4861-8d36-62a23010cb1d tempest-VolumesServicesTestJSON-1631223889 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:09:29 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-91475dd2-d356-4861-8d36-62a23010cb1d tempest-VolumesServicesTestJSON-1631223889 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:09:29 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-91475dd2-d356-4861-8d36-62a23010cb1d tempest-VolumesServicesTestJSON-1631223889 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:09:29 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-91475dd2-d356-4861-8d36-62a23010cb1d tempest-VolumesServicesTestJSON-1631223889 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:09:29 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-91475dd2-d356-4861-8d36-62a23010cb1d tempest-VolumesServicesTestJSON-1631223889 None] Selected osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c as target Quobyte volume. {{(pid=87515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 10:09:29 devstack cinder-volume[87515]: INFO cinder.volume.drivers.remotefs [None req-91475dd2-d356-4861-8d36-62a23010cb1d tempest-VolumesServicesTestJSON-1631223889 None] casted to osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c Sep 07 10:09:29 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-91475dd2-d356-4861-8d36-62a23010cb1d tempest-VolumesServicesTestJSON-1631223889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-af2825a6-e528-4e49-a4cd-b962ab3fc9d2 1073741824 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:09:29 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-d076784f-52f1-4997-b4e4-dad685616231 tempest-VolumesTransfersV357Test-436549971 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4bb7204-b8a9-4c5d-a440-fcd56da874c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0db4c760-3cc7-4031-9a0c-32867d9e2528', 'volume_size': 1}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:09:29 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-d076784f-52f1-4997-b4e4-dad685616231 tempest-VolumesTransfersV357Test-436549971 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea667158-2f67-4de0-b00e-507ae321fc6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:09:29 devstack sudo[100339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-af2825a6-e528-4e49-a4cd-b962ab3fc9d2 1073741824 Sep 07 10:09:29 devstack sudo[100339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:09:29 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-d076784f-52f1-4997-b4e4-dad685616231 tempest-VolumesTransfersV357Test-436549971 None] Volume volume-0db4c760-3cc7-4031-9a0c-32867d9e2528 (0db4c760-3cc7-4031-9a0c-32867d9e2528): created successfully Sep 07 10:09:29 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-d076784f-52f1-4997-b4e4-dad685616231 tempest-VolumesTransfersV357Test-436549971 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea667158-2f67-4de0-b00e-507ae321fc6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:09:29 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-d076784f-52f1-4997-b4e4-dad685616231 tempest-VolumesTransfersV357Test-436549971 None] Flow 'volume_create_manager' (f91ed04d-89d6-4df5-b0c6-9bf886ce57c0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:09:29 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-d076784f-52f1-4997-b4e4-dad685616231 tempest-VolumesTransfersV357Test-436549971 None] Created volume successfully. Sep 07 10:09:30 devstack sudo[100339]: pam_unix(sudo:session): session closed for user root Sep 07 10:09:30 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-91475dd2-d356-4861-8d36-62a23010cb1d tempest-VolumesServicesTestJSON-1631223889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-af2825a6-e528-4e49-a4cd-b962ab3fc9d2 1073741824" returned: 0 in 0.479s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:09:30 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-91475dd2-d356-4861-8d36-62a23010cb1d tempest-VolumesServicesTestJSON-1631223889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-af2825a6-e528-4e49-a4cd-b962ab3fc9d2 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:09:30 devstack sudo[100345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-af2825a6-e528-4e49-a4cd-b962ab3fc9d2 Sep 07 10:09:30 devstack sudo[100345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:09:30 devstack sudo[100345]: pam_unix(sudo:session): session closed for user root Sep 07 10:09:30 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-91475dd2-d356-4861-8d36-62a23010cb1d tempest-VolumesServicesTestJSON-1631223889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-af2825a6-e528-4e49-a4cd-b962ab3fc9d2" returned: 0 in 0.293s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:09:30 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-91475dd2-d356-4861-8d36-62a23010cb1d tempest-VolumesServicesTestJSON-1631223889 None] <== create_volume: return (818ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'} {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 10:09:30 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-91475dd2-d356-4861-8d36-62a23010cb1d tempest-VolumesServicesTestJSON-1631223889 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.823s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:09:30 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-91475dd2-d356-4861-8d36-62a23010cb1d tempest-VolumesServicesTestJSON-1631223889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46a1e84d-a523-4b8e-833f-f50fc0e6a552) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-af2825a6-e528-4e49-a4cd-b962ab3fc9d2', 'volume_size': 1}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:09:30 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-91475dd2-d356-4861-8d36-62a23010cb1d tempest-VolumesServicesTestJSON-1631223889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82b3a826-87c5-43d3-93b1-60658e9aa3d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:09:30 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-91475dd2-d356-4861-8d36-62a23010cb1d tempest-VolumesServicesTestJSON-1631223889 None] Volume volume-af2825a6-e528-4e49-a4cd-b962ab3fc9d2 (af2825a6-e528-4e49-a4cd-b962ab3fc9d2): created successfully Sep 07 10:09:30 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-91475dd2-d356-4861-8d36-62a23010cb1d tempest-VolumesServicesTestJSON-1631223889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82b3a826-87c5-43d3-93b1-60658e9aa3d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:09:30 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-91475dd2-d356-4861-8d36-62a23010cb1d tempest-VolumesServicesTestJSON-1631223889 None] Flow 'volume_create_manager' (5245cd63-e308-40e4-8bfe-2b1f2b62d07e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:09:30 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-91475dd2-d356-4861-8d36-62a23010cb1d tempest-VolumesServicesTestJSON-1631223889 None] Created volume successfully. Sep 07 10:09:31 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-46006af8-035c-4273-acca-8f54637a9529 tempest-VolumesTransfersV357Test-2040661467 None] Transfer volume completed successfully. Sep 07 10:09:32 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-8e33de2e-5507-4d5a-b4c7-a9b1771e8493 tempest-VolumesServicesTestJSON-1631223889 None] Acquiring lock "cinder-af2825a6-e528-4e49-a4cd-b962ab3fc9d2-delete_volume" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:09:32 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-8e33de2e-5507-4d5a-b4c7-a9b1771e8493 tempest-VolumesServicesTestJSON-1631223889 None] Lock "cinder-af2825a6-e528-4e49-a4cd-b962ab3fc9d2-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:09:32 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-8e33de2e-5507-4d5a-b4c7-a9b1771e8493 tempest-VolumesServicesTestJSON-1631223889 None] Acquiring lock "cinder-quobyte-af2825a6-e528-4e49-a4cd-b962ab3fc9d2" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:09:32 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-bd7f75b5-19e5-4ca4-84d7-36b5f4b375a5 tempest-VolumesTransfersV357Test-1099325936 None] Acquiring lock "cinder-0db4c760-3cc7-4031-9a0c-32867d9e2528-delete_volume" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:09:32 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-8e33de2e-5507-4d5a-b4c7-a9b1771e8493 tempest-VolumesServicesTestJSON-1631223889 None] Lock "cinder-quobyte-af2825a6-e528-4e49-a4cd-b962ab3fc9d2" acquired by "delete_volume" :: waited 0.039s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:09:32 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-bd7f75b5-19e5-4ca4-84d7-36b5f4b375a5 tempest-VolumesTransfersV357Test-1099325936 None] Lock "cinder-0db4c760-3cc7-4031-9a0c-32867d9e2528-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:09:32 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8285913-a5bf-4b3e-8e31-3b5891294f4c]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:09:32 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-8e33de2e-5507-4d5a-b4c7-a9b1771e8493 tempest-VolumesServicesTestJSON-1631223889 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-af2825a6-e528-4e49-a4cd-b962ab3fc9d2 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:09:32 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-bd7f75b5-19e5-4ca4-84d7-36b5f4b375a5 tempest-VolumesTransfersV357Test-1099325936 None] Acquiring lock "cinder-quobyte-0db4c760-3cc7-4031-9a0c-32867d9e2528" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:09:32 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-bd7f75b5-19e5-4ca4-84d7-36b5f4b375a5 tempest-VolumesTransfersV357Test-1099325936 None] Lock "cinder-quobyte-0db4c760-3cc7-4031-9a0c-32867d9e2528" acquired by "delete_volume" :: waited 0.020s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:09:32 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[2998f4e1-84d8-42c5-aa10-b2a33f1d781b]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:09:32 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-bd7f75b5-19e5-4ca4-84d7-36b5f4b375a5 tempest-VolumesTransfersV357Test-1099325936 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-0db4c760-3cc7-4031-9a0c-32867d9e2528 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:09:32 devstack sudo[100414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-af2825a6-e528-4e49-a4cd-b962ab3fc9d2 Sep 07 10:09:32 devstack sudo[100414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:09:32 devstack sudo[100415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-0db4c760-3cc7-4031-9a0c-32867d9e2528 Sep 07 10:09:32 devstack sudo[100415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:09:32 devstack sudo[100414]: pam_unix(sudo:session): session closed for user root Sep 07 10:09:32 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-8e33de2e-5507-4d5a-b4c7-a9b1771e8493 tempest-VolumesServicesTestJSON-1631223889 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-af2825a6-e528-4e49-a4cd-b962ab3fc9d2" returned: 0 in 0.478s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:09:32 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-8e33de2e-5507-4d5a-b4c7-a9b1771e8493 tempest-VolumesServicesTestJSON-1631223889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-af2825a6-e528-4e49-a4cd-b962ab3fc9d2 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:09:32 devstack sudo[100423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-af2825a6-e528-4e49-a4cd-b962ab3fc9d2 Sep 07 10:09:32 devstack sudo[100423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:09:32 devstack sudo[100415]: pam_unix(sudo:session): session closed for user root Sep 07 10:09:32 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-bd7f75b5-19e5-4ca4-84d7-36b5f4b375a5 tempest-VolumesTransfersV357Test-1099325936 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-0db4c760-3cc7-4031-9a0c-32867d9e2528" returned: 0 in 0.562s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:09:32 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-bd7f75b5-19e5-4ca4-84d7-36b5f4b375a5 tempest-VolumesTransfersV357Test-1099325936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-0db4c760-3cc7-4031-9a0c-32867d9e2528 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:09:33 devstack sudo[100428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-0db4c760-3cc7-4031-9a0c-32867d9e2528 Sep 07 10:09:33 devstack sudo[100428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:09:33 devstack sudo[100423]: pam_unix(sudo:session): session closed for user root Sep 07 10:09:33 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-8e33de2e-5507-4d5a-b4c7-a9b1771e8493 tempest-VolumesServicesTestJSON-1631223889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-af2825a6-e528-4e49-a4cd-b962ab3fc9d2" returned: 0 in 0.397s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:09:33 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-8e33de2e-5507-4d5a-b4c7-a9b1771e8493 tempest-VolumesServicesTestJSON-1631223889 None] Lock "cinder-quobyte-af2825a6-e528-4e49-a4cd-b962ab3fc9d2" released by "delete_volume" :: held 0.937s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:09:33 devstack cinder-volume[87515]: DEBUG cinder.quota [None req-8e33de2e-5507-4d5a-b4c7-a9b1771e8493 tempest-VolumesServicesTestJSON-1631223889 None] Created reservations ['a21febc1-0b69-44a6-8637-b9d1f5aef29d', 'd41a4976-65fc-41e3-b4dc-bcd939a8c06a', 'aa6daaa2-be82-4353-9897-69b923a89307', 'a80a881a-9b09-4495-a14c-639a07040c86'] {{(pid=87515) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:09:33 devstack sudo[100428]: pam_unix(sudo:session): session closed for user root Sep 07 10:09:33 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-bd7f75b5-19e5-4ca4-84d7-36b5f4b375a5 tempest-VolumesTransfersV357Test-1099325936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-0db4c760-3cc7-4031-9a0c-32867d9e2528" returned: 0 in 0.316s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:09:33 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-bd7f75b5-19e5-4ca4-84d7-36b5f4b375a5 tempest-VolumesTransfersV357Test-1099325936 None] Lock "cinder-quobyte-0db4c760-3cc7-4031-9a0c-32867d9e2528" released by "delete_volume" :: held 0.948s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:09:33 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-8e33de2e-5507-4d5a-b4c7-a9b1771e8493 tempest-VolumesServicesTestJSON-1631223889 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:09:33 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-8e33de2e-5507-4d5a-b4c7-a9b1771e8493 tempest-VolumesServicesTestJSON-1631223889 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:09:33 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-8e33de2e-5507-4d5a-b4c7-a9b1771e8493 tempest-VolumesServicesTestJSON-1631223889 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:09:33 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-8e33de2e-5507-4d5a-b4c7-a9b1771e8493 tempest-VolumesServicesTestJSON-1631223889 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:09:33 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-8e33de2e-5507-4d5a-b4c7-a9b1771e8493 tempest-VolumesServicesTestJSON-1631223889 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:09:33 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-8e33de2e-5507-4d5a-b4c7-a9b1771e8493 tempest-VolumesServicesTestJSON-1631223889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:09:33 devstack sudo[100432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a Sep 07 10:09:33 devstack sudo[100432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:09:33 devstack cinder-volume[87515]: DEBUG cinder.quota [None req-bd7f75b5-19e5-4ca4-84d7-36b5f4b375a5 tempest-VolumesTransfersV357Test-1099325936 None] Created reservations ['962eb1dd-78a8-475c-ac00-934ddbb4069f', '02553a57-06e1-4045-b5c2-01c5c8a7fb5f', '7cca161a-e5f6-40ad-aa1e-ec28c4773735', 'd03052a9-3170-43c6-99ac-40907d9a8a41'] {{(pid=87515) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:09:33 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-bd7f75b5-19e5-4ca4-84d7-36b5f4b375a5 tempest-VolumesTransfersV357Test-1099325936 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:09:33 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-bd7f75b5-19e5-4ca4-84d7-36b5f4b375a5 tempest-VolumesTransfersV357Test-1099325936 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:09:33 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-bd7f75b5-19e5-4ca4-84d7-36b5f4b375a5 tempest-VolumesTransfersV357Test-1099325936 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:09:33 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-bd7f75b5-19e5-4ca4-84d7-36b5f4b375a5 tempest-VolumesTransfersV357Test-1099325936 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:09:33 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-bd7f75b5-19e5-4ca4-84d7-36b5f4b375a5 tempest-VolumesTransfersV357Test-1099325936 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:09:33 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-bd7f75b5-19e5-4ca4-84d7-36b5f4b375a5 tempest-VolumesTransfersV357Test-1099325936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:09:33 devstack sudo[100434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a Sep 07 10:09:33 devstack sudo[100434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:09:33 devstack sudo[100432]: pam_unix(sudo:session): session closed for user root Sep 07 10:09:33 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-8e33de2e-5507-4d5a-b4c7-a9b1771e8493 tempest-VolumesServicesTestJSON-1631223889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a" returned: 0 in 0.343s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:09:33 devstack cinder-volume[87515]: DEBUG cinder.manager [None req-8e33de2e-5507-4d5a-b4c7-a9b1771e8493 tempest-VolumesServicesTestJSON-1631223889 None] Notifying Schedulers of capabilities ... {{(pid=87515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:09:33 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-8e33de2e-5507-4d5a-b4c7-a9b1771e8493 tempest-VolumesServicesTestJSON-1631223889 None] Deleted volume successfully. Sep 07 10:09:33 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-8e33de2e-5507-4d5a-b4c7-a9b1771e8493 tempest-VolumesServicesTestJSON-1631223889 None] Lock "cinder-af2825a6-e528-4e49-a4cd-b962ab3fc9d2-delete_volume" released by "delete_volume" :: held 1.622s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:09:33 devstack sudo[100434]: pam_unix(sudo:session): session closed for user root Sep 07 10:09:33 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-bd7f75b5-19e5-4ca4-84d7-36b5f4b375a5 tempest-VolumesTransfersV357Test-1099325936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a" returned: 0 in 0.327s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:09:33 devstack cinder-volume[87515]: DEBUG cinder.manager [None req-bd7f75b5-19e5-4ca4-84d7-36b5f4b375a5 tempest-VolumesTransfersV357Test-1099325936 None] Notifying Schedulers of capabilities ... {{(pid=87515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:09:33 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-bd7f75b5-19e5-4ca4-84d7-36b5f4b375a5 tempest-VolumesTransfersV357Test-1099325936 None] Deleted volume successfully. Sep 07 10:09:33 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-bd7f75b5-19e5-4ca4-84d7-36b5f4b375a5 tempest-VolumesTransfersV357Test-1099325936 None] Lock "cinder-0db4c760-3cc7-4031-9a0c-32867d9e2528-delete_volume" released by "delete_volume" :: held 1.663s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:09:35 devstack cinder-volume[87515]: DEBUG cinder.volume.flows.manager.create_volume [None req-6e9ecd97-dca4-46da-a17a-9c6895dde683 tempest-VolumesTransfersV357Test-436549971 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 10:09:35 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-6e9ecd97-dca4-46da-a17a-9c6895dde683 tempest-VolumesTransfersV357Test-436549971 None] Flow 'volume_create_manager' (d5c99873-d629-4012-9af0-f3c9f23dcdd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:09:35 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-6e9ecd97-dca4-46da-a17a-9c6895dde683 tempest-VolumesTransfersV357Test-436549971 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56a4dbd7-dd3a-419b-aa49-b52e3ebd751a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:09:35 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-6e9ecd97-dca4-46da-a17a-9c6895dde683 tempest-VolumesTransfersV357Test-436549971 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56a4dbd7-dd3a-419b-aa49-b52e3ebd751a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:09:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1886381058',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2065ede-91cb-4bf2-ab47-215d5e8c384c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80ba1954b6c546f3b986592ca3986251',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:09:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:09:35Z,use_quota=True,user_id='d9fc507c57c34f999b2f35a4cf9987ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3a092cd-7947-4cbf-abff-4ba9567becf0),volume_type_id=f3a092cd-7947-4cbf-abff-4ba9567becf0)' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:09:35 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-6e9ecd97-dca4-46da-a17a-9c6895dde683 tempest-VolumesTransfersV357Test-436549971 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d70bb3c-a2c8-4f04-9b13-f99362afa7c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:09:35 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-6e9ecd97-dca4-46da-a17a-9c6895dde683 tempest-VolumesTransfersV357Test-436549971 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d70bb3c-a2c8-4f04-9b13-f99362afa7c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:09:35 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-6e9ecd97-dca4-46da-a17a-9c6895dde683 tempest-VolumesTransfersV357Test-436549971 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71adff79-2bcd-4a92-816e-01c51be2cb0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:09:35 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-6e9ecd97-dca4-46da-a17a-9c6895dde683 tempest-VolumesTransfersV357Test-436549971 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71adff79-2bcd-4a92-816e-01c51be2cb0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd2065ede-91cb-4bf2-ab47-215d5e8c384c', 'volume_name': 'volume-d2065ede-91cb-4bf2-ab47-215d5e8c384c', 'volume_size': 1}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:09:35 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-6e9ecd97-dca4-46da-a17a-9c6895dde683 tempest-VolumesTransfersV357Test-436549971 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c28e6b50-8ca4-4c2a-a4e6-232447664203) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:09:35 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-6e9ecd97-dca4-46da-a17a-9c6895dde683 tempest-VolumesTransfersV357Test-436549971 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c28e6b50-8ca4-4c2a-a4e6-232447664203) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:09:35 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-6e9ecd97-dca4-46da-a17a-9c6895dde683 tempest-VolumesTransfersV357Test-436549971 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a026cc4-8f19-478d-9bc7-0aa8118d0b7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:09:35 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-6e9ecd97-dca4-46da-a17a-9c6895dde683 tempest-VolumesTransfersV357Test-436549971 None] Volume d2065ede-91cb-4bf2-ab47-215d5e8c384c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d2065ede-91cb-4bf2-ab47-215d5e8c384c', 'volume_size': 1} Sep 07 10:09:35 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-6e9ecd97-dca4-46da-a17a-9c6895dde683 tempest-VolumesTransfersV357Test-436549971 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:09:35 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-6e9ecd97-dca4-46da-a17a-9c6895dde683 tempest-VolumesTransfersV357Test-436549971 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:09:35 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-6e9ecd97-dca4-46da-a17a-9c6895dde683 tempest-VolumesTransfersV357Test-436549971 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:09:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1886381058',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2065ede-91cb-4bf2-ab47-215d5e8c384c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80ba1954b6c546f3b986592ca3986251',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:09:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:09:35Z,use_quota=True,user_id='d9fc507c57c34f999b2f35a4cf9987ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3a092cd-7947-4cbf-abff-4ba9567becf0),volume_type_id=f3a092cd-7947-4cbf-abff-4ba9567becf0)}" {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 10:09:35 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-6e9ecd97-dca4-46da-a17a-9c6895dde683 tempest-VolumesTransfersV357Test-436549971 None] Creating volume d2065ede-91cb-4bf2-ab47-215d5e8c384c {{(pid=87515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 10:09:35 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-6e9ecd97-dca4-46da-a17a-9c6895dde683 tempest-VolumesTransfersV357Test-436549971 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:09:35 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-6e9ecd97-dca4-46da-a17a-9c6895dde683 tempest-VolumesTransfersV357Test-436549971 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:09:35 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-6e9ecd97-dca4-46da-a17a-9c6895dde683 tempest-VolumesTransfersV357Test-436549971 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:09:35 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-6e9ecd97-dca4-46da-a17a-9c6895dde683 tempest-VolumesTransfersV357Test-436549971 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:09:35 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-6e9ecd97-dca4-46da-a17a-9c6895dde683 tempest-VolumesTransfersV357Test-436549971 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:09:35 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-6e9ecd97-dca4-46da-a17a-9c6895dde683 tempest-VolumesTransfersV357Test-436549971 None] Selected osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c as target Quobyte volume. {{(pid=87515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 10:09:35 devstack cinder-volume[87515]: INFO cinder.volume.drivers.remotefs [None req-6e9ecd97-dca4-46da-a17a-9c6895dde683 tempest-VolumesTransfersV357Test-436549971 None] casted to osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c Sep 07 10:09:35 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-6e9ecd97-dca4-46da-a17a-9c6895dde683 tempest-VolumesTransfersV357Test-436549971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-d2065ede-91cb-4bf2-ab47-215d5e8c384c 1073741824 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:09:35 devstack sudo[100438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-d2065ede-91cb-4bf2-ab47-215d5e8c384c 1073741824 Sep 07 10:09:35 devstack sudo[100438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:09:35 devstack sudo[100438]: pam_unix(sudo:session): session closed for user root Sep 07 10:09:35 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-6e9ecd97-dca4-46da-a17a-9c6895dde683 tempest-VolumesTransfersV357Test-436549971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-d2065ede-91cb-4bf2-ab47-215d5e8c384c 1073741824" returned: 0 in 0.611s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:09:35 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-6e9ecd97-dca4-46da-a17a-9c6895dde683 tempest-VolumesTransfersV357Test-436549971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-d2065ede-91cb-4bf2-ab47-215d5e8c384c {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:09:36 devstack sudo[100447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-d2065ede-91cb-4bf2-ab47-215d5e8c384c Sep 07 10:09:36 devstack sudo[100447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:09:36 devstack sudo[100447]: pam_unix(sudo:session): session closed for user root Sep 07 10:09:36 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-6e9ecd97-dca4-46da-a17a-9c6895dde683 tempest-VolumesTransfersV357Test-436549971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-d2065ede-91cb-4bf2-ab47-215d5e8c384c" returned: 0 in 0.361s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:09:36 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-6e9ecd97-dca4-46da-a17a-9c6895dde683 tempest-VolumesTransfersV357Test-436549971 None] <== create_volume: return (1031ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'} {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 10:09:36 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-6e9ecd97-dca4-46da-a17a-9c6895dde683 tempest-VolumesTransfersV357Test-436549971 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.033s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:09:36 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-6e9ecd97-dca4-46da-a17a-9c6895dde683 tempest-VolumesTransfersV357Test-436549971 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a026cc4-8f19-478d-9bc7-0aa8118d0b7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d2065ede-91cb-4bf2-ab47-215d5e8c384c', 'volume_size': 1}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:09:36 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-6e9ecd97-dca4-46da-a17a-9c6895dde683 tempest-VolumesTransfersV357Test-436549971 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61bd28af-bb17-4b40-b911-6340427a94ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:09:36 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-6e9ecd97-dca4-46da-a17a-9c6895dde683 tempest-VolumesTransfersV357Test-436549971 None] Volume volume-d2065ede-91cb-4bf2-ab47-215d5e8c384c (d2065ede-91cb-4bf2-ab47-215d5e8c384c): created successfully Sep 07 10:09:36 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-6e9ecd97-dca4-46da-a17a-9c6895dde683 tempest-VolumesTransfersV357Test-436549971 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61bd28af-bb17-4b40-b911-6340427a94ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:09:36 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-6e9ecd97-dca4-46da-a17a-9c6895dde683 tempest-VolumesTransfersV357Test-436549971 None] Flow 'volume_create_manager' (d5c99873-d629-4012-9af0-f3c9f23dcdd3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:09:36 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-6e9ecd97-dca4-46da-a17a-9c6895dde683 tempest-VolumesTransfersV357Test-436549971 None] Created volume successfully. Sep 07 10:09:37 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-b2506701-b2b1-4a47-a4b4-a4ddf6118013 tempest-VolumesTransfersV357Test-1099325936 None] Acquiring lock "cinder-d2065ede-91cb-4bf2-ab47-215d5e8c384c-delete_volume" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:09:37 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-b2506701-b2b1-4a47-a4b4-a4ddf6118013 tempest-VolumesTransfersV357Test-1099325936 None] Lock "cinder-d2065ede-91cb-4bf2-ab47-215d5e8c384c-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:09:37 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-b2506701-b2b1-4a47-a4b4-a4ddf6118013 tempest-VolumesTransfersV357Test-1099325936 None] Acquiring lock "cinder-quobyte-d2065ede-91cb-4bf2-ab47-215d5e8c384c" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:09:37 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-b2506701-b2b1-4a47-a4b4-a4ddf6118013 tempest-VolumesTransfersV357Test-1099325936 None] Lock "cinder-quobyte-d2065ede-91cb-4bf2-ab47-215d5e8c384c" acquired by "delete_volume" :: waited 0.017s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:09:37 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[31cab098-c303-45d1-acb9-b17164647639]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:09:37 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-b2506701-b2b1-4a47-a4b4-a4ddf6118013 tempest-VolumesTransfersV357Test-1099325936 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-d2065ede-91cb-4bf2-ab47-215d5e8c384c {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:09:37 devstack sudo[100457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-d2065ede-91cb-4bf2-ab47-215d5e8c384c Sep 07 10:09:37 devstack sudo[100457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:09:38 devstack sudo[100457]: pam_unix(sudo:session): session closed for user root Sep 07 10:09:38 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-b2506701-b2b1-4a47-a4b4-a4ddf6118013 tempest-VolumesTransfersV357Test-1099325936 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-d2065ede-91cb-4bf2-ab47-215d5e8c384c" returned: 0 in 0.409s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:09:38 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-b2506701-b2b1-4a47-a4b4-a4ddf6118013 tempest-VolumesTransfersV357Test-1099325936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-d2065ede-91cb-4bf2-ab47-215d5e8c384c {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:09:38 devstack sudo[100462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-d2065ede-91cb-4bf2-ab47-215d5e8c384c Sep 07 10:09:38 devstack sudo[100462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:09:38 devstack sudo[100462]: pam_unix(sudo:session): session closed for user root Sep 07 10:09:38 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-b2506701-b2b1-4a47-a4b4-a4ddf6118013 tempest-VolumesTransfersV357Test-1099325936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-d2065ede-91cb-4bf2-ab47-215d5e8c384c" returned: 0 in 0.322s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:09:38 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-b2506701-b2b1-4a47-a4b4-a4ddf6118013 tempest-VolumesTransfersV357Test-1099325936 None] Lock "cinder-quobyte-d2065ede-91cb-4bf2-ab47-215d5e8c384c" released by "delete_volume" :: held 0.792s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:09:38 devstack cinder-volume[87515]: DEBUG cinder.quota [None req-b2506701-b2b1-4a47-a4b4-a4ddf6118013 tempest-VolumesTransfersV357Test-1099325936 None] Created reservations ['8ad8d6ea-e93b-49a4-8bf1-3a595152f05f', 'e7f8c0f8-ea89-4bba-bf66-19ba819753fd', 'e9e53466-5796-4482-a626-7b90404f5dd4', '809e5834-9856-4d7e-85d4-e6f57c7515dd'] {{(pid=87515) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:09:38 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-b2506701-b2b1-4a47-a4b4-a4ddf6118013 tempest-VolumesTransfersV357Test-1099325936 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:09:38 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-b2506701-b2b1-4a47-a4b4-a4ddf6118013 tempest-VolumesTransfersV357Test-1099325936 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:09:38 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-b2506701-b2b1-4a47-a4b4-a4ddf6118013 tempest-VolumesTransfersV357Test-1099325936 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:09:38 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-b2506701-b2b1-4a47-a4b4-a4ddf6118013 tempest-VolumesTransfersV357Test-1099325936 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:09:38 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-b2506701-b2b1-4a47-a4b4-a4ddf6118013 tempest-VolumesTransfersV357Test-1099325936 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:09:38 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-b2506701-b2b1-4a47-a4b4-a4ddf6118013 tempest-VolumesTransfersV357Test-1099325936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:09:38 devstack sudo[100465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a Sep 07 10:09:38 devstack sudo[100465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:09:39 devstack sudo[100465]: pam_unix(sudo:session): session closed for user root Sep 07 10:09:39 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-b2506701-b2b1-4a47-a4b4-a4ddf6118013 tempest-VolumesTransfersV357Test-1099325936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a" returned: 0 in 0.290s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:09:39 devstack cinder-volume[87515]: DEBUG cinder.manager [None req-b2506701-b2b1-4a47-a4b4-a4ddf6118013 tempest-VolumesTransfersV357Test-1099325936 None] Notifying Schedulers of capabilities ... {{(pid=87515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:09:39 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-b2506701-b2b1-4a47-a4b4-a4ddf6118013 tempest-VolumesTransfersV357Test-1099325936 None] Deleted volume successfully. Sep 07 10:09:39 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-b2506701-b2b1-4a47-a4b4-a4ddf6118013 tempest-VolumesTransfersV357Test-1099325936 None] Lock "cinder-d2065ede-91cb-4bf2-ab47-215d5e8c384c-delete_volume" released by "delete_volume" :: held 1.379s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:09:41 devstack cinder-volume[87515]: DEBUG cinder.volume.flows.manager.create_volume [None req-949b36fc-53c5-40cf-8986-724f0c809bb2 tempest-VolumeTypesAccessTest-1904485717 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 10:09:41 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-949b36fc-53c5-40cf-8986-724f0c809bb2 tempest-VolumeTypesAccessTest-1904485717 None] Flow 'volume_create_manager' (0687fc75-5b02-4eae-9346-1f998ac1eb63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:09:41 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-949b36fc-53c5-40cf-8986-724f0c809bb2 tempest-VolumeTypesAccessTest-1904485717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6bd1d50d-f0e8-4e72-814e-a7d53f4fd01f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:09:41 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-949b36fc-53c5-40cf-8986-724f0c809bb2 tempest-VolumeTypesAccessTest-1904485717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6bd1d50d-f0e8-4e72-814e-a7d53f4fd01f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:09:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1832516297',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ddcbb13-d513-43ae-8432-b7dc4bf877fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d10848cc8414890a8b53480479ed3f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:09:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:09:42Z,use_quota=True,user_id='c5cf16ccf7a94533b1183b6b13b79b2a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ada8eeb-f5cf-4c83-83b3-dd96a77a9776),volume_type_id=5ada8eeb-f5cf-4c83-83b3-dd96a77a9776)' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:09:41 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-949b36fc-53c5-40cf-8986-724f0c809bb2 tempest-VolumeTypesAccessTest-1904485717 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81004f2d-41db-4c0d-9493-2ad1a7443ff8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:09:41 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-949b36fc-53c5-40cf-8986-724f0c809bb2 tempest-VolumeTypesAccessTest-1904485717 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81004f2d-41db-4c0d-9493-2ad1a7443ff8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:09:41 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-949b36fc-53c5-40cf-8986-724f0c809bb2 tempest-VolumeTypesAccessTest-1904485717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d4324fd-96f4-40d1-b129-8419ff2911f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:09:41 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-949b36fc-53c5-40cf-8986-724f0c809bb2 tempest-VolumeTypesAccessTest-1904485717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d4324fd-96f4-40d1-b129-8419ff2911f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1ddcbb13-d513-43ae-8432-b7dc4bf877fa', 'volume_name': 'volume-1ddcbb13-d513-43ae-8432-b7dc4bf877fa', 'volume_size': 1}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:09:41 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-949b36fc-53c5-40cf-8986-724f0c809bb2 tempest-VolumeTypesAccessTest-1904485717 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5452588e-120e-4758-9a9a-8be3026dcbb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:09:41 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-949b36fc-53c5-40cf-8986-724f0c809bb2 tempest-VolumeTypesAccessTest-1904485717 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5452588e-120e-4758-9a9a-8be3026dcbb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:09:41 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-949b36fc-53c5-40cf-8986-724f0c809bb2 tempest-VolumeTypesAccessTest-1904485717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b911d272-6a58-44d1-9124-caa21579d99e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:09:41 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-949b36fc-53c5-40cf-8986-724f0c809bb2 tempest-VolumeTypesAccessTest-1904485717 None] Volume 1ddcbb13-d513-43ae-8432-b7dc4bf877fa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1ddcbb13-d513-43ae-8432-b7dc4bf877fa', 'volume_size': 1} Sep 07 10:09:41 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-949b36fc-53c5-40cf-8986-724f0c809bb2 tempest-VolumeTypesAccessTest-1904485717 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:09:41 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-949b36fc-53c5-40cf-8986-724f0c809bb2 tempest-VolumeTypesAccessTest-1904485717 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:09:41 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-949b36fc-53c5-40cf-8986-724f0c809bb2 tempest-VolumeTypesAccessTest-1904485717 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:09:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1832516297',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ddcbb13-d513-43ae-8432-b7dc4bf877fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d10848cc8414890a8b53480479ed3f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:09:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:09:42Z,use_quota=True,user_id='c5cf16ccf7a94533b1183b6b13b79b2a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ada8eeb-f5cf-4c83-83b3-dd96a77a9776),volume_type_id=5ada8eeb-f5cf-4c83-83b3-dd96a77a9776)}" {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 10:09:41 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-949b36fc-53c5-40cf-8986-724f0c809bb2 tempest-VolumeTypesAccessTest-1904485717 None] Creating volume 1ddcbb13-d513-43ae-8432-b7dc4bf877fa {{(pid=87515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 10:09:41 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-949b36fc-53c5-40cf-8986-724f0c809bb2 tempest-VolumeTypesAccessTest-1904485717 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:09:41 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-949b36fc-53c5-40cf-8986-724f0c809bb2 tempest-VolumeTypesAccessTest-1904485717 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:09:41 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-949b36fc-53c5-40cf-8986-724f0c809bb2 tempest-VolumeTypesAccessTest-1904485717 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:09:41 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-949b36fc-53c5-40cf-8986-724f0c809bb2 tempest-VolumeTypesAccessTest-1904485717 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:09:41 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-949b36fc-53c5-40cf-8986-724f0c809bb2 tempest-VolumeTypesAccessTest-1904485717 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:09:41 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-949b36fc-53c5-40cf-8986-724f0c809bb2 tempest-VolumeTypesAccessTest-1904485717 None] Selected osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c as target Quobyte volume. {{(pid=87515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 10:09:41 devstack cinder-volume[87515]: INFO cinder.volume.drivers.remotefs [None req-949b36fc-53c5-40cf-8986-724f0c809bb2 tempest-VolumeTypesAccessTest-1904485717 None] casted to osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c Sep 07 10:09:41 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-949b36fc-53c5-40cf-8986-724f0c809bb2 tempest-VolumeTypesAccessTest-1904485717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-1ddcbb13-d513-43ae-8432-b7dc4bf877fa 1073741824 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:09:41 devstack sudo[100469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-1ddcbb13-d513-43ae-8432-b7dc4bf877fa 1073741824 Sep 07 10:09:41 devstack sudo[100469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:09:42 devstack sudo[100469]: pam_unix(sudo:session): session closed for user root Sep 07 10:09:42 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-949b36fc-53c5-40cf-8986-724f0c809bb2 tempest-VolumeTypesAccessTest-1904485717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-1ddcbb13-d513-43ae-8432-b7dc4bf877fa 1073741824" returned: 0 in 0.485s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:09:42 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-949b36fc-53c5-40cf-8986-724f0c809bb2 tempest-VolumeTypesAccessTest-1904485717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-1ddcbb13-d513-43ae-8432-b7dc4bf877fa {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:09:42 devstack sudo[100475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-1ddcbb13-d513-43ae-8432-b7dc4bf877fa Sep 07 10:09:42 devstack sudo[100475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:09:42 devstack sudo[100475]: pam_unix(sudo:session): session closed for user root Sep 07 10:09:42 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-949b36fc-53c5-40cf-8986-724f0c809bb2 tempest-VolumeTypesAccessTest-1904485717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-1ddcbb13-d513-43ae-8432-b7dc4bf877fa" returned: 0 in 0.296s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:09:42 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-949b36fc-53c5-40cf-8986-724f0c809bb2 tempest-VolumeTypesAccessTest-1904485717 None] <== create_volume: return (838ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'} {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 10:09:42 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-949b36fc-53c5-40cf-8986-724f0c809bb2 tempest-VolumeTypesAccessTest-1904485717 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.840s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:09:42 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-949b36fc-53c5-40cf-8986-724f0c809bb2 tempest-VolumeTypesAccessTest-1904485717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b911d272-6a58-44d1-9124-caa21579d99e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1ddcbb13-d513-43ae-8432-b7dc4bf877fa', 'volume_size': 1}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:09:42 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-949b36fc-53c5-40cf-8986-724f0c809bb2 tempest-VolumeTypesAccessTest-1904485717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5d6a7e6-af91-44a2-898e-a1e8b09e38e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:09:42 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-949b36fc-53c5-40cf-8986-724f0c809bb2 tempest-VolumeTypesAccessTest-1904485717 None] Volume volume-1ddcbb13-d513-43ae-8432-b7dc4bf877fa (1ddcbb13-d513-43ae-8432-b7dc4bf877fa): created successfully Sep 07 10:09:42 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-949b36fc-53c5-40cf-8986-724f0c809bb2 tempest-VolumeTypesAccessTest-1904485717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5d6a7e6-af91-44a2-898e-a1e8b09e38e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:09:42 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-949b36fc-53c5-40cf-8986-724f0c809bb2 tempest-VolumeTypesAccessTest-1904485717 None] Flow 'volume_create_manager' (0687fc75-5b02-4eae-9346-1f998ac1eb63) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:09:42 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-949b36fc-53c5-40cf-8986-724f0c809bb2 tempest-VolumeTypesAccessTest-1904485717 None] Created volume successfully. Sep 07 10:09:43 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-31b6a65c-dfd1-4b27-b9ce-79bf40be16cb tempest-VolumeTypesAccessTest-1904485717 None] Acquiring lock "cinder-1ddcbb13-d513-43ae-8432-b7dc4bf877fa-delete_volume" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:09:43 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-31b6a65c-dfd1-4b27-b9ce-79bf40be16cb tempest-VolumeTypesAccessTest-1904485717 None] Lock "cinder-1ddcbb13-d513-43ae-8432-b7dc4bf877fa-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:09:43 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-31b6a65c-dfd1-4b27-b9ce-79bf40be16cb tempest-VolumeTypesAccessTest-1904485717 None] Acquiring lock "cinder-quobyte-1ddcbb13-d513-43ae-8432-b7dc4bf877fa" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:09:43 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-31b6a65c-dfd1-4b27-b9ce-79bf40be16cb tempest-VolumeTypesAccessTest-1904485717 None] Lock "cinder-quobyte-1ddcbb13-d513-43ae-8432-b7dc4bf877fa" acquired by "delete_volume" :: waited 0.018s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:09:43 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[feb6a31d-ea5e-4557-8ff3-561c8eb3b114]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:09:43 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-31b6a65c-dfd1-4b27-b9ce-79bf40be16cb tempest-VolumeTypesAccessTest-1904485717 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-1ddcbb13-d513-43ae-8432-b7dc4bf877fa {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:09:44 devstack sudo[100478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-1ddcbb13-d513-43ae-8432-b7dc4bf877fa Sep 07 10:09:44 devstack sudo[100478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:09:44 devstack sudo[100478]: pam_unix(sudo:session): session closed for user root Sep 07 10:09:44 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-31b6a65c-dfd1-4b27-b9ce-79bf40be16cb tempest-VolumeTypesAccessTest-1904485717 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-1ddcbb13-d513-43ae-8432-b7dc4bf877fa" returned: 0 in 0.413s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:09:44 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-31b6a65c-dfd1-4b27-b9ce-79bf40be16cb tempest-VolumeTypesAccessTest-1904485717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-1ddcbb13-d513-43ae-8432-b7dc4bf877fa {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:09:44 devstack sudo[100483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-1ddcbb13-d513-43ae-8432-b7dc4bf877fa Sep 07 10:09:44 devstack sudo[100483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:09:44 devstack sudo[100483]: pam_unix(sudo:session): session closed for user root Sep 07 10:09:44 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-31b6a65c-dfd1-4b27-b9ce-79bf40be16cb tempest-VolumeTypesAccessTest-1904485717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-1ddcbb13-d513-43ae-8432-b7dc4bf877fa" returned: 0 in 0.304s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:09:44 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-31b6a65c-dfd1-4b27-b9ce-79bf40be16cb tempest-VolumeTypesAccessTest-1904485717 None] Lock "cinder-quobyte-1ddcbb13-d513-43ae-8432-b7dc4bf877fa" released by "delete_volume" :: held 0.765s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:09:44 devstack cinder-volume[87515]: WARNING cinder.quota [None req-31b6a65c-dfd1-4b27-b9ce-79bf40be16cb tempest-VolumeTypesAccessTest-1904485717 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1038707468 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1038707468, it is now deprecated. Please use the default quota class for default quota. Sep 07 10:09:44 devstack cinder-volume[87515]: WARNING cinder.quota [None req-31b6a65c-dfd1-4b27-b9ce-79bf40be16cb tempest-VolumeTypesAccessTest-1904485717 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1038707468 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1038707468, it is now deprecated. Please use the default quota class for default quota. Sep 07 10:09:44 devstack cinder-volume[87515]: DEBUG cinder.quota [None req-31b6a65c-dfd1-4b27-b9ce-79bf40be16cb tempest-VolumeTypesAccessTest-1904485717 None] Created reservations ['df261011-83fa-4aac-94f3-025fb96c7e4c', 'd52b5398-c25a-4d35-a707-b87e9cb0823a', 'e6d910a7-8a8d-4482-b3e5-dee0bec73ae3', '4c1eb885-b0bd-48ca-9c6d-16d94cd58b7e'] {{(pid=87515) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:09:44 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-31b6a65c-dfd1-4b27-b9ce-79bf40be16cb tempest-VolumeTypesAccessTest-1904485717 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:09:44 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-31b6a65c-dfd1-4b27-b9ce-79bf40be16cb tempest-VolumeTypesAccessTest-1904485717 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:09:44 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-31b6a65c-dfd1-4b27-b9ce-79bf40be16cb tempest-VolumeTypesAccessTest-1904485717 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:09:44 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-31b6a65c-dfd1-4b27-b9ce-79bf40be16cb tempest-VolumeTypesAccessTest-1904485717 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:09:44 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-31b6a65c-dfd1-4b27-b9ce-79bf40be16cb tempest-VolumeTypesAccessTest-1904485717 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:09:44 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-31b6a65c-dfd1-4b27-b9ce-79bf40be16cb tempest-VolumeTypesAccessTest-1904485717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:09:44 devstack sudo[100486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a Sep 07 10:09:44 devstack sudo[100486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:09:45 devstack sudo[100486]: pam_unix(sudo:session): session closed for user root Sep 07 10:09:45 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-31b6a65c-dfd1-4b27-b9ce-79bf40be16cb tempest-VolumeTypesAccessTest-1904485717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a" returned: 0 in 0.340s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:09:45 devstack cinder-volume[87515]: DEBUG cinder.manager [None req-31b6a65c-dfd1-4b27-b9ce-79bf40be16cb tempest-VolumeTypesAccessTest-1904485717 None] Notifying Schedulers of capabilities ... {{(pid=87515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:09:45 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-31b6a65c-dfd1-4b27-b9ce-79bf40be16cb tempest-VolumeTypesAccessTest-1904485717 None] Deleted volume successfully. Sep 07 10:09:45 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-31b6a65c-dfd1-4b27-b9ce-79bf40be16cb tempest-VolumeTypesAccessTest-1904485717 None] Lock "cinder-1ddcbb13-d513-43ae-8432-b7dc4bf877fa-delete_volume" released by "delete_volume" :: held 1.400s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:09:46 devstack cinder-volume[87515]: DEBUG cinder.volume.flows.manager.create_volume [None req-4b99874c-87d5-46c2-bedb-0f6b547e749a tempest-VolumesCloneNegativeTest-1621018739 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 10:09:46 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-4b99874c-87d5-46c2-bedb-0f6b547e749a tempest-VolumesCloneNegativeTest-1621018739 None] Flow 'volume_create_manager' (9b8b8ce5-4d26-4b5a-8e87-187798dd32f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:09:46 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-4b99874c-87d5-46c2-bedb-0f6b547e749a tempest-VolumesCloneNegativeTest-1621018739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c602be16-b1d4-4147-ae2f-735951153726) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:09:46 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-4b99874c-87d5-46c2-bedb-0f6b547e749a tempest-VolumesCloneNegativeTest-1621018739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c602be16-b1d4-4147-ae2f-735951153726) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:09:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-327016457',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7cd009a8-92ee-4d34-84fa-336159f75b48,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0eff469c2714ce8b1a1887381c02e9e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:09:47Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:09:47Z,use_quota=True,user_id='751e4154479a4de0be1aaa715470b1fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3a092cd-7947-4cbf-abff-4ba9567becf0),volume_type_id=f3a092cd-7947-4cbf-abff-4ba9567becf0)' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:09:46 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-4b99874c-87d5-46c2-bedb-0f6b547e749a tempest-VolumesCloneNegativeTest-1621018739 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e01bcd57-b108-4607-918c-b14f1d3970ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:09:46 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-4b99874c-87d5-46c2-bedb-0f6b547e749a tempest-VolumesCloneNegativeTest-1621018739 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e01bcd57-b108-4607-918c-b14f1d3970ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:09:46 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-4b99874c-87d5-46c2-bedb-0f6b547e749a tempest-VolumesCloneNegativeTest-1621018739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b49179c-7e8e-47c9-8dc3-417e168e1417) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:09:46 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-4b99874c-87d5-46c2-bedb-0f6b547e749a tempest-VolumesCloneNegativeTest-1621018739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b49179c-7e8e-47c9-8dc3-417e168e1417) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7cd009a8-92ee-4d34-84fa-336159f75b48', 'volume_name': 'volume-7cd009a8-92ee-4d34-84fa-336159f75b48', 'volume_size': 2}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:09:46 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-4b99874c-87d5-46c2-bedb-0f6b547e749a tempest-VolumesCloneNegativeTest-1621018739 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1df3956-0d36-4b1c-b00e-18bee76877a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:09:46 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-4b99874c-87d5-46c2-bedb-0f6b547e749a tempest-VolumesCloneNegativeTest-1621018739 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1df3956-0d36-4b1c-b00e-18bee76877a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:09:46 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-4b99874c-87d5-46c2-bedb-0f6b547e749a tempest-VolumesCloneNegativeTest-1621018739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8205e89a-89da-4ac0-b261-522320785e0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:09:46 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-4b99874c-87d5-46c2-bedb-0f6b547e749a tempest-VolumesCloneNegativeTest-1621018739 None] Volume 7cd009a8-92ee-4d34-84fa-336159f75b48: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7cd009a8-92ee-4d34-84fa-336159f75b48', 'volume_size': 2} Sep 07 10:09:46 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-4b99874c-87d5-46c2-bedb-0f6b547e749a tempest-VolumesCloneNegativeTest-1621018739 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:09:46 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-4b99874c-87d5-46c2-bedb-0f6b547e749a tempest-VolumesCloneNegativeTest-1621018739 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:09:46 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-4b99874c-87d5-46c2-bedb-0f6b547e749a tempest-VolumesCloneNegativeTest-1621018739 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:09:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-327016457',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7cd009a8-92ee-4d34-84fa-336159f75b48,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0eff469c2714ce8b1a1887381c02e9e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:09:47Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:09:47Z,use_quota=True,user_id='751e4154479a4de0be1aaa715470b1fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3a092cd-7947-4cbf-abff-4ba9567becf0),volume_type_id=f3a092cd-7947-4cbf-abff-4ba9567becf0)}" {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 10:09:46 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-4b99874c-87d5-46c2-bedb-0f6b547e749a tempest-VolumesCloneNegativeTest-1621018739 None] Creating volume 7cd009a8-92ee-4d34-84fa-336159f75b48 {{(pid=87515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 10:09:46 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-4b99874c-87d5-46c2-bedb-0f6b547e749a tempest-VolumesCloneNegativeTest-1621018739 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:09:46 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-4b99874c-87d5-46c2-bedb-0f6b547e749a tempest-VolumesCloneNegativeTest-1621018739 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:09:46 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-4b99874c-87d5-46c2-bedb-0f6b547e749a tempest-VolumesCloneNegativeTest-1621018739 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:09:46 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-4b99874c-87d5-46c2-bedb-0f6b547e749a tempest-VolumesCloneNegativeTest-1621018739 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:09:46 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-4b99874c-87d5-46c2-bedb-0f6b547e749a tempest-VolumesCloneNegativeTest-1621018739 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:09:46 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-4b99874c-87d5-46c2-bedb-0f6b547e749a tempest-VolumesCloneNegativeTest-1621018739 None] Selected osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c as target Quobyte volume. {{(pid=87515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 10:09:46 devstack cinder-volume[87515]: INFO cinder.volume.drivers.remotefs [None req-4b99874c-87d5-46c2-bedb-0f6b547e749a tempest-VolumesCloneNegativeTest-1621018739 None] casted to osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c Sep 07 10:09:46 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-4b99874c-87d5-46c2-bedb-0f6b547e749a tempest-VolumesCloneNegativeTest-1621018739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-7cd009a8-92ee-4d34-84fa-336159f75b48 2147483648 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:09:46 devstack sudo[100514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-7cd009a8-92ee-4d34-84fa-336159f75b48 2147483648 Sep 07 10:09:46 devstack sudo[100514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:09:47 devstack sudo[100514]: pam_unix(sudo:session): session closed for user root Sep 07 10:09:47 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-4b99874c-87d5-46c2-bedb-0f6b547e749a tempest-VolumesCloneNegativeTest-1621018739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-7cd009a8-92ee-4d34-84fa-336159f75b48 2147483648" returned: 0 in 0.561s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:09:47 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-4b99874c-87d5-46c2-bedb-0f6b547e749a tempest-VolumesCloneNegativeTest-1621018739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-7cd009a8-92ee-4d34-84fa-336159f75b48 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:09:47 devstack sudo[100520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-7cd009a8-92ee-4d34-84fa-336159f75b48 Sep 07 10:09:47 devstack sudo[100520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:09:47 devstack sudo[100520]: pam_unix(sudo:session): session closed for user root Sep 07 10:09:47 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-4b99874c-87d5-46c2-bedb-0f6b547e749a tempest-VolumesCloneNegativeTest-1621018739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-7cd009a8-92ee-4d34-84fa-336159f75b48" returned: 0 in 0.311s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:09:47 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-4b99874c-87d5-46c2-bedb-0f6b547e749a tempest-VolumesCloneNegativeTest-1621018739 None] <== create_volume: return (916ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'} {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 10:09:47 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-4b99874c-87d5-46c2-bedb-0f6b547e749a tempest-VolumesCloneNegativeTest-1621018739 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.919s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:09:47 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-4b99874c-87d5-46c2-bedb-0f6b547e749a tempest-VolumesCloneNegativeTest-1621018739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8205e89a-89da-4ac0-b261-522320785e0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7cd009a8-92ee-4d34-84fa-336159f75b48', 'volume_size': 2}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:09:47 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-4b99874c-87d5-46c2-bedb-0f6b547e749a tempest-VolumesCloneNegativeTest-1621018739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35541ea4-ae7c-41fb-965d-0d5f6f151b37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:09:47 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-4b99874c-87d5-46c2-bedb-0f6b547e749a tempest-VolumesCloneNegativeTest-1621018739 None] Volume volume-7cd009a8-92ee-4d34-84fa-336159f75b48 (7cd009a8-92ee-4d34-84fa-336159f75b48): created successfully Sep 07 10:09:47 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-4b99874c-87d5-46c2-bedb-0f6b547e749a tempest-VolumesCloneNegativeTest-1621018739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35541ea4-ae7c-41fb-965d-0d5f6f151b37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:09:47 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-4b99874c-87d5-46c2-bedb-0f6b547e749a tempest-VolumesCloneNegativeTest-1621018739 None] Flow 'volume_create_manager' (9b8b8ce5-4d26-4b5a-8e87-187798dd32f1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:09:47 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-4b99874c-87d5-46c2-bedb-0f6b547e749a tempest-VolumesCloneNegativeTest-1621018739 None] Created volume successfully. Sep 07 10:09:48 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-87c77878-3948-481a-a741-a809b8913756 tempest-VolumesCloneNegativeTest-1621018739 None] Acquiring lock "cinder-7cd009a8-92ee-4d34-84fa-336159f75b48-delete_volume" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:09:48 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-87c77878-3948-481a-a741-a809b8913756 tempest-VolumesCloneNegativeTest-1621018739 None] Lock "cinder-7cd009a8-92ee-4d34-84fa-336159f75b48-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:09:48 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-87c77878-3948-481a-a741-a809b8913756 tempest-VolumesCloneNegativeTest-1621018739 None] Acquiring lock "cinder-quobyte-7cd009a8-92ee-4d34-84fa-336159f75b48" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:09:48 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-87c77878-3948-481a-a741-a809b8913756 tempest-VolumesCloneNegativeTest-1621018739 None] Lock "cinder-quobyte-7cd009a8-92ee-4d34-84fa-336159f75b48" acquired by "delete_volume" :: waited 0.016s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:09:49 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f7059ba-522d-4120-bb78-060819580c38]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:09:49 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-87c77878-3948-481a-a741-a809b8913756 tempest-VolumesCloneNegativeTest-1621018739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-7cd009a8-92ee-4d34-84fa-336159f75b48 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:09:49 devstack sudo[100525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-7cd009a8-92ee-4d34-84fa-336159f75b48 Sep 07 10:09:49 devstack sudo[100525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:09:49 devstack sudo[100525]: pam_unix(sudo:session): session closed for user root Sep 07 10:09:49 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-87c77878-3948-481a-a741-a809b8913756 tempest-VolumesCloneNegativeTest-1621018739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-7cd009a8-92ee-4d34-84fa-336159f75b48" returned: 0 in 0.398s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:09:49 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-87c77878-3948-481a-a741-a809b8913756 tempest-VolumesCloneNegativeTest-1621018739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-7cd009a8-92ee-4d34-84fa-336159f75b48 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:09:49 devstack sudo[100530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-7cd009a8-92ee-4d34-84fa-336159f75b48 Sep 07 10:09:49 devstack sudo[100530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:09:49 devstack sudo[100530]: pam_unix(sudo:session): session closed for user root Sep 07 10:09:49 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-87c77878-3948-481a-a741-a809b8913756 tempest-VolumesCloneNegativeTest-1621018739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-7cd009a8-92ee-4d34-84fa-336159f75b48" returned: 0 in 0.285s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:09:49 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-87c77878-3948-481a-a741-a809b8913756 tempest-VolumesCloneNegativeTest-1621018739 None] Lock "cinder-quobyte-7cd009a8-92ee-4d34-84fa-336159f75b48" released by "delete_volume" :: held 0.730s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:09:49 devstack cinder-volume[87515]: DEBUG cinder.quota [None req-87c77878-3948-481a-a741-a809b8913756 tempest-VolumesCloneNegativeTest-1621018739 None] Created reservations ['7791ce8c-6048-46c6-814a-f40d12116780', '747a3e3f-1ceb-47db-b7a1-c5fc1f7f38df', '9a1ea544-afb3-4f29-a410-d7b9753b360c', 'b61151f0-e138-40fd-a56a-7518055edc90'] {{(pid=87515) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:09:49 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-87c77878-3948-481a-a741-a809b8913756 tempest-VolumesCloneNegativeTest-1621018739 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:09:49 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-87c77878-3948-481a-a741-a809b8913756 tempest-VolumesCloneNegativeTest-1621018739 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:09:49 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-87c77878-3948-481a-a741-a809b8913756 tempest-VolumesCloneNegativeTest-1621018739 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:09:49 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-87c77878-3948-481a-a741-a809b8913756 tempest-VolumesCloneNegativeTest-1621018739 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:09:49 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-87c77878-3948-481a-a741-a809b8913756 tempest-VolumesCloneNegativeTest-1621018739 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:09:49 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-87c77878-3948-481a-a741-a809b8913756 tempest-VolumesCloneNegativeTest-1621018739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:09:49 devstack sudo[100533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a Sep 07 10:09:49 devstack sudo[100533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:09:50 devstack sudo[100533]: pam_unix(sudo:session): session closed for user root Sep 07 10:09:50 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-87c77878-3948-481a-a741-a809b8913756 tempest-VolumesCloneNegativeTest-1621018739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a" returned: 0 in 0.288s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:09:50 devstack cinder-volume[87515]: DEBUG cinder.manager [None req-87c77878-3948-481a-a741-a809b8913756 tempest-VolumesCloneNegativeTest-1621018739 None] Notifying Schedulers of capabilities ... {{(pid=87515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:09:50 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-87c77878-3948-481a-a741-a809b8913756 tempest-VolumesCloneNegativeTest-1621018739 None] Deleted volume successfully. Sep 07 10:09:50 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-87c77878-3948-481a-a741-a809b8913756 tempest-VolumesCloneNegativeTest-1621018739 None] Lock "cinder-7cd009a8-92ee-4d34-84fa-336159f75b48-delete_volume" released by "delete_volume" :: held 1.257s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:09:54 devstack cinder-volume[87515]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb0779cf-7f44-4f69-ae17-a894289b2bce tempest-VolumesExtendTest-430807235 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 10:09:54 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-fb0779cf-7f44-4f69-ae17-a894289b2bce tempest-VolumesExtendTest-430807235 None] Flow 'volume_create_manager' (ba585f5b-09cd-4f27-a0b3-a99e72df5b98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:09:54 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-fb0779cf-7f44-4f69-ae17-a894289b2bce tempest-VolumesExtendTest-430807235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (538a0a29-f9c6-4663-b1e9-20b5de57b02f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:09:54 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-fb0779cf-7f44-4f69-ae17-a894289b2bce tempest-VolumesExtendTest-430807235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (538a0a29-f9c6-4663-b1e9-20b5de57b02f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:09:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1088851237',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7f55bf0-ff41-441a-a8e0-2b8ffab79153,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1f76c3b94d04c8bbfbc78d181ebc1b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:09:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:09:55Z,use_quota=True,user_id='c6c21cd7ab15490bb8401bd3450e41c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3a092cd-7947-4cbf-abff-4ba9567becf0),volume_type_id=f3a092cd-7947-4cbf-abff-4ba9567becf0)' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:09:54 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-fb0779cf-7f44-4f69-ae17-a894289b2bce tempest-VolumesExtendTest-430807235 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b17b2f1-5aae-4112-89bc-744074f5c3a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:09:54 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-fb0779cf-7f44-4f69-ae17-a894289b2bce tempest-VolumesExtendTest-430807235 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b17b2f1-5aae-4112-89bc-744074f5c3a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:09:54 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-fb0779cf-7f44-4f69-ae17-a894289b2bce tempest-VolumesExtendTest-430807235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50cee972-4611-4dc8-926c-f6abbaa4f371) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:09:54 devstack cinder-volume[87515]: DEBUG cinder.image.glance [None req-fb0779cf-7f44-4f69-ae17-a894289b2bce tempest-VolumesExtendTest-430807235 None] Creating Keystone auth plugin from conf {{(pid=87515) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 07 10:09:55 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-fb0779cf-7f44-4f69-ae17-a894289b2bce tempest-VolumesExtendTest-430807235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50cee972-4611-4dc8-926c-f6abbaa4f371) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'e7f55bf0-ff41-441a-a8e0-2b8ffab79153', 'volume_name': 'volume-e7f55bf0-ff41-441a-a8e0-2b8ffab79153', 'volume_size': 1, 'image_id': '26019e10-1e1f-4514-b191-397ccf1d59e6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/26019e10-1e1f-4514-b191-397ccf1d59e6', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4765956d565c46c2a4a703c5a550ca58', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '26019e10-1e1f-4514-b191-397ccf1d59e6', 'created_at': datetime.datetime(2026, 9, 7, 7, 52, 21, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 7, 7, 52, 22, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/26019e10-1e1f-4514-b191-397ccf1d59e6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:09:55 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-fb0779cf-7f44-4f69-ae17-a894289b2bce tempest-VolumesExtendTest-430807235 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14faab8d-eb1e-4e22-b463-8a3f2f0d26fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:09:55 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-fb0779cf-7f44-4f69-ae17-a894289b2bce tempest-VolumesExtendTest-430807235 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14faab8d-eb1e-4e22-b463-8a3f2f0d26fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:09:55 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-fb0779cf-7f44-4f69-ae17-a894289b2bce tempest-VolumesExtendTest-430807235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (508ebb44-3ff5-46f8-afa6-f818d462aaee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:09:55 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-fb0779cf-7f44-4f69-ae17-a894289b2bce tempest-VolumesExtendTest-430807235 None] Volume e7f55bf0-ff41-441a-a8e0-2b8ffab79153: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-e7f55bf0-ff41-441a-a8e0-2b8ffab79153', 'volume_size': 1, 'image_id': '26019e10-1e1f-4514-b191-397ccf1d59e6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/26019e10-1e1f-4514-b191-397ccf1d59e6', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4765956d565c46c2a4a703c5a550ca58', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '26019e10-1e1f-4514-b191-397ccf1d59e6', 'created_at': datetime.datetime(2026, 9, 7, 7, 52, 21, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 7, 7, 52, 22, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/26019e10-1e1f-4514-b191-397ccf1d59e6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 07 10:09:55 devstack cinder-volume[87515]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb0779cf-7f44-4f69-ae17-a894289b2bce tempest-VolumesExtendTest-430807235 None] Trying to clone e7f55bf0-ff41-441a-a8e0-2b8ffab79153 from image 26019e10-1e1f-4514-b191-397ccf1d59e6 at location (None, [{'url': 'file:///opt/stack/data/glance/images/26019e10-1e1f-4514-b191-397ccf1d59e6', 'metadata': {}}]). {{(pid=87515) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 07 10:09:55 devstack cinder-volume[87515]: DEBUG cinder.image.image_utils [None req-fb0779cf-7f44-4f69-ae17-a894289b2bce tempest-VolumesExtendTest-430807235 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_26019e10-1e1f-4514-b191-397ccf1d59e6_cbg_qakndevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87515) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 07 10:09:55 devstack cinder-volume[87515]: INFO cinder.image.image_utils [None req-fb0779cf-7f44-4f69-ae17-a894289b2bce tempest-VolumesExtendTest-430807235 None] Image download 20.69 MB at 20.69 MB/s Sep 07 10:09:55 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a5ba901-4c23-4908-87db-f1408176c347]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:09:55 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-fb0779cf-7f44-4f69-ae17-a894289b2bce tempest-VolumesExtendTest-430807235 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_26019e10-1e1f-4514-b191-397ccf1d59e6_cbg_qakndevstack@QuobyteHD {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:09:56 devstack sudo[100540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_26019e10-1e1f-4514-b191-397ccf1d59e6_cbg_qakndevstack@QuobyteHD Sep 07 10:09:56 devstack sudo[100540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:09:56 devstack sudo[100540]: pam_unix(sudo:session): session closed for user root Sep 07 10:09:56 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-fb0779cf-7f44-4f69-ae17-a894289b2bce tempest-VolumesExtendTest-430807235 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_26019e10-1e1f-4514-b191-397ccf1d59e6_cbg_qakndevstack@QuobyteHD" returned: 0 in 0.405s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:09:56 devstack cinder-volume[87515]: DEBUG cinder.image.image_utils [None req-fb0779cf-7f44-4f69-ae17-a894289b2bce tempest-VolumesExtendTest-430807235 None] Temporary image 26019e10-1e1f-4514-b191-397ccf1d59e6 is fetched for user c6c21cd7ab15490bb8401bd3450e41c9. {{(pid=87515) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 07 10:09:56 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1acadc4-4b71-45c6-9af7-bde5da3313d5]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:09:56 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-fb0779cf-7f44-4f69-ae17-a894289b2bce tempest-VolumesExtendTest-430807235 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_26019e10-1e1f-4514-b191-397ccf1d59e6_cbg_qakndevstack@QuobyteHD {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:09:56 devstack sudo[100547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_26019e10-1e1f-4514-b191-397ccf1d59e6_cbg_qakndevstack@QuobyteHD Sep 07 10:09:56 devstack sudo[100547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:09:56 devstack sudo[100547]: pam_unix(sudo:session): session closed for user root Sep 07 10:09:56 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-fb0779cf-7f44-4f69-ae17-a894289b2bce tempest-VolumesExtendTest-430807235 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_26019e10-1e1f-4514-b191-397ccf1d59e6_cbg_qakndevstack@QuobyteHD" returned: 0 in 0.406s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:09:56 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-fb0779cf-7f44-4f69-ae17-a894289b2bce tempest-VolumesExtendTest-430807235 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:09:56 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-fb0779cf-7f44-4f69-ae17-a894289b2bce tempest-VolumesExtendTest-430807235 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:09:56 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-fb0779cf-7f44-4f69-ae17-a894289b2bce tempest-VolumesExtendTest-430807235 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:09:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1088851237',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7f55bf0-ff41-441a-a8e0-2b8ffab79153,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1f76c3b94d04c8bbfbc78d181ebc1b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:09:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:09:55Z,use_quota=True,user_id='c6c21cd7ab15490bb8401bd3450e41c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3a092cd-7947-4cbf-abff-4ba9567becf0),volume_type_id=f3a092cd-7947-4cbf-abff-4ba9567becf0)}" {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 10:09:56 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-fb0779cf-7f44-4f69-ae17-a894289b2bce tempest-VolumesExtendTest-430807235 None] Creating volume e7f55bf0-ff41-441a-a8e0-2b8ffab79153 {{(pid=87515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 10:09:56 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-fb0779cf-7f44-4f69-ae17-a894289b2bce tempest-VolumesExtendTest-430807235 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:09:56 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-fb0779cf-7f44-4f69-ae17-a894289b2bce tempest-VolumesExtendTest-430807235 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:09:56 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-fb0779cf-7f44-4f69-ae17-a894289b2bce tempest-VolumesExtendTest-430807235 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:09:56 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-fb0779cf-7f44-4f69-ae17-a894289b2bce tempest-VolumesExtendTest-430807235 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:09:56 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-fb0779cf-7f44-4f69-ae17-a894289b2bce tempest-VolumesExtendTest-430807235 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:09:56 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-fb0779cf-7f44-4f69-ae17-a894289b2bce tempest-VolumesExtendTest-430807235 None] Selected osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c as target Quobyte volume. {{(pid=87515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 10:09:56 devstack cinder-volume[87515]: INFO cinder.volume.drivers.remotefs [None req-fb0779cf-7f44-4f69-ae17-a894289b2bce tempest-VolumesExtendTest-430807235 None] casted to osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c Sep 07 10:09:56 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-fb0779cf-7f44-4f69-ae17-a894289b2bce tempest-VolumesExtendTest-430807235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-e7f55bf0-ff41-441a-a8e0-2b8ffab79153 1073741824 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:09:56 devstack sudo[100553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-e7f55bf0-ff41-441a-a8e0-2b8ffab79153 1073741824 Sep 07 10:09:56 devstack sudo[100553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:09:57 devstack sudo[100553]: pam_unix(sudo:session): session closed for user root Sep 07 10:09:57 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-fb0779cf-7f44-4f69-ae17-a894289b2bce tempest-VolumesExtendTest-430807235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-e7f55bf0-ff41-441a-a8e0-2b8ffab79153 1073741824" returned: 0 in 0.542s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:09:57 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-fb0779cf-7f44-4f69-ae17-a894289b2bce tempest-VolumesExtendTest-430807235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-e7f55bf0-ff41-441a-a8e0-2b8ffab79153 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:09:57 devstack sudo[100562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-e7f55bf0-ff41-441a-a8e0-2b8ffab79153 Sep 07 10:09:57 devstack sudo[100562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:09:57 devstack sudo[100562]: pam_unix(sudo:session): session closed for user root Sep 07 10:09:57 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-fb0779cf-7f44-4f69-ae17-a894289b2bce tempest-VolumesExtendTest-430807235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-e7f55bf0-ff41-441a-a8e0-2b8ffab79153" returned: 0 in 0.288s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:09:57 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-fb0779cf-7f44-4f69-ae17-a894289b2bce tempest-VolumesExtendTest-430807235 None] <== create_volume: return (894ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'} {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 10:09:57 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-fb0779cf-7f44-4f69-ae17-a894289b2bce tempest-VolumesExtendTest-430807235 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.898s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:09:57 devstack cinder-volume[87515]: DEBUG cinder.volume.volume_utils [None req-fb0779cf-7f44-4f69-ae17-a894289b2bce tempest-VolumesExtendTest-430807235 None] Attempting download of 26019e10-1e1f-4514-b191-397ccf1d59e6 ((None, [{'url': 'file:///opt/stack/data/glance/images/26019e10-1e1f-4514-b191-397ccf1d59e6', 'metadata': {}}])) to volume e7f55bf0-ff41-441a-a8e0-2b8ffab79153. {{(pid=87515) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 07 10:09:57 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [req-4b63954d-dda3-4495-9e3b-0e799c9b24d2 req-5e63587e-55e4-4db5-8107-e7f9c1180f13 tempest-TestServerVolumeAttachmentScenario-1829138586 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:09:57 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [req-4b63954d-dda3-4495-9e3b-0e799c9b24d2 req-5e63587e-55e4-4db5-8107-e7f9c1180f13 tempest-TestServerVolumeAttachmentScenario-1829138586 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:09:57 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfe86cab-c71a-406e-9a29-811537adca39]: (4, 'raw') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:09:57 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-fb0779cf-7f44-4f69-ae17-a894289b2bce tempest-VolumesExtendTest-430807235 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_26019e10-1e1f-4514-b191-397ccf1d59e6_9jt_wldu {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:09:57 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [req-4b63954d-dda3-4495-9e3b-0e799c9b24d2 req-5e63587e-55e4-4db5-8107-e7f9c1180f13 tempest-TestServerVolumeAttachmentScenario-1829138586 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.040s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:09:57 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [req-4b63954d-dda3-4495-9e3b-0e799c9b24d2 req-5e63587e-55e4-4db5-8107-e7f9c1180f13 tempest-TestServerVolumeAttachmentScenario-1829138586 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c', 'name': 'volume-ec5ef6cb-bd26-4ec4-b3fc-061bdf60d1b9', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '97ece3fb-d44c-4458-bac6-e004b661989b', 'enforce_multipath': True} {{(pid=87515) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 07 10:09:58 devstack sudo[100574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_26019e10-1e1f-4514-b191-397ccf1d59e6_9jt_wldu Sep 07 10:09:58 devstack sudo[100574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:09:58 devstack cinder-volume[87515]: INFO cinder.volume.manager [req-4b63954d-dda3-4495-9e3b-0e799c9b24d2 req-5e63587e-55e4-4db5-8107-e7f9c1180f13 tempest-TestServerVolumeAttachmentScenario-1829138586 None] attachment_update completed successfully. Sep 07 10:09:58 devstack sudo[100574]: pam_unix(sudo:session): session closed for user root Sep 07 10:09:58 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-fb0779cf-7f44-4f69-ae17-a894289b2bce tempest-VolumesExtendTest-430807235 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_26019e10-1e1f-4514-b191-397ccf1d59e6_9jt_wldu" returned: 0 in 0.451s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:09:58 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-fb0779cf-7f44-4f69-ae17-a894289b2bce tempest-VolumesExtendTest-430807235 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_26019e10-1e1f-4514-b191-397ccf1d59e6_9jt_wldu {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:09:58 devstack sudo[100651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_26019e10-1e1f-4514-b191-397ccf1d59e6_9jt_wldu Sep 07 10:09:58 devstack sudo[100651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:09:58 devstack sudo[100651]: pam_unix(sudo:session): session closed for user root Sep 07 10:09:58 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-fb0779cf-7f44-4f69-ae17-a894289b2bce tempest-VolumesExtendTest-430807235 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_26019e10-1e1f-4514-b191-397ccf1d59e6_9jt_wldu" returned: 1 in 0.425s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:09:58 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-fb0779cf-7f44-4f69-ae17-a894289b2bce tempest-VolumesExtendTest-430807235 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_26019e10-1e1f-4514-b191-397ccf1d59e6_9jt_wldu' failed. Not Retrying. {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 07 10:09:58 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[86f9be91-e227-4f44-af9a-8b6587d3bfe1]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:09:58 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-fb0779cf-7f44-4f69-ae17-a894289b2bce tempest-VolumesExtendTest-430807235 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_26019e10-1e1f-4514-b191-397ccf1d59e6_cbg_qakndevstack@QuobyteHD {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:09:58 devstack sudo[100975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_26019e10-1e1f-4514-b191-397ccf1d59e6_cbg_qakndevstack@QuobyteHD Sep 07 10:09:58 devstack sudo[100975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:09:59 devstack sudo[100975]: pam_unix(sudo:session): session closed for user root Sep 07 10:09:59 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-fb0779cf-7f44-4f69-ae17-a894289b2bce tempest-VolumesExtendTest-430807235 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_26019e10-1e1f-4514-b191-397ccf1d59e6_cbg_qakndevstack@QuobyteHD" returned: 0 in 0.367s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:09:59 devstack cinder-volume[87515]: DEBUG cinder.image.image_utils [None req-fb0779cf-7f44-4f69-ae17-a894289b2bce tempest-VolumesExtendTest-430807235 None] 26019e10-1e1f-4514-b191-397ccf1d59e6 was qcow2, converting to qcow2 {{(pid=87515) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 07 10:09:59 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-fb0779cf-7f44-4f69-ae17-a894289b2bce tempest-VolumesExtendTest-430807235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_26019e10-1e1f-4514-b191-397ccf1d59e6_cbg_qakndevstack@QuobyteHD /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-e7f55bf0-ff41-441a-a8e0-2b8ffab79153 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:09:59 devstack sudo[100981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_26019e10-1e1f-4514-b191-397ccf1d59e6_cbg_qakndevstack@QuobyteHD /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-e7f55bf0-ff41-441a-a8e0-2b8ffab79153 Sep 07 10:09:59 devstack sudo[100981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:09:59 devstack cinder-volume[87515]: DEBUG cinder.volume.flows.manager.create_volume [None req-b2ceb7af-f6cd-49fa-b306-616245d9c1d4 tempest-VolumesImageMetadata-1763266149 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 10:09:59 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-b2ceb7af-f6cd-49fa-b306-616245d9c1d4 tempest-VolumesImageMetadata-1763266149 None] Flow 'volume_create_manager' (c24f545f-7761-4941-9dba-03de0f6c164b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:09:59 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-b2ceb7af-f6cd-49fa-b306-616245d9c1d4 tempest-VolumesImageMetadata-1763266149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f456b3b1-ee85-4dc2-90ef-210e52e56ab5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:09:59 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-b2ceb7af-f6cd-49fa-b306-616245d9c1d4 tempest-VolumesImageMetadata-1763266149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f456b3b1-ee85-4dc2-90ef-210e52e56ab5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:09:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1045283084',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=860c50e5-9598-43a4-a9e1-9dd5711c485a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a52547fad38448368ea7c6da1cbeed72',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:09:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:09:59Z,use_quota=True,user_id='2a665bd00b114a35bab8467fdf908d7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3a092cd-7947-4cbf-abff-4ba9567becf0),volume_type_id=f3a092cd-7947-4cbf-abff-4ba9567becf0)' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:09:59 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-b2ceb7af-f6cd-49fa-b306-616245d9c1d4 tempest-VolumesImageMetadata-1763266149 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27f34d0d-e667-4ed3-9f17-3c3d3a9782d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:09:59 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-b2ceb7af-f6cd-49fa-b306-616245d9c1d4 tempest-VolumesImageMetadata-1763266149 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27f34d0d-e667-4ed3-9f17-3c3d3a9782d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:09:59 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-b2ceb7af-f6cd-49fa-b306-616245d9c1d4 tempest-VolumesImageMetadata-1763266149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6107cb69-c6a2-4de7-9bc2-dda2b59cb3ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:09:59 devstack cinder-volume[87515]: DEBUG cinder.image.glance [None req-b2ceb7af-f6cd-49fa-b306-616245d9c1d4 tempest-VolumesImageMetadata-1763266149 None] Creating Keystone auth plugin from conf {{(pid=87515) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 07 10:09:59 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-b2ceb7af-f6cd-49fa-b306-616245d9c1d4 tempest-VolumesImageMetadata-1763266149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6107cb69-c6a2-4de7-9bc2-dda2b59cb3ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '860c50e5-9598-43a4-a9e1-9dd5711c485a', 'volume_name': 'volume-860c50e5-9598-43a4-a9e1-9dd5711c485a', 'volume_size': 1, 'image_id': '26019e10-1e1f-4514-b191-397ccf1d59e6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/26019e10-1e1f-4514-b191-397ccf1d59e6', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4765956d565c46c2a4a703c5a550ca58', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '26019e10-1e1f-4514-b191-397ccf1d59e6', 'created_at': datetime.datetime(2026, 9, 7, 7, 52, 21, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 7, 7, 52, 22, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/26019e10-1e1f-4514-b191-397ccf1d59e6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:09:59 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-b2ceb7af-f6cd-49fa-b306-616245d9c1d4 tempest-VolumesImageMetadata-1763266149 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ee89191-eb9d-4fbf-bbb0-e589ef163049) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:09:59 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-b2ceb7af-f6cd-49fa-b306-616245d9c1d4 tempest-VolumesImageMetadata-1763266149 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ee89191-eb9d-4fbf-bbb0-e589ef163049) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:09:59 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-b2ceb7af-f6cd-49fa-b306-616245d9c1d4 tempest-VolumesImageMetadata-1763266149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f52ca65-0996-406b-b350-5bba5b5d5354) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:09:59 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-b2ceb7af-f6cd-49fa-b306-616245d9c1d4 tempest-VolumesImageMetadata-1763266149 None] Volume 860c50e5-9598-43a4-a9e1-9dd5711c485a: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-860c50e5-9598-43a4-a9e1-9dd5711c485a', 'volume_size': 1, 'image_id': '26019e10-1e1f-4514-b191-397ccf1d59e6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/26019e10-1e1f-4514-b191-397ccf1d59e6', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4765956d565c46c2a4a703c5a550ca58', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '26019e10-1e1f-4514-b191-397ccf1d59e6', 'created_at': datetime.datetime(2026, 9, 7, 7, 52, 21, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 7, 7, 52, 22, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/26019e10-1e1f-4514-b191-397ccf1d59e6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 07 10:09:59 devstack cinder-volume[87515]: DEBUG cinder.volume.flows.manager.create_volume [None req-b2ceb7af-f6cd-49fa-b306-616245d9c1d4 tempest-VolumesImageMetadata-1763266149 None] Trying to clone 860c50e5-9598-43a4-a9e1-9dd5711c485a from image 26019e10-1e1f-4514-b191-397ccf1d59e6 at location (None, [{'url': 'file:///opt/stack/data/glance/images/26019e10-1e1f-4514-b191-397ccf1d59e6', 'metadata': {}}]). {{(pid=87515) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 07 10:09:59 devstack cinder-volume[87515]: DEBUG cinder.image.image_utils [None req-b2ceb7af-f6cd-49fa-b306-616245d9c1d4 tempest-VolumesImageMetadata-1763266149 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_26019e10-1e1f-4514-b191-397ccf1d59e6_zap1fubgdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87515) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 07 10:09:59 devstack cinder-volume[87515]: INFO cinder.image.image_utils [None req-b2ceb7af-f6cd-49fa-b306-616245d9c1d4 tempest-VolumesImageMetadata-1763266149 None] Image download 20.69 MB at 20.69 MB/s Sep 07 10:10:00 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ef8dc8f-bf3f-44b0-bb74-7abf564a73fd]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:10:00 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-b2ceb7af-f6cd-49fa-b306-616245d9c1d4 tempest-VolumesImageMetadata-1763266149 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_26019e10-1e1f-4514-b191-397ccf1d59e6_zap1fubgdevstack@QuobyteHD {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:10:00 devstack sudo[100990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_26019e10-1e1f-4514-b191-397ccf1d59e6_zap1fubgdevstack@QuobyteHD Sep 07 10:10:00 devstack sudo[100990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:10:00 devstack sudo[100990]: pam_unix(sudo:session): session closed for user root Sep 07 10:10:00 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-b2ceb7af-f6cd-49fa-b306-616245d9c1d4 tempest-VolumesImageMetadata-1763266149 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_26019e10-1e1f-4514-b191-397ccf1d59e6_zap1fubgdevstack@QuobyteHD" returned: 0 in 0.436s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:10:00 devstack cinder-volume[87515]: DEBUG cinder.image.image_utils [None req-b2ceb7af-f6cd-49fa-b306-616245d9c1d4 tempest-VolumesImageMetadata-1763266149 None] Temporary image 26019e10-1e1f-4514-b191-397ccf1d59e6 is fetched for user 2a665bd00b114a35bab8467fdf908d7a. {{(pid=87515) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 07 10:10:00 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[39d767e3-230d-4f78-a2eb-3fbf7fef536e]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:10:00 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-b2ceb7af-f6cd-49fa-b306-616245d9c1d4 tempest-VolumesImageMetadata-1763266149 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_26019e10-1e1f-4514-b191-397ccf1d59e6_zap1fubgdevstack@QuobyteHD {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:10:00 devstack sudo[100995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_26019e10-1e1f-4514-b191-397ccf1d59e6_zap1fubgdevstack@QuobyteHD Sep 07 10:10:00 devstack sudo[100995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:10:00 devstack sudo[100995]: pam_unix(sudo:session): session closed for user root Sep 07 10:10:00 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-b2ceb7af-f6cd-49fa-b306-616245d9c1d4 tempest-VolumesImageMetadata-1763266149 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_26019e10-1e1f-4514-b191-397ccf1d59e6_zap1fubgdevstack@QuobyteHD" returned: 0 in 0.358s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:10:00 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-b2ceb7af-f6cd-49fa-b306-616245d9c1d4 tempest-VolumesImageMetadata-1763266149 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:10:00 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-b2ceb7af-f6cd-49fa-b306-616245d9c1d4 tempest-VolumesImageMetadata-1763266149 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:10:00 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-b2ceb7af-f6cd-49fa-b306-616245d9c1d4 tempest-VolumesImageMetadata-1763266149 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:09:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1045283084',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=860c50e5-9598-43a4-a9e1-9dd5711c485a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a52547fad38448368ea7c6da1cbeed72',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:09:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:09:59Z,use_quota=True,user_id='2a665bd00b114a35bab8467fdf908d7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3a092cd-7947-4cbf-abff-4ba9567becf0),volume_type_id=f3a092cd-7947-4cbf-abff-4ba9567becf0)}" {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 10:10:00 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-b2ceb7af-f6cd-49fa-b306-616245d9c1d4 tempest-VolumesImageMetadata-1763266149 None] Creating volume 860c50e5-9598-43a4-a9e1-9dd5711c485a {{(pid=87515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 10:10:00 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-b2ceb7af-f6cd-49fa-b306-616245d9c1d4 tempest-VolumesImageMetadata-1763266149 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:10:00 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-b2ceb7af-f6cd-49fa-b306-616245d9c1d4 tempest-VolumesImageMetadata-1763266149 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:10:00 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-b2ceb7af-f6cd-49fa-b306-616245d9c1d4 tempest-VolumesImageMetadata-1763266149 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:10:00 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-b2ceb7af-f6cd-49fa-b306-616245d9c1d4 tempest-VolumesImageMetadata-1763266149 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:10:00 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-b2ceb7af-f6cd-49fa-b306-616245d9c1d4 tempest-VolumesImageMetadata-1763266149 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:10:00 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-b2ceb7af-f6cd-49fa-b306-616245d9c1d4 tempest-VolumesImageMetadata-1763266149 None] Selected osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c as target Quobyte volume. {{(pid=87515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 10:10:00 devstack cinder-volume[87515]: INFO cinder.volume.drivers.remotefs [None req-b2ceb7af-f6cd-49fa-b306-616245d9c1d4 tempest-VolumesImageMetadata-1763266149 None] casted to osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c Sep 07 10:10:00 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-b2ceb7af-f6cd-49fa-b306-616245d9c1d4 tempest-VolumesImageMetadata-1763266149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-860c50e5-9598-43a4-a9e1-9dd5711c485a 1073741824 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:10:00 devstack sudo[101000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-860c50e5-9598-43a4-a9e1-9dd5711c485a 1073741824 Sep 07 10:10:00 devstack sudo[101000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:10:01 devstack sudo[100981]: pam_unix(sudo:session): session closed for user root Sep 07 10:10:01 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-fb0779cf-7f44-4f69-ae17-a894289b2bce tempest-VolumesExtendTest-430807235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_26019e10-1e1f-4514-b191-397ccf1d59e6_cbg_qakndevstack@QuobyteHD /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-e7f55bf0-ff41-441a-a8e0-2b8ffab79153" returned: 0 in 1.958s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:10:01 devstack cinder-volume[87515]: DEBUG cinder.image.image_utils [None req-fb0779cf-7f44-4f69-ae17-a894289b2bce tempest-VolumesExtendTest-430807235 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_26019e10-1e1f-4514-b191-397ccf1d59e6_cbg_qakndevstack@QuobyteHD, size 112.00 MB, duration 1.96 sec, destination /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-e7f55bf0-ff41-441a-a8e0-2b8ffab79153 {{(pid=87515) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 07 10:10:01 devstack cinder-volume[87515]: INFO cinder.image.image_utils [None req-fb0779cf-7f44-4f69-ae17-a894289b2bce tempest-VolumesExtendTest-430807235 None] Converted 112.00 MB image at 57.16 MB/s Sep 07 10:10:01 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-fb0779cf-7f44-4f69-ae17-a894289b2bce tempest-VolumesExtendTest-430807235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-e7f55bf0-ff41-441a-a8e0-2b8ffab79153 1G {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:10:01 devstack sudo[101002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-e7f55bf0-ff41-441a-a8e0-2b8ffab79153 1G Sep 07 10:10:01 devstack sudo[101002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:10:01 devstack sudo[101000]: pam_unix(sudo:session): session closed for user root Sep 07 10:10:01 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-b2ceb7af-f6cd-49fa-b306-616245d9c1d4 tempest-VolumesImageMetadata-1763266149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-860c50e5-9598-43a4-a9e1-9dd5711c485a 1073741824" returned: 0 in 0.505s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:10:01 devstack sudo[101002]: pam_unix(sudo:session): session closed for user root Sep 07 10:10:01 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-fb0779cf-7f44-4f69-ae17-a894289b2bce tempest-VolumesExtendTest-430807235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-e7f55bf0-ff41-441a-a8e0-2b8ffab79153 1G" returned: 0 in 0.403s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:10:01 devstack cinder-volume[87515]: DEBUG cinder.volume.volume_utils [None req-fb0779cf-7f44-4f69-ae17-a894289b2bce tempest-VolumesExtendTest-430807235 None] Downloaded image 26019e10-1e1f-4514-b191-397ccf1d59e6 ((None, [{'url': 'file:///opt/stack/data/glance/images/26019e10-1e1f-4514-b191-397ccf1d59e6', 'metadata': {}}])) to volume e7f55bf0-ff41-441a-a8e0-2b8ffab79153 successfully. {{(pid=87515) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 07 10:10:01 devstack cinder-volume[87515]: DEBUG cinder.image.image_utils [None req-fb0779cf-7f44-4f69-ae17-a894289b2bce tempest-VolumesExtendTest-430807235 None] Temporary image 26019e10-1e1f-4514-b191-397ccf1d59e6 for user c6c21cd7ab15490bb8401bd3450e41c9 is deleted. {{(pid=87515) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 07 10:10:01 devstack cinder-volume[87515]: DEBUG cinder.volume.volume_utils [None req-fb0779cf-7f44-4f69-ae17-a894289b2bce tempest-VolumesExtendTest-430807235 None] Marking volume e7f55bf0-ff41-441a-a8e0-2b8ffab79153 as bootable. {{(pid=87515) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 07 10:10:01 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-b2ceb7af-f6cd-49fa-b306-616245d9c1d4 tempest-VolumesImageMetadata-1763266149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-860c50e5-9598-43a4-a9e1-9dd5711c485a {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:10:01 devstack cinder-volume[87515]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb0779cf-7f44-4f69-ae17-a894289b2bce tempest-VolumesExtendTest-430807235 None] Copying metadata from image 26019e10-1e1f-4514-b191-397ccf1d59e6 to e7f55bf0-ff41-441a-a8e0-2b8ffab79153. {{(pid=87515) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 07 10:10:01 devstack cinder-volume[87515]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb0779cf-7f44-4f69-ae17-a894289b2bce tempest-VolumesExtendTest-430807235 None] Creating volume glance metadata for volume e7f55bf0-ff41-441a-a8e0-2b8ffab79153 backed by image 26019e10-1e1f-4514-b191-397ccf1d59e6 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '26019e10-1e1f-4514-b191-397ccf1d59e6', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87515) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 07 10:10:01 devstack sudo[101012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-860c50e5-9598-43a4-a9e1-9dd5711c485a Sep 07 10:10:01 devstack sudo[101012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:10:01 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-fb0779cf-7f44-4f69-ae17-a894289b2bce tempest-VolumesExtendTest-430807235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (508ebb44-3ff5-46f8-afa6-f818d462aaee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e7f55bf0-ff41-441a-a8e0-2b8ffab79153', 'volume_size': 1, 'image_id': '26019e10-1e1f-4514-b191-397ccf1d59e6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/26019e10-1e1f-4514-b191-397ccf1d59e6', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4765956d565c46c2a4a703c5a550ca58', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '26019e10-1e1f-4514-b191-397ccf1d59e6', 'created_at': datetime.datetime(2026, 9, 7, 7, 52, 21, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 7, 7, 52, 22, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/26019e10-1e1f-4514-b191-397ccf1d59e6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:10:01 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-fb0779cf-7f44-4f69-ae17-a894289b2bce tempest-VolumesExtendTest-430807235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e2fb154-fb51-452a-bb37-17cf6a0cb92f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:10:01 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-fb0779cf-7f44-4f69-ae17-a894289b2bce tempest-VolumesExtendTest-430807235 None] Volume volume-e7f55bf0-ff41-441a-a8e0-2b8ffab79153 (e7f55bf0-ff41-441a-a8e0-2b8ffab79153): created successfully Sep 07 10:10:01 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-fb0779cf-7f44-4f69-ae17-a894289b2bce tempest-VolumesExtendTest-430807235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e2fb154-fb51-452a-bb37-17cf6a0cb92f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:10:01 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-fb0779cf-7f44-4f69-ae17-a894289b2bce tempest-VolumesExtendTest-430807235 None] Flow 'volume_create_manager' (ba585f5b-09cd-4f27-a0b3-a99e72df5b98) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:10:01 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-fb0779cf-7f44-4f69-ae17-a894289b2bce tempest-VolumesExtendTest-430807235 None] Created volume successfully. Sep 07 10:10:01 devstack sudo[101012]: pam_unix(sudo:session): session closed for user root Sep 07 10:10:01 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-b2ceb7af-f6cd-49fa-b306-616245d9c1d4 tempest-VolumesImageMetadata-1763266149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-860c50e5-9598-43a4-a9e1-9dd5711c485a" returned: 0 in 0.258s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:10:01 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-b2ceb7af-f6cd-49fa-b306-616245d9c1d4 tempest-VolumesImageMetadata-1763266149 None] <== create_volume: return (822ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'} {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 10:10:01 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-b2ceb7af-f6cd-49fa-b306-616245d9c1d4 tempest-VolumesImageMetadata-1763266149 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.825s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:10:01 devstack cinder-volume[87515]: DEBUG cinder.volume.volume_utils [None req-b2ceb7af-f6cd-49fa-b306-616245d9c1d4 tempest-VolumesImageMetadata-1763266149 None] Attempting download of 26019e10-1e1f-4514-b191-397ccf1d59e6 ((None, [{'url': 'file:///opt/stack/data/glance/images/26019e10-1e1f-4514-b191-397ccf1d59e6', 'metadata': {}}])) to volume 860c50e5-9598-43a4-a9e1-9dd5711c485a. {{(pid=87515) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 07 10:10:01 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[eed59d31-bfdd-4cc1-8123-df6937bd150e]: (4, 'raw') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:10:01 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-b2ceb7af-f6cd-49fa-b306-616245d9c1d4 tempest-VolumesImageMetadata-1763266149 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_26019e10-1e1f-4514-b191-397ccf1d59e6_qppjz9m1 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:10:01 devstack sudo[101015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_26019e10-1e1f-4514-b191-397ccf1d59e6_qppjz9m1 Sep 07 10:10:01 devstack sudo[101015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:10:02 devstack sudo[101015]: pam_unix(sudo:session): session closed for user root Sep 07 10:10:02 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-b2ceb7af-f6cd-49fa-b306-616245d9c1d4 tempest-VolumesImageMetadata-1763266149 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_26019e10-1e1f-4514-b191-397ccf1d59e6_qppjz9m1" returned: 0 in 0.355s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:10:02 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-b2ceb7af-f6cd-49fa-b306-616245d9c1d4 tempest-VolumesImageMetadata-1763266149 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_26019e10-1e1f-4514-b191-397ccf1d59e6_qppjz9m1 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:10:02 devstack sudo[101019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_26019e10-1e1f-4514-b191-397ccf1d59e6_qppjz9m1 Sep 07 10:10:02 devstack sudo[101019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:10:02 devstack sudo[101019]: pam_unix(sudo:session): session closed for user root Sep 07 10:10:02 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-e8ca8f70-d90d-45fb-9965-315b2c7a61d6 tempest-VolumesExtendTest-430807235 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:10:02 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-e8ca8f70-d90d-45fb-9965-315b2c7a61d6 tempest-VolumesExtendTest-430807235 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:10:02 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-b2ceb7af-f6cd-49fa-b306-616245d9c1d4 tempest-VolumesImageMetadata-1763266149 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_26019e10-1e1f-4514-b191-397ccf1d59e6_qppjz9m1" returned: 1 in 0.369s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:10:02 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-b2ceb7af-f6cd-49fa-b306-616245d9c1d4 tempest-VolumesImageMetadata-1763266149 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_26019e10-1e1f-4514-b191-397ccf1d59e6_qppjz9m1' failed. Not Retrying. {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 07 10:10:02 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[c50f57e5-e560-4056-a157-8adb29e742bd]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:10:02 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-b2ceb7af-f6cd-49fa-b306-616245d9c1d4 tempest-VolumesImageMetadata-1763266149 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_26019e10-1e1f-4514-b191-397ccf1d59e6_zap1fubgdevstack@QuobyteHD {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:10:02 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae810f6d-08c3-420a-8512-d0de9805dc33]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:10:02 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-e8ca8f70-d90d-45fb-9965-315b2c7a61d6 tempest-VolumesExtendTest-430807235 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-e7f55bf0-ff41-441a-a8e0-2b8ffab79153 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:10:02 devstack sudo[101027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_26019e10-1e1f-4514-b191-397ccf1d59e6_zap1fubgdevstack@QuobyteHD Sep 07 10:10:02 devstack sudo[101027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:10:02 devstack sudo[101028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-e7f55bf0-ff41-441a-a8e0-2b8ffab79153 Sep 07 10:10:02 devstack sudo[101028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:10:02 devstack sudo[101027]: pam_unix(sudo:session): session closed for user root Sep 07 10:10:02 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-b2ceb7af-f6cd-49fa-b306-616245d9c1d4 tempest-VolumesImageMetadata-1763266149 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_26019e10-1e1f-4514-b191-397ccf1d59e6_zap1fubgdevstack@QuobyteHD" returned: 0 in 0.417s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:10:02 devstack cinder-volume[87515]: DEBUG cinder.image.image_utils [None req-b2ceb7af-f6cd-49fa-b306-616245d9c1d4 tempest-VolumesImageMetadata-1763266149 None] 26019e10-1e1f-4514-b191-397ccf1d59e6 was qcow2, converting to qcow2 {{(pid=87515) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 07 10:10:03 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-b2ceb7af-f6cd-49fa-b306-616245d9c1d4 tempest-VolumesImageMetadata-1763266149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_26019e10-1e1f-4514-b191-397ccf1d59e6_zap1fubgdevstack@QuobyteHD /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-860c50e5-9598-43a4-a9e1-9dd5711c485a {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:10:03 devstack sudo[101028]: pam_unix(sudo:session): session closed for user root Sep 07 10:10:03 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-e8ca8f70-d90d-45fb-9965-315b2c7a61d6 tempest-VolumesExtendTest-430807235 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-e7f55bf0-ff41-441a-a8e0-2b8ffab79153" returned: 0 in 0.417s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:10:03 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-e8ca8f70-d90d-45fb-9965-315b2c7a61d6 tempest-VolumesExtendTest-430807235 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-e7f55bf0-ff41-441a-a8e0-2b8ffab79153 2G {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:10:03 devstack sudo[101043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_26019e10-1e1f-4514-b191-397ccf1d59e6_zap1fubgdevstack@QuobyteHD /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-860c50e5-9598-43a4-a9e1-9dd5711c485a Sep 07 10:10:03 devstack sudo[101043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:10:03 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-e8ca8f70-d90d-45fb-9965-315b2c7a61d6 tempest-VolumesExtendTest-430807235 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-e7f55bf0-ff41-441a-a8e0-2b8ffab79153 2G" returned: 0 in 0.129s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:10:03 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-e8ca8f70-d90d-45fb-9965-315b2c7a61d6 tempest-VolumesExtendTest-430807235 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.596s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:10:03 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [req-008df760-0040-489e-bc80-df2744df6b88 req-5a0c3e12-c5fa-4346-9a0d-70dbecfaf26d tempest-TestServerVolumeAttachmentScenario-1829138586 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:10:03 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [req-008df760-0040-489e-bc80-df2744df6b88 req-5a0c3e12-c5fa-4346-9a0d-70dbecfaf26d tempest-TestServerVolumeAttachmentScenario-1829138586 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:10:03 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [req-008df760-0040-489e-bc80-df2744df6b88 req-5a0c3e12-c5fa-4346-9a0d-70dbecfaf26d tempest-TestServerVolumeAttachmentScenario-1829138586 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.022s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:10:03 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-e8ca8f70-d90d-45fb-9965-315b2c7a61d6 tempest-VolumesExtendTest-430807235 None] Extend volume completed successfully. Sep 07 10:10:03 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [req-008df760-0040-489e-bc80-df2744df6b88 req-5a0c3e12-c5fa-4346-9a0d-70dbecfaf26d tempest-TestServerVolumeAttachmentScenario-1829138586 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c', 'name': 'volume-63322935-468a-400c-8a29-86201154a482', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e1ddf505-eef3-4612-bc4e-9331e669f71a', 'enforce_multipath': True} {{(pid=87515) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 07 10:10:03 devstack cinder-volume[87515]: INFO cinder.volume.manager [req-008df760-0040-489e-bc80-df2744df6b88 req-5a0c3e12-c5fa-4346-9a0d-70dbecfaf26d tempest-TestServerVolumeAttachmentScenario-1829138586 None] attachment_update completed successfully. Sep 07 10:10:04 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-16b36dce-b8d6-4379-89dd-2bf934262946 tempest-VolumesExtendTest-430807235 None] Acquiring lock "cinder-e7f55bf0-ff41-441a-a8e0-2b8ffab79153-delete_volume" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:10:04 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-16b36dce-b8d6-4379-89dd-2bf934262946 tempest-VolumesExtendTest-430807235 None] Lock "cinder-e7f55bf0-ff41-441a-a8e0-2b8ffab79153-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:10:04 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-16b36dce-b8d6-4379-89dd-2bf934262946 tempest-VolumesExtendTest-430807235 None] Acquiring lock "cinder-quobyte-e7f55bf0-ff41-441a-a8e0-2b8ffab79153" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:10:04 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-16b36dce-b8d6-4379-89dd-2bf934262946 tempest-VolumesExtendTest-430807235 None] Lock "cinder-quobyte-e7f55bf0-ff41-441a-a8e0-2b8ffab79153" acquired by "delete_volume" :: waited 0.019s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:10:04 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a508774-0368-4a69-8f31-45f170b6c100]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:10:04 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-16b36dce-b8d6-4379-89dd-2bf934262946 tempest-VolumesExtendTest-430807235 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-e7f55bf0-ff41-441a-a8e0-2b8ffab79153 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:10:04 devstack sudo[101060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-e7f55bf0-ff41-441a-a8e0-2b8ffab79153 Sep 07 10:10:04 devstack sudo[101060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:10:04 devstack sudo[101060]: pam_unix(sudo:session): session closed for user root Sep 07 10:10:04 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-16b36dce-b8d6-4379-89dd-2bf934262946 tempest-VolumesExtendTest-430807235 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-e7f55bf0-ff41-441a-a8e0-2b8ffab79153" returned: 0 in 0.447s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:10:04 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-16b36dce-b8d6-4379-89dd-2bf934262946 tempest-VolumesExtendTest-430807235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-e7f55bf0-ff41-441a-a8e0-2b8ffab79153 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:10:04 devstack sudo[101066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-e7f55bf0-ff41-441a-a8e0-2b8ffab79153 Sep 07 10:10:04 devstack sudo[101066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:10:04 devstack cinder-volume[87515]: INFO cinder.volume.manager [req-133725ba-9388-4956-af82-126d2742bbc2 req-29428acb-9e0a-472f-800e-7414f38dd98a tempest-TestServerVolumeAttachmentScenario-1829138586 None] Terminate volume connection completed successfully. Sep 07 10:10:04 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [req-133725ba-9388-4956-af82-126d2742bbc2 req-29428acb-9e0a-472f-800e-7414f38dd98a tempest-TestServerVolumeAttachmentScenario-1829138586 None] Deleting attachment e1ddf505-eef3-4612-bc4e-9331e669f71a. {{(pid=87515) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 07 10:10:04 devstack sudo[101066]: pam_unix(sudo:session): session closed for user root Sep 07 10:10:04 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-16b36dce-b8d6-4379-89dd-2bf934262946 tempest-VolumesExtendTest-430807235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-e7f55bf0-ff41-441a-a8e0-2b8ffab79153" returned: 0 in 0.270s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:10:04 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-16b36dce-b8d6-4379-89dd-2bf934262946 tempest-VolumesExtendTest-430807235 None] Lock "cinder-quobyte-e7f55bf0-ff41-441a-a8e0-2b8ffab79153" released by "delete_volume" :: held 0.765s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:10:05 devstack cinder-volume[87515]: DEBUG cinder.quota [None req-16b36dce-b8d6-4379-89dd-2bf934262946 tempest-VolumesExtendTest-430807235 None] Created reservations ['0a82c3ce-c85e-4f2b-9ebf-fcc371b90c09', 'e5eb8687-5acf-4c3f-aae5-c0d5ff023ce5', 'df865a2e-422d-4795-803a-f4c0ba4423b8', '1c17958e-2469-43c9-8f1c-7fafe9a72679'] {{(pid=87515) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:10:05 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-16b36dce-b8d6-4379-89dd-2bf934262946 tempest-VolumesExtendTest-430807235 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:10:05 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-16b36dce-b8d6-4379-89dd-2bf934262946 tempest-VolumesExtendTest-430807235 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:10:05 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-16b36dce-b8d6-4379-89dd-2bf934262946 tempest-VolumesExtendTest-430807235 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:10:05 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-16b36dce-b8d6-4379-89dd-2bf934262946 tempest-VolumesExtendTest-430807235 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:10:05 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-16b36dce-b8d6-4379-89dd-2bf934262946 tempest-VolumesExtendTest-430807235 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:10:05 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-16b36dce-b8d6-4379-89dd-2bf934262946 tempest-VolumesExtendTest-430807235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:10:05 devstack sudo[101071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a Sep 07 10:10:05 devstack sudo[101071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:10:05 devstack sudo[101043]: pam_unix(sudo:session): session closed for user root Sep 07 10:10:05 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-b2ceb7af-f6cd-49fa-b306-616245d9c1d4 tempest-VolumesImageMetadata-1763266149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_26019e10-1e1f-4514-b191-397ccf1d59e6_zap1fubgdevstack@QuobyteHD /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-860c50e5-9598-43a4-a9e1-9dd5711c485a" returned: 0 in 2.157s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:10:05 devstack cinder-volume[87515]: DEBUG cinder.image.image_utils [None req-b2ceb7af-f6cd-49fa-b306-616245d9c1d4 tempest-VolumesImageMetadata-1763266149 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_26019e10-1e1f-4514-b191-397ccf1d59e6_zap1fubgdevstack@QuobyteHD, size 112.00 MB, duration 2.16 sec, destination /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-860c50e5-9598-43a4-a9e1-9dd5711c485a {{(pid=87515) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 07 10:10:05 devstack cinder-volume[87515]: INFO cinder.image.image_utils [None req-b2ceb7af-f6cd-49fa-b306-616245d9c1d4 tempest-VolumesImageMetadata-1763266149 None] Converted 112.00 MB image at 51.89 MB/s Sep 07 10:10:05 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-b2ceb7af-f6cd-49fa-b306-616245d9c1d4 tempest-VolumesImageMetadata-1763266149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-860c50e5-9598-43a4-a9e1-9dd5711c485a 1G {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:10:05 devstack sudo[101073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-860c50e5-9598-43a4-a9e1-9dd5711c485a 1G Sep 07 10:10:05 devstack sudo[101073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:10:05 devstack sudo[101071]: pam_unix(sudo:session): session closed for user root Sep 07 10:10:05 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-16b36dce-b8d6-4379-89dd-2bf934262946 tempest-VolumesExtendTest-430807235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a" returned: 0 in 0.273s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:10:05 devstack cinder-volume[87515]: DEBUG cinder.manager [None req-16b36dce-b8d6-4379-89dd-2bf934262946 tempest-VolumesExtendTest-430807235 None] Notifying Schedulers of capabilities ... {{(pid=87515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:10:05 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-16b36dce-b8d6-4379-89dd-2bf934262946 tempest-VolumesExtendTest-430807235 None] Deleted volume successfully. Sep 07 10:10:05 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-16b36dce-b8d6-4379-89dd-2bf934262946 tempest-VolumesExtendTest-430807235 None] Lock "cinder-e7f55bf0-ff41-441a-a8e0-2b8ffab79153-delete_volume" released by "delete_volume" :: held 1.306s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:10:05 devstack sudo[101073]: pam_unix(sudo:session): session closed for user root Sep 07 10:10:05 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-b2ceb7af-f6cd-49fa-b306-616245d9c1d4 tempest-VolumesImageMetadata-1763266149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-860c50e5-9598-43a4-a9e1-9dd5711c485a 1G" returned: 0 in 0.344s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:10:05 devstack cinder-volume[87515]: DEBUG cinder.volume.volume_utils [None req-b2ceb7af-f6cd-49fa-b306-616245d9c1d4 tempest-VolumesImageMetadata-1763266149 None] Downloaded image 26019e10-1e1f-4514-b191-397ccf1d59e6 ((None, [{'url': 'file:///opt/stack/data/glance/images/26019e10-1e1f-4514-b191-397ccf1d59e6', 'metadata': {}}])) to volume 860c50e5-9598-43a4-a9e1-9dd5711c485a successfully. {{(pid=87515) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 07 10:10:05 devstack cinder-volume[87515]: DEBUG cinder.image.image_utils [None req-b2ceb7af-f6cd-49fa-b306-616245d9c1d4 tempest-VolumesImageMetadata-1763266149 None] Temporary image 26019e10-1e1f-4514-b191-397ccf1d59e6 for user 2a665bd00b114a35bab8467fdf908d7a is deleted. {{(pid=87515) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 07 10:10:05 devstack cinder-volume[87515]: DEBUG cinder.volume.volume_utils [None req-b2ceb7af-f6cd-49fa-b306-616245d9c1d4 tempest-VolumesImageMetadata-1763266149 None] Marking volume 860c50e5-9598-43a4-a9e1-9dd5711c485a as bootable. {{(pid=87515) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 07 10:10:05 devstack cinder-volume[87515]: DEBUG cinder.volume.flows.manager.create_volume [None req-b2ceb7af-f6cd-49fa-b306-616245d9c1d4 tempest-VolumesImageMetadata-1763266149 None] Copying metadata from image 26019e10-1e1f-4514-b191-397ccf1d59e6 to 860c50e5-9598-43a4-a9e1-9dd5711c485a. {{(pid=87515) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 07 10:10:05 devstack cinder-volume[87515]: DEBUG cinder.volume.flows.manager.create_volume [None req-b2ceb7af-f6cd-49fa-b306-616245d9c1d4 tempest-VolumesImageMetadata-1763266149 None] Creating volume glance metadata for volume 860c50e5-9598-43a4-a9e1-9dd5711c485a backed by image 26019e10-1e1f-4514-b191-397ccf1d59e6 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '26019e10-1e1f-4514-b191-397ccf1d59e6', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87515) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 07 10:10:05 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-b2ceb7af-f6cd-49fa-b306-616245d9c1d4 tempest-VolumesImageMetadata-1763266149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f52ca65-0996-406b-b350-5bba5b5d5354) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-860c50e5-9598-43a4-a9e1-9dd5711c485a', 'volume_size': 1, 'image_id': '26019e10-1e1f-4514-b191-397ccf1d59e6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/26019e10-1e1f-4514-b191-397ccf1d59e6', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4765956d565c46c2a4a703c5a550ca58', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '26019e10-1e1f-4514-b191-397ccf1d59e6', 'created_at': datetime.datetime(2026, 9, 7, 7, 52, 21, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 7, 7, 52, 22, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/26019e10-1e1f-4514-b191-397ccf1d59e6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:10:05 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-b2ceb7af-f6cd-49fa-b306-616245d9c1d4 tempest-VolumesImageMetadata-1763266149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb8d0677-b4e0-404d-9145-6e2d6bc7fe33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:10:05 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-b2ceb7af-f6cd-49fa-b306-616245d9c1d4 tempest-VolumesImageMetadata-1763266149 None] Volume volume-860c50e5-9598-43a4-a9e1-9dd5711c485a (860c50e5-9598-43a4-a9e1-9dd5711c485a): created successfully Sep 07 10:10:05 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-b2ceb7af-f6cd-49fa-b306-616245d9c1d4 tempest-VolumesImageMetadata-1763266149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb8d0677-b4e0-404d-9145-6e2d6bc7fe33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:10:05 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-b2ceb7af-f6cd-49fa-b306-616245d9c1d4 tempest-VolumesImageMetadata-1763266149 None] Flow 'volume_create_manager' (c24f545f-7761-4941-9dba-03de0f6c164b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:10:05 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-b2ceb7af-f6cd-49fa-b306-616245d9c1d4 tempest-VolumesImageMetadata-1763266149 None] Created volume successfully. Sep 07 10:10:05 devstack cinder-volume[87515]: DEBUG dbcounter [-] [87515] Writing DB stats cinder:UPDATE=111,cinder:SELECT=111,cinder:INSERT=32,cinder:DELETE=10 {{(pid=87515) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 10:10:05 devstack cinder-volume[87515]: DEBUG cinder.volume.flows.manager.create_volume [None req-82d61dfb-466c-4698-9c38-cf317c0cd3e3 tempest-VolumesExtendTest-430807235 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 10:10:05 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-82d61dfb-466c-4698-9c38-cf317c0cd3e3 tempest-VolumesExtendTest-430807235 None] Flow 'volume_create_manager' (242e003d-aad0-469e-9c74-f66ad93192fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:10:05 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-82d61dfb-466c-4698-9c38-cf317c0cd3e3 tempest-VolumesExtendTest-430807235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2faa3c20-c766-4a8a-be87-468145330fbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:10:05 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-82d61dfb-466c-4698-9c38-cf317c0cd3e3 tempest-VolumesExtendTest-430807235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2faa3c20-c766-4a8a-be87-468145330fbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:10:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1836466412',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d6b7a18-9e66-4a3e-9c18-bb41c8ce34be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1f76c3b94d04c8bbfbc78d181ebc1b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:10:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:10:06Z,use_quota=True,user_id='c6c21cd7ab15490bb8401bd3450e41c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3a092cd-7947-4cbf-abff-4ba9567becf0),volume_type_id=f3a092cd-7947-4cbf-abff-4ba9567becf0)' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:10:05 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-82d61dfb-466c-4698-9c38-cf317c0cd3e3 tempest-VolumesExtendTest-430807235 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dcebd6e9-7d52-40b6-8fec-224421995f80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:10:05 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-82d61dfb-466c-4698-9c38-cf317c0cd3e3 tempest-VolumesExtendTest-430807235 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dcebd6e9-7d52-40b6-8fec-224421995f80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:10:05 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-82d61dfb-466c-4698-9c38-cf317c0cd3e3 tempest-VolumesExtendTest-430807235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21281879-763d-4a08-8cba-cee817f187dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:10:05 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-82d61dfb-466c-4698-9c38-cf317c0cd3e3 tempest-VolumesExtendTest-430807235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21281879-763d-4a08-8cba-cee817f187dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0d6b7a18-9e66-4a3e-9c18-bb41c8ce34be', 'volume_name': 'volume-0d6b7a18-9e66-4a3e-9c18-bb41c8ce34be', 'volume_size': 1}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:10:05 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-82d61dfb-466c-4698-9c38-cf317c0cd3e3 tempest-VolumesExtendTest-430807235 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd22904b-3fb5-4151-a747-151f22566914) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:10:05 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-82d61dfb-466c-4698-9c38-cf317c0cd3e3 tempest-VolumesExtendTest-430807235 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd22904b-3fb5-4151-a747-151f22566914) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:10:05 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-82d61dfb-466c-4698-9c38-cf317c0cd3e3 tempest-VolumesExtendTest-430807235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e043227-e351-4060-a632-88fc24b6877b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:10:05 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-82d61dfb-466c-4698-9c38-cf317c0cd3e3 tempest-VolumesExtendTest-430807235 None] Volume 0d6b7a18-9e66-4a3e-9c18-bb41c8ce34be: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0d6b7a18-9e66-4a3e-9c18-bb41c8ce34be', 'volume_size': 1} Sep 07 10:10:05 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-82d61dfb-466c-4698-9c38-cf317c0cd3e3 tempest-VolumesExtendTest-430807235 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:10:05 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-82d61dfb-466c-4698-9c38-cf317c0cd3e3 tempest-VolumesExtendTest-430807235 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:10:05 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-82d61dfb-466c-4698-9c38-cf317c0cd3e3 tempest-VolumesExtendTest-430807235 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:10:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1836466412',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d6b7a18-9e66-4a3e-9c18-bb41c8ce34be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1f76c3b94d04c8bbfbc78d181ebc1b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:10:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:10:06Z,use_quota=True,user_id='c6c21cd7ab15490bb8401bd3450e41c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3a092cd-7947-4cbf-abff-4ba9567becf0),volume_type_id=f3a092cd-7947-4cbf-abff-4ba9567becf0)}" {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 10:10:05 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-82d61dfb-466c-4698-9c38-cf317c0cd3e3 tempest-VolumesExtendTest-430807235 None] Creating volume 0d6b7a18-9e66-4a3e-9c18-bb41c8ce34be {{(pid=87515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 10:10:05 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-82d61dfb-466c-4698-9c38-cf317c0cd3e3 tempest-VolumesExtendTest-430807235 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:10:05 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-82d61dfb-466c-4698-9c38-cf317c0cd3e3 tempest-VolumesExtendTest-430807235 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:10:05 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-82d61dfb-466c-4698-9c38-cf317c0cd3e3 tempest-VolumesExtendTest-430807235 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:10:05 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-82d61dfb-466c-4698-9c38-cf317c0cd3e3 tempest-VolumesExtendTest-430807235 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:10:05 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-82d61dfb-466c-4698-9c38-cf317c0cd3e3 tempest-VolumesExtendTest-430807235 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:10:05 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-82d61dfb-466c-4698-9c38-cf317c0cd3e3 tempest-VolumesExtendTest-430807235 None] Selected osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c as target Quobyte volume. {{(pid=87515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 10:10:05 devstack cinder-volume[87515]: INFO cinder.volume.drivers.remotefs [None req-82d61dfb-466c-4698-9c38-cf317c0cd3e3 tempest-VolumesExtendTest-430807235 None] casted to osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c Sep 07 10:10:05 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-82d61dfb-466c-4698-9c38-cf317c0cd3e3 tempest-VolumesExtendTest-430807235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-0d6b7a18-9e66-4a3e-9c18-bb41c8ce34be 1073741824 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:10:05 devstack sudo[101080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-0d6b7a18-9e66-4a3e-9c18-bb41c8ce34be 1073741824 Sep 07 10:10:05 devstack sudo[101080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:10:06 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-f26c7b1a-87c9-4334-9426-32177c0587ca tempest-VolumesImageMetadata-1763266149 None] Acquiring lock "cinder-860c50e5-9598-43a4-a9e1-9dd5711c485a-delete_volume" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:10:06 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-f26c7b1a-87c9-4334-9426-32177c0587ca tempest-VolumesImageMetadata-1763266149 None] Lock "cinder-860c50e5-9598-43a4-a9e1-9dd5711c485a-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:10:06 devstack cinder-volume[87515]: DEBUG dbcounter [-] [87515] Writing DB stats cinder:SELECT=93,cinder:UPDATE=122,cinder:INSERT=42,cinder:DELETE=11 {{(pid=87515) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 10:10:06 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-f26c7b1a-87c9-4334-9426-32177c0587ca tempest-VolumesImageMetadata-1763266149 None] Acquiring lock "cinder-quobyte-860c50e5-9598-43a4-a9e1-9dd5711c485a" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:10:06 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-f26c7b1a-87c9-4334-9426-32177c0587ca tempest-VolumesImageMetadata-1763266149 None] Lock "cinder-quobyte-860c50e5-9598-43a4-a9e1-9dd5711c485a" acquired by "delete_volume" :: waited 0.020s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:10:06 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbaeac33-6a4e-4d4c-b74d-c312d841a6f5]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:10:06 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-f26c7b1a-87c9-4334-9426-32177c0587ca tempest-VolumesImageMetadata-1763266149 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-860c50e5-9598-43a4-a9e1-9dd5711c485a {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:10:06 devstack sudo[101080]: pam_unix(sudo:session): session closed for user root Sep 07 10:10:06 devstack sudo[101086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-860c50e5-9598-43a4-a9e1-9dd5711c485a Sep 07 10:10:06 devstack sudo[101086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:10:06 devstack cinder-volume[87515]: INFO cinder.volume.manager [req-52cf4ed0-e00f-4da9-b1cf-6eb3c8a8903b req-14dfed7e-e584-458c-8a74-f0ffe8b7829b tempest-TestServerVolumeAttachmentScenario-1829138586 None] Terminate volume connection completed successfully. Sep 07 10:10:06 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [req-52cf4ed0-e00f-4da9-b1cf-6eb3c8a8903b req-14dfed7e-e584-458c-8a74-f0ffe8b7829b tempest-TestServerVolumeAttachmentScenario-1829138586 None] Deleting attachment 97ece3fb-d44c-4458-bac6-e004b661989b. {{(pid=87515) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 07 10:10:06 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-82d61dfb-466c-4698-9c38-cf317c0cd3e3 tempest-VolumesExtendTest-430807235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-0d6b7a18-9e66-4a3e-9c18-bb41c8ce34be 1073741824" returned: 0 in 0.579s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:10:06 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-82d61dfb-466c-4698-9c38-cf317c0cd3e3 tempest-VolumesExtendTest-430807235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-0d6b7a18-9e66-4a3e-9c18-bb41c8ce34be {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:10:06 devstack sudo[101115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-0d6b7a18-9e66-4a3e-9c18-bb41c8ce34be Sep 07 10:10:06 devstack sudo[101115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:10:06 devstack sudo[101086]: pam_unix(sudo:session): session closed for user root Sep 07 10:10:06 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-f26c7b1a-87c9-4334-9426-32177c0587ca tempest-VolumesImageMetadata-1763266149 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-860c50e5-9598-43a4-a9e1-9dd5711c485a" returned: 0 in 0.437s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:10:06 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-f26c7b1a-87c9-4334-9426-32177c0587ca tempest-VolumesImageMetadata-1763266149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-860c50e5-9598-43a4-a9e1-9dd5711c485a {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:10:06 devstack sudo[101121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-860c50e5-9598-43a4-a9e1-9dd5711c485a Sep 07 10:10:06 devstack sudo[101121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:10:06 devstack sudo[101115]: pam_unix(sudo:session): session closed for user root Sep 07 10:10:06 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-82d61dfb-466c-4698-9c38-cf317c0cd3e3 tempest-VolumesExtendTest-430807235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-0d6b7a18-9e66-4a3e-9c18-bb41c8ce34be" returned: 0 in 0.282s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:10:06 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-82d61dfb-466c-4698-9c38-cf317c0cd3e3 tempest-VolumesExtendTest-430807235 None] <== create_volume: return (912ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'} {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 10:10:06 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-82d61dfb-466c-4698-9c38-cf317c0cd3e3 tempest-VolumesExtendTest-430807235 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.915s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:10:06 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-82d61dfb-466c-4698-9c38-cf317c0cd3e3 tempest-VolumesExtendTest-430807235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e043227-e351-4060-a632-88fc24b6877b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0d6b7a18-9e66-4a3e-9c18-bb41c8ce34be', 'volume_size': 1}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:10:06 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-82d61dfb-466c-4698-9c38-cf317c0cd3e3 tempest-VolumesExtendTest-430807235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61d4adac-f6fb-41e7-98b4-f7cf882be03b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:10:06 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-82d61dfb-466c-4698-9c38-cf317c0cd3e3 tempest-VolumesExtendTest-430807235 None] Volume volume-0d6b7a18-9e66-4a3e-9c18-bb41c8ce34be (0d6b7a18-9e66-4a3e-9c18-bb41c8ce34be): created successfully Sep 07 10:10:06 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-82d61dfb-466c-4698-9c38-cf317c0cd3e3 tempest-VolumesExtendTest-430807235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61d4adac-f6fb-41e7-98b4-f7cf882be03b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:10:06 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-82d61dfb-466c-4698-9c38-cf317c0cd3e3 tempest-VolumesExtendTest-430807235 None] Flow 'volume_create_manager' (242e003d-aad0-469e-9c74-f66ad93192fd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:10:06 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-82d61dfb-466c-4698-9c38-cf317c0cd3e3 tempest-VolumesExtendTest-430807235 None] Created volume successfully. Sep 07 10:10:07 devstack sudo[101121]: pam_unix(sudo:session): session closed for user root Sep 07 10:10:07 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-f26c7b1a-87c9-4334-9426-32177c0587ca tempest-VolumesImageMetadata-1763266149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-860c50e5-9598-43a4-a9e1-9dd5711c485a" returned: 0 in 0.244s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:10:07 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-f26c7b1a-87c9-4334-9426-32177c0587ca tempest-VolumesImageMetadata-1763266149 None] Lock "cinder-quobyte-860c50e5-9598-43a4-a9e1-9dd5711c485a" released by "delete_volume" :: held 0.721s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:10:07 devstack cinder-volume[87515]: DEBUG cinder.quota [None req-f26c7b1a-87c9-4334-9426-32177c0587ca tempest-VolumesImageMetadata-1763266149 None] Created reservations ['dc89bdc9-f477-49ff-8e6c-cf3730e85923', '564c8892-87e1-4ef7-809b-7deb4b9a0d7b', '4af1c6be-c331-4e9a-8901-3563142af323', 'b6bd1843-ab0f-4af8-9630-586c15cef7e5'] {{(pid=87515) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:10:07 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-f26c7b1a-87c9-4334-9426-32177c0587ca tempest-VolumesImageMetadata-1763266149 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:10:07 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-f26c7b1a-87c9-4334-9426-32177c0587ca tempest-VolumesImageMetadata-1763266149 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:10:07 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-f26c7b1a-87c9-4334-9426-32177c0587ca tempest-VolumesImageMetadata-1763266149 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:10:07 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-f26c7b1a-87c9-4334-9426-32177c0587ca tempest-VolumesImageMetadata-1763266149 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:10:07 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-f26c7b1a-87c9-4334-9426-32177c0587ca tempest-VolumesImageMetadata-1763266149 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:10:07 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-f26c7b1a-87c9-4334-9426-32177c0587ca tempest-VolumesImageMetadata-1763266149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:10:07 devstack sudo[101124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a Sep 07 10:10:07 devstack sudo[101124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:10:07 devstack sudo[101124]: pam_unix(sudo:session): session closed for user root Sep 07 10:10:07 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-f26c7b1a-87c9-4334-9426-32177c0587ca tempest-VolumesImageMetadata-1763266149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a" returned: 0 in 0.260s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:10:07 devstack cinder-volume[87515]: DEBUG cinder.manager [None req-f26c7b1a-87c9-4334-9426-32177c0587ca tempest-VolumesImageMetadata-1763266149 None] Notifying Schedulers of capabilities ... {{(pid=87515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:10:07 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-f26c7b1a-87c9-4334-9426-32177c0587ca tempest-VolumesImageMetadata-1763266149 None] Deleted volume successfully. Sep 07 10:10:07 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-f26c7b1a-87c9-4334-9426-32177c0587ca tempest-VolumesImageMetadata-1763266149 None] Lock "cinder-860c50e5-9598-43a4-a9e1-9dd5711c485a-delete_volume" released by "delete_volume" :: held 1.217s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:10:08 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-9c544e6f-3290-4071-8bb4-ccb33e34cb67 tempest-VolumesExtendTest-430807235 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:10:08 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-9c544e6f-3290-4071-8bb4-ccb33e34cb67 tempest-VolumesExtendTest-430807235 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:10:08 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-9c544e6f-3290-4071-8bb4-ccb33e34cb67 tempest-VolumesExtendTest-430807235 None] Creating offline snapshot 322a7840-ccb7-4893-9500-99e30b9315b0 of volume 0d6b7a18-9e66-4a3e-9c18-bb41c8ce34be {{(pid=87515) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 10:10:08 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[858b3921-489e-461a-8e1e-0df11c2b7e0d]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:10:08 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-9c544e6f-3290-4071-8bb4-ccb33e34cb67 tempest-VolumesExtendTest-430807235 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-0d6b7a18-9e66-4a3e-9c18-bb41c8ce34be {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:10:08 devstack sudo[101146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-0d6b7a18-9e66-4a3e-9c18-bb41c8ce34be Sep 07 10:10:08 devstack sudo[101146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:10:08 devstack sudo[101146]: pam_unix(sudo:session): session closed for user root Sep 07 10:10:08 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-9c544e6f-3290-4071-8bb4-ccb33e34cb67 tempest-VolumesExtendTest-430807235 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-0d6b7a18-9e66-4a3e-9c18-bb41c8ce34be" returned: 0 in 0.421s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:10:08 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-9c544e6f-3290-4071-8bb4-ccb33e34cb67 tempest-VolumesExtendTest-430807235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-0d6b7a18-9e66-4a3e-9c18-bb41c8ce34be,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-0d6b7a18-9e66-4a3e-9c18-bb41c8ce34be.322a7840-ccb7-4893-9500-99e30b9315b0 1G {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:10:08 devstack sudo[101153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-0d6b7a18-9e66-4a3e-9c18-bb41c8ce34be,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-0d6b7a18-9e66-4a3e-9c18-bb41c8ce34be.322a7840-ccb7-4893-9500-99e30b9315b0 1G Sep 07 10:10:08 devstack sudo[101153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:10:09 devstack sudo[101153]: pam_unix(sudo:session): session closed for user root Sep 07 10:10:09 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-9c544e6f-3290-4071-8bb4-ccb33e34cb67 tempest-VolumesExtendTest-430807235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-0d6b7a18-9e66-4a3e-9c18-bb41c8ce34be,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-0d6b7a18-9e66-4a3e-9c18-bb41c8ce34be.322a7840-ccb7-4893-9500-99e30b9315b0 1G" returned: 0 in 0.541s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:10:09 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-9c544e6f-3290-4071-8bb4-ccb33e34cb67 tempest-VolumesExtendTest-430807235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0d6b7a18-9e66-4a3e-9c18-bb41c8ce34be -F qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-0d6b7a18-9e66-4a3e-9c18-bb41c8ce34be.322a7840-ccb7-4893-9500-99e30b9315b0 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:10:09 devstack sudo[101160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0d6b7a18-9e66-4a3e-9c18-bb41c8ce34be -F qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-0d6b7a18-9e66-4a3e-9c18-bb41c8ce34be.322a7840-ccb7-4893-9500-99e30b9315b0 Sep 07 10:10:09 devstack sudo[101160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:10:09 devstack sudo[101160]: pam_unix(sudo:session): session closed for user root Sep 07 10:10:09 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-9c544e6f-3290-4071-8bb4-ccb33e34cb67 tempest-VolumesExtendTest-430807235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0d6b7a18-9e66-4a3e-9c18-bb41c8ce34be -F qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-0d6b7a18-9e66-4a3e-9c18-bb41c8ce34be.322a7840-ccb7-4893-9500-99e30b9315b0" returned: 0 in 0.400s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:10:09 devstack cinder-volume[87515]: WARNING cinder.volume.drivers.remotefs [None req-9c544e6f-3290-4071-8bb4-ccb33e34cb67 tempest-VolumesExtendTest-430807235 None] /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-0d6b7a18-9e66-4a3e-9c18-bb41c8ce34be.322a7840-ccb7-4893-9500-99e30b9315b0 is being set with open permissions: ugo+rw Sep 07 10:10:09 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-9c544e6f-3290-4071-8bb4-ccb33e34cb67 tempest-VolumesExtendTest-430807235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-0d6b7a18-9e66-4a3e-9c18-bb41c8ce34be.322a7840-ccb7-4893-9500-99e30b9315b0 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:10:09 devstack sudo[101167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-0d6b7a18-9e66-4a3e-9c18-bb41c8ce34be.322a7840-ccb7-4893-9500-99e30b9315b0 Sep 07 10:10:09 devstack sudo[101167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:10:09 devstack sudo[101167]: pam_unix(sudo:session): session closed for user root Sep 07 10:10:09 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-9c544e6f-3290-4071-8bb4-ccb33e34cb67 tempest-VolumesExtendTest-430807235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-0d6b7a18-9e66-4a3e-9c18-bb41c8ce34be.322a7840-ccb7-4893-9500-99e30b9315b0" returned: 0 in 0.307s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:10:09 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-9c544e6f-3290-4071-8bb4-ccb33e34cb67 tempest-VolumesExtendTest-430807235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-0d6b7a18-9e66-4a3e-9c18-bb41c8ce34be.info {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:10:10 devstack sudo[101171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-0d6b7a18-9e66-4a3e-9c18-bb41c8ce34be.info Sep 07 10:10:10 devstack sudo[101171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:10:10 devstack sudo[101171]: pam_unix(sudo:session): session closed for user root Sep 07 10:10:10 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-9c544e6f-3290-4071-8bb4-ccb33e34cb67 tempest-VolumesExtendTest-430807235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-0d6b7a18-9e66-4a3e-9c18-bb41c8ce34be.info" returned: 0 in 0.346s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:10:10 devstack cinder-volume[87515]: WARNING cinder.volume.drivers.remotefs [None req-9c544e6f-3290-4071-8bb4-ccb33e34cb67 tempest-VolumesExtendTest-430807235 None] /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-0d6b7a18-9e66-4a3e-9c18-bb41c8ce34be.info is being set with open permissions: ugo+rw Sep 07 10:10:10 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-9c544e6f-3290-4071-8bb4-ccb33e34cb67 tempest-VolumesExtendTest-430807235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-0d6b7a18-9e66-4a3e-9c18-bb41c8ce34be.info {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:10:10 devstack sudo[101174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-0d6b7a18-9e66-4a3e-9c18-bb41c8ce34be.info Sep 07 10:10:10 devstack sudo[101174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:10:10 devstack sudo[101174]: pam_unix(sudo:session): session closed for user root Sep 07 10:10:10 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-9c544e6f-3290-4071-8bb4-ccb33e34cb67 tempest-VolumesExtendTest-430807235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-0d6b7a18-9e66-4a3e-9c18-bb41c8ce34be.info" returned: 0 in 0.254s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:10:10 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-9c544e6f-3290-4071-8bb4-ccb33e34cb67 tempest-VolumesExtendTest-430807235 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.391s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:10:10 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-9c544e6f-3290-4071-8bb4-ccb33e34cb67 tempest-VolumesExtendTest-430807235 None] Create snapshot completed successfully Sep 07 10:10:11 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-6635eca9-40ca-4cc7-a537-1b02d3ff9e0f tempest-VolumesExtendTest-430807235 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:10:11 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-6635eca9-40ca-4cc7-a537-1b02d3ff9e0f tempest-VolumesExtendTest-430807235 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.002s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:10:11 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0e3d6e2-0f84-427d-96b5-4997b84fcda3]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:10:11 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-6635eca9-40ca-4cc7-a537-1b02d3ff9e0f tempest-VolumesExtendTest-430807235 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-0d6b7a18-9e66-4a3e-9c18-bb41c8ce34be {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:10:11 devstack cinder-volume[87515]: DEBUG oslo_service.periodic_task [None req-cebd6a9d-3073-42a1-b65a-b38d444d85ed None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87515) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 10:10:11 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-cebd6a9d-3073-42a1-b65a-b38d444d85ed None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:10:11 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-cebd6a9d-3073-42a1-b65a-b38d444d85ed None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:10:11 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-cebd6a9d-3073-42a1-b65a-b38d444d85ed None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:10:11 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-cebd6a9d-3073-42a1-b65a-b38d444d85ed None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:10:11 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-cebd6a9d-3073-42a1-b65a-b38d444d85ed None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:10:11 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-cebd6a9d-3073-42a1-b65a-b38d444d85ed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:10:11 devstack sudo[101178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a Sep 07 10:10:11 devstack sudo[101178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:10:11 devstack sudo[101177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-0d6b7a18-9e66-4a3e-9c18-bb41c8ce34be Sep 07 10:10:11 devstack sudo[101177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:10:11 devstack sudo[101178]: pam_unix(sudo:session): session closed for user root Sep 07 10:10:11 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-cebd6a9d-3073-42a1-b65a-b38d444d85ed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a" returned: 0 in 0.321s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:10:11 devstack cinder-volume[87515]: DEBUG cinder.manager [None req-cebd6a9d-3073-42a1-b65a-b38d444d85ed None None] Notifying Schedulers of capabilities ... {{(pid=87515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:10:11 devstack cinder-volume[87515]: DEBUG oslo_service.periodic_task [None req-cebd6a9d-3073-42a1-b65a-b38d444d85ed None None] Running periodic task VolumeManager._thread_info {{(pid=87515) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 10:10:11 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-cebd6a9d-3073-42a1-b65a-b38d444d85ed None None] thread count: 29 {{(pid=87515) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 07 10:10:11 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-cebd6a9d-3073-42a1-b65a-b38d444d85ed None None] thread info: [<_MainThread(MainThread, started 131647121809536)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87515) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 07 10:10:11 devstack sudo[101177]: pam_unix(sudo:session): session closed for user root Sep 07 10:10:11 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-6635eca9-40ca-4cc7-a537-1b02d3ff9e0f tempest-VolumesExtendTest-430807235 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-0d6b7a18-9e66-4a3e-9c18-bb41c8ce34be" returned: 0 in 0.449s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:10:11 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-6635eca9-40ca-4cc7-a537-1b02d3ff9e0f tempest-VolumesExtendTest-430807235 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-0d6b7a18-9e66-4a3e-9c18-bb41c8ce34be.322a7840-ccb7-4893-9500-99e30b9315b0 2G {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:10:12 devstack cinder-volume[87515]: DEBUG cinder.volume.flows.manager.create_volume [None req-92746d40-7b65-4c33-9779-17561e21e3e1 tempest-SnapshotMetadataTestJSON-769140256 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 10:10:12 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-92746d40-7b65-4c33-9779-17561e21e3e1 tempest-SnapshotMetadataTestJSON-769140256 None] Flow 'volume_create_manager' (9809e471-29d2-47cb-9c43-ed8b85db6a5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:10:12 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-92746d40-7b65-4c33-9779-17561e21e3e1 tempest-SnapshotMetadataTestJSON-769140256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1bd2afa-e24c-41d4-9841-938bbfdb67f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:10:12 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-6635eca9-40ca-4cc7-a537-1b02d3ff9e0f tempest-VolumesExtendTest-430807235 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-0d6b7a18-9e66-4a3e-9c18-bb41c8ce34be.322a7840-ccb7-4893-9500-99e30b9315b0 2G" returned: 0 in 0.162s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:10:12 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-6635eca9-40ca-4cc7-a537-1b02d3ff9e0f tempest-VolumesExtendTest-430807235 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.657s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:10:12 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-92746d40-7b65-4c33-9779-17561e21e3e1 tempest-SnapshotMetadataTestJSON-769140256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1bd2afa-e24c-41d4-9841-938bbfdb67f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:10:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1184146483',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c1000d7-5276-495d-8c88-dc292e32d161,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='77da6ef5d0854cacbff503efe269d73b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:10:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:10:12Z,use_quota=True,user_id='e71cb6c347b249faa4937072b5c8769c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3a092cd-7947-4cbf-abff-4ba9567becf0),volume_type_id=f3a092cd-7947-4cbf-abff-4ba9567becf0)' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:10:12 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-92746d40-7b65-4c33-9779-17561e21e3e1 tempest-SnapshotMetadataTestJSON-769140256 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f92fb41-9aed-4dce-9d32-839e8669410c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:10:12 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-92746d40-7b65-4c33-9779-17561e21e3e1 tempest-SnapshotMetadataTestJSON-769140256 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f92fb41-9aed-4dce-9d32-839e8669410c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:10:12 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-92746d40-7b65-4c33-9779-17561e21e3e1 tempest-SnapshotMetadataTestJSON-769140256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f74b9a93-fad4-4cb7-9024-a0101f043de3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:10:12 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-92746d40-7b65-4c33-9779-17561e21e3e1 tempest-SnapshotMetadataTestJSON-769140256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f74b9a93-fad4-4cb7-9024-a0101f043de3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5c1000d7-5276-495d-8c88-dc292e32d161', 'volume_name': 'volume-5c1000d7-5276-495d-8c88-dc292e32d161', 'volume_size': 1}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:10:12 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-92746d40-7b65-4c33-9779-17561e21e3e1 tempest-SnapshotMetadataTestJSON-769140256 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8342663e-78df-4279-b9b8-261a0cddf62e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:10:12 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-92746d40-7b65-4c33-9779-17561e21e3e1 tempest-SnapshotMetadataTestJSON-769140256 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8342663e-78df-4279-b9b8-261a0cddf62e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:10:12 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-92746d40-7b65-4c33-9779-17561e21e3e1 tempest-SnapshotMetadataTestJSON-769140256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed80e381-0afc-4fcb-8294-6c4d408438b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:10:12 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-92746d40-7b65-4c33-9779-17561e21e3e1 tempest-SnapshotMetadataTestJSON-769140256 None] Volume 5c1000d7-5276-495d-8c88-dc292e32d161: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5c1000d7-5276-495d-8c88-dc292e32d161', 'volume_size': 1} Sep 07 10:10:12 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-92746d40-7b65-4c33-9779-17561e21e3e1 tempest-SnapshotMetadataTestJSON-769140256 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:10:12 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-92746d40-7b65-4c33-9779-17561e21e3e1 tempest-SnapshotMetadataTestJSON-769140256 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:10:12 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-92746d40-7b65-4c33-9779-17561e21e3e1 tempest-SnapshotMetadataTestJSON-769140256 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:10:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1184146483',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c1000d7-5276-495d-8c88-dc292e32d161,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='77da6ef5d0854cacbff503efe269d73b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:10:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:10:12Z,use_quota=True,user_id='e71cb6c347b249faa4937072b5c8769c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3a092cd-7947-4cbf-abff-4ba9567becf0),volume_type_id=f3a092cd-7947-4cbf-abff-4ba9567becf0)}" {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 10:10:12 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-92746d40-7b65-4c33-9779-17561e21e3e1 tempest-SnapshotMetadataTestJSON-769140256 None] Creating volume 5c1000d7-5276-495d-8c88-dc292e32d161 {{(pid=87515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 10:10:12 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-92746d40-7b65-4c33-9779-17561e21e3e1 tempest-SnapshotMetadataTestJSON-769140256 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:10:12 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-92746d40-7b65-4c33-9779-17561e21e3e1 tempest-SnapshotMetadataTestJSON-769140256 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:10:12 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-92746d40-7b65-4c33-9779-17561e21e3e1 tempest-SnapshotMetadataTestJSON-769140256 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:10:12 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-92746d40-7b65-4c33-9779-17561e21e3e1 tempest-SnapshotMetadataTestJSON-769140256 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:10:12 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-92746d40-7b65-4c33-9779-17561e21e3e1 tempest-SnapshotMetadataTestJSON-769140256 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:10:12 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-92746d40-7b65-4c33-9779-17561e21e3e1 tempest-SnapshotMetadataTestJSON-769140256 None] Selected osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c as target Quobyte volume. {{(pid=87515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 10:10:12 devstack cinder-volume[87515]: INFO cinder.volume.drivers.remotefs [None req-92746d40-7b65-4c33-9779-17561e21e3e1 tempest-SnapshotMetadataTestJSON-769140256 None] casted to osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c Sep 07 10:10:12 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-92746d40-7b65-4c33-9779-17561e21e3e1 tempest-SnapshotMetadataTestJSON-769140256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-5c1000d7-5276-495d-8c88-dc292e32d161 1073741824 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:10:12 devstack sudo[101188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-5c1000d7-5276-495d-8c88-dc292e32d161 1073741824 Sep 07 10:10:12 devstack sudo[101188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:10:12 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-6635eca9-40ca-4cc7-a537-1b02d3ff9e0f tempest-VolumesExtendTest-430807235 None] Extend volume completed successfully. Sep 07 10:10:12 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-14477ec8-08e3-40ec-9c36-05e3595f8978 tempest-TestServerVolumeAttachmentScenario-1829138586 None] Acquiring lock "cinder-63322935-468a-400c-8a29-86201154a482-delete_volume" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:10:12 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-14477ec8-08e3-40ec-9c36-05e3595f8978 tempest-TestServerVolumeAttachmentScenario-1829138586 None] Lock "cinder-63322935-468a-400c-8a29-86201154a482-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:10:12 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-14477ec8-08e3-40ec-9c36-05e3595f8978 tempest-TestServerVolumeAttachmentScenario-1829138586 None] Acquiring lock "cinder-quobyte-63322935-468a-400c-8a29-86201154a482" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:10:12 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-14477ec8-08e3-40ec-9c36-05e3595f8978 tempest-TestServerVolumeAttachmentScenario-1829138586 None] Lock "cinder-quobyte-63322935-468a-400c-8a29-86201154a482" acquired by "delete_volume" :: waited 0.027s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:10:12 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[fff7c4db-b12b-4e0b-b645-bd8e00575c69]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:10:12 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-14477ec8-08e3-40ec-9c36-05e3595f8978 tempest-TestServerVolumeAttachmentScenario-1829138586 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-63322935-468a-400c-8a29-86201154a482 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:10:12 devstack sudo[101188]: pam_unix(sudo:session): session closed for user root Sep 07 10:10:12 devstack sudo[101197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-63322935-468a-400c-8a29-86201154a482 Sep 07 10:10:12 devstack sudo[101197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:10:12 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-0a8c414c-7cdf-49a5-ade0-3d169e4ceec7 tempest-VolumesExtendTest-430807235 None] Acquiring lock "cinder-322a7840-ccb7-4893-9500-99e30b9315b0-delete_snapshot" by "delete_snapshot" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:10:12 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-92746d40-7b65-4c33-9779-17561e21e3e1 tempest-SnapshotMetadataTestJSON-769140256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-5c1000d7-5276-495d-8c88-dc292e32d161 1073741824" returned: 0 in 0.547s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:10:12 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-0a8c414c-7cdf-49a5-ade0-3d169e4ceec7 tempest-VolumesExtendTest-430807235 None] Lock "cinder-322a7840-ccb7-4893-9500-99e30b9315b0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:10:12 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-0a8c414c-7cdf-49a5-ade0-3d169e4ceec7 tempest-VolumesExtendTest-430807235 None] Acquiring lock "cinder-quobyte-0d6b7a18-9e66-4a3e-9c18-bb41c8ce34be" by "delete_snapshot" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:10:12 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-0a8c414c-7cdf-49a5-ade0-3d169e4ceec7 tempest-VolumesExtendTest-430807235 None] Lock "cinder-quobyte-0d6b7a18-9e66-4a3e-9c18-bb41c8ce34be" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:10:12 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-0a8c414c-7cdf-49a5-ade0-3d169e4ceec7 tempest-VolumesExtendTest-430807235 None] Acquiring lock "cinder-quobyte-322a7840-ccb7-4893-9500-99e30b9315b0" by "_delete_snapshot" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:10:12 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-92746d40-7b65-4c33-9779-17561e21e3e1 tempest-SnapshotMetadataTestJSON-769140256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-5c1000d7-5276-495d-8c88-dc292e32d161 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:10:12 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-0a8c414c-7cdf-49a5-ade0-3d169e4ceec7 tempest-VolumesExtendTest-430807235 None] Lock "cinder-quobyte-322a7840-ccb7-4893-9500-99e30b9315b0" acquired by "_delete_snapshot" :: waited 0.038s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:10:12 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-0a8c414c-7cdf-49a5-ade0-3d169e4ceec7 tempest-VolumesExtendTest-430807235 None] Deleting offline snapshot 322a7840-ccb7-4893-9500-99e30b9315b0 of volume 0d6b7a18-9e66-4a3e-9c18-bb41c8ce34be {{(pid=87515) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 10:10:12 devstack sudo[101199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-5c1000d7-5276-495d-8c88-dc292e32d161 Sep 07 10:10:12 devstack sudo[101199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:10:12 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-0a8c414c-7cdf-49a5-ade0-3d169e4ceec7 tempest-VolumesExtendTest-430807235 None] snapshot_file for this snap is: volume-0d6b7a18-9e66-4a3e-9c18-bb41c8ce34be.322a7840-ccb7-4893-9500-99e30b9315b0 {{(pid=87515) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 10:10:12 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c66d2f8-79bf-42f2-a6c2-e0f5da5dfb35]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:10:12 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-0a8c414c-7cdf-49a5-ade0-3d169e4ceec7 tempest-VolumesExtendTest-430807235 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-0d6b7a18-9e66-4a3e-9c18-bb41c8ce34be.322a7840-ccb7-4893-9500-99e30b9315b0 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:10:13 devstack sudo[101201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-0d6b7a18-9e66-4a3e-9c18-bb41c8ce34be.322a7840-ccb7-4893-9500-99e30b9315b0 Sep 07 10:10:13 devstack sudo[101201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:10:13 devstack sudo[101197]: pam_unix(sudo:session): session closed for user root Sep 07 10:10:13 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-14477ec8-08e3-40ec-9c36-05e3595f8978 tempest-TestServerVolumeAttachmentScenario-1829138586 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-63322935-468a-400c-8a29-86201154a482" returned: 0 in 0.418s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:10:13 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-14477ec8-08e3-40ec-9c36-05e3595f8978 tempest-TestServerVolumeAttachmentScenario-1829138586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-63322935-468a-400c-8a29-86201154a482 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:10:13 devstack sudo[101207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-63322935-468a-400c-8a29-86201154a482 Sep 07 10:10:13 devstack sudo[101207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:10:13 devstack sudo[101199]: pam_unix(sudo:session): session closed for user root Sep 07 10:10:13 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-92746d40-7b65-4c33-9779-17561e21e3e1 tempest-SnapshotMetadataTestJSON-769140256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-5c1000d7-5276-495d-8c88-dc292e32d161" returned: 0 in 0.259s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:10:13 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-92746d40-7b65-4c33-9779-17561e21e3e1 tempest-SnapshotMetadataTestJSON-769140256 None] <== create_volume: return (884ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'} {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 10:10:13 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-92746d40-7b65-4c33-9779-17561e21e3e1 tempest-SnapshotMetadataTestJSON-769140256 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.886s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:10:13 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-92746d40-7b65-4c33-9779-17561e21e3e1 tempest-SnapshotMetadataTestJSON-769140256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed80e381-0afc-4fcb-8294-6c4d408438b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5c1000d7-5276-495d-8c88-dc292e32d161', 'volume_size': 1}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:10:13 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-92746d40-7b65-4c33-9779-17561e21e3e1 tempest-SnapshotMetadataTestJSON-769140256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76d655ff-d3be-4400-85f4-044f2ec53868) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:10:13 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-92746d40-7b65-4c33-9779-17561e21e3e1 tempest-SnapshotMetadataTestJSON-769140256 None] Volume volume-5c1000d7-5276-495d-8c88-dc292e32d161 (5c1000d7-5276-495d-8c88-dc292e32d161): created successfully Sep 07 10:10:13 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-92746d40-7b65-4c33-9779-17561e21e3e1 tempest-SnapshotMetadataTestJSON-769140256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76d655ff-d3be-4400-85f4-044f2ec53868) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:10:13 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-92746d40-7b65-4c33-9779-17561e21e3e1 tempest-SnapshotMetadataTestJSON-769140256 None] Flow 'volume_create_manager' (9809e471-29d2-47cb-9c43-ed8b85db6a5f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:10:13 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-92746d40-7b65-4c33-9779-17561e21e3e1 tempest-SnapshotMetadataTestJSON-769140256 None] Created volume successfully. Sep 07 10:10:13 devstack sudo[101201]: pam_unix(sudo:session): session closed for user root Sep 07 10:10:13 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-0a8c414c-7cdf-49a5-ade0-3d169e4ceec7 tempest-VolumesExtendTest-430807235 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-0d6b7a18-9e66-4a3e-9c18-bb41c8ce34be.322a7840-ccb7-4893-9500-99e30b9315b0" returned: 0 in 0.389s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:10:13 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-0a8c414c-7cdf-49a5-ade0-3d169e4ceec7 tempest-VolumesExtendTest-430807235 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0d6b7a18-9e66-4a3e-9c18-bb41c8ce34be(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87515) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 10:10:13 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[10ca4708-5f74-49df-be7e-ba5f03006954]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:10:13 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-0a8c414c-7cdf-49a5-ade0-3d169e4ceec7 tempest-VolumesExtendTest-430807235 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-0d6b7a18-9e66-4a3e-9c18-bb41c8ce34be {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:10:13 devstack sudo[101207]: pam_unix(sudo:session): session closed for user root Sep 07 10:10:13 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-14477ec8-08e3-40ec-9c36-05e3595f8978 tempest-TestServerVolumeAttachmentScenario-1829138586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-63322935-468a-400c-8a29-86201154a482" returned: 0 in 0.287s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:10:13 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-14477ec8-08e3-40ec-9c36-05e3595f8978 tempest-TestServerVolumeAttachmentScenario-1829138586 None] Lock "cinder-quobyte-63322935-468a-400c-8a29-86201154a482" released by "delete_volume" :: held 0.760s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:10:13 devstack cinder-volume[87515]: DEBUG cinder.quota [None req-14477ec8-08e3-40ec-9c36-05e3595f8978 tempest-TestServerVolumeAttachmentScenario-1829138586 None] Created reservations ['66bd6ccb-ffba-40ac-b868-f6ff17100c58', 'b7c6568f-fe78-42d2-9616-55e3ee0c5c8b', 'bf218313-9f4b-41ac-8922-6117ecfe814e', 'e37623d1-e3fc-40d4-a5cd-a2c13426d4d5'] {{(pid=87515) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:10:13 devstack sudo[101214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-0d6b7a18-9e66-4a3e-9c18-bb41c8ce34be Sep 07 10:10:13 devstack sudo[101214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:10:13 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-14477ec8-08e3-40ec-9c36-05e3595f8978 tempest-TestServerVolumeAttachmentScenario-1829138586 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:10:13 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-14477ec8-08e3-40ec-9c36-05e3595f8978 tempest-TestServerVolumeAttachmentScenario-1829138586 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:10:13 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-14477ec8-08e3-40ec-9c36-05e3595f8978 tempest-TestServerVolumeAttachmentScenario-1829138586 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:10:13 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-14477ec8-08e3-40ec-9c36-05e3595f8978 tempest-TestServerVolumeAttachmentScenario-1829138586 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:10:13 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-14477ec8-08e3-40ec-9c36-05e3595f8978 tempest-TestServerVolumeAttachmentScenario-1829138586 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:10:13 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-14477ec8-08e3-40ec-9c36-05e3595f8978 tempest-TestServerVolumeAttachmentScenario-1829138586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:10:13 devstack sudo[101216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a Sep 07 10:10:13 devstack sudo[101216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:10:13 devstack sudo[101214]: pam_unix(sudo:session): session closed for user root Sep 07 10:10:13 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-7fd885bc-1e1c-4889-8cc7-1b0b68aa3821 tempest-TestServerVolumeAttachmentScenario-1829138586 None] Acquiring lock "cinder-ec5ef6cb-bd26-4ec4-b3fc-061bdf60d1b9-delete_volume" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:10:13 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-0a8c414c-7cdf-49a5-ade0-3d169e4ceec7 tempest-VolumesExtendTest-430807235 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-0d6b7a18-9e66-4a3e-9c18-bb41c8ce34be" returned: 0 in 0.395s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:10:13 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-0a8c414c-7cdf-49a5-ade0-3d169e4ceec7 tempest-VolumesExtendTest-430807235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-0d6b7a18-9e66-4a3e-9c18-bb41c8ce34be.322a7840-ccb7-4893-9500-99e30b9315b0 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:10:13 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-7fd885bc-1e1c-4889-8cc7-1b0b68aa3821 tempest-TestServerVolumeAttachmentScenario-1829138586 None] Lock "cinder-ec5ef6cb-bd26-4ec4-b3fc-061bdf60d1b9-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:10:13 devstack sudo[101216]: pam_unix(sudo:session): session closed for user root Sep 07 10:10:13 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-14477ec8-08e3-40ec-9c36-05e3595f8978 tempest-TestServerVolumeAttachmentScenario-1829138586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a" returned: 0 in 0.271s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:10:13 devstack cinder-volume[87515]: DEBUG cinder.manager [None req-14477ec8-08e3-40ec-9c36-05e3595f8978 tempest-TestServerVolumeAttachmentScenario-1829138586 None] Notifying Schedulers of capabilities ... {{(pid=87515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:10:13 devstack sudo[101223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-0d6b7a18-9e66-4a3e-9c18-bb41c8ce34be.322a7840-ccb7-4893-9500-99e30b9315b0 Sep 07 10:10:13 devstack sudo[101223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:10:13 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-14477ec8-08e3-40ec-9c36-05e3595f8978 tempest-TestServerVolumeAttachmentScenario-1829138586 None] Deleted volume successfully. Sep 07 10:10:13 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-14477ec8-08e3-40ec-9c36-05e3595f8978 tempest-TestServerVolumeAttachmentScenario-1829138586 None] Lock "cinder-63322935-468a-400c-8a29-86201154a482-delete_volume" released by "delete_volume" :: held 1.273s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:10:13 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-7fd885bc-1e1c-4889-8cc7-1b0b68aa3821 tempest-TestServerVolumeAttachmentScenario-1829138586 None] Acquiring lock "cinder-quobyte-ec5ef6cb-bd26-4ec4-b3fc-061bdf60d1b9" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:10:13 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-7fd885bc-1e1c-4889-8cc7-1b0b68aa3821 tempest-TestServerVolumeAttachmentScenario-1829138586 None] Lock "cinder-quobyte-ec5ef6cb-bd26-4ec4-b3fc-061bdf60d1b9" acquired by "delete_volume" :: waited 0.014s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:10:13 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f167037-1a41-45e7-a55f-242dc07cf77e]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:10:13 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-7fd885bc-1e1c-4889-8cc7-1b0b68aa3821 tempest-TestServerVolumeAttachmentScenario-1829138586 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-ec5ef6cb-bd26-4ec4-b3fc-061bdf60d1b9 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:10:13 devstack sudo[101225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-ec5ef6cb-bd26-4ec4-b3fc-061bdf60d1b9 Sep 07 10:10:13 devstack sudo[101225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:10:14 devstack sudo[101223]: pam_unix(sudo:session): session closed for user root Sep 07 10:10:14 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-0a8c414c-7cdf-49a5-ade0-3d169e4ceec7 tempest-VolumesExtendTest-430807235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-0d6b7a18-9e66-4a3e-9c18-bb41c8ce34be.322a7840-ccb7-4893-9500-99e30b9315b0" returned: 0 in 0.383s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:10:14 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-0a8c414c-7cdf-49a5-ade0-3d169e4ceec7 tempest-VolumesExtendTest-430807235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-0d6b7a18-9e66-4a3e-9c18-bb41c8ce34be.322a7840-ccb7-4893-9500-99e30b9315b0 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:10:14 devstack sudo[101230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-0d6b7a18-9e66-4a3e-9c18-bb41c8ce34be.322a7840-ccb7-4893-9500-99e30b9315b0 Sep 07 10:10:14 devstack sudo[101230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:10:14 devstack sudo[101225]: pam_unix(sudo:session): session closed for user root Sep 07 10:10:14 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-7fd885bc-1e1c-4889-8cc7-1b0b68aa3821 tempest-TestServerVolumeAttachmentScenario-1829138586 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-ec5ef6cb-bd26-4ec4-b3fc-061bdf60d1b9" returned: 0 in 0.395s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:10:14 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-7fd885bc-1e1c-4889-8cc7-1b0b68aa3821 tempest-TestServerVolumeAttachmentScenario-1829138586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-ec5ef6cb-bd26-4ec4-b3fc-061bdf60d1b9 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:10:14 devstack sudo[101235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-ec5ef6cb-bd26-4ec4-b3fc-061bdf60d1b9 Sep 07 10:10:14 devstack sudo[101235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:10:14 devstack sudo[101230]: pam_unix(sudo:session): session closed for user root Sep 07 10:10:14 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-0a8c414c-7cdf-49a5-ade0-3d169e4ceec7 tempest-VolumesExtendTest-430807235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-0d6b7a18-9e66-4a3e-9c18-bb41c8ce34be.322a7840-ccb7-4893-9500-99e30b9315b0" returned: 0 in 0.279s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:10:14 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-02b9fd3c-7829-4a10-b03b-7572308f1597 tempest-SnapshotMetadataTestJSON-769140256 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:10:14 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-02b9fd3c-7829-4a10-b03b-7572308f1597 tempest-SnapshotMetadataTestJSON-769140256 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:10:14 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-0a8c414c-7cdf-49a5-ade0-3d169e4ceec7 tempest-VolumesExtendTest-430807235 None] Lock "cinder-quobyte-322a7840-ccb7-4893-9500-99e30b9315b0" released by "_delete_snapshot" :: held 1.570s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:10:14 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-0a8c414c-7cdf-49a5-ade0-3d169e4ceec7 tempest-VolumesExtendTest-430807235 None] Lock "cinder-quobyte-0d6b7a18-9e66-4a3e-9c18-bb41c8ce34be" released by "delete_snapshot" :: held 1.620s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:10:14 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-02b9fd3c-7829-4a10-b03b-7572308f1597 tempest-SnapshotMetadataTestJSON-769140256 None] Creating offline snapshot 16a80bfa-3407-40bf-b879-320ca0b4a6bc of volume 5c1000d7-5276-495d-8c88-dc292e32d161 {{(pid=87515) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 10:10:14 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[29611d94-e0bb-44e5-ab5f-f2a4474be36f]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:10:14 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-02b9fd3c-7829-4a10-b03b-7572308f1597 tempest-SnapshotMetadataTestJSON-769140256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-5c1000d7-5276-495d-8c88-dc292e32d161 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:10:14 devstack sudo[101235]: pam_unix(sudo:session): session closed for user root Sep 07 10:10:14 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-7fd885bc-1e1c-4889-8cc7-1b0b68aa3821 tempest-TestServerVolumeAttachmentScenario-1829138586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-ec5ef6cb-bd26-4ec4-b3fc-061bdf60d1b9" returned: 0 in 0.275s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:10:14 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-7fd885bc-1e1c-4889-8cc7-1b0b68aa3821 tempest-TestServerVolumeAttachmentScenario-1829138586 None] Lock "cinder-quobyte-ec5ef6cb-bd26-4ec4-b3fc-061bdf60d1b9" released by "delete_volume" :: held 0.717s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:10:14 devstack cinder-volume[87515]: DEBUG cinder.quota [None req-0a8c414c-7cdf-49a5-ade0-3d169e4ceec7 tempest-VolumesExtendTest-430807235 None] Created reservations ['2c286d30-649c-4ed8-ae21-3bdb38d9d548', 'c04983a9-94f4-4316-a69e-82672a58bb0e', 'f32f9298-67d6-4a84-9802-609fb6d407fc', '37a89ff6-2392-48b1-95d0-1c31e76421b5'] {{(pid=87515) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:10:14 devstack cinder-volume[87515]: DEBUG cinder.quota [None req-7fd885bc-1e1c-4889-8cc7-1b0b68aa3821 tempest-TestServerVolumeAttachmentScenario-1829138586 None] Created reservations ['84a65e18-2b0a-4e1b-9737-23eca263aef5', '3cd2c14f-13da-4cb7-b26a-f88c6779bfd1', 'e5bfeb83-537e-4c01-bd1b-87b4d7d7ef7c', 'd9320afc-4910-4dc0-8fcc-7e1ce2bdf7db'] {{(pid=87515) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:10:14 devstack sudo[101239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-5c1000d7-5276-495d-8c88-dc292e32d161 Sep 07 10:10:14 devstack sudo[101239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:10:14 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-0a8c414c-7cdf-49a5-ade0-3d169e4ceec7 tempest-VolumesExtendTest-430807235 None] Delete snapshot completed successfully. Sep 07 10:10:14 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-0a8c414c-7cdf-49a5-ade0-3d169e4ceec7 tempest-VolumesExtendTest-430807235 None] Lock "cinder-322a7840-ccb7-4893-9500-99e30b9315b0-delete_snapshot" released by "delete_snapshot" :: held 1.824s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:10:14 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-7fd885bc-1e1c-4889-8cc7-1b0b68aa3821 tempest-TestServerVolumeAttachmentScenario-1829138586 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:10:14 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-7fd885bc-1e1c-4889-8cc7-1b0b68aa3821 tempest-TestServerVolumeAttachmentScenario-1829138586 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:10:14 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-7fd885bc-1e1c-4889-8cc7-1b0b68aa3821 tempest-TestServerVolumeAttachmentScenario-1829138586 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:10:14 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-7fd885bc-1e1c-4889-8cc7-1b0b68aa3821 tempest-TestServerVolumeAttachmentScenario-1829138586 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:10:14 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-7fd885bc-1e1c-4889-8cc7-1b0b68aa3821 tempest-TestServerVolumeAttachmentScenario-1829138586 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:10:14 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-7fd885bc-1e1c-4889-8cc7-1b0b68aa3821 tempest-TestServerVolumeAttachmentScenario-1829138586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:10:14 devstack sudo[101241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a Sep 07 10:10:14 devstack sudo[101241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:10:14 devstack sudo[101239]: pam_unix(sudo:session): session closed for user root Sep 07 10:10:14 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-02b9fd3c-7829-4a10-b03b-7572308f1597 tempest-SnapshotMetadataTestJSON-769140256 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-5c1000d7-5276-495d-8c88-dc292e32d161" returned: 0 in 0.417s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:10:14 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-02b9fd3c-7829-4a10-b03b-7572308f1597 tempest-SnapshotMetadataTestJSON-769140256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-5c1000d7-5276-495d-8c88-dc292e32d161,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-5c1000d7-5276-495d-8c88-dc292e32d161.16a80bfa-3407-40bf-b879-320ca0b4a6bc 1G {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:10:14 devstack sudo[101247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-5c1000d7-5276-495d-8c88-dc292e32d161,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-5c1000d7-5276-495d-8c88-dc292e32d161.16a80bfa-3407-40bf-b879-320ca0b4a6bc 1G Sep 07 10:10:14 devstack sudo[101247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:10:14 devstack sudo[101241]: pam_unix(sudo:session): session closed for user root Sep 07 10:10:14 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-7fd885bc-1e1c-4889-8cc7-1b0b68aa3821 tempest-TestServerVolumeAttachmentScenario-1829138586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a" returned: 0 in 0.278s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:10:14 devstack cinder-volume[87515]: DEBUG cinder.manager [None req-7fd885bc-1e1c-4889-8cc7-1b0b68aa3821 tempest-TestServerVolumeAttachmentScenario-1829138586 None] Notifying Schedulers of capabilities ... {{(pid=87515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:10:14 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-7fd885bc-1e1c-4889-8cc7-1b0b68aa3821 tempest-TestServerVolumeAttachmentScenario-1829138586 None] Deleted volume successfully. Sep 07 10:10:14 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-7fd885bc-1e1c-4889-8cc7-1b0b68aa3821 tempest-TestServerVolumeAttachmentScenario-1829138586 None] Lock "cinder-ec5ef6cb-bd26-4ec4-b3fc-061bdf60d1b9-delete_volume" released by "delete_volume" :: held 1.238s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:10:15 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-54bedbb6-6475-4185-9291-b017dd1989cc tempest-VolumesExtendTest-430807235 None] Acquiring lock "cinder-0d6b7a18-9e66-4a3e-9c18-bb41c8ce34be-delete_volume" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:10:15 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-54bedbb6-6475-4185-9291-b017dd1989cc tempest-VolumesExtendTest-430807235 None] Lock "cinder-0d6b7a18-9e66-4a3e-9c18-bb41c8ce34be-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:10:15 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-54bedbb6-6475-4185-9291-b017dd1989cc tempest-VolumesExtendTest-430807235 None] Acquiring lock "cinder-quobyte-0d6b7a18-9e66-4a3e-9c18-bb41c8ce34be" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:10:15 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-54bedbb6-6475-4185-9291-b017dd1989cc tempest-VolumesExtendTest-430807235 None] Lock "cinder-quobyte-0d6b7a18-9e66-4a3e-9c18-bb41c8ce34be" acquired by "delete_volume" :: waited 0.020s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:10:15 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[da0590ae-3e38-414d-8510-7366b8586586]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:10:15 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-54bedbb6-6475-4185-9291-b017dd1989cc tempest-VolumesExtendTest-430807235 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-0d6b7a18-9e66-4a3e-9c18-bb41c8ce34be {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:10:15 devstack sudo[101251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-0d6b7a18-9e66-4a3e-9c18-bb41c8ce34be Sep 07 10:10:15 devstack sudo[101251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:10:15 devstack sudo[101247]: pam_unix(sudo:session): session closed for user root Sep 07 10:10:15 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-02b9fd3c-7829-4a10-b03b-7572308f1597 tempest-SnapshotMetadataTestJSON-769140256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-5c1000d7-5276-495d-8c88-dc292e32d161,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-5c1000d7-5276-495d-8c88-dc292e32d161.16a80bfa-3407-40bf-b879-320ca0b4a6bc 1G" returned: 0 in 0.503s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:10:15 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-02b9fd3c-7829-4a10-b03b-7572308f1597 tempest-SnapshotMetadataTestJSON-769140256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5c1000d7-5276-495d-8c88-dc292e32d161 -F qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-5c1000d7-5276-495d-8c88-dc292e32d161.16a80bfa-3407-40bf-b879-320ca0b4a6bc {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:10:15 devstack sudo[101255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5c1000d7-5276-495d-8c88-dc292e32d161 -F qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-5c1000d7-5276-495d-8c88-dc292e32d161.16a80bfa-3407-40bf-b879-320ca0b4a6bc Sep 07 10:10:15 devstack sudo[101255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:10:15 devstack sudo[101251]: pam_unix(sudo:session): session closed for user root Sep 07 10:10:15 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-54bedbb6-6475-4185-9291-b017dd1989cc tempest-VolumesExtendTest-430807235 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-0d6b7a18-9e66-4a3e-9c18-bb41c8ce34be" returned: 0 in 0.437s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:10:15 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-54bedbb6-6475-4185-9291-b017dd1989cc tempest-VolumesExtendTest-430807235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-0d6b7a18-9e66-4a3e-9c18-bb41c8ce34be {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:10:15 devstack sudo[101261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-0d6b7a18-9e66-4a3e-9c18-bb41c8ce34be Sep 07 10:10:15 devstack sudo[101261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:10:15 devstack sudo[101255]: pam_unix(sudo:session): session closed for user root Sep 07 10:10:15 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-02b9fd3c-7829-4a10-b03b-7572308f1597 tempest-SnapshotMetadataTestJSON-769140256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5c1000d7-5276-495d-8c88-dc292e32d161 -F qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-5c1000d7-5276-495d-8c88-dc292e32d161.16a80bfa-3407-40bf-b879-320ca0b4a6bc" returned: 0 in 0.337s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:10:15 devstack cinder-volume[87515]: WARNING cinder.volume.drivers.remotefs [None req-02b9fd3c-7829-4a10-b03b-7572308f1597 tempest-SnapshotMetadataTestJSON-769140256 None] /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-5c1000d7-5276-495d-8c88-dc292e32d161.16a80bfa-3407-40bf-b879-320ca0b4a6bc is being set with open permissions: ugo+rw Sep 07 10:10:15 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-02b9fd3c-7829-4a10-b03b-7572308f1597 tempest-SnapshotMetadataTestJSON-769140256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-5c1000d7-5276-495d-8c88-dc292e32d161.16a80bfa-3407-40bf-b879-320ca0b4a6bc {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:10:15 devstack sudo[101267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-5c1000d7-5276-495d-8c88-dc292e32d161.16a80bfa-3407-40bf-b879-320ca0b4a6bc Sep 07 10:10:15 devstack sudo[101267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:10:15 devstack sudo[101261]: pam_unix(sudo:session): session closed for user root Sep 07 10:10:15 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-54bedbb6-6475-4185-9291-b017dd1989cc tempest-VolumesExtendTest-430807235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-0d6b7a18-9e66-4a3e-9c18-bb41c8ce34be" returned: 0 in 0.282s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:10:15 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-54bedbb6-6475-4185-9291-b017dd1989cc tempest-VolumesExtendTest-430807235 None] Lock "cinder-quobyte-0d6b7a18-9e66-4a3e-9c18-bb41c8ce34be" released by "delete_volume" :: held 0.777s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:10:15 devstack cinder-volume[87515]: DEBUG cinder.quota [None req-54bedbb6-6475-4185-9291-b017dd1989cc tempest-VolumesExtendTest-430807235 None] Created reservations ['4a7ea822-6f82-4541-b720-a64ff440eb0a', '8d02d40e-e82e-440c-95ad-04cd99f42ad9', 'b91843b7-595d-40a3-9cd5-ebc13eefef25', 'f4e32228-fec1-4338-bf6e-c994b6a56f29'] {{(pid=87515) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:10:16 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-54bedbb6-6475-4185-9291-b017dd1989cc tempest-VolumesExtendTest-430807235 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:10:16 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-54bedbb6-6475-4185-9291-b017dd1989cc tempest-VolumesExtendTest-430807235 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:10:16 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-54bedbb6-6475-4185-9291-b017dd1989cc tempest-VolumesExtendTest-430807235 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:10:16 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-54bedbb6-6475-4185-9291-b017dd1989cc tempest-VolumesExtendTest-430807235 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:10:16 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-54bedbb6-6475-4185-9291-b017dd1989cc tempest-VolumesExtendTest-430807235 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:10:16 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-54bedbb6-6475-4185-9291-b017dd1989cc tempest-VolumesExtendTest-430807235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:10:16 devstack sudo[101267]: pam_unix(sudo:session): session closed for user root Sep 07 10:10:16 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-02b9fd3c-7829-4a10-b03b-7572308f1597 tempest-SnapshotMetadataTestJSON-769140256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-5c1000d7-5276-495d-8c88-dc292e32d161.16a80bfa-3407-40bf-b879-320ca0b4a6bc" returned: 0 in 0.312s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:10:16 devstack sudo[101271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a Sep 07 10:10:16 devstack sudo[101271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:10:16 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-02b9fd3c-7829-4a10-b03b-7572308f1597 tempest-SnapshotMetadataTestJSON-769140256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-5c1000d7-5276-495d-8c88-dc292e32d161.info {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:10:16 devstack sudo[101273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-5c1000d7-5276-495d-8c88-dc292e32d161.info Sep 07 10:10:16 devstack sudo[101273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:10:16 devstack sudo[101271]: pam_unix(sudo:session): session closed for user root Sep 07 10:10:16 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-54bedbb6-6475-4185-9291-b017dd1989cc tempest-VolumesExtendTest-430807235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a" returned: 0 in 0.273s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:10:16 devstack cinder-volume[87515]: DEBUG cinder.manager [None req-54bedbb6-6475-4185-9291-b017dd1989cc tempest-VolumesExtendTest-430807235 None] Notifying Schedulers of capabilities ... {{(pid=87515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:10:16 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-54bedbb6-6475-4185-9291-b017dd1989cc tempest-VolumesExtendTest-430807235 None] Deleted volume successfully. Sep 07 10:10:16 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-54bedbb6-6475-4185-9291-b017dd1989cc tempest-VolumesExtendTest-430807235 None] Lock "cinder-0d6b7a18-9e66-4a3e-9c18-bb41c8ce34be-delete_volume" released by "delete_volume" :: held 1.300s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:10:16 devstack sudo[101273]: pam_unix(sudo:session): session closed for user root Sep 07 10:10:16 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-02b9fd3c-7829-4a10-b03b-7572308f1597 tempest-SnapshotMetadataTestJSON-769140256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-5c1000d7-5276-495d-8c88-dc292e32d161.info" returned: 0 in 0.312s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:10:16 devstack cinder-volume[87515]: WARNING cinder.volume.drivers.remotefs [None req-02b9fd3c-7829-4a10-b03b-7572308f1597 tempest-SnapshotMetadataTestJSON-769140256 None] /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-5c1000d7-5276-495d-8c88-dc292e32d161.info is being set with open permissions: ugo+rw Sep 07 10:10:16 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-02b9fd3c-7829-4a10-b03b-7572308f1597 tempest-SnapshotMetadataTestJSON-769140256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-5c1000d7-5276-495d-8c88-dc292e32d161.info {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:10:16 devstack sudo[101277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-5c1000d7-5276-495d-8c88-dc292e32d161.info Sep 07 10:10:16 devstack sudo[101277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:10:16 devstack sudo[101277]: pam_unix(sudo:session): session closed for user root Sep 07 10:10:16 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-02b9fd3c-7829-4a10-b03b-7572308f1597 tempest-SnapshotMetadataTestJSON-769140256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-5c1000d7-5276-495d-8c88-dc292e32d161.info" returned: 0 in 0.307s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:10:16 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-02b9fd3c-7829-4a10-b03b-7572308f1597 tempest-SnapshotMetadataTestJSON-769140256 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.306s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:10:16 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-02b9fd3c-7829-4a10-b03b-7572308f1597 tempest-SnapshotMetadataTestJSON-769140256 None] Create snapshot completed successfully Sep 07 10:10:18 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-6c8d3034-0fe3-42f9-aafb-41533a01f08f tempest-SnapshotMetadataTestJSON-769140256 None] Acquiring lock "cinder-16a80bfa-3407-40bf-b879-320ca0b4a6bc-delete_snapshot" by "delete_snapshot" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:10:18 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-6c8d3034-0fe3-42f9-aafb-41533a01f08f tempest-SnapshotMetadataTestJSON-769140256 None] Lock "cinder-16a80bfa-3407-40bf-b879-320ca0b4a6bc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:10:18 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-6c8d3034-0fe3-42f9-aafb-41533a01f08f tempest-SnapshotMetadataTestJSON-769140256 None] Acquiring lock "cinder-quobyte-5c1000d7-5276-495d-8c88-dc292e32d161" by "delete_snapshot" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:10:18 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-6c8d3034-0fe3-42f9-aafb-41533a01f08f tempest-SnapshotMetadataTestJSON-769140256 None] Lock "cinder-quobyte-5c1000d7-5276-495d-8c88-dc292e32d161" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:10:18 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-6c8d3034-0fe3-42f9-aafb-41533a01f08f tempest-SnapshotMetadataTestJSON-769140256 None] Acquiring lock "cinder-quobyte-16a80bfa-3407-40bf-b879-320ca0b4a6bc" by "_delete_snapshot" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:10:18 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-6c8d3034-0fe3-42f9-aafb-41533a01f08f tempest-SnapshotMetadataTestJSON-769140256 None] Lock "cinder-quobyte-16a80bfa-3407-40bf-b879-320ca0b4a6bc" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:10:18 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-6c8d3034-0fe3-42f9-aafb-41533a01f08f tempest-SnapshotMetadataTestJSON-769140256 None] Deleting offline snapshot 16a80bfa-3407-40bf-b879-320ca0b4a6bc of volume 5c1000d7-5276-495d-8c88-dc292e32d161 {{(pid=87515) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 10:10:18 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-6c8d3034-0fe3-42f9-aafb-41533a01f08f tempest-SnapshotMetadataTestJSON-769140256 None] snapshot_file for this snap is: volume-5c1000d7-5276-495d-8c88-dc292e32d161.16a80bfa-3407-40bf-b879-320ca0b4a6bc {{(pid=87515) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 10:10:18 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b9c5e04-a36a-48b9-9412-7555f08c6198]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:10:18 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-6c8d3034-0fe3-42f9-aafb-41533a01f08f tempest-SnapshotMetadataTestJSON-769140256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-5c1000d7-5276-495d-8c88-dc292e32d161.16a80bfa-3407-40bf-b879-320ca0b4a6bc {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:10:18 devstack sudo[101281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-5c1000d7-5276-495d-8c88-dc292e32d161.16a80bfa-3407-40bf-b879-320ca0b4a6bc Sep 07 10:10:18 devstack sudo[101281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:10:19 devstack sudo[101281]: pam_unix(sudo:session): session closed for user root Sep 07 10:10:19 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-6c8d3034-0fe3-42f9-aafb-41533a01f08f tempest-SnapshotMetadataTestJSON-769140256 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-5c1000d7-5276-495d-8c88-dc292e32d161.16a80bfa-3407-40bf-b879-320ca0b4a6bc" returned: 0 in 0.478s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:10:19 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-6c8d3034-0fe3-42f9-aafb-41533a01f08f tempest-SnapshotMetadataTestJSON-769140256 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5c1000d7-5276-495d-8c88-dc292e32d161(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87515) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 10:10:19 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[52e4b2ec-35e3-468e-8b6c-3f60be17b8ab]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:10:19 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-6c8d3034-0fe3-42f9-aafb-41533a01f08f tempest-SnapshotMetadataTestJSON-769140256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-5c1000d7-5276-495d-8c88-dc292e32d161 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:10:19 devstack sudo[101287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-5c1000d7-5276-495d-8c88-dc292e32d161 Sep 07 10:10:19 devstack sudo[101287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:10:19 devstack sudo[101287]: pam_unix(sudo:session): session closed for user root Sep 07 10:10:19 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-6c8d3034-0fe3-42f9-aafb-41533a01f08f tempest-SnapshotMetadataTestJSON-769140256 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-5c1000d7-5276-495d-8c88-dc292e32d161" returned: 0 in 0.474s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:10:19 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-6c8d3034-0fe3-42f9-aafb-41533a01f08f tempest-SnapshotMetadataTestJSON-769140256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-5c1000d7-5276-495d-8c88-dc292e32d161.16a80bfa-3407-40bf-b879-320ca0b4a6bc {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:10:19 devstack sudo[101292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-5c1000d7-5276-495d-8c88-dc292e32d161.16a80bfa-3407-40bf-b879-320ca0b4a6bc Sep 07 10:10:19 devstack sudo[101292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:10:20 devstack sudo[101292]: pam_unix(sudo:session): session closed for user root Sep 07 10:10:20 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-6c8d3034-0fe3-42f9-aafb-41533a01f08f tempest-SnapshotMetadataTestJSON-769140256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-5c1000d7-5276-495d-8c88-dc292e32d161.16a80bfa-3407-40bf-b879-320ca0b4a6bc" returned: 0 in 0.448s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:10:20 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-6c8d3034-0fe3-42f9-aafb-41533a01f08f tempest-SnapshotMetadataTestJSON-769140256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-5c1000d7-5276-495d-8c88-dc292e32d161.16a80bfa-3407-40bf-b879-320ca0b4a6bc {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:10:20 devstack sudo[101299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-5c1000d7-5276-495d-8c88-dc292e32d161.16a80bfa-3407-40bf-b879-320ca0b4a6bc Sep 07 10:10:20 devstack sudo[101299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:10:20 devstack sudo[101299]: pam_unix(sudo:session): session closed for user root Sep 07 10:10:20 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-6c8d3034-0fe3-42f9-aafb-41533a01f08f tempest-SnapshotMetadataTestJSON-769140256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-5c1000d7-5276-495d-8c88-dc292e32d161.16a80bfa-3407-40bf-b879-320ca0b4a6bc" returned: 0 in 0.295s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:10:20 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-6c8d3034-0fe3-42f9-aafb-41533a01f08f tempest-SnapshotMetadataTestJSON-769140256 None] Lock "cinder-quobyte-16a80bfa-3407-40bf-b879-320ca0b4a6bc" released by "_delete_snapshot" :: held 1.846s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:10:20 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-6c8d3034-0fe3-42f9-aafb-41533a01f08f tempest-SnapshotMetadataTestJSON-769140256 None] Lock "cinder-quobyte-5c1000d7-5276-495d-8c88-dc292e32d161" released by "delete_snapshot" :: held 1.887s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:10:20 devstack cinder-volume[87515]: DEBUG cinder.quota [None req-6c8d3034-0fe3-42f9-aafb-41533a01f08f tempest-SnapshotMetadataTestJSON-769140256 None] Created reservations ['1e3d8335-fde5-4a8f-b6fa-62be7fa04575', 'af29a92b-3b9c-4089-bf03-bdbb039661b0', 'ef3565cd-e1b7-4265-af4f-a30307c5de1b', 'c9f618a1-892d-4129-ae0b-6febeb24ff2f'] {{(pid=87515) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:10:20 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-6c8d3034-0fe3-42f9-aafb-41533a01f08f tempest-SnapshotMetadataTestJSON-769140256 None] Delete snapshot completed successfully. Sep 07 10:10:20 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-6c8d3034-0fe3-42f9-aafb-41533a01f08f tempest-SnapshotMetadataTestJSON-769140256 None] Lock "cinder-16a80bfa-3407-40bf-b879-320ca0b4a6bc-delete_snapshot" released by "delete_snapshot" :: held 2.136s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:10:20 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-e6515979-f4df-416d-a7bd-3b6decf45a84 tempest-SnapshotMetadataTestJSON-769140256 None] Acquiring lock "cinder-5c1000d7-5276-495d-8c88-dc292e32d161-delete_volume" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:10:20 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-e6515979-f4df-416d-a7bd-3b6decf45a84 tempest-SnapshotMetadataTestJSON-769140256 None] Lock "cinder-5c1000d7-5276-495d-8c88-dc292e32d161-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:10:20 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-e6515979-f4df-416d-a7bd-3b6decf45a84 tempest-SnapshotMetadataTestJSON-769140256 None] Acquiring lock "cinder-quobyte-5c1000d7-5276-495d-8c88-dc292e32d161" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:10:20 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-e6515979-f4df-416d-a7bd-3b6decf45a84 tempest-SnapshotMetadataTestJSON-769140256 None] Lock "cinder-quobyte-5c1000d7-5276-495d-8c88-dc292e32d161" acquired by "delete_volume" :: waited 0.024s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:10:21 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3f85ef2-a5bd-4770-a7d8-ac107f69a5bd]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:10:21 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-e6515979-f4df-416d-a7bd-3b6decf45a84 tempest-SnapshotMetadataTestJSON-769140256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-5c1000d7-5276-495d-8c88-dc292e32d161 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:10:21 devstack sudo[101302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-5c1000d7-5276-495d-8c88-dc292e32d161 Sep 07 10:10:21 devstack sudo[101302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:10:21 devstack sudo[101302]: pam_unix(sudo:session): session closed for user root Sep 07 10:10:21 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-e6515979-f4df-416d-a7bd-3b6decf45a84 tempest-SnapshotMetadataTestJSON-769140256 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-5c1000d7-5276-495d-8c88-dc292e32d161" returned: 0 in 0.441s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:10:21 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-e6515979-f4df-416d-a7bd-3b6decf45a84 tempest-SnapshotMetadataTestJSON-769140256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-5c1000d7-5276-495d-8c88-dc292e32d161 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:10:21 devstack sudo[101307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-5c1000d7-5276-495d-8c88-dc292e32d161 Sep 07 10:10:21 devstack sudo[101307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:10:21 devstack sudo[101307]: pam_unix(sudo:session): session closed for user root Sep 07 10:10:21 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-e6515979-f4df-416d-a7bd-3b6decf45a84 tempest-SnapshotMetadataTestJSON-769140256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-5c1000d7-5276-495d-8c88-dc292e32d161" returned: 0 in 0.284s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:10:21 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-e6515979-f4df-416d-a7bd-3b6decf45a84 tempest-SnapshotMetadataTestJSON-769140256 None] Lock "cinder-quobyte-5c1000d7-5276-495d-8c88-dc292e32d161" released by "delete_volume" :: held 0.801s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:10:21 devstack cinder-volume[87515]: DEBUG cinder.quota [None req-e6515979-f4df-416d-a7bd-3b6decf45a84 tempest-SnapshotMetadataTestJSON-769140256 None] Created reservations ['df0d2831-8ad7-4927-8b87-2b8329ecc4f2', 'c05855a7-dbfb-43f7-8a00-c4c3671b33b0', '9a071cbd-55e8-48ad-8842-3a55f6c7cd8e', 'a55224fa-714f-4f37-a94c-0bd97ef9c8d4'] {{(pid=87515) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:10:21 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-e6515979-f4df-416d-a7bd-3b6decf45a84 tempest-SnapshotMetadataTestJSON-769140256 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:10:21 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-e6515979-f4df-416d-a7bd-3b6decf45a84 tempest-SnapshotMetadataTestJSON-769140256 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:10:21 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-e6515979-f4df-416d-a7bd-3b6decf45a84 tempest-SnapshotMetadataTestJSON-769140256 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:10:21 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-e6515979-f4df-416d-a7bd-3b6decf45a84 tempest-SnapshotMetadataTestJSON-769140256 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:10:21 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-e6515979-f4df-416d-a7bd-3b6decf45a84 tempest-SnapshotMetadataTestJSON-769140256 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:10:21 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-e6515979-f4df-416d-a7bd-3b6decf45a84 tempest-SnapshotMetadataTestJSON-769140256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:10:21 devstack sudo[101311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a Sep 07 10:10:21 devstack sudo[101311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:10:22 devstack sudo[101311]: pam_unix(sudo:session): session closed for user root Sep 07 10:10:22 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-e6515979-f4df-416d-a7bd-3b6decf45a84 tempest-SnapshotMetadataTestJSON-769140256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a" returned: 0 in 0.335s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:10:22 devstack cinder-volume[87515]: DEBUG cinder.manager [None req-e6515979-f4df-416d-a7bd-3b6decf45a84 tempest-SnapshotMetadataTestJSON-769140256 None] Notifying Schedulers of capabilities ... {{(pid=87515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:10:22 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-e6515979-f4df-416d-a7bd-3b6decf45a84 tempest-SnapshotMetadataTestJSON-769140256 None] Deleted volume successfully. Sep 07 10:10:22 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-e6515979-f4df-416d-a7bd-3b6decf45a84 tempest-SnapshotMetadataTestJSON-769140256 None] Lock "cinder-5c1000d7-5276-495d-8c88-dc292e32d161-delete_volume" released by "delete_volume" :: held 1.429s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:10:31 devstack cinder-volume[87515]: DEBUG dbcounter [-] [87515] Writing DB stats cinder:SELECT=44,cinder:INSERT=18,cinder:UPDATE=69,cinder:DELETE=5 {{(pid=87515) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 10:10:32 devstack cinder-volume[87515]: DEBUG dbcounter [-] [87515] Writing DB stats cinder:UPDATE=56,cinder:SELECT=52,cinder:INSERT=14,cinder:DELETE=4 {{(pid=87515) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 10:10:33 devstack cinder-volume[87515]: DEBUG cinder.volume.flows.manager.create_volume [None req-d6bf7a09-c960-4d33-ad61-276f143f2bb5 tempest-VolumesDeleteCascade-2079002316 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 10:10:33 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-d6bf7a09-c960-4d33-ad61-276f143f2bb5 tempest-VolumesDeleteCascade-2079002316 None] Flow 'volume_create_manager' (aa1a18a6-63bc-4267-9958-2b72528453d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:10:33 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-d6bf7a09-c960-4d33-ad61-276f143f2bb5 tempest-VolumesDeleteCascade-2079002316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (070a6f91-5ff3-404c-9137-394787a5a965) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:10:33 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-d6bf7a09-c960-4d33-ad61-276f143f2bb5 tempest-VolumesDeleteCascade-2079002316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (070a6f91-5ff3-404c-9137-394787a5a965) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:10:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1721991425',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19f9a1be-f975-4aa3-9da6-fea382a01b15,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4233f41eb56c4b6dbba2cdccb6a4f181',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:10:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:10:33Z,use_quota=True,user_id='7d395b3ed6d0465e89b8fe65f5db9d5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3a092cd-7947-4cbf-abff-4ba9567becf0),volume_type_id=f3a092cd-7947-4cbf-abff-4ba9567becf0)' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:10:33 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-d6bf7a09-c960-4d33-ad61-276f143f2bb5 tempest-VolumesDeleteCascade-2079002316 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4468bf57-7d92-419b-888e-9a3cfe84ba49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:10:33 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-d6bf7a09-c960-4d33-ad61-276f143f2bb5 tempest-VolumesDeleteCascade-2079002316 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4468bf57-7d92-419b-888e-9a3cfe84ba49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:10:33 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-d6bf7a09-c960-4d33-ad61-276f143f2bb5 tempest-VolumesDeleteCascade-2079002316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e20ad5af-8f6d-409e-8084-3f24ff123183) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:10:33 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-d6bf7a09-c960-4d33-ad61-276f143f2bb5 tempest-VolumesDeleteCascade-2079002316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e20ad5af-8f6d-409e-8084-3f24ff123183) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '19f9a1be-f975-4aa3-9da6-fea382a01b15', 'volume_name': 'volume-19f9a1be-f975-4aa3-9da6-fea382a01b15', 'volume_size': 1}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:10:33 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-d6bf7a09-c960-4d33-ad61-276f143f2bb5 tempest-VolumesDeleteCascade-2079002316 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41eb8fc3-8360-4134-90cd-9563ab532e5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:10:33 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-d6bf7a09-c960-4d33-ad61-276f143f2bb5 tempest-VolumesDeleteCascade-2079002316 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41eb8fc3-8360-4134-90cd-9563ab532e5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:10:33 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-d6bf7a09-c960-4d33-ad61-276f143f2bb5 tempest-VolumesDeleteCascade-2079002316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9afc461-ff24-4020-9aa1-1eb2554b4f5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:10:33 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-d6bf7a09-c960-4d33-ad61-276f143f2bb5 tempest-VolumesDeleteCascade-2079002316 None] Volume 19f9a1be-f975-4aa3-9da6-fea382a01b15: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-19f9a1be-f975-4aa3-9da6-fea382a01b15', 'volume_size': 1} Sep 07 10:10:33 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-d6bf7a09-c960-4d33-ad61-276f143f2bb5 tempest-VolumesDeleteCascade-2079002316 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:10:33 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-d6bf7a09-c960-4d33-ad61-276f143f2bb5 tempest-VolumesDeleteCascade-2079002316 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:10:33 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-d6bf7a09-c960-4d33-ad61-276f143f2bb5 tempest-VolumesDeleteCascade-2079002316 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:10:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1721991425',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19f9a1be-f975-4aa3-9da6-fea382a01b15,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4233f41eb56c4b6dbba2cdccb6a4f181',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:10:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:10:33Z,use_quota=True,user_id='7d395b3ed6d0465e89b8fe65f5db9d5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3a092cd-7947-4cbf-abff-4ba9567becf0),volume_type_id=f3a092cd-7947-4cbf-abff-4ba9567becf0)}" {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 10:10:33 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-d6bf7a09-c960-4d33-ad61-276f143f2bb5 tempest-VolumesDeleteCascade-2079002316 None] Creating volume 19f9a1be-f975-4aa3-9da6-fea382a01b15 {{(pid=87515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 10:10:33 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-d6bf7a09-c960-4d33-ad61-276f143f2bb5 tempest-VolumesDeleteCascade-2079002316 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:10:33 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-d6bf7a09-c960-4d33-ad61-276f143f2bb5 tempest-VolumesDeleteCascade-2079002316 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:10:33 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-d6bf7a09-c960-4d33-ad61-276f143f2bb5 tempest-VolumesDeleteCascade-2079002316 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:10:33 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-d6bf7a09-c960-4d33-ad61-276f143f2bb5 tempest-VolumesDeleteCascade-2079002316 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:10:33 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-d6bf7a09-c960-4d33-ad61-276f143f2bb5 tempest-VolumesDeleteCascade-2079002316 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:10:33 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-d6bf7a09-c960-4d33-ad61-276f143f2bb5 tempest-VolumesDeleteCascade-2079002316 None] Selected osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c as target Quobyte volume. {{(pid=87515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 10:10:33 devstack cinder-volume[87515]: INFO cinder.volume.drivers.remotefs [None req-d6bf7a09-c960-4d33-ad61-276f143f2bb5 tempest-VolumesDeleteCascade-2079002316 None] casted to osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c Sep 07 10:10:33 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-d6bf7a09-c960-4d33-ad61-276f143f2bb5 tempest-VolumesDeleteCascade-2079002316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-19f9a1be-f975-4aa3-9da6-fea382a01b15 1073741824 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:10:33 devstack sudo[101353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-19f9a1be-f975-4aa3-9da6-fea382a01b15 1073741824 Sep 07 10:10:33 devstack sudo[101353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:10:34 devstack sudo[101353]: pam_unix(sudo:session): session closed for user root Sep 07 10:10:34 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-d6bf7a09-c960-4d33-ad61-276f143f2bb5 tempest-VolumesDeleteCascade-2079002316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-19f9a1be-f975-4aa3-9da6-fea382a01b15 1073741824" returned: 0 in 0.522s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:10:34 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-d6bf7a09-c960-4d33-ad61-276f143f2bb5 tempest-VolumesDeleteCascade-2079002316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-19f9a1be-f975-4aa3-9da6-fea382a01b15 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:10:34 devstack sudo[101359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-19f9a1be-f975-4aa3-9da6-fea382a01b15 Sep 07 10:10:34 devstack sudo[101359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:10:34 devstack sudo[101359]: pam_unix(sudo:session): session closed for user root Sep 07 10:10:34 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-d6bf7a09-c960-4d33-ad61-276f143f2bb5 tempest-VolumesDeleteCascade-2079002316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-19f9a1be-f975-4aa3-9da6-fea382a01b15" returned: 0 in 0.289s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:10:34 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-d6bf7a09-c960-4d33-ad61-276f143f2bb5 tempest-VolumesDeleteCascade-2079002316 None] <== create_volume: return (858ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'} {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 10:10:34 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-d6bf7a09-c960-4d33-ad61-276f143f2bb5 tempest-VolumesDeleteCascade-2079002316 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.861s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:10:34 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-d6bf7a09-c960-4d33-ad61-276f143f2bb5 tempest-VolumesDeleteCascade-2079002316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9afc461-ff24-4020-9aa1-1eb2554b4f5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-19f9a1be-f975-4aa3-9da6-fea382a01b15', 'volume_size': 1}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:10:34 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-d6bf7a09-c960-4d33-ad61-276f143f2bb5 tempest-VolumesDeleteCascade-2079002316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c808c2ff-ff48-4875-933e-96a8b796f655) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:10:34 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-d6bf7a09-c960-4d33-ad61-276f143f2bb5 tempest-VolumesDeleteCascade-2079002316 None] Volume volume-19f9a1be-f975-4aa3-9da6-fea382a01b15 (19f9a1be-f975-4aa3-9da6-fea382a01b15): created successfully Sep 07 10:10:34 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-d6bf7a09-c960-4d33-ad61-276f143f2bb5 tempest-VolumesDeleteCascade-2079002316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c808c2ff-ff48-4875-933e-96a8b796f655) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:10:34 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-d6bf7a09-c960-4d33-ad61-276f143f2bb5 tempest-VolumesDeleteCascade-2079002316 None] Flow 'volume_create_manager' (aa1a18a6-63bc-4267-9958-2b72528453d1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:10:34 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-d6bf7a09-c960-4d33-ad61-276f143f2bb5 tempest-VolumesDeleteCascade-2079002316 None] Created volume successfully. Sep 07 10:10:35 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-66088c4c-b276-4673-b55b-1389a1083d64 tempest-VolumesDeleteCascade-2079002316 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:10:35 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-66088c4c-b276-4673-b55b-1389a1083d64 tempest-VolumesDeleteCascade-2079002316 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:10:35 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-66088c4c-b276-4673-b55b-1389a1083d64 tempest-VolumesDeleteCascade-2079002316 None] Creating offline snapshot 84885eee-2b83-4c34-95cd-f15ed3d6c9d5 of volume 19f9a1be-f975-4aa3-9da6-fea382a01b15 {{(pid=87515) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 10:10:35 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dfd29ac-6556-4bf5-8558-0fb2742ef028]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:10:35 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-66088c4c-b276-4673-b55b-1389a1083d64 tempest-VolumesDeleteCascade-2079002316 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-19f9a1be-f975-4aa3-9da6-fea382a01b15 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:10:35 devstack sudo[101362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-19f9a1be-f975-4aa3-9da6-fea382a01b15 Sep 07 10:10:35 devstack sudo[101362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:10:36 devstack sudo[101362]: pam_unix(sudo:session): session closed for user root Sep 07 10:10:36 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-66088c4c-b276-4673-b55b-1389a1083d64 tempest-VolumesDeleteCascade-2079002316 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-19f9a1be-f975-4aa3-9da6-fea382a01b15" returned: 0 in 0.373s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:10:36 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-66088c4c-b276-4673-b55b-1389a1083d64 tempest-VolumesDeleteCascade-2079002316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-19f9a1be-f975-4aa3-9da6-fea382a01b15,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-19f9a1be-f975-4aa3-9da6-fea382a01b15.84885eee-2b83-4c34-95cd-f15ed3d6c9d5 1G {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:10:36 devstack sudo[101368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-19f9a1be-f975-4aa3-9da6-fea382a01b15,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-19f9a1be-f975-4aa3-9da6-fea382a01b15.84885eee-2b83-4c34-95cd-f15ed3d6c9d5 1G Sep 07 10:10:36 devstack sudo[101368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:10:36 devstack sudo[101368]: pam_unix(sudo:session): session closed for user root Sep 07 10:10:36 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-66088c4c-b276-4673-b55b-1389a1083d64 tempest-VolumesDeleteCascade-2079002316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-19f9a1be-f975-4aa3-9da6-fea382a01b15,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-19f9a1be-f975-4aa3-9da6-fea382a01b15.84885eee-2b83-4c34-95cd-f15ed3d6c9d5 1G" returned: 0 in 0.600s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:10:36 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-66088c4c-b276-4673-b55b-1389a1083d64 tempest-VolumesDeleteCascade-2079002316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-19f9a1be-f975-4aa3-9da6-fea382a01b15 -F qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-19f9a1be-f975-4aa3-9da6-fea382a01b15.84885eee-2b83-4c34-95cd-f15ed3d6c9d5 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:10:36 devstack sudo[101373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-19f9a1be-f975-4aa3-9da6-fea382a01b15 -F qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-19f9a1be-f975-4aa3-9da6-fea382a01b15.84885eee-2b83-4c34-95cd-f15ed3d6c9d5 Sep 07 10:10:36 devstack sudo[101373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:10:37 devstack sudo[101373]: pam_unix(sudo:session): session closed for user root Sep 07 10:10:37 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-66088c4c-b276-4673-b55b-1389a1083d64 tempest-VolumesDeleteCascade-2079002316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-19f9a1be-f975-4aa3-9da6-fea382a01b15 -F qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-19f9a1be-f975-4aa3-9da6-fea382a01b15.84885eee-2b83-4c34-95cd-f15ed3d6c9d5" returned: 0 in 0.427s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:10:37 devstack cinder-volume[87515]: WARNING cinder.volume.drivers.remotefs [None req-66088c4c-b276-4673-b55b-1389a1083d64 tempest-VolumesDeleteCascade-2079002316 None] /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-19f9a1be-f975-4aa3-9da6-fea382a01b15.84885eee-2b83-4c34-95cd-f15ed3d6c9d5 is being set with open permissions: ugo+rw Sep 07 10:10:37 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-66088c4c-b276-4673-b55b-1389a1083d64 tempest-VolumesDeleteCascade-2079002316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-19f9a1be-f975-4aa3-9da6-fea382a01b15.84885eee-2b83-4c34-95cd-f15ed3d6c9d5 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:10:37 devstack sudo[101385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-19f9a1be-f975-4aa3-9da6-fea382a01b15.84885eee-2b83-4c34-95cd-f15ed3d6c9d5 Sep 07 10:10:37 devstack sudo[101385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:10:37 devstack sudo[101385]: pam_unix(sudo:session): session closed for user root Sep 07 10:10:37 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-66088c4c-b276-4673-b55b-1389a1083d64 tempest-VolumesDeleteCascade-2079002316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-19f9a1be-f975-4aa3-9da6-fea382a01b15.84885eee-2b83-4c34-95cd-f15ed3d6c9d5" returned: 0 in 0.314s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:10:37 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-66088c4c-b276-4673-b55b-1389a1083d64 tempest-VolumesDeleteCascade-2079002316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-19f9a1be-f975-4aa3-9da6-fea382a01b15.info {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:10:37 devstack sudo[101388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-19f9a1be-f975-4aa3-9da6-fea382a01b15.info Sep 07 10:10:37 devstack sudo[101388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:10:37 devstack sudo[101388]: pam_unix(sudo:session): session closed for user root Sep 07 10:10:37 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-66088c4c-b276-4673-b55b-1389a1083d64 tempest-VolumesDeleteCascade-2079002316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-19f9a1be-f975-4aa3-9da6-fea382a01b15.info" returned: 0 in 0.314s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:10:37 devstack cinder-volume[87515]: WARNING cinder.volume.drivers.remotefs [None req-66088c4c-b276-4673-b55b-1389a1083d64 tempest-VolumesDeleteCascade-2079002316 None] /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-19f9a1be-f975-4aa3-9da6-fea382a01b15.info is being set with open permissions: ugo+rw Sep 07 10:10:37 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-66088c4c-b276-4673-b55b-1389a1083d64 tempest-VolumesDeleteCascade-2079002316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-19f9a1be-f975-4aa3-9da6-fea382a01b15.info {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:10:37 devstack sudo[101391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-19f9a1be-f975-4aa3-9da6-fea382a01b15.info Sep 07 10:10:37 devstack sudo[101391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:10:38 devstack sudo[101391]: pam_unix(sudo:session): session closed for user root Sep 07 10:10:38 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-66088c4c-b276-4673-b55b-1389a1083d64 tempest-VolumesDeleteCascade-2079002316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-19f9a1be-f975-4aa3-9da6-fea382a01b15.info" returned: 0 in 0.286s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:10:38 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-66088c4c-b276-4673-b55b-1389a1083d64 tempest-VolumesDeleteCascade-2079002316 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.426s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:10:38 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-66088c4c-b276-4673-b55b-1389a1083d64 tempest-VolumesDeleteCascade-2079002316 None] Create snapshot completed successfully Sep 07 10:10:39 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-f8428170-f39c-4f5d-b377-2e2327a12031 tempest-VolumesDeleteCascade-2079002316 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:10:39 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-f8428170-f39c-4f5d-b377-2e2327a12031 tempest-VolumesDeleteCascade-2079002316 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:10:39 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-f8428170-f39c-4f5d-b377-2e2327a12031 tempest-VolumesDeleteCascade-2079002316 None] Creating offline snapshot 50507412-1991-47f9-8c63-d6dc276b5957 of volume 19f9a1be-f975-4aa3-9da6-fea382a01b15 {{(pid=87515) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 10:10:39 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[4394dc13-aff8-4ac3-9ec4-ebe2e50037ad]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:10:39 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-f8428170-f39c-4f5d-b377-2e2327a12031 tempest-VolumesDeleteCascade-2079002316 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-19f9a1be-f975-4aa3-9da6-fea382a01b15.84885eee-2b83-4c34-95cd-f15ed3d6c9d5 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:10:39 devstack sudo[101395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-19f9a1be-f975-4aa3-9da6-fea382a01b15.84885eee-2b83-4c34-95cd-f15ed3d6c9d5 Sep 07 10:10:39 devstack sudo[101395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:10:39 devstack sudo[101395]: pam_unix(sudo:session): session closed for user root Sep 07 10:10:39 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-f8428170-f39c-4f5d-b377-2e2327a12031 tempest-VolumesDeleteCascade-2079002316 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-19f9a1be-f975-4aa3-9da6-fea382a01b15.84885eee-2b83-4c34-95cd-f15ed3d6c9d5" returned: 0 in 0.431s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:10:39 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-f8428170-f39c-4f5d-b377-2e2327a12031 tempest-VolumesDeleteCascade-2079002316 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-19f9a1be-f975-4aa3-9da6-fea382a01b15(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87515) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 10:10:39 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-f8428170-f39c-4f5d-b377-2e2327a12031 tempest-VolumesDeleteCascade-2079002316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-19f9a1be-f975-4aa3-9da6-fea382a01b15.84885eee-2b83-4c34-95cd-f15ed3d6c9d5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-19f9a1be-f975-4aa3-9da6-fea382a01b15.50507412-1991-47f9-8c63-d6dc276b5957 1G {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:10:39 devstack sudo[101400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-19f9a1be-f975-4aa3-9da6-fea382a01b15.84885eee-2b83-4c34-95cd-f15ed3d6c9d5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-19f9a1be-f975-4aa3-9da6-fea382a01b15.50507412-1991-47f9-8c63-d6dc276b5957 1G Sep 07 10:10:39 devstack sudo[101400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:10:40 devstack sudo[101400]: pam_unix(sudo:session): session closed for user root Sep 07 10:10:40 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-f8428170-f39c-4f5d-b377-2e2327a12031 tempest-VolumesDeleteCascade-2079002316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-19f9a1be-f975-4aa3-9da6-fea382a01b15.84885eee-2b83-4c34-95cd-f15ed3d6c9d5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-19f9a1be-f975-4aa3-9da6-fea382a01b15.50507412-1991-47f9-8c63-d6dc276b5957 1G" returned: 0 in 0.558s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:10:40 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-f8428170-f39c-4f5d-b377-2e2327a12031 tempest-VolumesDeleteCascade-2079002316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-19f9a1be-f975-4aa3-9da6-fea382a01b15.84885eee-2b83-4c34-95cd-f15ed3d6c9d5 -F qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-19f9a1be-f975-4aa3-9da6-fea382a01b15.50507412-1991-47f9-8c63-d6dc276b5957 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:10:40 devstack sudo[101407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-19f9a1be-f975-4aa3-9da6-fea382a01b15.84885eee-2b83-4c34-95cd-f15ed3d6c9d5 -F qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-19f9a1be-f975-4aa3-9da6-fea382a01b15.50507412-1991-47f9-8c63-d6dc276b5957 Sep 07 10:10:40 devstack sudo[101407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:10:40 devstack sudo[101407]: pam_unix(sudo:session): session closed for user root Sep 07 10:10:40 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-f8428170-f39c-4f5d-b377-2e2327a12031 tempest-VolumesDeleteCascade-2079002316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-19f9a1be-f975-4aa3-9da6-fea382a01b15.84885eee-2b83-4c34-95cd-f15ed3d6c9d5 -F qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-19f9a1be-f975-4aa3-9da6-fea382a01b15.50507412-1991-47f9-8c63-d6dc276b5957" returned: 0 in 0.352s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:10:40 devstack cinder-volume[87515]: WARNING cinder.volume.drivers.remotefs [None req-f8428170-f39c-4f5d-b377-2e2327a12031 tempest-VolumesDeleteCascade-2079002316 None] /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-19f9a1be-f975-4aa3-9da6-fea382a01b15.50507412-1991-47f9-8c63-d6dc276b5957 is being set with open permissions: ugo+rw Sep 07 10:10:40 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-f8428170-f39c-4f5d-b377-2e2327a12031 tempest-VolumesDeleteCascade-2079002316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-19f9a1be-f975-4aa3-9da6-fea382a01b15.50507412-1991-47f9-8c63-d6dc276b5957 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:10:40 devstack sudo[101413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-19f9a1be-f975-4aa3-9da6-fea382a01b15.50507412-1991-47f9-8c63-d6dc276b5957 Sep 07 10:10:40 devstack sudo[101413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:10:40 devstack sudo[101413]: pam_unix(sudo:session): session closed for user root Sep 07 10:10:40 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-f8428170-f39c-4f5d-b377-2e2327a12031 tempest-VolumesDeleteCascade-2079002316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-19f9a1be-f975-4aa3-9da6-fea382a01b15.50507412-1991-47f9-8c63-d6dc276b5957" returned: 0 in 0.325s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:10:40 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-f8428170-f39c-4f5d-b377-2e2327a12031 tempest-VolumesDeleteCascade-2079002316 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.818s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:10:40 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-f8428170-f39c-4f5d-b377-2e2327a12031 tempest-VolumesDeleteCascade-2079002316 None] Create snapshot completed successfully Sep 07 10:10:41 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-3e97444e-7bd6-4c29-992a-5c875c4a68cd tempest-VolumesDeleteCascade-2079002316 None] Acquiring lock "cinder-19f9a1be-f975-4aa3-9da6-fea382a01b15-delete_volume" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:10:41 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-3e97444e-7bd6-4c29-992a-5c875c4a68cd tempest-VolumesDeleteCascade-2079002316 None] Lock "cinder-19f9a1be-f975-4aa3-9da6-fea382a01b15-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:10:41 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-3e97444e-7bd6-4c29-992a-5c875c4a68cd tempest-VolumesDeleteCascade-2079002316 None] Performing cascade delete. {{(pid=87515) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Sep 07 10:10:41 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-3e97444e-7bd6-4c29-992a-5c875c4a68cd tempest-VolumesDeleteCascade-2079002316 None] Acquiring lock "cinder-50507412-1991-47f9-8c63-d6dc276b5957-delete_snapshot" by "delete_snapshot" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:10:41 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-3e97444e-7bd6-4c29-992a-5c875c4a68cd tempest-VolumesDeleteCascade-2079002316 None] Lock "cinder-50507412-1991-47f9-8c63-d6dc276b5957-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:10:41 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-3e97444e-7bd6-4c29-992a-5c875c4a68cd tempest-VolumesDeleteCascade-2079002316 None] Acquiring lock "cinder-quobyte-19f9a1be-f975-4aa3-9da6-fea382a01b15" by "delete_snapshot" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:10:41 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-3e97444e-7bd6-4c29-992a-5c875c4a68cd tempest-VolumesDeleteCascade-2079002316 None] Lock "cinder-quobyte-19f9a1be-f975-4aa3-9da6-fea382a01b15" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:10:41 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-3e97444e-7bd6-4c29-992a-5c875c4a68cd tempest-VolumesDeleteCascade-2079002316 None] Acquiring lock "cinder-quobyte-50507412-1991-47f9-8c63-d6dc276b5957" by "_delete_snapshot" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:10:41 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-3e97444e-7bd6-4c29-992a-5c875c4a68cd tempest-VolumesDeleteCascade-2079002316 None] Lock "cinder-quobyte-50507412-1991-47f9-8c63-d6dc276b5957" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:10:41 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-3e97444e-7bd6-4c29-992a-5c875c4a68cd tempest-VolumesDeleteCascade-2079002316 None] Deleting offline snapshot 50507412-1991-47f9-8c63-d6dc276b5957 of volume 19f9a1be-f975-4aa3-9da6-fea382a01b15 {{(pid=87515) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 10:10:41 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-3e97444e-7bd6-4c29-992a-5c875c4a68cd tempest-VolumesDeleteCascade-2079002316 None] snapshot_file for this snap is: volume-19f9a1be-f975-4aa3-9da6-fea382a01b15.50507412-1991-47f9-8c63-d6dc276b5957 {{(pid=87515) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 10:10:41 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[9773796f-7402-42e9-a9c4-b58d68f37218]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:10:41 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-3e97444e-7bd6-4c29-992a-5c875c4a68cd tempest-VolumesDeleteCascade-2079002316 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-19f9a1be-f975-4aa3-9da6-fea382a01b15.50507412-1991-47f9-8c63-d6dc276b5957 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:10:41 devstack sudo[101416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-19f9a1be-f975-4aa3-9da6-fea382a01b15.50507412-1991-47f9-8c63-d6dc276b5957 Sep 07 10:10:41 devstack sudo[101416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:10:42 devstack sudo[101416]: pam_unix(sudo:session): session closed for user root Sep 07 10:10:42 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-3e97444e-7bd6-4c29-992a-5c875c4a68cd tempest-VolumesDeleteCascade-2079002316 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-19f9a1be-f975-4aa3-9da6-fea382a01b15.50507412-1991-47f9-8c63-d6dc276b5957" returned: 0 in 0.443s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:10:42 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-3e97444e-7bd6-4c29-992a-5c875c4a68cd tempest-VolumesDeleteCascade-2079002316 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-19f9a1be-f975-4aa3-9da6-fea382a01b15(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87515) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 10:10:42 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d639f6f-23f6-49e4-8531-0fc82dab5dfd]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:10:42 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-3e97444e-7bd6-4c29-992a-5c875c4a68cd tempest-VolumesDeleteCascade-2079002316 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-19f9a1be-f975-4aa3-9da6-fea382a01b15.84885eee-2b83-4c34-95cd-f15ed3d6c9d5 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:10:42 devstack sudo[101423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-19f9a1be-f975-4aa3-9da6-fea382a01b15.84885eee-2b83-4c34-95cd-f15ed3d6c9d5 Sep 07 10:10:42 devstack sudo[101423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:10:42 devstack sudo[101423]: pam_unix(sudo:session): session closed for user root Sep 07 10:10:42 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-3e97444e-7bd6-4c29-992a-5c875c4a68cd tempest-VolumesDeleteCascade-2079002316 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-19f9a1be-f975-4aa3-9da6-fea382a01b15.84885eee-2b83-4c34-95cd-f15ed3d6c9d5" returned: 0 in 0.424s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:10:42 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-3e97444e-7bd6-4c29-992a-5c875c4a68cd tempest-VolumesDeleteCascade-2079002316 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-19f9a1be-f975-4aa3-9da6-fea382a01b15(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87515) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 10:10:42 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-3e97444e-7bd6-4c29-992a-5c875c4a68cd tempest-VolumesDeleteCascade-2079002316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-19f9a1be-f975-4aa3-9da6-fea382a01b15.50507412-1991-47f9-8c63-d6dc276b5957 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:10:42 devstack sudo[101428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-19f9a1be-f975-4aa3-9da6-fea382a01b15.50507412-1991-47f9-8c63-d6dc276b5957 Sep 07 10:10:42 devstack sudo[101428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:10:42 devstack sudo[101428]: pam_unix(sudo:session): session closed for user root Sep 07 10:10:42 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-3e97444e-7bd6-4c29-992a-5c875c4a68cd tempest-VolumesDeleteCascade-2079002316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-19f9a1be-f975-4aa3-9da6-fea382a01b15.50507412-1991-47f9-8c63-d6dc276b5957" returned: 0 in 0.406s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:10:42 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-3e97444e-7bd6-4c29-992a-5c875c4a68cd tempest-VolumesDeleteCascade-2079002316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-19f9a1be-f975-4aa3-9da6-fea382a01b15.50507412-1991-47f9-8c63-d6dc276b5957 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:10:42 devstack sudo[101434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-19f9a1be-f975-4aa3-9da6-fea382a01b15.50507412-1991-47f9-8c63-d6dc276b5957 Sep 07 10:10:42 devstack sudo[101434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:10:43 devstack sudo[101434]: pam_unix(sudo:session): session closed for user root Sep 07 10:10:43 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-3e97444e-7bd6-4c29-992a-5c875c4a68cd tempest-VolumesDeleteCascade-2079002316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-19f9a1be-f975-4aa3-9da6-fea382a01b15.50507412-1991-47f9-8c63-d6dc276b5957" returned: 0 in 0.288s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:10:43 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-3e97444e-7bd6-4c29-992a-5c875c4a68cd tempest-VolumesDeleteCascade-2079002316 None] Lock "cinder-quobyte-50507412-1991-47f9-8c63-d6dc276b5957" released by "_delete_snapshot" :: held 1.688s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:10:43 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-3e97444e-7bd6-4c29-992a-5c875c4a68cd tempest-VolumesDeleteCascade-2079002316 None] Lock "cinder-quobyte-19f9a1be-f975-4aa3-9da6-fea382a01b15" released by "delete_snapshot" :: held 1.720s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:10:43 devstack cinder-volume[87515]: DEBUG cinder.quota [None req-3e97444e-7bd6-4c29-992a-5c875c4a68cd tempest-VolumesDeleteCascade-2079002316 None] Created reservations ['d491a7f8-f2ae-4b5d-9c1b-f8e6fa07b358', '83066db2-8dcb-4756-83c4-284cb158b4f2', '60337e44-18f8-4140-b640-72bb606c9adb', 'f97de1f4-4823-4a19-a586-de10cea586ea'] {{(pid=87515) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:10:43 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-3e97444e-7bd6-4c29-992a-5c875c4a68cd tempest-VolumesDeleteCascade-2079002316 None] Delete snapshot completed successfully. Sep 07 10:10:43 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-3e97444e-7bd6-4c29-992a-5c875c4a68cd tempest-VolumesDeleteCascade-2079002316 None] Lock "cinder-50507412-1991-47f9-8c63-d6dc276b5957-delete_snapshot" released by "delete_snapshot" :: held 1.919s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:10:43 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-3e97444e-7bd6-4c29-992a-5c875c4a68cd tempest-VolumesDeleteCascade-2079002316 None] Acquiring lock "cinder-84885eee-2b83-4c34-95cd-f15ed3d6c9d5-delete_snapshot" by "delete_snapshot" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:10:43 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-3e97444e-7bd6-4c29-992a-5c875c4a68cd tempest-VolumesDeleteCascade-2079002316 None] Lock "cinder-84885eee-2b83-4c34-95cd-f15ed3d6c9d5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:10:43 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-3e97444e-7bd6-4c29-992a-5c875c4a68cd tempest-VolumesDeleteCascade-2079002316 None] Acquiring lock "cinder-quobyte-19f9a1be-f975-4aa3-9da6-fea382a01b15" by "delete_snapshot" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:10:43 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-3e97444e-7bd6-4c29-992a-5c875c4a68cd tempest-VolumesDeleteCascade-2079002316 None] Lock "cinder-quobyte-19f9a1be-f975-4aa3-9da6-fea382a01b15" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:10:43 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-3e97444e-7bd6-4c29-992a-5c875c4a68cd tempest-VolumesDeleteCascade-2079002316 None] Acquiring lock "cinder-quobyte-84885eee-2b83-4c34-95cd-f15ed3d6c9d5" by "_delete_snapshot" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:10:43 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-3e97444e-7bd6-4c29-992a-5c875c4a68cd tempest-VolumesDeleteCascade-2079002316 None] Lock "cinder-quobyte-84885eee-2b83-4c34-95cd-f15ed3d6c9d5" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:10:43 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-3e97444e-7bd6-4c29-992a-5c875c4a68cd tempest-VolumesDeleteCascade-2079002316 None] Deleting offline snapshot 84885eee-2b83-4c34-95cd-f15ed3d6c9d5 of volume 19f9a1be-f975-4aa3-9da6-fea382a01b15 {{(pid=87515) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 10:10:43 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-3e97444e-7bd6-4c29-992a-5c875c4a68cd tempest-VolumesDeleteCascade-2079002316 None] snapshot_file for this snap is: volume-19f9a1be-f975-4aa3-9da6-fea382a01b15.84885eee-2b83-4c34-95cd-f15ed3d6c9d5 {{(pid=87515) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 10:10:43 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c865985-ec0e-4535-b822-6cd1fa611893]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:10:43 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-3e97444e-7bd6-4c29-992a-5c875c4a68cd tempest-VolumesDeleteCascade-2079002316 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-19f9a1be-f975-4aa3-9da6-fea382a01b15.84885eee-2b83-4c34-95cd-f15ed3d6c9d5 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:10:43 devstack sudo[101437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-19f9a1be-f975-4aa3-9da6-fea382a01b15.84885eee-2b83-4c34-95cd-f15ed3d6c9d5 Sep 07 10:10:43 devstack sudo[101437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:10:43 devstack sudo[101437]: pam_unix(sudo:session): session closed for user root Sep 07 10:10:44 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-3e97444e-7bd6-4c29-992a-5c875c4a68cd tempest-VolumesDeleteCascade-2079002316 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-19f9a1be-f975-4aa3-9da6-fea382a01b15.84885eee-2b83-4c34-95cd-f15ed3d6c9d5" returned: 0 in 0.466s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:10:44 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-3e97444e-7bd6-4c29-992a-5c875c4a68cd tempest-VolumesDeleteCascade-2079002316 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-19f9a1be-f975-4aa3-9da6-fea382a01b15(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87515) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 10:10:44 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a600971-7a3e-4c43-acc1-830cf43e949a]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:10:44 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-3e97444e-7bd6-4c29-992a-5c875c4a68cd tempest-VolumesDeleteCascade-2079002316 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-19f9a1be-f975-4aa3-9da6-fea382a01b15 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:10:44 devstack sudo[101442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-19f9a1be-f975-4aa3-9da6-fea382a01b15 Sep 07 10:10:44 devstack sudo[101442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:10:44 devstack sudo[101442]: pam_unix(sudo:session): session closed for user root Sep 07 10:10:44 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-3e97444e-7bd6-4c29-992a-5c875c4a68cd tempest-VolumesDeleteCascade-2079002316 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-19f9a1be-f975-4aa3-9da6-fea382a01b15" returned: 0 in 0.455s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:10:44 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-3e97444e-7bd6-4c29-992a-5c875c4a68cd tempest-VolumesDeleteCascade-2079002316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-19f9a1be-f975-4aa3-9da6-fea382a01b15.84885eee-2b83-4c34-95cd-f15ed3d6c9d5 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:10:44 devstack sudo[101447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-19f9a1be-f975-4aa3-9da6-fea382a01b15.84885eee-2b83-4c34-95cd-f15ed3d6c9d5 Sep 07 10:10:44 devstack sudo[101447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:10:44 devstack sudo[101447]: pam_unix(sudo:session): session closed for user root Sep 07 10:10:44 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-3e97444e-7bd6-4c29-992a-5c875c4a68cd tempest-VolumesDeleteCascade-2079002316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-19f9a1be-f975-4aa3-9da6-fea382a01b15.84885eee-2b83-4c34-95cd-f15ed3d6c9d5" returned: 0 in 0.409s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:10:44 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-3e97444e-7bd6-4c29-992a-5c875c4a68cd tempest-VolumesDeleteCascade-2079002316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-19f9a1be-f975-4aa3-9da6-fea382a01b15.84885eee-2b83-4c34-95cd-f15ed3d6c9d5 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:10:44 devstack sudo[101452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-19f9a1be-f975-4aa3-9da6-fea382a01b15.84885eee-2b83-4c34-95cd-f15ed3d6c9d5 Sep 07 10:10:44 devstack sudo[101452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:10:45 devstack sudo[101452]: pam_unix(sudo:session): session closed for user root Sep 07 10:10:45 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-3e97444e-7bd6-4c29-992a-5c875c4a68cd tempest-VolumesDeleteCascade-2079002316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-19f9a1be-f975-4aa3-9da6-fea382a01b15.84885eee-2b83-4c34-95cd-f15ed3d6c9d5" returned: 0 in 0.294s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:10:45 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-3e97444e-7bd6-4c29-992a-5c875c4a68cd tempest-VolumesDeleteCascade-2079002316 None] Lock "cinder-quobyte-84885eee-2b83-4c34-95cd-f15ed3d6c9d5" released by "_delete_snapshot" :: held 1.774s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:10:45 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-3e97444e-7bd6-4c29-992a-5c875c4a68cd tempest-VolumesDeleteCascade-2079002316 None] Lock "cinder-quobyte-19f9a1be-f975-4aa3-9da6-fea382a01b15" released by "delete_snapshot" :: held 1.805s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:10:45 devstack cinder-volume[87515]: DEBUG cinder.quota [None req-3e97444e-7bd6-4c29-992a-5c875c4a68cd tempest-VolumesDeleteCascade-2079002316 None] Created reservations ['31f3b06b-5989-4a25-a760-a3979674ed5d', 'fac2b3af-edf8-4b60-ba97-c4a2b1e67462', '625ab3a7-5b01-49eb-a87d-1fb7521a32f0', '99d15a1b-52b9-43b5-a60a-c976a753b22b'] {{(pid=87515) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:10:45 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-3e97444e-7bd6-4c29-992a-5c875c4a68cd tempest-VolumesDeleteCascade-2079002316 None] Delete snapshot completed successfully. Sep 07 10:10:45 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-3e97444e-7bd6-4c29-992a-5c875c4a68cd tempest-VolumesDeleteCascade-2079002316 None] Lock "cinder-84885eee-2b83-4c34-95cd-f15ed3d6c9d5-delete_snapshot" released by "delete_snapshot" :: held 1.990s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:10:45 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-3e97444e-7bd6-4c29-992a-5c875c4a68cd tempest-VolumesDeleteCascade-2079002316 None] Snapshots deleted, issuing volume delete {{(pid=87515) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Sep 07 10:10:45 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-3e97444e-7bd6-4c29-992a-5c875c4a68cd tempest-VolumesDeleteCascade-2079002316 None] Acquiring lock "cinder-quobyte-19f9a1be-f975-4aa3-9da6-fea382a01b15" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:10:45 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-3e97444e-7bd6-4c29-992a-5c875c4a68cd tempest-VolumesDeleteCascade-2079002316 None] Lock "cinder-quobyte-19f9a1be-f975-4aa3-9da6-fea382a01b15" acquired by "delete_volume" :: waited 0.018s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:10:45 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8dd703f-690c-4e74-bcd5-e5df26d6698f]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:10:45 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-3e97444e-7bd6-4c29-992a-5c875c4a68cd tempest-VolumesDeleteCascade-2079002316 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-19f9a1be-f975-4aa3-9da6-fea382a01b15 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:10:45 devstack sudo[101455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-19f9a1be-f975-4aa3-9da6-fea382a01b15 Sep 07 10:10:45 devstack sudo[101455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:10:45 devstack sudo[101455]: pam_unix(sudo:session): session closed for user root Sep 07 10:10:45 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-3e97444e-7bd6-4c29-992a-5c875c4a68cd tempest-VolumesDeleteCascade-2079002316 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-19f9a1be-f975-4aa3-9da6-fea382a01b15" returned: 0 in 0.423s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:10:45 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-3e97444e-7bd6-4c29-992a-5c875c4a68cd tempest-VolumesDeleteCascade-2079002316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-19f9a1be-f975-4aa3-9da6-fea382a01b15 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:10:45 devstack sudo[101461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-19f9a1be-f975-4aa3-9da6-fea382a01b15 Sep 07 10:10:45 devstack sudo[101461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:10:46 devstack sudo[101461]: pam_unix(sudo:session): session closed for user root Sep 07 10:10:46 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-3e97444e-7bd6-4c29-992a-5c875c4a68cd tempest-VolumesDeleteCascade-2079002316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-19f9a1be-f975-4aa3-9da6-fea382a01b15" returned: 0 in 0.300s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:10:46 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-3e97444e-7bd6-4c29-992a-5c875c4a68cd tempest-VolumesDeleteCascade-2079002316 None] Lock "cinder-quobyte-19f9a1be-f975-4aa3-9da6-fea382a01b15" released by "delete_volume" :: held 0.801s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:10:46 devstack cinder-volume[87515]: DEBUG cinder.quota [None req-3e97444e-7bd6-4c29-992a-5c875c4a68cd tempest-VolumesDeleteCascade-2079002316 None] Created reservations ['e6b819b3-c2eb-464f-9c3e-5ed782263fac', 'f2d33a7d-22a0-4b9f-91fd-a6202101c8f5', '12d94754-f12f-4d46-bdcd-46b51425172f', 'c5e07c0d-6761-4c4d-9da0-fe7c2bff296f'] {{(pid=87515) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:10:46 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-3e97444e-7bd6-4c29-992a-5c875c4a68cd tempest-VolumesDeleteCascade-2079002316 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:10:46 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-3e97444e-7bd6-4c29-992a-5c875c4a68cd tempest-VolumesDeleteCascade-2079002316 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:10:46 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-3e97444e-7bd6-4c29-992a-5c875c4a68cd tempest-VolumesDeleteCascade-2079002316 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:10:46 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-3e97444e-7bd6-4c29-992a-5c875c4a68cd tempest-VolumesDeleteCascade-2079002316 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:10:46 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-3e97444e-7bd6-4c29-992a-5c875c4a68cd tempest-VolumesDeleteCascade-2079002316 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:10:46 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-3e97444e-7bd6-4c29-992a-5c875c4a68cd tempest-VolumesDeleteCascade-2079002316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:10:46 devstack sudo[101464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a Sep 07 10:10:46 devstack sudo[101464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:10:46 devstack sudo[101464]: pam_unix(sudo:session): session closed for user root Sep 07 10:10:46 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-3e97444e-7bd6-4c29-992a-5c875c4a68cd tempest-VolumesDeleteCascade-2079002316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a" returned: 0 in 0.280s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:10:46 devstack cinder-volume[87515]: DEBUG cinder.manager [None req-3e97444e-7bd6-4c29-992a-5c875c4a68cd tempest-VolumesDeleteCascade-2079002316 None] Notifying Schedulers of capabilities ... {{(pid=87515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:10:46 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-3e97444e-7bd6-4c29-992a-5c875c4a68cd tempest-VolumesDeleteCascade-2079002316 None] Deleted volume successfully. Sep 07 10:10:46 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-3e97444e-7bd6-4c29-992a-5c875c4a68cd tempest-VolumesDeleteCascade-2079002316 None] Lock "cinder-19f9a1be-f975-4aa3-9da6-fea382a01b15-delete_volume" released by "delete_volume" :: held 5.351s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:10:47 devstack cinder-volume[87515]: DEBUG cinder.volume.flows.manager.create_volume [None req-46108c58-7285-4ca9-b4cb-2dd0ab770f8c tempest-VolumesDeleteCascade-2079002316 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 10:10:47 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-46108c58-7285-4ca9-b4cb-2dd0ab770f8c tempest-VolumesDeleteCascade-2079002316 None] Flow 'volume_create_manager' (a10c3e9a-6fe9-4e9c-affc-753f33e774be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:10:47 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-46108c58-7285-4ca9-b4cb-2dd0ab770f8c tempest-VolumesDeleteCascade-2079002316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0235d96-1649-4ac0-a2c7-d9640ded0f59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:10:47 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-46108c58-7285-4ca9-b4cb-2dd0ab770f8c tempest-VolumesDeleteCascade-2079002316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0235d96-1649-4ac0-a2c7-d9640ded0f59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:10:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-848652504',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34408c0b-5d91-47d3-9c89-661d7a6b539c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4233f41eb56c4b6dbba2cdccb6a4f181',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:10:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:10:48Z,use_quota=True,user_id='7d395b3ed6d0465e89b8fe65f5db9d5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3a092cd-7947-4cbf-abff-4ba9567becf0),volume_type_id=f3a092cd-7947-4cbf-abff-4ba9567becf0)' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:10:47 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-46108c58-7285-4ca9-b4cb-2dd0ab770f8c tempest-VolumesDeleteCascade-2079002316 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c330a1bb-3102-418b-be39-b1f7e290b6c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:10:47 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-46108c58-7285-4ca9-b4cb-2dd0ab770f8c tempest-VolumesDeleteCascade-2079002316 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c330a1bb-3102-418b-be39-b1f7e290b6c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:10:47 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-46108c58-7285-4ca9-b4cb-2dd0ab770f8c tempest-VolumesDeleteCascade-2079002316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (450ed034-ae8e-4e47-aa8b-ab306099ee5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:10:47 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-46108c58-7285-4ca9-b4cb-2dd0ab770f8c tempest-VolumesDeleteCascade-2079002316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (450ed034-ae8e-4e47-aa8b-ab306099ee5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '34408c0b-5d91-47d3-9c89-661d7a6b539c', 'volume_name': 'volume-34408c0b-5d91-47d3-9c89-661d7a6b539c', 'volume_size': 1}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:10:47 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-46108c58-7285-4ca9-b4cb-2dd0ab770f8c tempest-VolumesDeleteCascade-2079002316 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4fde3ac9-f5e7-42f8-a863-c3bf61422129) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:10:47 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-46108c58-7285-4ca9-b4cb-2dd0ab770f8c tempest-VolumesDeleteCascade-2079002316 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4fde3ac9-f5e7-42f8-a863-c3bf61422129) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:10:47 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-46108c58-7285-4ca9-b4cb-2dd0ab770f8c tempest-VolumesDeleteCascade-2079002316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1317ae2-98ad-47c5-9b68-53a56d96e0d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:10:47 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-46108c58-7285-4ca9-b4cb-2dd0ab770f8c tempest-VolumesDeleteCascade-2079002316 None] Volume 34408c0b-5d91-47d3-9c89-661d7a6b539c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-34408c0b-5d91-47d3-9c89-661d7a6b539c', 'volume_size': 1} Sep 07 10:10:47 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-46108c58-7285-4ca9-b4cb-2dd0ab770f8c tempest-VolumesDeleteCascade-2079002316 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:10:47 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-46108c58-7285-4ca9-b4cb-2dd0ab770f8c tempest-VolumesDeleteCascade-2079002316 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:10:47 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-46108c58-7285-4ca9-b4cb-2dd0ab770f8c tempest-VolumesDeleteCascade-2079002316 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:10:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-848652504',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34408c0b-5d91-47d3-9c89-661d7a6b539c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4233f41eb56c4b6dbba2cdccb6a4f181',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:10:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:10:48Z,use_quota=True,user_id='7d395b3ed6d0465e89b8fe65f5db9d5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3a092cd-7947-4cbf-abff-4ba9567becf0),volume_type_id=f3a092cd-7947-4cbf-abff-4ba9567becf0)}" {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 10:10:47 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-46108c58-7285-4ca9-b4cb-2dd0ab770f8c tempest-VolumesDeleteCascade-2079002316 None] Creating volume 34408c0b-5d91-47d3-9c89-661d7a6b539c {{(pid=87515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 10:10:47 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-46108c58-7285-4ca9-b4cb-2dd0ab770f8c tempest-VolumesDeleteCascade-2079002316 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:10:47 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-46108c58-7285-4ca9-b4cb-2dd0ab770f8c tempest-VolumesDeleteCascade-2079002316 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:10:47 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-46108c58-7285-4ca9-b4cb-2dd0ab770f8c tempest-VolumesDeleteCascade-2079002316 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:10:47 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-46108c58-7285-4ca9-b4cb-2dd0ab770f8c tempest-VolumesDeleteCascade-2079002316 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:10:47 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-46108c58-7285-4ca9-b4cb-2dd0ab770f8c tempest-VolumesDeleteCascade-2079002316 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:10:47 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-46108c58-7285-4ca9-b4cb-2dd0ab770f8c tempest-VolumesDeleteCascade-2079002316 None] Selected osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c as target Quobyte volume. {{(pid=87515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 10:10:47 devstack cinder-volume[87515]: INFO cinder.volume.drivers.remotefs [None req-46108c58-7285-4ca9-b4cb-2dd0ab770f8c tempest-VolumesDeleteCascade-2079002316 None] casted to osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c Sep 07 10:10:47 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-46108c58-7285-4ca9-b4cb-2dd0ab770f8c tempest-VolumesDeleteCascade-2079002316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-34408c0b-5d91-47d3-9c89-661d7a6b539c 1073741824 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:10:47 devstack sudo[101467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-34408c0b-5d91-47d3-9c89-661d7a6b539c 1073741824 Sep 07 10:10:47 devstack sudo[101467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:10:48 devstack sudo[101467]: pam_unix(sudo:session): session closed for user root Sep 07 10:10:48 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-46108c58-7285-4ca9-b4cb-2dd0ab770f8c tempest-VolumesDeleteCascade-2079002316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-34408c0b-5d91-47d3-9c89-661d7a6b539c 1073741824" returned: 0 in 0.570s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:10:48 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-46108c58-7285-4ca9-b4cb-2dd0ab770f8c tempest-VolumesDeleteCascade-2079002316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-34408c0b-5d91-47d3-9c89-661d7a6b539c {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:10:48 devstack sudo[101477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-34408c0b-5d91-47d3-9c89-661d7a6b539c Sep 07 10:10:48 devstack sudo[101477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:10:48 devstack sudo[101477]: pam_unix(sudo:session): session closed for user root Sep 07 10:10:48 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-46108c58-7285-4ca9-b4cb-2dd0ab770f8c tempest-VolumesDeleteCascade-2079002316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-34408c0b-5d91-47d3-9c89-661d7a6b539c" returned: 0 in 0.346s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:10:48 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-46108c58-7285-4ca9-b4cb-2dd0ab770f8c tempest-VolumesDeleteCascade-2079002316 None] <== create_volume: return (972ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'} {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 10:10:48 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-46108c58-7285-4ca9-b4cb-2dd0ab770f8c tempest-VolumesDeleteCascade-2079002316 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.975s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:10:48 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-46108c58-7285-4ca9-b4cb-2dd0ab770f8c tempest-VolumesDeleteCascade-2079002316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1317ae2-98ad-47c5-9b68-53a56d96e0d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-34408c0b-5d91-47d3-9c89-661d7a6b539c', 'volume_size': 1}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:10:48 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-46108c58-7285-4ca9-b4cb-2dd0ab770f8c tempest-VolumesDeleteCascade-2079002316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ae52271-c1b9-4336-ab2e-b1bc50cb882b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:10:48 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-46108c58-7285-4ca9-b4cb-2dd0ab770f8c tempest-VolumesDeleteCascade-2079002316 None] Volume volume-34408c0b-5d91-47d3-9c89-661d7a6b539c (34408c0b-5d91-47d3-9c89-661d7a6b539c): created successfully Sep 07 10:10:48 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-46108c58-7285-4ca9-b4cb-2dd0ab770f8c tempest-VolumesDeleteCascade-2079002316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ae52271-c1b9-4336-ab2e-b1bc50cb882b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:10:48 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-46108c58-7285-4ca9-b4cb-2dd0ab770f8c tempest-VolumesDeleteCascade-2079002316 None] Flow 'volume_create_manager' (a10c3e9a-6fe9-4e9c-affc-753f33e774be) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:10:48 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-46108c58-7285-4ca9-b4cb-2dd0ab770f8c tempest-VolumesDeleteCascade-2079002316 None] Created volume successfully. Sep 07 10:10:50 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-f408c205-2ce9-40cc-ae95-dd5e0c6d5e2a tempest-VolumesDeleteCascade-2079002316 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:10:50 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-f408c205-2ce9-40cc-ae95-dd5e0c6d5e2a tempest-VolumesDeleteCascade-2079002316 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:10:50 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-f408c205-2ce9-40cc-ae95-dd5e0c6d5e2a tempest-VolumesDeleteCascade-2079002316 None] Creating offline snapshot fc732808-cf78-40cb-8c32-de16658386c6 of volume 34408c0b-5d91-47d3-9c89-661d7a6b539c {{(pid=87515) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 10:10:50 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fbb7c6a-056a-48de-9fa1-ae65ea741afd]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:10:50 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-f408c205-2ce9-40cc-ae95-dd5e0c6d5e2a tempest-VolumesDeleteCascade-2079002316 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-34408c0b-5d91-47d3-9c89-661d7a6b539c {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:10:50 devstack sudo[101481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-34408c0b-5d91-47d3-9c89-661d7a6b539c Sep 07 10:10:50 devstack sudo[101481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:10:50 devstack sudo[101481]: pam_unix(sudo:session): session closed for user root Sep 07 10:10:50 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-f408c205-2ce9-40cc-ae95-dd5e0c6d5e2a tempest-VolumesDeleteCascade-2079002316 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-34408c0b-5d91-47d3-9c89-661d7a6b539c" returned: 0 in 0.500s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:10:50 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-f408c205-2ce9-40cc-ae95-dd5e0c6d5e2a tempest-VolumesDeleteCascade-2079002316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-34408c0b-5d91-47d3-9c89-661d7a6b539c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-34408c0b-5d91-47d3-9c89-661d7a6b539c.fc732808-cf78-40cb-8c32-de16658386c6 1G {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:10:51 devstack sudo[101490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-34408c0b-5d91-47d3-9c89-661d7a6b539c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-34408c0b-5d91-47d3-9c89-661d7a6b539c.fc732808-cf78-40cb-8c32-de16658386c6 1G Sep 07 10:10:51 devstack sudo[101490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:10:51 devstack sudo[101490]: pam_unix(sudo:session): session closed for user root Sep 07 10:10:51 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-f408c205-2ce9-40cc-ae95-dd5e0c6d5e2a tempest-VolumesDeleteCascade-2079002316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-34408c0b-5d91-47d3-9c89-661d7a6b539c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-34408c0b-5d91-47d3-9c89-661d7a6b539c.fc732808-cf78-40cb-8c32-de16658386c6 1G" returned: 0 in 0.565s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:10:51 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-f408c205-2ce9-40cc-ae95-dd5e0c6d5e2a tempest-VolumesDeleteCascade-2079002316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-34408c0b-5d91-47d3-9c89-661d7a6b539c -F qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-34408c0b-5d91-47d3-9c89-661d7a6b539c.fc732808-cf78-40cb-8c32-de16658386c6 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:10:51 devstack sudo[101510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-34408c0b-5d91-47d3-9c89-661d7a6b539c -F qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-34408c0b-5d91-47d3-9c89-661d7a6b539c.fc732808-cf78-40cb-8c32-de16658386c6 Sep 07 10:10:51 devstack sudo[101510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:10:51 devstack sudo[101510]: pam_unix(sudo:session): session closed for user root Sep 07 10:10:51 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-f408c205-2ce9-40cc-ae95-dd5e0c6d5e2a tempest-VolumesDeleteCascade-2079002316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-34408c0b-5d91-47d3-9c89-661d7a6b539c -F qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-34408c0b-5d91-47d3-9c89-661d7a6b539c.fc732808-cf78-40cb-8c32-de16658386c6" returned: 0 in 0.409s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:10:51 devstack cinder-volume[87515]: WARNING cinder.volume.drivers.remotefs [None req-f408c205-2ce9-40cc-ae95-dd5e0c6d5e2a tempest-VolumesDeleteCascade-2079002316 None] /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-34408c0b-5d91-47d3-9c89-661d7a6b539c.fc732808-cf78-40cb-8c32-de16658386c6 is being set with open permissions: ugo+rw Sep 07 10:10:51 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-f408c205-2ce9-40cc-ae95-dd5e0c6d5e2a tempest-VolumesDeleteCascade-2079002316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-34408c0b-5d91-47d3-9c89-661d7a6b539c.fc732808-cf78-40cb-8c32-de16658386c6 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:10:51 devstack sudo[101526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-34408c0b-5d91-47d3-9c89-661d7a6b539c.fc732808-cf78-40cb-8c32-de16658386c6 Sep 07 10:10:51 devstack sudo[101526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:10:52 devstack sudo[101526]: pam_unix(sudo:session): session closed for user root Sep 07 10:10:52 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-f408c205-2ce9-40cc-ae95-dd5e0c6d5e2a tempest-VolumesDeleteCascade-2079002316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-34408c0b-5d91-47d3-9c89-661d7a6b539c.fc732808-cf78-40cb-8c32-de16658386c6" returned: 0 in 0.316s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:10:52 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-f408c205-2ce9-40cc-ae95-dd5e0c6d5e2a tempest-VolumesDeleteCascade-2079002316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-34408c0b-5d91-47d3-9c89-661d7a6b539c.info {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:10:52 devstack sudo[101537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-34408c0b-5d91-47d3-9c89-661d7a6b539c.info Sep 07 10:10:52 devstack sudo[101537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:10:52 devstack sudo[101537]: pam_unix(sudo:session): session closed for user root Sep 07 10:10:52 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-f408c205-2ce9-40cc-ae95-dd5e0c6d5e2a tempest-VolumesDeleteCascade-2079002316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-34408c0b-5d91-47d3-9c89-661d7a6b539c.info" returned: 0 in 0.313s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:10:52 devstack cinder-volume[87515]: WARNING cinder.volume.drivers.remotefs [None req-f408c205-2ce9-40cc-ae95-dd5e0c6d5e2a tempest-VolumesDeleteCascade-2079002316 None] /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-34408c0b-5d91-47d3-9c89-661d7a6b539c.info is being set with open permissions: ugo+rw Sep 07 10:10:52 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-f408c205-2ce9-40cc-ae95-dd5e0c6d5e2a tempest-VolumesDeleteCascade-2079002316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-34408c0b-5d91-47d3-9c89-661d7a6b539c.info {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:10:52 devstack sudo[101540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-34408c0b-5d91-47d3-9c89-661d7a6b539c.info Sep 07 10:10:52 devstack sudo[101540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:10:53 devstack sudo[101540]: pam_unix(sudo:session): session closed for user root Sep 07 10:10:53 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-f408c205-2ce9-40cc-ae95-dd5e0c6d5e2a tempest-VolumesDeleteCascade-2079002316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-34408c0b-5d91-47d3-9c89-661d7a6b539c.info" returned: 0 in 0.426s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:10:53 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-f408c205-2ce9-40cc-ae95-dd5e0c6d5e2a tempest-VolumesDeleteCascade-2079002316 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.698s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:10:53 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-f408c205-2ce9-40cc-ae95-dd5e0c6d5e2a tempest-VolumesDeleteCascade-2079002316 None] Create snapshot completed successfully Sep 07 10:10:54 devstack cinder-volume[87515]: DEBUG cinder.volume.flows.manager.create_volume [None req-420594b0-121c-401f-b9b3-9b2aee9a1122 tempest-VolumesDeleteCascade-2079002316 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 10:10:54 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-420594b0-121c-401f-b9b3-9b2aee9a1122 tempest-VolumesDeleteCascade-2079002316 None] Flow 'volume_create_manager' (afdec9b5-f8d5-4097-96dc-099981a71a0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:10:54 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-420594b0-121c-401f-b9b3-9b2aee9a1122 tempest-VolumesDeleteCascade-2079002316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b44e039-dd06-4e88-85f6-dc542ed35e3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:10:54 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-420594b0-121c-401f-b9b3-9b2aee9a1122 tempest-VolumesDeleteCascade-2079002316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b44e039-dd06-4e88-85f6-dc542ed35e3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:10:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-764410403',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69c8ae07-a598-4792-927a-fecd8ee0d963,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4233f41eb56c4b6dbba2cdccb6a4f181',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:10:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=fc732808-cf78-40cb-8c32-de16658386c6,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:10:54Z,use_quota=True,user_id='7d395b3ed6d0465e89b8fe65f5db9d5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3a092cd-7947-4cbf-abff-4ba9567becf0),volume_type_id=f3a092cd-7947-4cbf-abff-4ba9567becf0)' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:10:54 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-420594b0-121c-401f-b9b3-9b2aee9a1122 tempest-VolumesDeleteCascade-2079002316 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1b2d480-6aa2-41c1-b3f5-01a11b19f642) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:10:54 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-420594b0-121c-401f-b9b3-9b2aee9a1122 tempest-VolumesDeleteCascade-2079002316 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1b2d480-6aa2-41c1-b3f5-01a11b19f642) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:10:54 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-420594b0-121c-401f-b9b3-9b2aee9a1122 tempest-VolumesDeleteCascade-2079002316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79ea046e-296c-44fa-8b5a-004f643c8f64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:10:54 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-420594b0-121c-401f-b9b3-9b2aee9a1122 tempest-VolumesDeleteCascade-2079002316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79ea046e-296c-44fa-8b5a-004f643c8f64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '69c8ae07-a598-4792-927a-fecd8ee0d963', 'volume_name': 'volume-69c8ae07-a598-4792-927a-fecd8ee0d963', 'volume_size': 1, 'snapshot_id': 'fc732808-cf78-40cb-8c32-de16658386c6'}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:10:54 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-420594b0-121c-401f-b9b3-9b2aee9a1122 tempest-VolumesDeleteCascade-2079002316 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8dd11994-f79d-4690-ad54-5fb7c94fd03f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:10:54 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-420594b0-121c-401f-b9b3-9b2aee9a1122 tempest-VolumesDeleteCascade-2079002316 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8dd11994-f79d-4690-ad54-5fb7c94fd03f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:10:54 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-420594b0-121c-401f-b9b3-9b2aee9a1122 tempest-VolumesDeleteCascade-2079002316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (717d8170-fcac-42c1-bf5d-1d18e94d98fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:10:54 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-420594b0-121c-401f-b9b3-9b2aee9a1122 tempest-VolumesDeleteCascade-2079002316 None] Volume 69c8ae07-a598-4792-927a-fecd8ee0d963: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-69c8ae07-a598-4792-927a-fecd8ee0d963', 'volume_size': 1, 'snapshot_id': 'fc732808-cf78-40cb-8c32-de16658386c6'} Sep 07 10:10:54 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-420594b0-121c-401f-b9b3-9b2aee9a1122 tempest-VolumesDeleteCascade-2079002316 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:10:54 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-420594b0-121c-401f-b9b3-9b2aee9a1122 tempest-VolumesDeleteCascade-2079002316 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:10:54 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-420594b0-121c-401f-b9b3-9b2aee9a1122 tempest-VolumesDeleteCascade-2079002316 None] Acquiring lock "cinder-quobyte-fc732808-cf78-40cb-8c32-de16658386c6-69c8ae07-a598-4792-927a-fecd8ee0d963" by "_create_volume_from_snapshot" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:10:54 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-420594b0-121c-401f-b9b3-9b2aee9a1122 tempest-VolumesDeleteCascade-2079002316 None] Lock "cinder-quobyte-fc732808-cf78-40cb-8c32-de16658386c6-69c8ae07-a598-4792-927a-fecd8ee0d963" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:10:54 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-420594b0-121c-401f-b9b3-9b2aee9a1122 tempest-VolumesDeleteCascade-2079002316 None] Creating volume 69c8ae07-a598-4792-927a-fecd8ee0d963 from snapshot fc732808-cf78-40cb-8c32-de16658386c6 {{(pid=87515) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 07 10:10:54 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-420594b0-121c-401f-b9b3-9b2aee9a1122 tempest-VolumesDeleteCascade-2079002316 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:10:54 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-420594b0-121c-401f-b9b3-9b2aee9a1122 tempest-VolumesDeleteCascade-2079002316 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:10:54 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-420594b0-121c-401f-b9b3-9b2aee9a1122 tempest-VolumesDeleteCascade-2079002316 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:10:54 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-420594b0-121c-401f-b9b3-9b2aee9a1122 tempest-VolumesDeleteCascade-2079002316 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:10:54 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-420594b0-121c-401f-b9b3-9b2aee9a1122 tempest-VolumesDeleteCascade-2079002316 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:10:54 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-420594b0-121c-401f-b9b3-9b2aee9a1122 tempest-VolumesDeleteCascade-2079002316 None] Selected osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c as target Quobyte volume. {{(pid=87515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 10:10:54 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-420594b0-121c-401f-b9b3-9b2aee9a1122 tempest-VolumesDeleteCascade-2079002316 None] Acquiring lock "cinder-quobyte-69c8ae07-a598-4792-927a-fecd8ee0d963" by "_copy_volume_from_snapshot" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:10:54 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-420594b0-121c-401f-b9b3-9b2aee9a1122 tempest-VolumesDeleteCascade-2079002316 None] Lock "cinder-quobyte-69c8ae07-a598-4792-927a-fecd8ee0d963" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:10:54 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-420594b0-121c-401f-b9b3-9b2aee9a1122 tempest-VolumesDeleteCascade-2079002316 None] snapshot: fc732808-cf78-40cb-8c32-de16658386c6, volume: 69c8ae07-a598-4792-927a-fecd8ee0d963, {{(pid=87515) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 07 10:10:54 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-420594b0-121c-401f-b9b3-9b2aee9a1122 tempest-VolumesDeleteCascade-2079002316 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:10:54 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-420594b0-121c-401f-b9b3-9b2aee9a1122 tempest-VolumesDeleteCascade-2079002316 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:10:54 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-420594b0-121c-401f-b9b3-9b2aee9a1122 tempest-VolumesDeleteCascade-2079002316 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:10:54 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-420594b0-121c-401f-b9b3-9b2aee9a1122 tempest-VolumesDeleteCascade-2079002316 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:10:54 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-420594b0-121c-401f-b9b3-9b2aee9a1122 tempest-VolumesDeleteCascade-2079002316 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:10:54 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b8b6d71-6cb3-4be2-84d4-1ba98a4a6e85]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:10:54 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-420594b0-121c-401f-b9b3-9b2aee9a1122 tempest-VolumesDeleteCascade-2079002316 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-34408c0b-5d91-47d3-9c89-661d7a6b539c.fc732808-cf78-40cb-8c32-de16658386c6 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:10:54 devstack sudo[101609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-34408c0b-5d91-47d3-9c89-661d7a6b539c.fc732808-cf78-40cb-8c32-de16658386c6 Sep 07 10:10:54 devstack sudo[101609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:10:55 devstack sudo[101609]: pam_unix(sudo:session): session closed for user root Sep 07 10:10:55 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-420594b0-121c-401f-b9b3-9b2aee9a1122 tempest-VolumesDeleteCascade-2079002316 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-34408c0b-5d91-47d3-9c89-661d7a6b539c.fc732808-cf78-40cb-8c32-de16658386c6" returned: 0 in 0.486s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:10:55 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-420594b0-121c-401f-b9b3-9b2aee9a1122 tempest-VolumesDeleteCascade-2079002316 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-34408c0b-5d91-47d3-9c89-661d7a6b539c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87515) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 10:10:55 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d0d8411-aeec-4b44-b5a8-ecee5d89cfbc]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:10:55 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-420594b0-121c-401f-b9b3-9b2aee9a1122 tempest-VolumesDeleteCascade-2079002316 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-34408c0b-5d91-47d3-9c89-661d7a6b539c {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:10:55 devstack sudo[101616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-34408c0b-5d91-47d3-9c89-661d7a6b539c Sep 07 10:10:55 devstack sudo[101616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:10:55 devstack sudo[101616]: pam_unix(sudo:session): session closed for user root Sep 07 10:10:55 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-420594b0-121c-401f-b9b3-9b2aee9a1122 tempest-VolumesDeleteCascade-2079002316 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-34408c0b-5d91-47d3-9c89-661d7a6b539c" returned: 0 in 0.392s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:10:55 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-420594b0-121c-401f-b9b3-9b2aee9a1122 tempest-VolumesDeleteCascade-2079002316 None] will copy from snapshot at /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-34408c0b-5d91-47d3-9c89-661d7a6b539c {{(pid=87515) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 07 10:10:55 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-420594b0-121c-401f-b9b3-9b2aee9a1122 tempest-VolumesDeleteCascade-2079002316 None] Creating direct copy from snapshot {{(pid=87515) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 07 10:10:55 devstack cinder-volume[87515]: DEBUG cinder.utils [None req-420594b0-121c-401f-b9b3-9b2aee9a1122 tempest-VolumesDeleteCascade-2079002316 None] Path /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-69c8ae07-a598-4792-927a-fecd8ee0d963 not found in is_blk_device check {{(pid=87515) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 07 10:10:55 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-420594b0-121c-401f-b9b3-9b2aee9a1122 tempest-VolumesDeleteCascade-2079002316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-34408c0b-5d91-47d3-9c89-661d7a6b539c /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-69c8ae07-a598-4792-927a-fecd8ee0d963 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:10:55 devstack sudo[101621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-34408c0b-5d91-47d3-9c89-661d7a6b539c /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-69c8ae07-a598-4792-927a-fecd8ee0d963 Sep 07 10:10:55 devstack sudo[101621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:10:59 devstack cinder-volume[87515]: DEBUG cinder.volume.flows.manager.create_volume [None req-1c2274a6-e62c-4ce2-b91c-ce60a447f571 tempest-TestMinimumBasicScenario-377324908 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 10:10:59 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-1c2274a6-e62c-4ce2-b91c-ce60a447f571 tempest-TestMinimumBasicScenario-377324908 None] Flow 'volume_create_manager' (5c588c84-6e9d-4c00-a468-b7483f456502) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:10:59 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-1c2274a6-e62c-4ce2-b91c-ce60a447f571 tempest-TestMinimumBasicScenario-377324908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d90c729d-16d4-47f9-a190-0f528a08d465) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:11:00 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-1c2274a6-e62c-4ce2-b91c-ce60a447f571 tempest-TestMinimumBasicScenario-377324908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d90c729d-16d4-47f9-a190-0f528a08d465) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:10:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1455092513',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e43b284-e13a-447a-99e5-88a736c2d8ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a96249f3d1424cb1a1688f4b45a04e3a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:11:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:11:00Z,use_quota=True,user_id='4ee8c346a8c74837a7c7e31f446aed27',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3a092cd-7947-4cbf-abff-4ba9567becf0),volume_type_id=f3a092cd-7947-4cbf-abff-4ba9567becf0)' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:11:00 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-1c2274a6-e62c-4ce2-b91c-ce60a447f571 tempest-TestMinimumBasicScenario-377324908 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8643b7c2-e979-4de7-a72a-e527a669171d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:11:00 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-1c2274a6-e62c-4ce2-b91c-ce60a447f571 tempest-TestMinimumBasicScenario-377324908 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8643b7c2-e979-4de7-a72a-e527a669171d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:11:00 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-1c2274a6-e62c-4ce2-b91c-ce60a447f571 tempest-TestMinimumBasicScenario-377324908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2981801-be43-4047-b246-ae7261de1cdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:11:00 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-1c2274a6-e62c-4ce2-b91c-ce60a447f571 tempest-TestMinimumBasicScenario-377324908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2981801-be43-4047-b246-ae7261de1cdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6e43b284-e13a-447a-99e5-88a736c2d8ec', 'volume_name': 'volume-6e43b284-e13a-447a-99e5-88a736c2d8ec', 'volume_size': 1}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:11:00 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-1c2274a6-e62c-4ce2-b91c-ce60a447f571 tempest-TestMinimumBasicScenario-377324908 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b904a540-4d55-4147-9798-b79074aa6e29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:11:00 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-1c2274a6-e62c-4ce2-b91c-ce60a447f571 tempest-TestMinimumBasicScenario-377324908 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b904a540-4d55-4147-9798-b79074aa6e29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:11:00 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-1c2274a6-e62c-4ce2-b91c-ce60a447f571 tempest-TestMinimumBasicScenario-377324908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59f0da85-0757-4abe-ba23-c05c7c4c78dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:11:00 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-1c2274a6-e62c-4ce2-b91c-ce60a447f571 tempest-TestMinimumBasicScenario-377324908 None] Volume 6e43b284-e13a-447a-99e5-88a736c2d8ec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6e43b284-e13a-447a-99e5-88a736c2d8ec', 'volume_size': 1} Sep 07 10:11:00 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-1c2274a6-e62c-4ce2-b91c-ce60a447f571 tempest-TestMinimumBasicScenario-377324908 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:11:03 devstack sudo[101621]: pam_unix(sudo:session): session closed for user root Sep 07 10:11:03 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-420594b0-121c-401f-b9b3-9b2aee9a1122 tempest-VolumesDeleteCascade-2079002316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-34408c0b-5d91-47d3-9c89-661d7a6b539c /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-69c8ae07-a598-4792-927a-fecd8ee0d963" returned: 0 in 7.784s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:11:03 devstack cinder-volume[87515]: DEBUG cinder.image.image_utils [None req-420594b0-121c-401f-b9b3-9b2aee9a1122 tempest-VolumesDeleteCascade-2079002316 None] Image conversion details: src /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-34408c0b-5d91-47d3-9c89-661d7a6b539c, size 1024.00 MB, duration 7.79 sec, destination /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-69c8ae07-a598-4792-927a-fecd8ee0d963 {{(pid=87515) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 07 10:11:03 devstack cinder-volume[87515]: INFO cinder.image.image_utils [None req-420594b0-121c-401f-b9b3-9b2aee9a1122 tempest-VolumesDeleteCascade-2079002316 None] Converted 1024.00 MB image at 131.52 MB/s Sep 07 10:11:03 devstack cinder-volume[87515]: WARNING cinder.volume.drivers.remotefs [None req-420594b0-121c-401f-b9b3-9b2aee9a1122 tempest-VolumesDeleteCascade-2079002316 None] /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-69c8ae07-a598-4792-927a-fecd8ee0d963 is being set with open permissions: ugo+rw Sep 07 10:11:03 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-420594b0-121c-401f-b9b3-9b2aee9a1122 tempest-VolumesDeleteCascade-2079002316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-69c8ae07-a598-4792-927a-fecd8ee0d963 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:11:03 devstack sudo[101646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-69c8ae07-a598-4792-927a-fecd8ee0d963 Sep 07 10:11:03 devstack sudo[101646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:11:03 devstack sudo[101646]: pam_unix(sudo:session): session closed for user root Sep 07 10:11:03 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-420594b0-121c-401f-b9b3-9b2aee9a1122 tempest-VolumesDeleteCascade-2079002316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-69c8ae07-a598-4792-927a-fecd8ee0d963" returned: 0 in 0.282s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:11:03 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-420594b0-121c-401f-b9b3-9b2aee9a1122 tempest-VolumesDeleteCascade-2079002316 None] Lock "cinder-quobyte-69c8ae07-a598-4792-927a-fecd8ee0d963" released by "_copy_volume_from_snapshot" :: held 9.058s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:11:03 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-420594b0-121c-401f-b9b3-9b2aee9a1122 tempest-VolumesDeleteCascade-2079002316 None] Lock "cinder-quobyte-fc732808-cf78-40cb-8c32-de16658386c6-69c8ae07-a598-4792-927a-fecd8ee0d963" released by "_create_volume_from_snapshot" :: held 9.161s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:11:03 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-420594b0-121c-401f-b9b3-9b2aee9a1122 tempest-VolumesDeleteCascade-2079002316 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.180s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:11:03 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-1c2274a6-e62c-4ce2-b91c-ce60a447f571 tempest-TestMinimumBasicScenario-377324908 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.494s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:11:03 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-1c2274a6-e62c-4ce2-b91c-ce60a447f571 tempest-TestMinimumBasicScenario-377324908 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:10:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1455092513',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e43b284-e13a-447a-99e5-88a736c2d8ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a96249f3d1424cb1a1688f4b45a04e3a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:11:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:11:00Z,use_quota=True,user_id='4ee8c346a8c74837a7c7e31f446aed27',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3a092cd-7947-4cbf-abff-4ba9567becf0),volume_type_id=f3a092cd-7947-4cbf-abff-4ba9567becf0)}" {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 10:11:03 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-1c2274a6-e62c-4ce2-b91c-ce60a447f571 tempest-TestMinimumBasicScenario-377324908 None] Creating volume 6e43b284-e13a-447a-99e5-88a736c2d8ec {{(pid=87515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 10:11:03 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-1c2274a6-e62c-4ce2-b91c-ce60a447f571 tempest-TestMinimumBasicScenario-377324908 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:11:03 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-1c2274a6-e62c-4ce2-b91c-ce60a447f571 tempest-TestMinimumBasicScenario-377324908 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:11:03 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-1c2274a6-e62c-4ce2-b91c-ce60a447f571 tempest-TestMinimumBasicScenario-377324908 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:11:03 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-1c2274a6-e62c-4ce2-b91c-ce60a447f571 tempest-TestMinimumBasicScenario-377324908 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:11:03 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-1c2274a6-e62c-4ce2-b91c-ce60a447f571 tempest-TestMinimumBasicScenario-377324908 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:11:03 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-1c2274a6-e62c-4ce2-b91c-ce60a447f571 tempest-TestMinimumBasicScenario-377324908 None] Selected osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c as target Quobyte volume. {{(pid=87515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 10:11:03 devstack cinder-volume[87515]: INFO cinder.volume.drivers.remotefs [None req-1c2274a6-e62c-4ce2-b91c-ce60a447f571 tempest-TestMinimumBasicScenario-377324908 None] casted to osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c Sep 07 10:11:03 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-1c2274a6-e62c-4ce2-b91c-ce60a447f571 tempest-TestMinimumBasicScenario-377324908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-6e43b284-e13a-447a-99e5-88a736c2d8ec 1073741824 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:11:03 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-420594b0-121c-401f-b9b3-9b2aee9a1122 tempest-VolumesDeleteCascade-2079002316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (717d8170-fcac-42c1-bf5d-1d18e94d98fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-69c8ae07-a598-4792-927a-fecd8ee0d963', 'volume_size': 1, 'snapshot_id': 'fc732808-cf78-40cb-8c32-de16658386c6'}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:11:03 devstack sudo[101649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-6e43b284-e13a-447a-99e5-88a736c2d8ec 1073741824 Sep 07 10:11:03 devstack sudo[101649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:11:03 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-420594b0-121c-401f-b9b3-9b2aee9a1122 tempest-VolumesDeleteCascade-2079002316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c5c3b1b-96ca-4904-82a3-6cc44dfcf940) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:11:03 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-420594b0-121c-401f-b9b3-9b2aee9a1122 tempest-VolumesDeleteCascade-2079002316 None] Volume volume-69c8ae07-a598-4792-927a-fecd8ee0d963 (69c8ae07-a598-4792-927a-fecd8ee0d963): created successfully Sep 07 10:11:03 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-420594b0-121c-401f-b9b3-9b2aee9a1122 tempest-VolumesDeleteCascade-2079002316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c5c3b1b-96ca-4904-82a3-6cc44dfcf940) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:11:03 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-420594b0-121c-401f-b9b3-9b2aee9a1122 tempest-VolumesDeleteCascade-2079002316 None] Flow 'volume_create_manager' (afdec9b5-f8d5-4097-96dc-099981a71a0d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:11:03 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-420594b0-121c-401f-b9b3-9b2aee9a1122 tempest-VolumesDeleteCascade-2079002316 None] Created volume successfully. Sep 07 10:11:04 devstack sudo[101649]: pam_unix(sudo:session): session closed for user root Sep 07 10:11:04 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-1c2274a6-e62c-4ce2-b91c-ce60a447f571 tempest-TestMinimumBasicScenario-377324908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-6e43b284-e13a-447a-99e5-88a736c2d8ec 1073741824" returned: 0 in 0.669s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:11:04 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-1c2274a6-e62c-4ce2-b91c-ce60a447f571 tempest-TestMinimumBasicScenario-377324908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-6e43b284-e13a-447a-99e5-88a736c2d8ec {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:11:04 devstack sudo[101655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-6e43b284-e13a-447a-99e5-88a736c2d8ec Sep 07 10:11:04 devstack sudo[101655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:11:04 devstack sudo[101655]: pam_unix(sudo:session): session closed for user root Sep 07 10:11:04 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-1c2274a6-e62c-4ce2-b91c-ce60a447f571 tempest-TestMinimumBasicScenario-377324908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-6e43b284-e13a-447a-99e5-88a736c2d8ec" returned: 0 in 0.383s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:11:04 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-1c2274a6-e62c-4ce2-b91c-ce60a447f571 tempest-TestMinimumBasicScenario-377324908 None] <== create_volume: return (1110ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'} {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 10:11:04 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-1c2274a6-e62c-4ce2-b91c-ce60a447f571 tempest-TestMinimumBasicScenario-377324908 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.113s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:11:04 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-1c2274a6-e62c-4ce2-b91c-ce60a447f571 tempest-TestMinimumBasicScenario-377324908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59f0da85-0757-4abe-ba23-c05c7c4c78dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6e43b284-e13a-447a-99e5-88a736c2d8ec', 'volume_size': 1}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:11:04 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-1c2274a6-e62c-4ce2-b91c-ce60a447f571 tempest-TestMinimumBasicScenario-377324908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af722ab0-31a3-447d-891c-189348c7ddef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:11:04 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-1c2274a6-e62c-4ce2-b91c-ce60a447f571 tempest-TestMinimumBasicScenario-377324908 None] Volume volume-6e43b284-e13a-447a-99e5-88a736c2d8ec (6e43b284-e13a-447a-99e5-88a736c2d8ec): created successfully Sep 07 10:11:04 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-1c2274a6-e62c-4ce2-b91c-ce60a447f571 tempest-TestMinimumBasicScenario-377324908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af722ab0-31a3-447d-891c-189348c7ddef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:11:04 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-1c2274a6-e62c-4ce2-b91c-ce60a447f571 tempest-TestMinimumBasicScenario-377324908 None] Flow 'volume_create_manager' (5c588c84-6e9d-4c00-a468-b7483f456502) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:11:04 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-1c2274a6-e62c-4ce2-b91c-ce60a447f571 tempest-TestMinimumBasicScenario-377324908 None] Created volume successfully. Sep 07 10:11:04 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-03fd55b1-58fa-4877-87e2-fece0533fd72 tempest-VolumesDeleteCascade-2079002316 None] Acquiring lock "cinder-34408c0b-5d91-47d3-9c89-661d7a6b539c-delete_volume" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:11:04 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-03fd55b1-58fa-4877-87e2-fece0533fd72 tempest-VolumesDeleteCascade-2079002316 None] Lock "cinder-34408c0b-5d91-47d3-9c89-661d7a6b539c-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:11:05 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-03fd55b1-58fa-4877-87e2-fece0533fd72 tempest-VolumesDeleteCascade-2079002316 None] Performing cascade delete. {{(pid=87515) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Sep 07 10:11:05 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-03fd55b1-58fa-4877-87e2-fece0533fd72 tempest-VolumesDeleteCascade-2079002316 None] Acquiring lock "cinder-fc732808-cf78-40cb-8c32-de16658386c6-delete_snapshot" by "delete_snapshot" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:11:05 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-03fd55b1-58fa-4877-87e2-fece0533fd72 tempest-VolumesDeleteCascade-2079002316 None] Lock "cinder-fc732808-cf78-40cb-8c32-de16658386c6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:11:05 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-03fd55b1-58fa-4877-87e2-fece0533fd72 tempest-VolumesDeleteCascade-2079002316 None] Acquiring lock "cinder-quobyte-34408c0b-5d91-47d3-9c89-661d7a6b539c" by "delete_snapshot" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:11:05 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-03fd55b1-58fa-4877-87e2-fece0533fd72 tempest-VolumesDeleteCascade-2079002316 None] Lock "cinder-quobyte-34408c0b-5d91-47d3-9c89-661d7a6b539c" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:11:05 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-03fd55b1-58fa-4877-87e2-fece0533fd72 tempest-VolumesDeleteCascade-2079002316 None] Acquiring lock "cinder-quobyte-fc732808-cf78-40cb-8c32-de16658386c6" by "_delete_snapshot" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:11:05 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-03fd55b1-58fa-4877-87e2-fece0533fd72 tempest-VolumesDeleteCascade-2079002316 None] Lock "cinder-quobyte-fc732808-cf78-40cb-8c32-de16658386c6" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:11:05 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-03fd55b1-58fa-4877-87e2-fece0533fd72 tempest-VolumesDeleteCascade-2079002316 None] Deleting offline snapshot fc732808-cf78-40cb-8c32-de16658386c6 of volume 34408c0b-5d91-47d3-9c89-661d7a6b539c {{(pid=87515) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 10:11:05 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-03fd55b1-58fa-4877-87e2-fece0533fd72 tempest-VolumesDeleteCascade-2079002316 None] snapshot_file for this snap is: volume-34408c0b-5d91-47d3-9c89-661d7a6b539c.fc732808-cf78-40cb-8c32-de16658386c6 {{(pid=87515) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 10:11:05 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2766983-f335-488c-a422-9af5576209f7]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:11:05 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-03fd55b1-58fa-4877-87e2-fece0533fd72 tempest-VolumesDeleteCascade-2079002316 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-34408c0b-5d91-47d3-9c89-661d7a6b539c.fc732808-cf78-40cb-8c32-de16658386c6 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:11:05 devstack sudo[101658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-34408c0b-5d91-47d3-9c89-661d7a6b539c.fc732808-cf78-40cb-8c32-de16658386c6 Sep 07 10:11:05 devstack sudo[101658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:11:05 devstack sudo[101658]: pam_unix(sudo:session): session closed for user root Sep 07 10:11:05 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-03fd55b1-58fa-4877-87e2-fece0533fd72 tempest-VolumesDeleteCascade-2079002316 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-34408c0b-5d91-47d3-9c89-661d7a6b539c.fc732808-cf78-40cb-8c32-de16658386c6" returned: 0 in 0.418s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:11:05 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-03fd55b1-58fa-4877-87e2-fece0533fd72 tempest-VolumesDeleteCascade-2079002316 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-34408c0b-5d91-47d3-9c89-661d7a6b539c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87515) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 10:11:05 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b021b64-160b-407f-a43a-9571f21296f6]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:11:05 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-03fd55b1-58fa-4877-87e2-fece0533fd72 tempest-VolumesDeleteCascade-2079002316 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-34408c0b-5d91-47d3-9c89-661d7a6b539c {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:11:05 devstack sudo[101664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-34408c0b-5d91-47d3-9c89-661d7a6b539c Sep 07 10:11:05 devstack sudo[101664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:11:05 devstack cinder-volume[87515]: DEBUG cinder.volume.flows.manager.create_volume [None req-48d9faed-b05f-49b8-b00d-f7263a78e326 tempest-TestImageHashVerification-2025397769 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 10:11:05 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-48d9faed-b05f-49b8-b00d-f7263a78e326 tempest-TestImageHashVerification-2025397769 None] Flow 'volume_create_manager' (69daef29-3b31-4626-8190-5bea997e3147) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:11:05 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-48d9faed-b05f-49b8-b00d-f7263a78e326 tempest-TestImageHashVerification-2025397769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56e2be82-0777-48d5-b545-7c42da6c0939) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:11:06 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-48d9faed-b05f-49b8-b00d-f7263a78e326 tempest-TestImageHashVerification-2025397769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56e2be82-0777-48d5-b545-7c42da6c0939) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:11:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-879532450',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=220ae635-cf18-41e2-a7bf-2d00428069d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8848ff7e4794d2b818de9d01144c638',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:11:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:11:06Z,use_quota=True,user_id='f922cea9c848471ab73fddba43c2fec5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3a092cd-7947-4cbf-abff-4ba9567becf0),volume_type_id=f3a092cd-7947-4cbf-abff-4ba9567becf0)' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:11:06 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-48d9faed-b05f-49b8-b00d-f7263a78e326 tempest-TestImageHashVerification-2025397769 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (911058a0-13e9-408c-b015-c4c4d885db0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:11:06 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-48d9faed-b05f-49b8-b00d-f7263a78e326 tempest-TestImageHashVerification-2025397769 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (911058a0-13e9-408c-b015-c4c4d885db0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:11:06 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-48d9faed-b05f-49b8-b00d-f7263a78e326 tempest-TestImageHashVerification-2025397769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71e2b993-cf02-42b6-8061-e8a522bce8bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:11:06 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-48d9faed-b05f-49b8-b00d-f7263a78e326 tempest-TestImageHashVerification-2025397769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71e2b993-cf02-42b6-8061-e8a522bce8bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '220ae635-cf18-41e2-a7bf-2d00428069d1', 'volume_name': 'volume-220ae635-cf18-41e2-a7bf-2d00428069d1', 'volume_size': 1}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:11:06 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-48d9faed-b05f-49b8-b00d-f7263a78e326 tempest-TestImageHashVerification-2025397769 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58889277-b879-4822-94b8-797c245ac62c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:11:06 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-48d9faed-b05f-49b8-b00d-f7263a78e326 tempest-TestImageHashVerification-2025397769 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58889277-b879-4822-94b8-797c245ac62c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:11:06 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-48d9faed-b05f-49b8-b00d-f7263a78e326 tempest-TestImageHashVerification-2025397769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df7c3782-eb97-4faa-a775-5c9e6e348d43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:11:06 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-48d9faed-b05f-49b8-b00d-f7263a78e326 tempest-TestImageHashVerification-2025397769 None] Volume 220ae635-cf18-41e2-a7bf-2d00428069d1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-220ae635-cf18-41e2-a7bf-2d00428069d1', 'volume_size': 1} Sep 07 10:11:06 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-48d9faed-b05f-49b8-b00d-f7263a78e326 tempest-TestImageHashVerification-2025397769 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:11:06 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-48d9faed-b05f-49b8-b00d-f7263a78e326 tempest-TestImageHashVerification-2025397769 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:11:06 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-48d9faed-b05f-49b8-b00d-f7263a78e326 tempest-TestImageHashVerification-2025397769 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:11:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-879532450',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=220ae635-cf18-41e2-a7bf-2d00428069d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8848ff7e4794d2b818de9d01144c638',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:11:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:11:06Z,use_quota=True,user_id='f922cea9c848471ab73fddba43c2fec5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3a092cd-7947-4cbf-abff-4ba9567becf0),volume_type_id=f3a092cd-7947-4cbf-abff-4ba9567becf0)}" {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 10:11:06 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-48d9faed-b05f-49b8-b00d-f7263a78e326 tempest-TestImageHashVerification-2025397769 None] Creating volume 220ae635-cf18-41e2-a7bf-2d00428069d1 {{(pid=87515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 10:11:06 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-48d9faed-b05f-49b8-b00d-f7263a78e326 tempest-TestImageHashVerification-2025397769 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:11:06 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-48d9faed-b05f-49b8-b00d-f7263a78e326 tempest-TestImageHashVerification-2025397769 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:11:06 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-48d9faed-b05f-49b8-b00d-f7263a78e326 tempest-TestImageHashVerification-2025397769 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:11:06 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-48d9faed-b05f-49b8-b00d-f7263a78e326 tempest-TestImageHashVerification-2025397769 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:11:06 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-48d9faed-b05f-49b8-b00d-f7263a78e326 tempest-TestImageHashVerification-2025397769 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:11:06 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-48d9faed-b05f-49b8-b00d-f7263a78e326 tempest-TestImageHashVerification-2025397769 None] Selected osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c as target Quobyte volume. {{(pid=87515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 10:11:06 devstack cinder-volume[87515]: INFO cinder.volume.drivers.remotefs [None req-48d9faed-b05f-49b8-b00d-f7263a78e326 tempest-TestImageHashVerification-2025397769 None] casted to osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c Sep 07 10:11:06 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-48d9faed-b05f-49b8-b00d-f7263a78e326 tempest-TestImageHashVerification-2025397769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-220ae635-cf18-41e2-a7bf-2d00428069d1 1073741824 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:11:06 devstack sudo[101671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-220ae635-cf18-41e2-a7bf-2d00428069d1 1073741824 Sep 07 10:11:06 devstack sudo[101671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:11:06 devstack sudo[101664]: pam_unix(sudo:session): session closed for user root Sep 07 10:11:06 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-03fd55b1-58fa-4877-87e2-fece0533fd72 tempest-VolumesDeleteCascade-2079002316 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-34408c0b-5d91-47d3-9c89-661d7a6b539c" returned: 0 in 0.739s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:11:06 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-03fd55b1-58fa-4877-87e2-fece0533fd72 tempest-VolumesDeleteCascade-2079002316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-34408c0b-5d91-47d3-9c89-661d7a6b539c.fc732808-cf78-40cb-8c32-de16658386c6 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:11:06 devstack sudo[101674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-34408c0b-5d91-47d3-9c89-661d7a6b539c.fc732808-cf78-40cb-8c32-de16658386c6 Sep 07 10:11:06 devstack sudo[101674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:11:06 devstack sudo[101671]: pam_unix(sudo:session): session closed for user root Sep 07 10:11:06 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-48d9faed-b05f-49b8-b00d-f7263a78e326 tempest-TestImageHashVerification-2025397769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-220ae635-cf18-41e2-a7bf-2d00428069d1 1073741824" returned: 0 in 0.603s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:11:06 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [req-eaded8c7-ff79-4e40-80b4-442b1ec38cd0 req-35c73e56-9ed8-4b04-8ee4-02cc20bbdf36 tempest-TestMinimumBasicScenario-377324908 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:11:06 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-48d9faed-b05f-49b8-b00d-f7263a78e326 tempest-TestImageHashVerification-2025397769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-220ae635-cf18-41e2-a7bf-2d00428069d1 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:11:06 devstack sudo[101692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-220ae635-cf18-41e2-a7bf-2d00428069d1 Sep 07 10:11:06 devstack sudo[101692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:11:06 devstack sudo[101674]: pam_unix(sudo:session): session closed for user root Sep 07 10:11:06 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-03fd55b1-58fa-4877-87e2-fece0533fd72 tempest-VolumesDeleteCascade-2079002316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-34408c0b-5d91-47d3-9c89-661d7a6b539c.fc732808-cf78-40cb-8c32-de16658386c6" returned: 0 in 0.508s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:11:06 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-03fd55b1-58fa-4877-87e2-fece0533fd72 tempest-VolumesDeleteCascade-2079002316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-34408c0b-5d91-47d3-9c89-661d7a6b539c.fc732808-cf78-40cb-8c32-de16658386c6 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:11:06 devstack sudo[101695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-34408c0b-5d91-47d3-9c89-661d7a6b539c.fc732808-cf78-40cb-8c32-de16658386c6 Sep 07 10:11:06 devstack sudo[101695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:11:07 devstack sudo[101692]: pam_unix(sudo:session): session closed for user root Sep 07 10:11:07 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-48d9faed-b05f-49b8-b00d-f7263a78e326 tempest-TestImageHashVerification-2025397769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-220ae635-cf18-41e2-a7bf-2d00428069d1" returned: 0 in 0.314s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:11:07 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-48d9faed-b05f-49b8-b00d-f7263a78e326 tempest-TestImageHashVerification-2025397769 None] <== create_volume: return (999ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'} {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 10:11:07 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-48d9faed-b05f-49b8-b00d-f7263a78e326 tempest-TestImageHashVerification-2025397769 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.004s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:11:07 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [req-eaded8c7-ff79-4e40-80b4-442b1ec38cd0 req-35c73e56-9ed8-4b04-8ee4-02cc20bbdf36 tempest-TestMinimumBasicScenario-377324908 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.332s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:11:07 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-48d9faed-b05f-49b8-b00d-f7263a78e326 tempest-TestImageHashVerification-2025397769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df7c3782-eb97-4faa-a775-5c9e6e348d43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-220ae635-cf18-41e2-a7bf-2d00428069d1', 'volume_size': 1}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:11:07 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-48d9faed-b05f-49b8-b00d-f7263a78e326 tempest-TestImageHashVerification-2025397769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee7dc9f8-ce83-4d71-9481-076821da3c2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:11:07 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [req-eaded8c7-ff79-4e40-80b4-442b1ec38cd0 req-35c73e56-9ed8-4b04-8ee4-02cc20bbdf36 tempest-TestMinimumBasicScenario-377324908 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.032s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:11:07 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-48d9faed-b05f-49b8-b00d-f7263a78e326 tempest-TestImageHashVerification-2025397769 None] Volume volume-220ae635-cf18-41e2-a7bf-2d00428069d1 (220ae635-cf18-41e2-a7bf-2d00428069d1): created successfully Sep 07 10:11:07 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-48d9faed-b05f-49b8-b00d-f7263a78e326 tempest-TestImageHashVerification-2025397769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee7dc9f8-ce83-4d71-9481-076821da3c2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:11:07 devstack sudo[101695]: pam_unix(sudo:session): session closed for user root Sep 07 10:11:07 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-48d9faed-b05f-49b8-b00d-f7263a78e326 tempest-TestImageHashVerification-2025397769 None] Flow 'volume_create_manager' (69daef29-3b31-4626-8190-5bea997e3147) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:11:07 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-03fd55b1-58fa-4877-87e2-fece0533fd72 tempest-VolumesDeleteCascade-2079002316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-34408c0b-5d91-47d3-9c89-661d7a6b539c.fc732808-cf78-40cb-8c32-de16658386c6" returned: 0 in 0.313s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:11:07 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-03fd55b1-58fa-4877-87e2-fece0533fd72 tempest-VolumesDeleteCascade-2079002316 None] Lock "cinder-quobyte-fc732808-cf78-40cb-8c32-de16658386c6" released by "_delete_snapshot" :: held 2.093s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:11:07 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-48d9faed-b05f-49b8-b00d-f7263a78e326 tempest-TestImageHashVerification-2025397769 None] Created volume successfully. Sep 07 10:11:07 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-03fd55b1-58fa-4877-87e2-fece0533fd72 tempest-VolumesDeleteCascade-2079002316 None] Lock "cinder-quobyte-34408c0b-5d91-47d3-9c89-661d7a6b539c" released by "delete_snapshot" :: held 2.140s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:11:07 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [req-eaded8c7-ff79-4e40-80b4-442b1ec38cd0 req-35c73e56-9ed8-4b04-8ee4-02cc20bbdf36 tempest-TestMinimumBasicScenario-377324908 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c', 'name': 'volume-6e43b284-e13a-447a-99e5-88a736c2d8ec', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'bbcf63f0-14f9-4333-ba83-8b3b09155ae9', 'enforce_multipath': True} {{(pid=87515) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 07 10:11:07 devstack cinder-volume[87515]: INFO cinder.volume.manager [req-eaded8c7-ff79-4e40-80b4-442b1ec38cd0 req-35c73e56-9ed8-4b04-8ee4-02cc20bbdf36 tempest-TestMinimumBasicScenario-377324908 None] attachment_update completed successfully. Sep 07 10:11:07 devstack cinder-volume[87515]: DEBUG cinder.quota [None req-03fd55b1-58fa-4877-87e2-fece0533fd72 tempest-VolumesDeleteCascade-2079002316 None] Created reservations ['46300b15-8e82-40b6-8c38-29698cb18e6c', '9bf1f97b-1cb7-46dd-bcd3-c1f0244f93fa', '36aa91a0-ea2e-4558-89d4-0057db1cb622', '6918dea8-5847-4db9-9531-960ef690e695'] {{(pid=87515) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:11:07 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-03fd55b1-58fa-4877-87e2-fece0533fd72 tempest-VolumesDeleteCascade-2079002316 None] Delete snapshot completed successfully. Sep 07 10:11:07 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-03fd55b1-58fa-4877-87e2-fece0533fd72 tempest-VolumesDeleteCascade-2079002316 None] Lock "cinder-fc732808-cf78-40cb-8c32-de16658386c6-delete_snapshot" released by "delete_snapshot" :: held 2.368s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:11:07 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-03fd55b1-58fa-4877-87e2-fece0533fd72 tempest-VolumesDeleteCascade-2079002316 None] Snapshots deleted, issuing volume delete {{(pid=87515) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Sep 07 10:11:07 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-03fd55b1-58fa-4877-87e2-fece0533fd72 tempest-VolumesDeleteCascade-2079002316 None] Acquiring lock "cinder-quobyte-34408c0b-5d91-47d3-9c89-661d7a6b539c" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:11:07 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-03fd55b1-58fa-4877-87e2-fece0533fd72 tempest-VolumesDeleteCascade-2079002316 None] Lock "cinder-quobyte-34408c0b-5d91-47d3-9c89-661d7a6b539c" acquired by "delete_volume" :: waited 0.026s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:11:07 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[67ee6731-e32a-4c98-a0ea-964c3f21f0b3]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:11:07 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-03fd55b1-58fa-4877-87e2-fece0533fd72 tempest-VolumesDeleteCascade-2079002316 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-34408c0b-5d91-47d3-9c89-661d7a6b539c {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:11:07 devstack sudo[101767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-34408c0b-5d91-47d3-9c89-661d7a6b539c Sep 07 10:11:07 devstack sudo[101767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:11:07 devstack sudo[101767]: pam_unix(sudo:session): session closed for user root Sep 07 10:11:07 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-03fd55b1-58fa-4877-87e2-fece0533fd72 tempest-VolumesDeleteCascade-2079002316 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-34408c0b-5d91-47d3-9c89-661d7a6b539c" returned: 0 in 0.435s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:11:07 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-03fd55b1-58fa-4877-87e2-fece0533fd72 tempest-VolumesDeleteCascade-2079002316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-34408c0b-5d91-47d3-9c89-661d7a6b539c {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:11:07 devstack sudo[102106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-34408c0b-5d91-47d3-9c89-661d7a6b539c Sep 07 10:11:07 devstack sudo[102106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:11:08 devstack sudo[102106]: pam_unix(sudo:session): session closed for user root Sep 07 10:11:08 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-03fd55b1-58fa-4877-87e2-fece0533fd72 tempest-VolumesDeleteCascade-2079002316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-34408c0b-5d91-47d3-9c89-661d7a6b539c" returned: 0 in 0.289s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:11:08 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-03fd55b1-58fa-4877-87e2-fece0533fd72 tempest-VolumesDeleteCascade-2079002316 None] Lock "cinder-quobyte-34408c0b-5d91-47d3-9c89-661d7a6b539c" released by "delete_volume" :: held 0.820s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:11:08 devstack cinder-volume[87515]: DEBUG cinder.quota [None req-03fd55b1-58fa-4877-87e2-fece0533fd72 tempest-VolumesDeleteCascade-2079002316 None] Created reservations ['eedb63d8-21af-4cd0-997e-21b43f5e2e1e', '4090940b-545d-4218-82dd-2b7c7c7bda51', '2fbfaa12-3a6c-45aa-8aba-20e2361343d2', '8367132a-f818-41ee-9f5f-6f09038e4974'] {{(pid=87515) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:11:08 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-03fd55b1-58fa-4877-87e2-fece0533fd72 tempest-VolumesDeleteCascade-2079002316 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:11:08 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-03fd55b1-58fa-4877-87e2-fece0533fd72 tempest-VolumesDeleteCascade-2079002316 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:11:08 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-03fd55b1-58fa-4877-87e2-fece0533fd72 tempest-VolumesDeleteCascade-2079002316 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:11:08 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-03fd55b1-58fa-4877-87e2-fece0533fd72 tempest-VolumesDeleteCascade-2079002316 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:11:08 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-03fd55b1-58fa-4877-87e2-fece0533fd72 tempest-VolumesDeleteCascade-2079002316 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:11:08 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-03fd55b1-58fa-4877-87e2-fece0533fd72 tempest-VolumesDeleteCascade-2079002316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:11:08 devstack sudo[102109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a Sep 07 10:11:08 devstack sudo[102109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:11:08 devstack sudo[102109]: pam_unix(sudo:session): session closed for user root Sep 07 10:11:08 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-03fd55b1-58fa-4877-87e2-fece0533fd72 tempest-VolumesDeleteCascade-2079002316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a" returned: 0 in 0.272s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:11:08 devstack cinder-volume[87515]: DEBUG cinder.manager [None req-03fd55b1-58fa-4877-87e2-fece0533fd72 tempest-VolumesDeleteCascade-2079002316 None] Notifying Schedulers of capabilities ... {{(pid=87515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:11:08 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-03fd55b1-58fa-4877-87e2-fece0533fd72 tempest-VolumesDeleteCascade-2079002316 None] Deleted volume successfully. Sep 07 10:11:08 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-03fd55b1-58fa-4877-87e2-fece0533fd72 tempest-VolumesDeleteCascade-2079002316 None] Lock "cinder-34408c0b-5d91-47d3-9c89-661d7a6b539c-delete_volume" released by "delete_volume" :: held 3.738s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:11:08 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-962cd9f5-1492-4118-827b-a9c15cd4e605 tempest-TestImageHashVerification-2025397769 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:11:08 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-962cd9f5-1492-4118-827b-a9c15cd4e605 tempest-TestImageHashVerification-2025397769 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:11:08 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[248c8b16-3e05-4211-847c-b4537f00de18]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:11:08 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-962cd9f5-1492-4118-827b-a9c15cd4e605 tempest-TestImageHashVerification-2025397769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-220ae635-cf18-41e2-a7bf-2d00428069d1 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:11:08 devstack sudo[102112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-220ae635-cf18-41e2-a7bf-2d00428069d1 Sep 07 10:11:08 devstack sudo[102112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:11:09 devstack sudo[102112]: pam_unix(sudo:session): session closed for user root Sep 07 10:11:09 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-962cd9f5-1492-4118-827b-a9c15cd4e605 tempest-TestImageHashVerification-2025397769 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-220ae635-cf18-41e2-a7bf-2d00428069d1" returned: 0 in 0.375s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:11:09 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c87ab29-9260-42a9-8222-4124d2b42349]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:11:09 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-962cd9f5-1492-4118-827b-a9c15cd4e605 tempest-TestImageHashVerification-2025397769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-220ae635-cf18-41e2-a7bf-2d00428069d1 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:11:09 devstack sudo[102118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-220ae635-cf18-41e2-a7bf-2d00428069d1 Sep 07 10:11:09 devstack sudo[102118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:11:09 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-568805d5-2705-44b9-91a4-ca61461753e7 tempest-VolumesDeleteCascade-2079002316 None] Acquiring lock "cinder-69c8ae07-a598-4792-927a-fecd8ee0d963-delete_volume" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:11:09 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-568805d5-2705-44b9-91a4-ca61461753e7 tempest-VolumesDeleteCascade-2079002316 None] Lock "cinder-69c8ae07-a598-4792-927a-fecd8ee0d963-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:11:09 devstack sudo[102118]: pam_unix(sudo:session): session closed for user root Sep 07 10:11:09 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-962cd9f5-1492-4118-827b-a9c15cd4e605 tempest-TestImageHashVerification-2025397769 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-220ae635-cf18-41e2-a7bf-2d00428069d1" returned: 0 in 0.429s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:11:09 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-962cd9f5-1492-4118-827b-a9c15cd4e605 tempest-TestImageHashVerification-2025397769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-220ae635-cf18-41e2-a7bf-2d00428069d1 /opt/stack/data/cinder/conversion/220ae635-cf18-41e2-a7bf-2d00428069d1.temp_image.1f8189ed-9bf5-40ea-8150-8e214dd245c4gtiiecmx.img {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:11:09 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-568805d5-2705-44b9-91a4-ca61461753e7 tempest-VolumesDeleteCascade-2079002316 None] Acquiring lock "cinder-quobyte-69c8ae07-a598-4792-927a-fecd8ee0d963" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:11:09 devstack sudo[102123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-220ae635-cf18-41e2-a7bf-2d00428069d1 /opt/stack/data/cinder/conversion/220ae635-cf18-41e2-a7bf-2d00428069d1.temp_image.1f8189ed-9bf5-40ea-8150-8e214dd245c4gtiiecmx.img Sep 07 10:11:09 devstack sudo[102123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:11:09 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-568805d5-2705-44b9-91a4-ca61461753e7 tempest-VolumesDeleteCascade-2079002316 None] Lock "cinder-quobyte-69c8ae07-a598-4792-927a-fecd8ee0d963" acquired by "delete_volume" :: waited 0.024s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:11:09 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[498e980e-e6a6-4793-9ff8-33d989627920]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:11:09 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-568805d5-2705-44b9-91a4-ca61461753e7 tempest-VolumesDeleteCascade-2079002316 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-69c8ae07-a598-4792-927a-fecd8ee0d963 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:11:09 devstack sudo[102125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-69c8ae07-a598-4792-927a-fecd8ee0d963 Sep 07 10:11:09 devstack sudo[102125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:11:10 devstack sudo[102125]: pam_unix(sudo:session): session closed for user root Sep 07 10:11:10 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-568805d5-2705-44b9-91a4-ca61461753e7 tempest-VolumesDeleteCascade-2079002316 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-69c8ae07-a598-4792-927a-fecd8ee0d963" returned: 0 in 1.054s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:11:10 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-568805d5-2705-44b9-91a4-ca61461753e7 tempest-VolumesDeleteCascade-2079002316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-69c8ae07-a598-4792-927a-fecd8ee0d963 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:11:10 devstack sudo[102141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-69c8ae07-a598-4792-927a-fecd8ee0d963 Sep 07 10:11:10 devstack sudo[102141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:11:11 devstack sudo[102141]: pam_unix(sudo:session): session closed for user root Sep 07 10:11:11 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-568805d5-2705-44b9-91a4-ca61461753e7 tempest-VolumesDeleteCascade-2079002316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-69c8ae07-a598-4792-927a-fecd8ee0d963" returned: 0 in 0.603s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:11:11 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-568805d5-2705-44b9-91a4-ca61461753e7 tempest-VolumesDeleteCascade-2079002316 None] Lock "cinder-quobyte-69c8ae07-a598-4792-927a-fecd8ee0d963" released by "delete_volume" :: held 1.726s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:11:11 devstack cinder-volume[87515]: DEBUG cinder.quota [None req-568805d5-2705-44b9-91a4-ca61461753e7 tempest-VolumesDeleteCascade-2079002316 None] Created reservations ['c1e4d044-6384-4014-b2d9-71395d697143', '17183a02-2f33-47be-90a2-640162aa7d6d', '8e5ed4dc-5fe4-4cef-98d5-11849f7147ec', 'f0566929-ec37-4a34-89b4-a569b32bd610'] {{(pid=87515) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:11:11 devstack cinder-volume[87515]: DEBUG oslo_service.periodic_task [None req-cebd6a9d-3073-42a1-b65a-b38d444d85ed None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87515) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 10:11:11 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-cebd6a9d-3073-42a1-b65a-b38d444d85ed None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:11:11 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-cebd6a9d-3073-42a1-b65a-b38d444d85ed None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:11:11 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-cebd6a9d-3073-42a1-b65a-b38d444d85ed None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:11:11 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-cebd6a9d-3073-42a1-b65a-b38d444d85ed None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:11:11 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-cebd6a9d-3073-42a1-b65a-b38d444d85ed None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:11:11 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-cebd6a9d-3073-42a1-b65a-b38d444d85ed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:11:11 devstack sudo[102144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a Sep 07 10:11:11 devstack sudo[102144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:11:11 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-568805d5-2705-44b9-91a4-ca61461753e7 tempest-VolumesDeleteCascade-2079002316 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:11:11 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-568805d5-2705-44b9-91a4-ca61461753e7 tempest-VolumesDeleteCascade-2079002316 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:11:11 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-568805d5-2705-44b9-91a4-ca61461753e7 tempest-VolumesDeleteCascade-2079002316 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:11:11 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-568805d5-2705-44b9-91a4-ca61461753e7 tempest-VolumesDeleteCascade-2079002316 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:11:11 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-568805d5-2705-44b9-91a4-ca61461753e7 tempest-VolumesDeleteCascade-2079002316 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:11:11 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-568805d5-2705-44b9-91a4-ca61461753e7 tempest-VolumesDeleteCascade-2079002316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:11:11 devstack sudo[102146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a Sep 07 10:11:11 devstack sudo[102146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:11:12 devstack sudo[102144]: pam_unix(sudo:session): session closed for user root Sep 07 10:11:12 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-cebd6a9d-3073-42a1-b65a-b38d444d85ed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a" returned: 0 in 0.678s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:11:12 devstack cinder-volume[87515]: DEBUG cinder.manager [None req-cebd6a9d-3073-42a1-b65a-b38d444d85ed None None] Notifying Schedulers of capabilities ... {{(pid=87515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:11:12 devstack cinder-volume[87515]: DEBUG oslo_service.periodic_task [None req-cebd6a9d-3073-42a1-b65a-b38d444d85ed None None] Running periodic task VolumeManager._thread_info {{(pid=87515) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 10:11:12 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-cebd6a9d-3073-42a1-b65a-b38d444d85ed None None] thread count: 29 {{(pid=87515) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 07 10:11:12 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-cebd6a9d-3073-42a1-b65a-b38d444d85ed None None] thread info: [<_MainThread(MainThread, started 131647121809536)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87515) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 07 10:11:12 devstack sudo[102146]: pam_unix(sudo:session): session closed for user root Sep 07 10:11:12 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-568805d5-2705-44b9-91a4-ca61461753e7 tempest-VolumesDeleteCascade-2079002316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a" returned: 0 in 0.743s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:11:12 devstack cinder-volume[87515]: DEBUG cinder.manager [None req-568805d5-2705-44b9-91a4-ca61461753e7 tempest-VolumesDeleteCascade-2079002316 None] Notifying Schedulers of capabilities ... {{(pid=87515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:11:12 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-568805d5-2705-44b9-91a4-ca61461753e7 tempest-VolumesDeleteCascade-2079002316 None] Deleted volume successfully. Sep 07 10:11:12 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-568805d5-2705-44b9-91a4-ca61461753e7 tempest-VolumesDeleteCascade-2079002316 None] Lock "cinder-69c8ae07-a598-4792-927a-fecd8ee0d963-delete_volume" released by "delete_volume" :: held 3.089s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:11:15 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-962cd9f5-1492-4118-827b-a9c15cd4e605 tempest-TestImageHashVerification-2025397769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-220ae635-cf18-41e2-a7bf-2d00428069d1 /opt/stack/data/cinder/conversion/220ae635-cf18-41e2-a7bf-2d00428069d1.temp_image.1f8189ed-9bf5-40ea-8150-8e214dd245c4gtiiecmx.img" returned: 0 in 5.456s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:11:15 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e4028b9-ad90-4525-8020-3b119f7382a8]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:11:15 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-962cd9f5-1492-4118-827b-a9c15cd4e605 tempest-TestImageHashVerification-2025397769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-220ae635-cf18-41e2-a7bf-2d00428069d1 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:11:15 devstack sudo[102153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-220ae635-cf18-41e2-a7bf-2d00428069d1 Sep 07 10:11:15 devstack sudo[102153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:11:15 devstack sudo[102153]: pam_unix(sudo:session): session closed for user root Sep 07 10:11:15 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-962cd9f5-1492-4118-827b-a9c15cd4e605 tempest-TestImageHashVerification-2025397769 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-220ae635-cf18-41e2-a7bf-2d00428069d1" returned: 0 in 0.808s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:11:15 devstack cinder-volume[87515]: DEBUG cinder.image.image_utils [None req-962cd9f5-1492-4118-827b-a9c15cd4e605 tempest-TestImageHashVerification-2025397769 None] Image conversion details: src /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-220ae635-cf18-41e2-a7bf-2d00428069d1, size 1024.00 MB, duration 5.46 sec, destination /opt/stack/data/cinder/conversion/220ae635-cf18-41e2-a7bf-2d00428069d1.temp_image.1f8189ed-9bf5-40ea-8150-8e214dd245c4gtiiecmx.img {{(pid=87515) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 07 10:11:15 devstack cinder-volume[87515]: INFO cinder.image.image_utils [None req-962cd9f5-1492-4118-827b-a9c15cd4e605 tempest-TestImageHashVerification-2025397769 None] Converted 1024.00 MB image at 187.65 MB/s Sep 07 10:11:15 devstack cinder-volume[87515]: DEBUG cinder.image.image_utils [None req-962cd9f5-1492-4118-827b-a9c15cd4e605 tempest-TestImageHashVerification-2025397769 None] 1f8189ed-9bf5-40ea-8150-8e214dd245c4 was raw, no need to convert to raw {{(pid=87515) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Sep 07 10:11:18 devstack cinder-volume[87515]: DEBUG cinder.volume.flows.manager.create_volume [None req-d9ac3a76-da13-42f2-ac99-a9215dd6eeb1 tempest-VolumesMetadataTest-1260135391 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 10:11:18 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-d9ac3a76-da13-42f2-ac99-a9215dd6eeb1 tempest-VolumesMetadataTest-1260135391 None] Flow 'volume_create_manager' (d53b11d3-7c2a-4457-854a-52781590399a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:11:18 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-d9ac3a76-da13-42f2-ac99-a9215dd6eeb1 tempest-VolumesMetadataTest-1260135391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09861237-6ba5-4acc-9adf-5a1dded7ae73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:11:18 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-d9ac3a76-da13-42f2-ac99-a9215dd6eeb1 tempest-VolumesMetadataTest-1260135391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09861237-6ba5-4acc-9adf-5a1dded7ae73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:11:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-173208831',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eea4b51b-fb61-4fb1-b97a-4f39060f3624,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='003ae7fd7c3b487ea4d41acb795278a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:11:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:11:19Z,use_quota=True,user_id='584e3b26907a4a25923a9d654bf670ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3a092cd-7947-4cbf-abff-4ba9567becf0),volume_type_id=f3a092cd-7947-4cbf-abff-4ba9567becf0)' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:11:18 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-d9ac3a76-da13-42f2-ac99-a9215dd6eeb1 tempest-VolumesMetadataTest-1260135391 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c67559a4-a2e9-4a93-953f-b4c44cef7040) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:11:18 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-d9ac3a76-da13-42f2-ac99-a9215dd6eeb1 tempest-VolumesMetadataTest-1260135391 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c67559a4-a2e9-4a93-953f-b4c44cef7040) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:11:18 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-d9ac3a76-da13-42f2-ac99-a9215dd6eeb1 tempest-VolumesMetadataTest-1260135391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed720757-59ed-49d6-b36e-5c97f4069fb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:11:18 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-d9ac3a76-da13-42f2-ac99-a9215dd6eeb1 tempest-VolumesMetadataTest-1260135391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed720757-59ed-49d6-b36e-5c97f4069fb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eea4b51b-fb61-4fb1-b97a-4f39060f3624', 'volume_name': 'volume-eea4b51b-fb61-4fb1-b97a-4f39060f3624', 'volume_size': 1}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:11:18 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-d9ac3a76-da13-42f2-ac99-a9215dd6eeb1 tempest-VolumesMetadataTest-1260135391 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff9674a6-285b-47cd-9c32-745090b9072e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:11:18 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-d9ac3a76-da13-42f2-ac99-a9215dd6eeb1 tempest-VolumesMetadataTest-1260135391 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff9674a6-285b-47cd-9c32-745090b9072e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:11:18 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-d9ac3a76-da13-42f2-ac99-a9215dd6eeb1 tempest-VolumesMetadataTest-1260135391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2f55134-a677-40bb-bca2-0b8aec9e58ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:11:18 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-d9ac3a76-da13-42f2-ac99-a9215dd6eeb1 tempest-VolumesMetadataTest-1260135391 None] Volume eea4b51b-fb61-4fb1-b97a-4f39060f3624: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eea4b51b-fb61-4fb1-b97a-4f39060f3624', 'volume_size': 1} Sep 07 10:11:18 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-d9ac3a76-da13-42f2-ac99-a9215dd6eeb1 tempest-VolumesMetadataTest-1260135391 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:11:28 devstack cinder-volume[87515]: DEBUG dbcounter [-] [87515] Writing DB stats cinder:UPDATE=64,cinder:INSERT=16,cinder:SELECT=57,cinder:DELETE=9 {{(pid=87515) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 10:11:28 devstack cinder-volume[87515]: DEBUG dbcounter [-] [87515] Writing DB stats cinder:SELECT=66,cinder:UPDATE=60,cinder:DELETE=2,cinder:INSERT=15 {{(pid=87515) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 10:11:37 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-962cd9f5-1492-4118-827b-a9c15cd4e605 tempest-TestImageHashVerification-2025397769 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 28.555s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:11:37 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-962cd9f5-1492-4118-827b-a9c15cd4e605 tempest-TestImageHashVerification-2025397769 None] Uploaded volume to glance image-id: 1f8189ed-9bf5-40ea-8150-8e214dd245c4. {{(pid=87515) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 07 10:11:37 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-d9ac3a76-da13-42f2-ac99-a9215dd6eeb1 tempest-VolumesMetadataTest-1260135391 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 18.425s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:11:37 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-d9ac3a76-da13-42f2-ac99-a9215dd6eeb1 tempest-VolumesMetadataTest-1260135391 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:11:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-173208831',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eea4b51b-fb61-4fb1-b97a-4f39060f3624,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='003ae7fd7c3b487ea4d41acb795278a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:11:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:11:19Z,use_quota=True,user_id='584e3b26907a4a25923a9d654bf670ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3a092cd-7947-4cbf-abff-4ba9567becf0),volume_type_id=f3a092cd-7947-4cbf-abff-4ba9567becf0)}" {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 10:11:37 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-d9ac3a76-da13-42f2-ac99-a9215dd6eeb1 tempest-VolumesMetadataTest-1260135391 None] Creating volume eea4b51b-fb61-4fb1-b97a-4f39060f3624 {{(pid=87515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 10:11:37 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-d9ac3a76-da13-42f2-ac99-a9215dd6eeb1 tempest-VolumesMetadataTest-1260135391 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:11:37 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-d9ac3a76-da13-42f2-ac99-a9215dd6eeb1 tempest-VolumesMetadataTest-1260135391 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:11:37 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-d9ac3a76-da13-42f2-ac99-a9215dd6eeb1 tempest-VolumesMetadataTest-1260135391 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:11:37 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-d9ac3a76-da13-42f2-ac99-a9215dd6eeb1 tempest-VolumesMetadataTest-1260135391 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:11:37 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-d9ac3a76-da13-42f2-ac99-a9215dd6eeb1 tempest-VolumesMetadataTest-1260135391 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:11:37 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-d9ac3a76-da13-42f2-ac99-a9215dd6eeb1 tempest-VolumesMetadataTest-1260135391 None] Selected osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c as target Quobyte volume. {{(pid=87515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 10:11:37 devstack cinder-volume[87515]: INFO cinder.volume.drivers.remotefs [None req-d9ac3a76-da13-42f2-ac99-a9215dd6eeb1 tempest-VolumesMetadataTest-1260135391 None] casted to osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c Sep 07 10:11:37 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-d9ac3a76-da13-42f2-ac99-a9215dd6eeb1 tempest-VolumesMetadataTest-1260135391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-eea4b51b-fb61-4fb1-b97a-4f39060f3624 1073741824 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:11:37 devstack sudo[102269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-eea4b51b-fb61-4fb1-b97a-4f39060f3624 1073741824 Sep 07 10:11:37 devstack sudo[102269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:11:37 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-962cd9f5-1492-4118-827b-a9c15cd4e605 tempest-TestImageHashVerification-2025397769 None] Copy volume to image completed successfully. Sep 07 10:11:37 devstack sudo[102269]: pam_unix(sudo:session): session closed for user root Sep 07 10:11:37 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-d9ac3a76-da13-42f2-ac99-a9215dd6eeb1 tempest-VolumesMetadataTest-1260135391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-eea4b51b-fb61-4fb1-b97a-4f39060f3624 1073741824" returned: 0 in 0.433s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:11:37 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-d9ac3a76-da13-42f2-ac99-a9215dd6eeb1 tempest-VolumesMetadataTest-1260135391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-eea4b51b-fb61-4fb1-b97a-4f39060f3624 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:11:37 devstack sudo[102274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-eea4b51b-fb61-4fb1-b97a-4f39060f3624 Sep 07 10:11:37 devstack sudo[102274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:11:38 devstack sudo[102274]: pam_unix(sudo:session): session closed for user root Sep 07 10:11:38 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-d9ac3a76-da13-42f2-ac99-a9215dd6eeb1 tempest-VolumesMetadataTest-1260135391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-eea4b51b-fb61-4fb1-b97a-4f39060f3624" returned: 0 in 0.259s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:11:38 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-d9ac3a76-da13-42f2-ac99-a9215dd6eeb1 tempest-VolumesMetadataTest-1260135391 None] <== create_volume: return (739ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'} {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 10:11:38 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-d9ac3a76-da13-42f2-ac99-a9215dd6eeb1 tempest-VolumesMetadataTest-1260135391 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.742s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:11:38 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-d9ac3a76-da13-42f2-ac99-a9215dd6eeb1 tempest-VolumesMetadataTest-1260135391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2f55134-a677-40bb-bca2-0b8aec9e58ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eea4b51b-fb61-4fb1-b97a-4f39060f3624', 'volume_size': 1}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:11:38 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-d9ac3a76-da13-42f2-ac99-a9215dd6eeb1 tempest-VolumesMetadataTest-1260135391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3cc895d8-028c-4f74-96ed-625abd4b8bf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:11:38 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-d9ac3a76-da13-42f2-ac99-a9215dd6eeb1 tempest-VolumesMetadataTest-1260135391 None] Volume volume-eea4b51b-fb61-4fb1-b97a-4f39060f3624 (eea4b51b-fb61-4fb1-b97a-4f39060f3624): created successfully Sep 07 10:11:38 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-d9ac3a76-da13-42f2-ac99-a9215dd6eeb1 tempest-VolumesMetadataTest-1260135391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3cc895d8-028c-4f74-96ed-625abd4b8bf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:11:38 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-d9ac3a76-da13-42f2-ac99-a9215dd6eeb1 tempest-VolumesMetadataTest-1260135391 None] Flow 'volume_create_manager' (d53b11d3-7c2a-4457-854a-52781590399a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:11:38 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-d9ac3a76-da13-42f2-ac99-a9215dd6eeb1 tempest-VolumesMetadataTest-1260135391 None] Created volume successfully. Sep 07 10:11:38 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-9e1ab06d-5152-4b1a-8744-b2011c88e1c1 tempest-TestImageHashVerification-2025397769 None] Acquiring lock "cinder-220ae635-cf18-41e2-a7bf-2d00428069d1-delete_volume" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:11:38 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-9e1ab06d-5152-4b1a-8744-b2011c88e1c1 tempest-TestImageHashVerification-2025397769 None] Lock "cinder-220ae635-cf18-41e2-a7bf-2d00428069d1-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:11:38 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-9e1ab06d-5152-4b1a-8744-b2011c88e1c1 tempest-TestImageHashVerification-2025397769 None] Acquiring lock "cinder-quobyte-220ae635-cf18-41e2-a7bf-2d00428069d1" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:11:38 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-9e1ab06d-5152-4b1a-8744-b2011c88e1c1 tempest-TestImageHashVerification-2025397769 None] Lock "cinder-quobyte-220ae635-cf18-41e2-a7bf-2d00428069d1" acquired by "delete_volume" :: waited 0.016s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:11:38 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[11114d86-972b-42eb-a6b2-633fe6cedaef]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:11:38 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-9e1ab06d-5152-4b1a-8744-b2011c88e1c1 tempest-TestImageHashVerification-2025397769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-220ae635-cf18-41e2-a7bf-2d00428069d1 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:11:38 devstack sudo[102277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-220ae635-cf18-41e2-a7bf-2d00428069d1 Sep 07 10:11:38 devstack sudo[102277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:11:39 devstack sudo[102277]: pam_unix(sudo:session): session closed for user root Sep 07 10:11:39 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-9e1ab06d-5152-4b1a-8744-b2011c88e1c1 tempest-TestImageHashVerification-2025397769 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-220ae635-cf18-41e2-a7bf-2d00428069d1" returned: 0 in 0.403s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:11:39 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-9e1ab06d-5152-4b1a-8744-b2011c88e1c1 tempest-TestImageHashVerification-2025397769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-220ae635-cf18-41e2-a7bf-2d00428069d1 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:11:39 devstack sudo[102283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-220ae635-cf18-41e2-a7bf-2d00428069d1 Sep 07 10:11:39 devstack sudo[102283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:11:39 devstack sudo[102283]: pam_unix(sudo:session): session closed for user root Sep 07 10:11:39 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-9e1ab06d-5152-4b1a-8744-b2011c88e1c1 tempest-TestImageHashVerification-2025397769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-220ae635-cf18-41e2-a7bf-2d00428069d1" returned: 0 in 0.263s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:11:39 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-9e1ab06d-5152-4b1a-8744-b2011c88e1c1 tempest-TestImageHashVerification-2025397769 None] Lock "cinder-quobyte-220ae635-cf18-41e2-a7bf-2d00428069d1" released by "delete_volume" :: held 0.706s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:11:39 devstack cinder-volume[87515]: DEBUG cinder.quota [None req-9e1ab06d-5152-4b1a-8744-b2011c88e1c1 tempest-TestImageHashVerification-2025397769 None] Created reservations ['bd0c5193-4b09-40fe-ab97-17bf24859e69', '172a4713-6281-45af-8d34-8811c7d3144d', 'ab458e29-4d54-4c3d-acc7-5d295f5b5b3b', '704bcb56-3590-436b-94cb-e37880c5bb93'] {{(pid=87515) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:11:39 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-9e1ab06d-5152-4b1a-8744-b2011c88e1c1 tempest-TestImageHashVerification-2025397769 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:11:39 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-9e1ab06d-5152-4b1a-8744-b2011c88e1c1 tempest-TestImageHashVerification-2025397769 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:11:39 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-9e1ab06d-5152-4b1a-8744-b2011c88e1c1 tempest-TestImageHashVerification-2025397769 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:11:39 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-9e1ab06d-5152-4b1a-8744-b2011c88e1c1 tempest-TestImageHashVerification-2025397769 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:11:39 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-9e1ab06d-5152-4b1a-8744-b2011c88e1c1 tempest-TestImageHashVerification-2025397769 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:11:39 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-9e1ab06d-5152-4b1a-8744-b2011c88e1c1 tempest-TestImageHashVerification-2025397769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:11:39 devstack sudo[102286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a Sep 07 10:11:39 devstack sudo[102286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:11:39 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-bfbed56d-59db-4f74-944e-fdec803539c5 tempest-VolumesMetadataTest-1260135391 None] Acquiring lock "cinder-eea4b51b-fb61-4fb1-b97a-4f39060f3624-delete_volume" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:11:39 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-bfbed56d-59db-4f74-944e-fdec803539c5 tempest-VolumesMetadataTest-1260135391 None] Lock "cinder-eea4b51b-fb61-4fb1-b97a-4f39060f3624-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:11:39 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-bfbed56d-59db-4f74-944e-fdec803539c5 tempest-VolumesMetadataTest-1260135391 None] Acquiring lock "cinder-quobyte-eea4b51b-fb61-4fb1-b97a-4f39060f3624" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:11:39 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-bfbed56d-59db-4f74-944e-fdec803539c5 tempest-VolumesMetadataTest-1260135391 None] Lock "cinder-quobyte-eea4b51b-fb61-4fb1-b97a-4f39060f3624" acquired by "delete_volume" :: waited 0.021s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:11:39 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bccaf19-5ab7-445f-831c-893bae074532]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:11:39 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-bfbed56d-59db-4f74-944e-fdec803539c5 tempest-VolumesMetadataTest-1260135391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-eea4b51b-fb61-4fb1-b97a-4f39060f3624 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:11:39 devstack sudo[102286]: pam_unix(sudo:session): session closed for user root Sep 07 10:11:39 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-9e1ab06d-5152-4b1a-8744-b2011c88e1c1 tempest-TestImageHashVerification-2025397769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a" returned: 0 in 0.377s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:11:39 devstack cinder-volume[87515]: DEBUG cinder.manager [None req-9e1ab06d-5152-4b1a-8744-b2011c88e1c1 tempest-TestImageHashVerification-2025397769 None] Notifying Schedulers of capabilities ... {{(pid=87515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:11:40 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-9e1ab06d-5152-4b1a-8744-b2011c88e1c1 tempest-TestImageHashVerification-2025397769 None] Deleted volume successfully. Sep 07 10:11:40 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-9e1ab06d-5152-4b1a-8744-b2011c88e1c1 tempest-TestImageHashVerification-2025397769 None] Lock "cinder-220ae635-cf18-41e2-a7bf-2d00428069d1-delete_volume" released by "delete_volume" :: held 1.336s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:11:40 devstack sudo[102289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-eea4b51b-fb61-4fb1-b97a-4f39060f3624 Sep 07 10:11:40 devstack sudo[102289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:11:40 devstack sudo[102289]: pam_unix(sudo:session): session closed for user root Sep 07 10:11:40 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-bfbed56d-59db-4f74-944e-fdec803539c5 tempest-VolumesMetadataTest-1260135391 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-eea4b51b-fb61-4fb1-b97a-4f39060f3624" returned: 0 in 0.417s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:11:40 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-bfbed56d-59db-4f74-944e-fdec803539c5 tempest-VolumesMetadataTest-1260135391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-eea4b51b-fb61-4fb1-b97a-4f39060f3624 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:11:40 devstack sudo[102294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-eea4b51b-fb61-4fb1-b97a-4f39060f3624 Sep 07 10:11:40 devstack sudo[102294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:11:40 devstack sudo[102294]: pam_unix(sudo:session): session closed for user root Sep 07 10:11:40 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-bfbed56d-59db-4f74-944e-fdec803539c5 tempest-VolumesMetadataTest-1260135391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-eea4b51b-fb61-4fb1-b97a-4f39060f3624" returned: 0 in 0.312s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:11:40 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-bfbed56d-59db-4f74-944e-fdec803539c5 tempest-VolumesMetadataTest-1260135391 None] Lock "cinder-quobyte-eea4b51b-fb61-4fb1-b97a-4f39060f3624" released by "delete_volume" :: held 0.783s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:11:40 devstack cinder-volume[87515]: DEBUG cinder.quota [None req-bfbed56d-59db-4f74-944e-fdec803539c5 tempest-VolumesMetadataTest-1260135391 None] Created reservations ['ea150bf0-4ce5-452f-92d4-f7e575b21fce', '720af577-cc42-45bc-8988-9ff35462e194', 'f6204f97-54e8-482c-a39e-7f14e52d34c1', 'd637f7f7-9f74-4cf7-90ca-11ed4c044f41'] {{(pid=87515) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:11:40 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-bfbed56d-59db-4f74-944e-fdec803539c5 tempest-VolumesMetadataTest-1260135391 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:11:40 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-bfbed56d-59db-4f74-944e-fdec803539c5 tempest-VolumesMetadataTest-1260135391 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:11:40 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-bfbed56d-59db-4f74-944e-fdec803539c5 tempest-VolumesMetadataTest-1260135391 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:11:40 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-bfbed56d-59db-4f74-944e-fdec803539c5 tempest-VolumesMetadataTest-1260135391 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:11:40 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-bfbed56d-59db-4f74-944e-fdec803539c5 tempest-VolumesMetadataTest-1260135391 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:11:40 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-bfbed56d-59db-4f74-944e-fdec803539c5 tempest-VolumesMetadataTest-1260135391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:11:40 devstack sudo[102298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a Sep 07 10:11:40 devstack sudo[102298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:11:41 devstack sudo[102298]: pam_unix(sudo:session): session closed for user root Sep 07 10:11:41 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-bfbed56d-59db-4f74-944e-fdec803539c5 tempest-VolumesMetadataTest-1260135391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a" returned: 0 in 0.268s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:11:41 devstack cinder-volume[87515]: DEBUG cinder.manager [None req-bfbed56d-59db-4f74-944e-fdec803539c5 tempest-VolumesMetadataTest-1260135391 None] Notifying Schedulers of capabilities ... {{(pid=87515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:11:41 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-bfbed56d-59db-4f74-944e-fdec803539c5 tempest-VolumesMetadataTest-1260135391 None] Deleted volume successfully. Sep 07 10:11:41 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-bfbed56d-59db-4f74-944e-fdec803539c5 tempest-VolumesMetadataTest-1260135391 None] Lock "cinder-eea4b51b-fb61-4fb1-b97a-4f39060f3624-delete_volume" released by "delete_volume" :: held 1.316s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:11:45 devstack cinder-volume[87515]: DEBUG cinder.volume.flows.manager.create_volume [None req-dfebdea2-e9fa-46a6-b1bc-9235dc38138a tempest-VolumesGetTest-329404913 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 10:11:45 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-dfebdea2-e9fa-46a6-b1bc-9235dc38138a tempest-VolumesGetTest-329404913 None] Flow 'volume_create_manager' (e1422116-62a6-460f-98d7-ec606fff4cf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:11:45 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-dfebdea2-e9fa-46a6-b1bc-9235dc38138a tempest-VolumesGetTest-329404913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e523e8ec-7138-4f38-b305-586fbcbef862) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:11:45 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-dfebdea2-e9fa-46a6-b1bc-9235dc38138a tempest-VolumesGetTest-329404913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e523e8ec-7138-4f38-b305-586fbcbef862) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:11:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1909332711',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=680e3845-a27e-4954-baca-4dc18c2ce86b,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='ecf34953525e4b9b81581ac36d4e0df0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:11:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:11:45Z,use_quota=True,user_id='680e26fefab8422488ad232f8032cf75',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3a092cd-7947-4cbf-abff-4ba9567becf0),volume_type_id=f3a092cd-7947-4cbf-abff-4ba9567becf0)' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:11:45 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-dfebdea2-e9fa-46a6-b1bc-9235dc38138a tempest-VolumesGetTest-329404913 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16add426-4672-4704-9e82-c06c61165d94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:11:45 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-dfebdea2-e9fa-46a6-b1bc-9235dc38138a tempest-VolumesGetTest-329404913 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16add426-4672-4704-9e82-c06c61165d94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:11:45 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-dfebdea2-e9fa-46a6-b1bc-9235dc38138a tempest-VolumesGetTest-329404913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (328fc5f5-d80a-41af-ac67-c03e77f94263) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:11:45 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-dfebdea2-e9fa-46a6-b1bc-9235dc38138a tempest-VolumesGetTest-329404913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (328fc5f5-d80a-41af-ac67-c03e77f94263) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '680e3845-a27e-4954-baca-4dc18c2ce86b', 'volume_name': 'volume-680e3845-a27e-4954-baca-4dc18c2ce86b', 'volume_size': 1}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:11:45 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-dfebdea2-e9fa-46a6-b1bc-9235dc38138a tempest-VolumesGetTest-329404913 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06c33c30-cd96-4a36-872a-e7442af5277d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:11:45 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-dfebdea2-e9fa-46a6-b1bc-9235dc38138a tempest-VolumesGetTest-329404913 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06c33c30-cd96-4a36-872a-e7442af5277d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:11:45 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-dfebdea2-e9fa-46a6-b1bc-9235dc38138a tempest-VolumesGetTest-329404913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ad79a5f-7c8a-4d4a-82b0-1e12976b320d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:11:45 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-dfebdea2-e9fa-46a6-b1bc-9235dc38138a tempest-VolumesGetTest-329404913 None] Volume 680e3845-a27e-4954-baca-4dc18c2ce86b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-680e3845-a27e-4954-baca-4dc18c2ce86b', 'volume_size': 1} Sep 07 10:11:45 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-dfebdea2-e9fa-46a6-b1bc-9235dc38138a tempest-VolumesGetTest-329404913 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:11:45 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-dfebdea2-e9fa-46a6-b1bc-9235dc38138a tempest-VolumesGetTest-329404913 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:11:45 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-dfebdea2-e9fa-46a6-b1bc-9235dc38138a tempest-VolumesGetTest-329404913 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:11:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1909332711',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=680e3845-a27e-4954-baca-4dc18c2ce86b,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='ecf34953525e4b9b81581ac36d4e0df0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:11:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:11:45Z,use_quota=True,user_id='680e26fefab8422488ad232f8032cf75',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3a092cd-7947-4cbf-abff-4ba9567becf0),volume_type_id=f3a092cd-7947-4cbf-abff-4ba9567becf0)}" {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 10:11:45 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-dfebdea2-e9fa-46a6-b1bc-9235dc38138a tempest-VolumesGetTest-329404913 None] Creating volume 680e3845-a27e-4954-baca-4dc18c2ce86b {{(pid=87515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 10:11:45 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-dfebdea2-e9fa-46a6-b1bc-9235dc38138a tempest-VolumesGetTest-329404913 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:11:45 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-dfebdea2-e9fa-46a6-b1bc-9235dc38138a tempest-VolumesGetTest-329404913 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:11:45 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-dfebdea2-e9fa-46a6-b1bc-9235dc38138a tempest-VolumesGetTest-329404913 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:11:45 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-dfebdea2-e9fa-46a6-b1bc-9235dc38138a tempest-VolumesGetTest-329404913 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:11:45 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-dfebdea2-e9fa-46a6-b1bc-9235dc38138a tempest-VolumesGetTest-329404913 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:11:45 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-dfebdea2-e9fa-46a6-b1bc-9235dc38138a tempest-VolumesGetTest-329404913 None] Selected osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c as target Quobyte volume. {{(pid=87515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 10:11:45 devstack cinder-volume[87515]: INFO cinder.volume.drivers.remotefs [None req-dfebdea2-e9fa-46a6-b1bc-9235dc38138a tempest-VolumesGetTest-329404913 None] casted to osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c Sep 07 10:11:45 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-dfebdea2-e9fa-46a6-b1bc-9235dc38138a tempest-VolumesGetTest-329404913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-680e3845-a27e-4954-baca-4dc18c2ce86b 1073741824 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:11:45 devstack sudo[102303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-680e3845-a27e-4954-baca-4dc18c2ce86b 1073741824 Sep 07 10:11:45 devstack sudo[102303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:11:46 devstack sudo[102303]: pam_unix(sudo:session): session closed for user root Sep 07 10:11:46 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-dfebdea2-e9fa-46a6-b1bc-9235dc38138a tempest-VolumesGetTest-329404913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-680e3845-a27e-4954-baca-4dc18c2ce86b 1073741824" returned: 0 in 0.459s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:11:46 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-dfebdea2-e9fa-46a6-b1bc-9235dc38138a tempest-VolumesGetTest-329404913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-680e3845-a27e-4954-baca-4dc18c2ce86b {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:11:46 devstack sudo[102309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-680e3845-a27e-4954-baca-4dc18c2ce86b Sep 07 10:11:46 devstack sudo[102309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:11:46 devstack sudo[102309]: pam_unix(sudo:session): session closed for user root Sep 07 10:11:46 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-dfebdea2-e9fa-46a6-b1bc-9235dc38138a tempest-VolumesGetTest-329404913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-680e3845-a27e-4954-baca-4dc18c2ce86b" returned: 0 in 0.346s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:11:46 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-dfebdea2-e9fa-46a6-b1bc-9235dc38138a tempest-VolumesGetTest-329404913 None] <== create_volume: return (854ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'} {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 10:11:46 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-dfebdea2-e9fa-46a6-b1bc-9235dc38138a tempest-VolumesGetTest-329404913 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.857s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:11:46 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-dfebdea2-e9fa-46a6-b1bc-9235dc38138a tempest-VolumesGetTest-329404913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ad79a5f-7c8a-4d4a-82b0-1e12976b320d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-680e3845-a27e-4954-baca-4dc18c2ce86b', 'volume_size': 1}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:11:46 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-dfebdea2-e9fa-46a6-b1bc-9235dc38138a tempest-VolumesGetTest-329404913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33ba1bfc-35f1-4df4-8d31-533a061e95fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:11:46 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-dfebdea2-e9fa-46a6-b1bc-9235dc38138a tempest-VolumesGetTest-329404913 None] Volume volume-680e3845-a27e-4954-baca-4dc18c2ce86b (680e3845-a27e-4954-baca-4dc18c2ce86b): created successfully Sep 07 10:11:46 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-dfebdea2-e9fa-46a6-b1bc-9235dc38138a tempest-VolumesGetTest-329404913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33ba1bfc-35f1-4df4-8d31-533a061e95fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:11:46 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-dfebdea2-e9fa-46a6-b1bc-9235dc38138a tempest-VolumesGetTest-329404913 None] Flow 'volume_create_manager' (e1422116-62a6-460f-98d7-ec606fff4cf9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:11:46 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-dfebdea2-e9fa-46a6-b1bc-9235dc38138a tempest-VolumesGetTest-329404913 None] Created volume successfully. Sep 07 10:11:48 devstack cinder-volume[87515]: DEBUG cinder.volume.flows.manager.create_volume [None req-a11f7a2e-e69f-43c2-b773-a9426bfe6193 tempest-VolumesGetTest-329404913 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 10:11:48 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-a11f7a2e-e69f-43c2-b773-a9426bfe6193 tempest-VolumesGetTest-329404913 None] Flow 'volume_create_manager' (216705ad-341b-4256-a56d-93b1fa172cb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:11:48 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-a11f7a2e-e69f-43c2-b773-a9426bfe6193 tempest-VolumesGetTest-329404913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (402b60a2-b403-4108-b42f-142cd6873e94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:11:48 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-a11f7a2e-e69f-43c2-b773-a9426bfe6193 tempest-VolumesGetTest-329404913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (402b60a2-b403-4108-b42f-142cd6873e94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:11:48Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1257265398',display_name='tempest-VolumesGetTest-Volume-1667482606',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c93aedb6-d8d2-44f2-8138-45a44ed0cadb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ecf34953525e4b9b81581ac36d4e0df0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:11:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:11:48Z,use_quota=True,user_id='680e26fefab8422488ad232f8032cf75',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3a092cd-7947-4cbf-abff-4ba9567becf0),volume_type_id=f3a092cd-7947-4cbf-abff-4ba9567becf0)' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:11:48 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-a11f7a2e-e69f-43c2-b773-a9426bfe6193 tempest-VolumesGetTest-329404913 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d501c76-e4a1-48ff-97e7-39e32cb278af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:11:48 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-a11f7a2e-e69f-43c2-b773-a9426bfe6193 tempest-VolumesGetTest-329404913 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d501c76-e4a1-48ff-97e7-39e32cb278af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:11:48 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-a11f7a2e-e69f-43c2-b773-a9426bfe6193 tempest-VolumesGetTest-329404913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90449544-7783-4525-b41a-09c39c9d5c72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:11:48 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-a11f7a2e-e69f-43c2-b773-a9426bfe6193 tempest-VolumesGetTest-329404913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90449544-7783-4525-b41a-09c39c9d5c72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c93aedb6-d8d2-44f2-8138-45a44ed0cadb', 'volume_name': 'volume-c93aedb6-d8d2-44f2-8138-45a44ed0cadb', 'volume_size': 1}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:11:48 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-a11f7a2e-e69f-43c2-b773-a9426bfe6193 tempest-VolumesGetTest-329404913 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (886933dc-bf0f-4f39-a8a5-94f36a097f94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:11:48 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-a11f7a2e-e69f-43c2-b773-a9426bfe6193 tempest-VolumesGetTest-329404913 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (886933dc-bf0f-4f39-a8a5-94f36a097f94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:11:48 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-a11f7a2e-e69f-43c2-b773-a9426bfe6193 tempest-VolumesGetTest-329404913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (281ef30c-e39e-42f8-a242-0a16bf93d9e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:11:48 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-a11f7a2e-e69f-43c2-b773-a9426bfe6193 tempest-VolumesGetTest-329404913 None] Volume c93aedb6-d8d2-44f2-8138-45a44ed0cadb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c93aedb6-d8d2-44f2-8138-45a44ed0cadb', 'volume_size': 1} Sep 07 10:11:48 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-a11f7a2e-e69f-43c2-b773-a9426bfe6193 tempest-VolumesGetTest-329404913 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:11:48 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-a11f7a2e-e69f-43c2-b773-a9426bfe6193 tempest-VolumesGetTest-329404913 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:11:48 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-a11f7a2e-e69f-43c2-b773-a9426bfe6193 tempest-VolumesGetTest-329404913 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:11:48Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1257265398',display_name='tempest-VolumesGetTest-Volume-1667482606',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c93aedb6-d8d2-44f2-8138-45a44ed0cadb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ecf34953525e4b9b81581ac36d4e0df0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:11:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:11:48Z,use_quota=True,user_id='680e26fefab8422488ad232f8032cf75',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3a092cd-7947-4cbf-abff-4ba9567becf0),volume_type_id=f3a092cd-7947-4cbf-abff-4ba9567becf0)}" {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 10:11:48 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-a11f7a2e-e69f-43c2-b773-a9426bfe6193 tempest-VolumesGetTest-329404913 None] Creating volume c93aedb6-d8d2-44f2-8138-45a44ed0cadb {{(pid=87515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 10:11:48 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-a11f7a2e-e69f-43c2-b773-a9426bfe6193 tempest-VolumesGetTest-329404913 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:11:48 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-a11f7a2e-e69f-43c2-b773-a9426bfe6193 tempest-VolumesGetTest-329404913 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:11:48 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-a11f7a2e-e69f-43c2-b773-a9426bfe6193 tempest-VolumesGetTest-329404913 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:11:48 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-a11f7a2e-e69f-43c2-b773-a9426bfe6193 tempest-VolumesGetTest-329404913 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:11:48 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-a11f7a2e-e69f-43c2-b773-a9426bfe6193 tempest-VolumesGetTest-329404913 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:11:48 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-a11f7a2e-e69f-43c2-b773-a9426bfe6193 tempest-VolumesGetTest-329404913 None] Selected osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c as target Quobyte volume. {{(pid=87515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 10:11:48 devstack cinder-volume[87515]: INFO cinder.volume.drivers.remotefs [None req-a11f7a2e-e69f-43c2-b773-a9426bfe6193 tempest-VolumesGetTest-329404913 None] casted to osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c Sep 07 10:11:48 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-a11f7a2e-e69f-43c2-b773-a9426bfe6193 tempest-VolumesGetTest-329404913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-c93aedb6-d8d2-44f2-8138-45a44ed0cadb 1073741824 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:11:48 devstack sudo[102318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-c93aedb6-d8d2-44f2-8138-45a44ed0cadb 1073741824 Sep 07 10:11:48 devstack sudo[102318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:11:48 devstack sudo[102318]: pam_unix(sudo:session): session closed for user root Sep 07 10:11:48 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-a11f7a2e-e69f-43c2-b773-a9426bfe6193 tempest-VolumesGetTest-329404913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-c93aedb6-d8d2-44f2-8138-45a44ed0cadb 1073741824" returned: 0 in 0.484s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:11:48 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-a11f7a2e-e69f-43c2-b773-a9426bfe6193 tempest-VolumesGetTest-329404913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-c93aedb6-d8d2-44f2-8138-45a44ed0cadb {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:11:48 devstack sudo[102324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-c93aedb6-d8d2-44f2-8138-45a44ed0cadb Sep 07 10:11:48 devstack sudo[102324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:11:49 devstack sudo[102324]: pam_unix(sudo:session): session closed for user root Sep 07 10:11:49 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-a11f7a2e-e69f-43c2-b773-a9426bfe6193 tempest-VolumesGetTest-329404913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-c93aedb6-d8d2-44f2-8138-45a44ed0cadb" returned: 0 in 0.299s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:11:49 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-a11f7a2e-e69f-43c2-b773-a9426bfe6193 tempest-VolumesGetTest-329404913 None] <== create_volume: return (834ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'} {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 10:11:49 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-a11f7a2e-e69f-43c2-b773-a9426bfe6193 tempest-VolumesGetTest-329404913 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.836s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:11:49 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-a11f7a2e-e69f-43c2-b773-a9426bfe6193 tempest-VolumesGetTest-329404913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (281ef30c-e39e-42f8-a242-0a16bf93d9e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c93aedb6-d8d2-44f2-8138-45a44ed0cadb', 'volume_size': 1}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:11:49 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-a11f7a2e-e69f-43c2-b773-a9426bfe6193 tempest-VolumesGetTest-329404913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (684cabd0-1ccb-417b-aec5-4551fe0df8b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:11:49 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-a11f7a2e-e69f-43c2-b773-a9426bfe6193 tempest-VolumesGetTest-329404913 None] Volume volume-c93aedb6-d8d2-44f2-8138-45a44ed0cadb (c93aedb6-d8d2-44f2-8138-45a44ed0cadb): created successfully Sep 07 10:11:49 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-a11f7a2e-e69f-43c2-b773-a9426bfe6193 tempest-VolumesGetTest-329404913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (684cabd0-1ccb-417b-aec5-4551fe0df8b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:11:49 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-a11f7a2e-e69f-43c2-b773-a9426bfe6193 tempest-VolumesGetTest-329404913 None] Flow 'volume_create_manager' (216705ad-341b-4256-a56d-93b1fa172cb1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:11:49 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-a11f7a2e-e69f-43c2-b773-a9426bfe6193 tempest-VolumesGetTest-329404913 None] Created volume successfully. Sep 07 10:11:50 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-adff4323-049a-4a06-a1f8-cb6b2e36adcd tempest-VolumesGetTest-329404913 None] Acquiring lock "cinder-c93aedb6-d8d2-44f2-8138-45a44ed0cadb-delete_volume" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:11:50 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-adff4323-049a-4a06-a1f8-cb6b2e36adcd tempest-VolumesGetTest-329404913 None] Lock "cinder-c93aedb6-d8d2-44f2-8138-45a44ed0cadb-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:11:50 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-adff4323-049a-4a06-a1f8-cb6b2e36adcd tempest-VolumesGetTest-329404913 None] Acquiring lock "cinder-quobyte-c93aedb6-d8d2-44f2-8138-45a44ed0cadb" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:11:50 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-adff4323-049a-4a06-a1f8-cb6b2e36adcd tempest-VolumesGetTest-329404913 None] Lock "cinder-quobyte-c93aedb6-d8d2-44f2-8138-45a44ed0cadb" acquired by "delete_volume" :: waited 0.020s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:11:50 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[4026d078-62d6-4f3c-9170-3be1e9ce981f]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:11:50 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-adff4323-049a-4a06-a1f8-cb6b2e36adcd tempest-VolumesGetTest-329404913 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-c93aedb6-d8d2-44f2-8138-45a44ed0cadb {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:11:50 devstack sudo[102328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-c93aedb6-d8d2-44f2-8138-45a44ed0cadb Sep 07 10:11:50 devstack sudo[102328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:11:50 devstack sudo[102328]: pam_unix(sudo:session): session closed for user root Sep 07 10:11:51 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-adff4323-049a-4a06-a1f8-cb6b2e36adcd tempest-VolumesGetTest-329404913 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-c93aedb6-d8d2-44f2-8138-45a44ed0cadb" returned: 0 in 0.393s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:11:51 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-adff4323-049a-4a06-a1f8-cb6b2e36adcd tempest-VolumesGetTest-329404913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-c93aedb6-d8d2-44f2-8138-45a44ed0cadb {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:11:51 devstack sudo[102333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-c93aedb6-d8d2-44f2-8138-45a44ed0cadb Sep 07 10:11:51 devstack sudo[102333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:11:51 devstack sudo[102333]: pam_unix(sudo:session): session closed for user root Sep 07 10:11:51 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-adff4323-049a-4a06-a1f8-cb6b2e36adcd tempest-VolumesGetTest-329404913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-c93aedb6-d8d2-44f2-8138-45a44ed0cadb" returned: 0 in 0.257s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:11:51 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-adff4323-049a-4a06-a1f8-cb6b2e36adcd tempest-VolumesGetTest-329404913 None] Lock "cinder-quobyte-c93aedb6-d8d2-44f2-8138-45a44ed0cadb" released by "delete_volume" :: held 0.700s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:11:51 devstack cinder-volume[87515]: DEBUG cinder.quota [None req-adff4323-049a-4a06-a1f8-cb6b2e36adcd tempest-VolumesGetTest-329404913 None] Created reservations ['683a6927-db76-4e7c-a01e-db3adc93906f', '5e1edd54-8126-4cb1-b83c-4aa055d0ebaa', 'c2dfa484-b3ba-4dc8-b510-a4001460984b', '8f09eadd-d2a2-44db-8079-2a0599af9f62'] {{(pid=87515) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:11:51 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-adff4323-049a-4a06-a1f8-cb6b2e36adcd tempest-VolumesGetTest-329404913 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:11:51 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-adff4323-049a-4a06-a1f8-cb6b2e36adcd tempest-VolumesGetTest-329404913 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:11:51 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-adff4323-049a-4a06-a1f8-cb6b2e36adcd tempest-VolumesGetTest-329404913 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:11:51 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-adff4323-049a-4a06-a1f8-cb6b2e36adcd tempest-VolumesGetTest-329404913 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:11:51 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-adff4323-049a-4a06-a1f8-cb6b2e36adcd tempest-VolumesGetTest-329404913 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:11:51 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-adff4323-049a-4a06-a1f8-cb6b2e36adcd tempest-VolumesGetTest-329404913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:11:51 devstack sudo[102338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a Sep 07 10:11:51 devstack sudo[102338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:11:51 devstack sudo[102338]: pam_unix(sudo:session): session closed for user root Sep 07 10:11:51 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-adff4323-049a-4a06-a1f8-cb6b2e36adcd tempest-VolumesGetTest-329404913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a" returned: 0 in 0.267s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:11:51 devstack cinder-volume[87515]: DEBUG cinder.manager [None req-adff4323-049a-4a06-a1f8-cb6b2e36adcd tempest-VolumesGetTest-329404913 None] Notifying Schedulers of capabilities ... {{(pid=87515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:11:51 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-adff4323-049a-4a06-a1f8-cb6b2e36adcd tempest-VolumesGetTest-329404913 None] Deleted volume successfully. Sep 07 10:11:51 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-adff4323-049a-4a06-a1f8-cb6b2e36adcd tempest-VolumesGetTest-329404913 None] Lock "cinder-c93aedb6-d8d2-44f2-8138-45a44ed0cadb-delete_volume" released by "delete_volume" :: held 1.194s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:11:51 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-0431436f-0856-4960-8029-74c2594c599c tempest-VolumesGetTest-329404913 None] Acquiring lock "cinder-680e3845-a27e-4954-baca-4dc18c2ce86b-delete_volume" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:11:51 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-0431436f-0856-4960-8029-74c2594c599c tempest-VolumesGetTest-329404913 None] Lock "cinder-680e3845-a27e-4954-baca-4dc18c2ce86b-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:11:51 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-0431436f-0856-4960-8029-74c2594c599c tempest-VolumesGetTest-329404913 None] Acquiring lock "cinder-quobyte-680e3845-a27e-4954-baca-4dc18c2ce86b" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:11:51 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-0431436f-0856-4960-8029-74c2594c599c tempest-VolumesGetTest-329404913 None] Lock "cinder-quobyte-680e3845-a27e-4954-baca-4dc18c2ce86b" acquired by "delete_volume" :: waited 0.018s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:11:51 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcf04d6c-57dc-4383-8188-fe4d9c906de7]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:11:51 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-0431436f-0856-4960-8029-74c2594c599c tempest-VolumesGetTest-329404913 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-680e3845-a27e-4954-baca-4dc18c2ce86b {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:11:51 devstack sudo[102341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-680e3845-a27e-4954-baca-4dc18c2ce86b Sep 07 10:11:51 devstack sudo[102341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:11:52 devstack sudo[102341]: pam_unix(sudo:session): session closed for user root Sep 07 10:11:52 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-0431436f-0856-4960-8029-74c2594c599c tempest-VolumesGetTest-329404913 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-680e3845-a27e-4954-baca-4dc18c2ce86b" returned: 0 in 0.400s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:11:52 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-0431436f-0856-4960-8029-74c2594c599c tempest-VolumesGetTest-329404913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-680e3845-a27e-4954-baca-4dc18c2ce86b {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:11:52 devstack sudo[102346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-680e3845-a27e-4954-baca-4dc18c2ce86b Sep 07 10:11:52 devstack sudo[102346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:11:52 devstack cinder-volume[87515]: DEBUG cinder.volume.flows.manager.create_volume [None req-b887d764-d8c7-4868-851f-68bcd9b69722 tempest-CreateVolumesFromSourceVolumeTest-159810001 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 10:11:52 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-b887d764-d8c7-4868-851f-68bcd9b69722 tempest-CreateVolumesFromSourceVolumeTest-159810001 None] Flow 'volume_create_manager' (95051b50-d525-4909-986f-45169fefb8d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:11:52 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-b887d764-d8c7-4868-851f-68bcd9b69722 tempest-CreateVolumesFromSourceVolumeTest-159810001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82986e27-f49b-4446-a257-a52b1a4287d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:11:52 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-b887d764-d8c7-4868-851f-68bcd9b69722 tempest-CreateVolumesFromSourceVolumeTest-159810001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82986e27-f49b-4446-a257-a52b1a4287d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:11:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1657341325',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=108a6609-d936-45bb-8573-634f69a9aee8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2762d32eade4835aab2ef6424f5c9bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:11:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:11:52Z,use_quota=True,user_id='6f0a017cc53c4175b5cf36fce5c762ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3a092cd-7947-4cbf-abff-4ba9567becf0),volume_type_id=f3a092cd-7947-4cbf-abff-4ba9567becf0)' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:11:52 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-b887d764-d8c7-4868-851f-68bcd9b69722 tempest-CreateVolumesFromSourceVolumeTest-159810001 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f573392-f279-4d2f-9619-5a1c6a2a9cd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:11:52 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-b887d764-d8c7-4868-851f-68bcd9b69722 tempest-CreateVolumesFromSourceVolumeTest-159810001 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f573392-f279-4d2f-9619-5a1c6a2a9cd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:11:52 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-b887d764-d8c7-4868-851f-68bcd9b69722 tempest-CreateVolumesFromSourceVolumeTest-159810001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c837511c-503d-4589-8578-0e276fc48a0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:11:52 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-b887d764-d8c7-4868-851f-68bcd9b69722 tempest-CreateVolumesFromSourceVolumeTest-159810001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c837511c-503d-4589-8578-0e276fc48a0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '108a6609-d936-45bb-8573-634f69a9aee8', 'volume_name': 'volume-108a6609-d936-45bb-8573-634f69a9aee8', 'volume_size': 1}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:11:52 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-b887d764-d8c7-4868-851f-68bcd9b69722 tempest-CreateVolumesFromSourceVolumeTest-159810001 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e280c48-92b2-4e42-9678-447e3ca8fb03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:11:52 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-b887d764-d8c7-4868-851f-68bcd9b69722 tempest-CreateVolumesFromSourceVolumeTest-159810001 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e280c48-92b2-4e42-9678-447e3ca8fb03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:11:52 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-b887d764-d8c7-4868-851f-68bcd9b69722 tempest-CreateVolumesFromSourceVolumeTest-159810001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee01bc80-7e99-49a5-94ee-bbdb0d967816) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:11:52 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-b887d764-d8c7-4868-851f-68bcd9b69722 tempest-CreateVolumesFromSourceVolumeTest-159810001 None] Volume 108a6609-d936-45bb-8573-634f69a9aee8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-108a6609-d936-45bb-8573-634f69a9aee8', 'volume_size': 1} Sep 07 10:11:52 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-b887d764-d8c7-4868-851f-68bcd9b69722 tempest-CreateVolumesFromSourceVolumeTest-159810001 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:11:52 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-b887d764-d8c7-4868-851f-68bcd9b69722 tempest-CreateVolumesFromSourceVolumeTest-159810001 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:11:52 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-b887d764-d8c7-4868-851f-68bcd9b69722 tempest-CreateVolumesFromSourceVolumeTest-159810001 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:11:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1657341325',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=108a6609-d936-45bb-8573-634f69a9aee8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2762d32eade4835aab2ef6424f5c9bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:11:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:11:52Z,use_quota=True,user_id='6f0a017cc53c4175b5cf36fce5c762ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3a092cd-7947-4cbf-abff-4ba9567becf0),volume_type_id=f3a092cd-7947-4cbf-abff-4ba9567becf0)}" {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 10:11:52 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-b887d764-d8c7-4868-851f-68bcd9b69722 tempest-CreateVolumesFromSourceVolumeTest-159810001 None] Creating volume 108a6609-d936-45bb-8573-634f69a9aee8 {{(pid=87515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 10:11:52 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-b887d764-d8c7-4868-851f-68bcd9b69722 tempest-CreateVolumesFromSourceVolumeTest-159810001 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:11:52 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-b887d764-d8c7-4868-851f-68bcd9b69722 tempest-CreateVolumesFromSourceVolumeTest-159810001 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:11:52 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-b887d764-d8c7-4868-851f-68bcd9b69722 tempest-CreateVolumesFromSourceVolumeTest-159810001 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:11:52 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-b887d764-d8c7-4868-851f-68bcd9b69722 tempest-CreateVolumesFromSourceVolumeTest-159810001 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:11:52 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-b887d764-d8c7-4868-851f-68bcd9b69722 tempest-CreateVolumesFromSourceVolumeTest-159810001 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:11:52 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-b887d764-d8c7-4868-851f-68bcd9b69722 tempest-CreateVolumesFromSourceVolumeTest-159810001 None] Selected osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c as target Quobyte volume. {{(pid=87515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 10:11:52 devstack cinder-volume[87515]: INFO cinder.volume.drivers.remotefs [None req-b887d764-d8c7-4868-851f-68bcd9b69722 tempest-CreateVolumesFromSourceVolumeTest-159810001 None] casted to osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c Sep 07 10:11:52 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-b887d764-d8c7-4868-851f-68bcd9b69722 tempest-CreateVolumesFromSourceVolumeTest-159810001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-108a6609-d936-45bb-8573-634f69a9aee8 1073741824 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:11:52 devstack sudo[102349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-108a6609-d936-45bb-8573-634f69a9aee8 1073741824 Sep 07 10:11:52 devstack sudo[102349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:11:52 devstack sudo[102346]: pam_unix(sudo:session): session closed for user root Sep 07 10:11:52 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-0431436f-0856-4960-8029-74c2594c599c tempest-VolumesGetTest-329404913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-680e3845-a27e-4954-baca-4dc18c2ce86b" returned: 0 in 0.283s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:11:52 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-0431436f-0856-4960-8029-74c2594c599c tempest-VolumesGetTest-329404913 None] Lock "cinder-quobyte-680e3845-a27e-4954-baca-4dc18c2ce86b" released by "delete_volume" :: held 0.726s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:11:52 devstack cinder-volume[87515]: DEBUG cinder.quota [None req-0431436f-0856-4960-8029-74c2594c599c tempest-VolumesGetTest-329404913 None] Created reservations ['c70b8213-787e-4927-a421-bb62d2b553b0', '1a0612e6-949b-49e2-b733-d9495c23d4e3', 'e8a3f0fe-61ed-4bdd-bc6e-f2992c9488bb', '86bcc7b3-38d4-4855-b505-e88c6e82fa82'] {{(pid=87515) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:11:52 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-0431436f-0856-4960-8029-74c2594c599c tempest-VolumesGetTest-329404913 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:11:52 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-0431436f-0856-4960-8029-74c2594c599c tempest-VolumesGetTest-329404913 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:11:52 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-0431436f-0856-4960-8029-74c2594c599c tempest-VolumesGetTest-329404913 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:11:52 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-0431436f-0856-4960-8029-74c2594c599c tempest-VolumesGetTest-329404913 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:11:52 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-0431436f-0856-4960-8029-74c2594c599c tempest-VolumesGetTest-329404913 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:11:52 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-0431436f-0856-4960-8029-74c2594c599c tempest-VolumesGetTest-329404913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:11:52 devstack sudo[102351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a Sep 07 10:11:52 devstack sudo[102351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:11:52 devstack sudo[102351]: pam_unix(sudo:session): session closed for user root Sep 07 10:11:52 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-0431436f-0856-4960-8029-74c2594c599c tempest-VolumesGetTest-329404913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a" returned: 0 in 0.303s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:11:52 devstack cinder-volume[87515]: DEBUG cinder.manager [None req-0431436f-0856-4960-8029-74c2594c599c tempest-VolumesGetTest-329404913 None] Notifying Schedulers of capabilities ... {{(pid=87515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:11:53 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-0431436f-0856-4960-8029-74c2594c599c tempest-VolumesGetTest-329404913 None] Deleted volume successfully. Sep 07 10:11:53 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-0431436f-0856-4960-8029-74c2594c599c tempest-VolumesGetTest-329404913 None] Lock "cinder-680e3845-a27e-4954-baca-4dc18c2ce86b-delete_volume" released by "delete_volume" :: held 1.271s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:11:53 devstack sudo[102349]: pam_unix(sudo:session): session closed for user root Sep 07 10:11:53 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-b887d764-d8c7-4868-851f-68bcd9b69722 tempest-CreateVolumesFromSourceVolumeTest-159810001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-108a6609-d936-45bb-8573-634f69a9aee8 1073741824" returned: 0 in 0.596s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:11:53 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-b887d764-d8c7-4868-851f-68bcd9b69722 tempest-CreateVolumesFromSourceVolumeTest-159810001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-108a6609-d936-45bb-8573-634f69a9aee8 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:11:53 devstack sudo[102358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-108a6609-d936-45bb-8573-634f69a9aee8 Sep 07 10:11:53 devstack sudo[102358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:11:53 devstack sudo[102358]: pam_unix(sudo:session): session closed for user root Sep 07 10:11:53 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-b887d764-d8c7-4868-851f-68bcd9b69722 tempest-CreateVolumesFromSourceVolumeTest-159810001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-108a6609-d936-45bb-8573-634f69a9aee8" returned: 0 in 0.325s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:11:53 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-b887d764-d8c7-4868-851f-68bcd9b69722 tempest-CreateVolumesFromSourceVolumeTest-159810001 None] <== create_volume: return (976ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'} {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 10:11:53 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-b887d764-d8c7-4868-851f-68bcd9b69722 tempest-CreateVolumesFromSourceVolumeTest-159810001 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.979s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:11:53 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-b887d764-d8c7-4868-851f-68bcd9b69722 tempest-CreateVolumesFromSourceVolumeTest-159810001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee01bc80-7e99-49a5-94ee-bbdb0d967816) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-108a6609-d936-45bb-8573-634f69a9aee8', 'volume_size': 1}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:11:53 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-b887d764-d8c7-4868-851f-68bcd9b69722 tempest-CreateVolumesFromSourceVolumeTest-159810001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (200257be-e693-4ee2-b7d5-37038fe2dd85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:11:53 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-b887d764-d8c7-4868-851f-68bcd9b69722 tempest-CreateVolumesFromSourceVolumeTest-159810001 None] Volume volume-108a6609-d936-45bb-8573-634f69a9aee8 (108a6609-d936-45bb-8573-634f69a9aee8): created successfully Sep 07 10:11:53 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-b887d764-d8c7-4868-851f-68bcd9b69722 tempest-CreateVolumesFromSourceVolumeTest-159810001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (200257be-e693-4ee2-b7d5-37038fe2dd85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:11:53 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-b887d764-d8c7-4868-851f-68bcd9b69722 tempest-CreateVolumesFromSourceVolumeTest-159810001 None] Flow 'volume_create_manager' (95051b50-d525-4909-986f-45169fefb8d0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:11:53 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-b887d764-d8c7-4868-851f-68bcd9b69722 tempest-CreateVolumesFromSourceVolumeTest-159810001 None] Created volume successfully. Sep 07 10:11:53 devstack cinder-volume[87515]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f03f54c-2915-420d-b6b5-c49284081136 tempest-VolumesGetTest-329404913 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 10:11:53 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-8f03f54c-2915-420d-b6b5-c49284081136 tempest-VolumesGetTest-329404913 None] Flow 'volume_create_manager' (152e14a3-9082-40fd-9673-f0fbd079d418) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:11:53 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-8f03f54c-2915-420d-b6b5-c49284081136 tempest-VolumesGetTest-329404913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9dfda120-5ac7-4c9e-9634-f4e86f96ed2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:11:53 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-8f03f54c-2915-420d-b6b5-c49284081136 tempest-VolumesGetTest-329404913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9dfda120-5ac7-4c9e-9634-f4e86f96ed2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:11:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1519020757',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa39d889-4a03-4588-8754-8fb05f5db852,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ecf34953525e4b9b81581ac36d4e0df0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:11:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:11:53Z,use_quota=True,user_id='680e26fefab8422488ad232f8032cf75',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3a092cd-7947-4cbf-abff-4ba9567becf0),volume_type_id=f3a092cd-7947-4cbf-abff-4ba9567becf0)' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:11:53 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-8f03f54c-2915-420d-b6b5-c49284081136 tempest-VolumesGetTest-329404913 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c526e94f-1bcf-4a2a-9f59-2f71376edc5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:11:53 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-8f03f54c-2915-420d-b6b5-c49284081136 tempest-VolumesGetTest-329404913 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c526e94f-1bcf-4a2a-9f59-2f71376edc5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:11:53 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-8f03f54c-2915-420d-b6b5-c49284081136 tempest-VolumesGetTest-329404913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96a0b220-0e95-4ee2-8409-5c8bc88570a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:11:53 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-8f03f54c-2915-420d-b6b5-c49284081136 tempest-VolumesGetTest-329404913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96a0b220-0e95-4ee2-8409-5c8bc88570a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fa39d889-4a03-4588-8754-8fb05f5db852', 'volume_name': 'volume-fa39d889-4a03-4588-8754-8fb05f5db852', 'volume_size': 1}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:11:53 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-8f03f54c-2915-420d-b6b5-c49284081136 tempest-VolumesGetTest-329404913 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db2e51ab-1f01-4c11-afbb-afcc401c7a59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:11:53 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-8f03f54c-2915-420d-b6b5-c49284081136 tempest-VolumesGetTest-329404913 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db2e51ab-1f01-4c11-afbb-afcc401c7a59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:11:53 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-8f03f54c-2915-420d-b6b5-c49284081136 tempest-VolumesGetTest-329404913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe2cf905-4141-472f-8760-3ec351e8ef25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:11:53 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-8f03f54c-2915-420d-b6b5-c49284081136 tempest-VolumesGetTest-329404913 None] Volume fa39d889-4a03-4588-8754-8fb05f5db852: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fa39d889-4a03-4588-8754-8fb05f5db852', 'volume_size': 1} Sep 07 10:11:53 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-8f03f54c-2915-420d-b6b5-c49284081136 tempest-VolumesGetTest-329404913 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:11:53 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-8f03f54c-2915-420d-b6b5-c49284081136 tempest-VolumesGetTest-329404913 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:11:53 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-8f03f54c-2915-420d-b6b5-c49284081136 tempest-VolumesGetTest-329404913 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:11:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1519020757',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa39d889-4a03-4588-8754-8fb05f5db852,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ecf34953525e4b9b81581ac36d4e0df0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:11:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:11:53Z,use_quota=True,user_id='680e26fefab8422488ad232f8032cf75',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3a092cd-7947-4cbf-abff-4ba9567becf0),volume_type_id=f3a092cd-7947-4cbf-abff-4ba9567becf0)}" {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 10:11:53 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-8f03f54c-2915-420d-b6b5-c49284081136 tempest-VolumesGetTest-329404913 None] Creating volume fa39d889-4a03-4588-8754-8fb05f5db852 {{(pid=87515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 10:11:53 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-8f03f54c-2915-420d-b6b5-c49284081136 tempest-VolumesGetTest-329404913 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:11:53 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-8f03f54c-2915-420d-b6b5-c49284081136 tempest-VolumesGetTest-329404913 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:11:53 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-8f03f54c-2915-420d-b6b5-c49284081136 tempest-VolumesGetTest-329404913 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:11:53 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-8f03f54c-2915-420d-b6b5-c49284081136 tempest-VolumesGetTest-329404913 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:11:53 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-8f03f54c-2915-420d-b6b5-c49284081136 tempest-VolumesGetTest-329404913 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:11:53 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-8f03f54c-2915-420d-b6b5-c49284081136 tempest-VolumesGetTest-329404913 None] Selected osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c as target Quobyte volume. {{(pid=87515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 10:11:53 devstack cinder-volume[87515]: INFO cinder.volume.drivers.remotefs [None req-8f03f54c-2915-420d-b6b5-c49284081136 tempest-VolumesGetTest-329404913 None] casted to osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c Sep 07 10:11:53 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-8f03f54c-2915-420d-b6b5-c49284081136 tempest-VolumesGetTest-329404913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-fa39d889-4a03-4588-8754-8fb05f5db852 1073741824 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:11:53 devstack sudo[102361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-fa39d889-4a03-4588-8754-8fb05f5db852 1073741824 Sep 07 10:11:53 devstack sudo[102361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:11:54 devstack sudo[102361]: pam_unix(sudo:session): session closed for user root Sep 07 10:11:54 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-8f03f54c-2915-420d-b6b5-c49284081136 tempest-VolumesGetTest-329404913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-fa39d889-4a03-4588-8754-8fb05f5db852 1073741824" returned: 0 in 0.419s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:11:54 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-8f03f54c-2915-420d-b6b5-c49284081136 tempest-VolumesGetTest-329404913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-fa39d889-4a03-4588-8754-8fb05f5db852 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:11:54 devstack sudo[102367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-fa39d889-4a03-4588-8754-8fb05f5db852 Sep 07 10:11:54 devstack sudo[102367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:11:54 devstack sudo[102367]: pam_unix(sudo:session): session closed for user root Sep 07 10:11:54 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-8f03f54c-2915-420d-b6b5-c49284081136 tempest-VolumesGetTest-329404913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-fa39d889-4a03-4588-8754-8fb05f5db852" returned: 0 in 0.250s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:11:54 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-8f03f54c-2915-420d-b6b5-c49284081136 tempest-VolumesGetTest-329404913 None] <== create_volume: return (716ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'} {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 10:11:54 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-8f03f54c-2915-420d-b6b5-c49284081136 tempest-VolumesGetTest-329404913 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.720s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:11:54 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-8f03f54c-2915-420d-b6b5-c49284081136 tempest-VolumesGetTest-329404913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe2cf905-4141-472f-8760-3ec351e8ef25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fa39d889-4a03-4588-8754-8fb05f5db852', 'volume_size': 1}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:11:54 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-8f03f54c-2915-420d-b6b5-c49284081136 tempest-VolumesGetTest-329404913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c44aaaa-05ef-486c-b14d-18af2c1ce889) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:11:54 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-8f03f54c-2915-420d-b6b5-c49284081136 tempest-VolumesGetTest-329404913 None] Volume volume-fa39d889-4a03-4588-8754-8fb05f5db852 (fa39d889-4a03-4588-8754-8fb05f5db852): created successfully Sep 07 10:11:54 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-8f03f54c-2915-420d-b6b5-c49284081136 tempest-VolumesGetTest-329404913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c44aaaa-05ef-486c-b14d-18af2c1ce889) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:11:54 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-8f03f54c-2915-420d-b6b5-c49284081136 tempest-VolumesGetTest-329404913 None] Flow 'volume_create_manager' (152e14a3-9082-40fd-9673-f0fbd079d418) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:11:54 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-8f03f54c-2915-420d-b6b5-c49284081136 tempest-VolumesGetTest-329404913 None] Created volume successfully. Sep 07 10:11:55 devstack cinder-volume[87515]: DEBUG cinder.volume.flows.manager.create_volume [None req-b8b44c68-f2b8-48bb-9d3c-59017a05ebb3 tempest-CreateVolumesFromSourceVolumeTest-159810001 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 10:11:55 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-b8b44c68-f2b8-48bb-9d3c-59017a05ebb3 tempest-CreateVolumesFromSourceVolumeTest-159810001 None] Flow 'volume_create_manager' (fe948e89-3805-4363-b48b-03fc4783d8e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:11:55 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-b8b44c68-f2b8-48bb-9d3c-59017a05ebb3 tempest-CreateVolumesFromSourceVolumeTest-159810001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5dc1750c-c7d5-474e-8841-8ff4312d2a73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:11:55 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-b8b44c68-f2b8-48bb-9d3c-59017a05ebb3 tempest-CreateVolumesFromSourceVolumeTest-159810001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5dc1750c-c7d5-474e-8841-8ff4312d2a73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:11:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1679328535',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0bd914e7-035e-4d45-a484-bd1e4cd84906,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2762d32eade4835aab2ef6424f5c9bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:11:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:11:55Z,use_quota=True,user_id='6f0a017cc53c4175b5cf36fce5c762ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3a092cd-7947-4cbf-abff-4ba9567becf0),volume_type_id=f3a092cd-7947-4cbf-abff-4ba9567becf0)' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:11:55 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-b8b44c68-f2b8-48bb-9d3c-59017a05ebb3 tempest-CreateVolumesFromSourceVolumeTest-159810001 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (102b6100-705a-408c-8af4-b4cc19d0401a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:11:55 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-b8b44c68-f2b8-48bb-9d3c-59017a05ebb3 tempest-CreateVolumesFromSourceVolumeTest-159810001 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (102b6100-705a-408c-8af4-b4cc19d0401a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:11:55 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-b8b44c68-f2b8-48bb-9d3c-59017a05ebb3 tempest-CreateVolumesFromSourceVolumeTest-159810001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04406303-b06f-423a-a0bc-3fae342a34d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:11:55 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-b8b44c68-f2b8-48bb-9d3c-59017a05ebb3 tempest-CreateVolumesFromSourceVolumeTest-159810001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04406303-b06f-423a-a0bc-3fae342a34d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0bd914e7-035e-4d45-a484-bd1e4cd84906', 'volume_name': 'volume-0bd914e7-035e-4d45-a484-bd1e4cd84906', 'volume_size': 1}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:11:55 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-b8b44c68-f2b8-48bb-9d3c-59017a05ebb3 tempest-CreateVolumesFromSourceVolumeTest-159810001 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33f52776-c1ca-4893-b84a-017f8e5a7c6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:11:55 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-b8b44c68-f2b8-48bb-9d3c-59017a05ebb3 tempest-CreateVolumesFromSourceVolumeTest-159810001 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33f52776-c1ca-4893-b84a-017f8e5a7c6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:11:55 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-b8b44c68-f2b8-48bb-9d3c-59017a05ebb3 tempest-CreateVolumesFromSourceVolumeTest-159810001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8363bc94-6510-40b2-9542-1911a98da93a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:11:55 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-b8b44c68-f2b8-48bb-9d3c-59017a05ebb3 tempest-CreateVolumesFromSourceVolumeTest-159810001 None] Volume 0bd914e7-035e-4d45-a484-bd1e4cd84906: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0bd914e7-035e-4d45-a484-bd1e4cd84906', 'volume_size': 1} Sep 07 10:11:55 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-b8b44c68-f2b8-48bb-9d3c-59017a05ebb3 tempest-CreateVolumesFromSourceVolumeTest-159810001 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:11:55 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-b8b44c68-f2b8-48bb-9d3c-59017a05ebb3 tempest-CreateVolumesFromSourceVolumeTest-159810001 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:11:55 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-b8b44c68-f2b8-48bb-9d3c-59017a05ebb3 tempest-CreateVolumesFromSourceVolumeTest-159810001 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:11:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1679328535',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0bd914e7-035e-4d45-a484-bd1e4cd84906,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2762d32eade4835aab2ef6424f5c9bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:11:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:11:55Z,use_quota=True,user_id='6f0a017cc53c4175b5cf36fce5c762ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3a092cd-7947-4cbf-abff-4ba9567becf0),volume_type_id=f3a092cd-7947-4cbf-abff-4ba9567becf0)}" {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 10:11:55 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-b8b44c68-f2b8-48bb-9d3c-59017a05ebb3 tempest-CreateVolumesFromSourceVolumeTest-159810001 None] Creating volume 0bd914e7-035e-4d45-a484-bd1e4cd84906 {{(pid=87515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 10:11:55 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-b8b44c68-f2b8-48bb-9d3c-59017a05ebb3 tempest-CreateVolumesFromSourceVolumeTest-159810001 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:11:55 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-b8b44c68-f2b8-48bb-9d3c-59017a05ebb3 tempest-CreateVolumesFromSourceVolumeTest-159810001 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:11:55 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-b8b44c68-f2b8-48bb-9d3c-59017a05ebb3 tempest-CreateVolumesFromSourceVolumeTest-159810001 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:11:55 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-b8b44c68-f2b8-48bb-9d3c-59017a05ebb3 tempest-CreateVolumesFromSourceVolumeTest-159810001 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:11:55 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-b8b44c68-f2b8-48bb-9d3c-59017a05ebb3 tempest-CreateVolumesFromSourceVolumeTest-159810001 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:11:55 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-b8b44c68-f2b8-48bb-9d3c-59017a05ebb3 tempest-CreateVolumesFromSourceVolumeTest-159810001 None] Selected osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c as target Quobyte volume. {{(pid=87515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 10:11:55 devstack cinder-volume[87515]: INFO cinder.volume.drivers.remotefs [None req-b8b44c68-f2b8-48bb-9d3c-59017a05ebb3 tempest-CreateVolumesFromSourceVolumeTest-159810001 None] casted to osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c Sep 07 10:11:55 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-b8b44c68-f2b8-48bb-9d3c-59017a05ebb3 tempest-CreateVolumesFromSourceVolumeTest-159810001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-0bd914e7-035e-4d45-a484-bd1e4cd84906 1073741824 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:11:55 devstack sudo[102374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-0bd914e7-035e-4d45-a484-bd1e4cd84906 1073741824 Sep 07 10:11:55 devstack sudo[102374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:11:55 devstack cinder-volume[87515]: DEBUG cinder.volume.flows.manager.create_volume [None req-d0d2dc67-9768-4b41-808a-674f1b821a37 tempest-VolumesGetTest-329404913 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 10:11:55 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-d0d2dc67-9768-4b41-808a-674f1b821a37 tempest-VolumesGetTest-329404913 None] Flow 'volume_create_manager' (2fbad1b4-6ab1-4d0b-abd9-a80742848395) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:11:55 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-d0d2dc67-9768-4b41-808a-674f1b821a37 tempest-VolumesGetTest-329404913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d6cdbf4-a16d-499d-985b-57558dc7596c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:11:55 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-d0d2dc67-9768-4b41-808a-674f1b821a37 tempest-VolumesGetTest-329404913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d6cdbf4-a16d-499d-985b-57558dc7596c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:11:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1453834735',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8dd6f09f-6b66-4ef2-a4b6-4bbe3dbba227,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='ecf34953525e4b9b81581ac36d4e0df0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:11:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=fa39d889-4a03-4588-8754-8fb05f5db852,status='creating',terminated_at=None,updated_at=2026-09-07T08:11:55Z,use_quota=True,user_id='680e26fefab8422488ad232f8032cf75',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3a092cd-7947-4cbf-abff-4ba9567becf0),volume_type_id=f3a092cd-7947-4cbf-abff-4ba9567becf0)' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:11:55 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-d0d2dc67-9768-4b41-808a-674f1b821a37 tempest-VolumesGetTest-329404913 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (918bd22d-fcb7-473f-ae17-a79bb0379132) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:11:55 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-d0d2dc67-9768-4b41-808a-674f1b821a37 tempest-VolumesGetTest-329404913 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (918bd22d-fcb7-473f-ae17-a79bb0379132) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:11:55 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-d0d2dc67-9768-4b41-808a-674f1b821a37 tempest-VolumesGetTest-329404913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6b27b62-58d3-428d-87be-ed094570fc21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:11:55 devstack cinder-volume[87515]: DEBUG cinder.volume.flows.manager.create_volume [None req-40c34168-8599-492f-b423-a898b6ea250b tempest-CreateVolumesFromSourceVolumeTest-159810001 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 10:11:55 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-40c34168-8599-492f-b423-a898b6ea250b tempest-CreateVolumesFromSourceVolumeTest-159810001 None] Flow 'volume_create_manager' (58b413a0-bcb4-4893-9920-daca90c8c437) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:11:55 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-40c34168-8599-492f-b423-a898b6ea250b tempest-CreateVolumesFromSourceVolumeTest-159810001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (208dff3b-891c-4146-b318-a0b11022afb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:11:55 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-d0d2dc67-9768-4b41-808a-674f1b821a37 tempest-VolumesGetTest-329404913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6b27b62-58d3-428d-87be-ed094570fc21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '8dd6f09f-6b66-4ef2-a4b6-4bbe3dbba227', 'volume_name': 'volume-8dd6f09f-6b66-4ef2-a4b6-4bbe3dbba227', 'volume_size': 1, 'source_volid': 'fa39d889-4a03-4588-8754-8fb05f5db852', 'source_volstatus': 'available'}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:11:55 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-d0d2dc67-9768-4b41-808a-674f1b821a37 tempest-VolumesGetTest-329404913 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d59d5387-3235-428d-9d5d-5420187e2833) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:11:55 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-d0d2dc67-9768-4b41-808a-674f1b821a37 tempest-VolumesGetTest-329404913 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d59d5387-3235-428d-9d5d-5420187e2833) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:11:55 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-d0d2dc67-9768-4b41-808a-674f1b821a37 tempest-VolumesGetTest-329404913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9369ec18-1ec7-48d7-9287-cbbb94309f88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:11:55 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-d0d2dc67-9768-4b41-808a-674f1b821a37 tempest-VolumesGetTest-329404913 None] Volume 8dd6f09f-6b66-4ef2-a4b6-4bbe3dbba227: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-8dd6f09f-6b66-4ef2-a4b6-4bbe3dbba227', 'volume_size': 1, 'source_volid': 'fa39d889-4a03-4588-8754-8fb05f5db852', 'source_volstatus': 'available'} Sep 07 10:11:55 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-40c34168-8599-492f-b423-a898b6ea250b tempest-CreateVolumesFromSourceVolumeTest-159810001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (208dff3b-891c-4146-b318-a0b11022afb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:11:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1306066007',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f38eae3-8745-4db8-8291-77c949cfcec4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2762d32eade4835aab2ef6424f5c9bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:11:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:11:56Z,use_quota=True,user_id='6f0a017cc53c4175b5cf36fce5c762ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3a092cd-7947-4cbf-abff-4ba9567becf0),volume_type_id=f3a092cd-7947-4cbf-abff-4ba9567becf0)' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:11:55 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-40c34168-8599-492f-b423-a898b6ea250b tempest-CreateVolumesFromSourceVolumeTest-159810001 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eaf99067-5fe0-4d74-a480-7e6f05c00299) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:11:55 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-40c34168-8599-492f-b423-a898b6ea250b tempest-CreateVolumesFromSourceVolumeTest-159810001 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eaf99067-5fe0-4d74-a480-7e6f05c00299) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:11:55 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-40c34168-8599-492f-b423-a898b6ea250b tempest-CreateVolumesFromSourceVolumeTest-159810001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d23d07c9-b313-4b0a-9ef4-bea3b010988d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:11:55 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-40c34168-8599-492f-b423-a898b6ea250b tempest-CreateVolumesFromSourceVolumeTest-159810001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d23d07c9-b313-4b0a-9ef4-bea3b010988d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8f38eae3-8745-4db8-8291-77c949cfcec4', 'volume_name': 'volume-8f38eae3-8745-4db8-8291-77c949cfcec4', 'volume_size': 1}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:11:55 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-40c34168-8599-492f-b423-a898b6ea250b tempest-CreateVolumesFromSourceVolumeTest-159810001 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4922d7c-6cc7-4e8b-b71e-9e617d63dcf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:11:55 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-40c34168-8599-492f-b423-a898b6ea250b tempest-CreateVolumesFromSourceVolumeTest-159810001 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4922d7c-6cc7-4e8b-b71e-9e617d63dcf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:11:55 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-40c34168-8599-492f-b423-a898b6ea250b tempest-CreateVolumesFromSourceVolumeTest-159810001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0db4e107-883d-4d1c-ad22-15dc168a4d28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:11:55 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-40c34168-8599-492f-b423-a898b6ea250b tempest-CreateVolumesFromSourceVolumeTest-159810001 None] Volume 8f38eae3-8745-4db8-8291-77c949cfcec4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8f38eae3-8745-4db8-8291-77c949cfcec4', 'volume_size': 1} Sep 07 10:11:55 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-40c34168-8599-492f-b423-a898b6ea250b tempest-CreateVolumesFromSourceVolumeTest-159810001 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:11:55 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-d0d2dc67-9768-4b41-808a-674f1b821a37 tempest-VolumesGetTest-329404913 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:11:56 devstack cinder-volume[87515]: DEBUG cinder.volume.flows.manager.create_volume [None req-700fe18b-e2ce-49d2-b5b4-8aaa7bdbb55d tempest-CreateVolumesFromSourceVolumeTest-159810001 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 10:11:56 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-700fe18b-e2ce-49d2-b5b4-8aaa7bdbb55d tempest-CreateVolumesFromSourceVolumeTest-159810001 None] Flow 'volume_create_manager' (38269942-4863-4f0e-bbe9-8f244a974196) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:11:56 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-700fe18b-e2ce-49d2-b5b4-8aaa7bdbb55d tempest-CreateVolumesFromSourceVolumeTest-159810001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd3a9ee8-0f56-4146-8e66-e462ad90a9e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:11:56 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-700fe18b-e2ce-49d2-b5b4-8aaa7bdbb55d tempest-CreateVolumesFromSourceVolumeTest-159810001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd3a9ee8-0f56-4146-8e66-e462ad90a9e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:11:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1687614910',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45a34ed7-f197-4f57-8661-1cd59de12da6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2762d32eade4835aab2ef6424f5c9bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:11:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:11:56Z,use_quota=True,user_id='6f0a017cc53c4175b5cf36fce5c762ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3a092cd-7947-4cbf-abff-4ba9567becf0),volume_type_id=f3a092cd-7947-4cbf-abff-4ba9567becf0)' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:11:56 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-700fe18b-e2ce-49d2-b5b4-8aaa7bdbb55d tempest-CreateVolumesFromSourceVolumeTest-159810001 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c977a93-aab4-47c3-9aef-efde46934753) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:11:56 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-700fe18b-e2ce-49d2-b5b4-8aaa7bdbb55d tempest-CreateVolumesFromSourceVolumeTest-159810001 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c977a93-aab4-47c3-9aef-efde46934753) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:11:56 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-700fe18b-e2ce-49d2-b5b4-8aaa7bdbb55d tempest-CreateVolumesFromSourceVolumeTest-159810001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7f634a7-271a-42a5-b058-89f61fe168c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:11:56 devstack sudo[102374]: pam_unix(sudo:session): session closed for user root Sep 07 10:11:56 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-700fe18b-e2ce-49d2-b5b4-8aaa7bdbb55d tempest-CreateVolumesFromSourceVolumeTest-159810001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7f634a7-271a-42a5-b058-89f61fe168c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '45a34ed7-f197-4f57-8661-1cd59de12da6', 'volume_name': 'volume-45a34ed7-f197-4f57-8661-1cd59de12da6', 'volume_size': 1}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:11:56 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-700fe18b-e2ce-49d2-b5b4-8aaa7bdbb55d tempest-CreateVolumesFromSourceVolumeTest-159810001 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b6f2028-d987-43ee-a00c-1fbddcd40faa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:11:56 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-700fe18b-e2ce-49d2-b5b4-8aaa7bdbb55d tempest-CreateVolumesFromSourceVolumeTest-159810001 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b6f2028-d987-43ee-a00c-1fbddcd40faa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:11:56 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-700fe18b-e2ce-49d2-b5b4-8aaa7bdbb55d tempest-CreateVolumesFromSourceVolumeTest-159810001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45a8acb7-2be1-4ba0-afb4-564a73f0fe2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:11:56 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-700fe18b-e2ce-49d2-b5b4-8aaa7bdbb55d tempest-CreateVolumesFromSourceVolumeTest-159810001 None] Volume 45a34ed7-f197-4f57-8661-1cd59de12da6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-45a34ed7-f197-4f57-8661-1cd59de12da6', 'volume_size': 1} Sep 07 10:11:56 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-700fe18b-e2ce-49d2-b5b4-8aaa7bdbb55d tempest-CreateVolumesFromSourceVolumeTest-159810001 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:11:56 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-b8b44c68-f2b8-48bb-9d3c-59017a05ebb3 tempest-CreateVolumesFromSourceVolumeTest-159810001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-0bd914e7-035e-4d45-a484-bd1e4cd84906 1073741824" returned: 0 in 0.824s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:11:56 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-b8b44c68-f2b8-48bb-9d3c-59017a05ebb3 tempest-CreateVolumesFromSourceVolumeTest-159810001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-0bd914e7-035e-4d45-a484-bd1e4cd84906 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:11:56 devstack sudo[102381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-0bd914e7-035e-4d45-a484-bd1e4cd84906 Sep 07 10:11:56 devstack sudo[102381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:11:56 devstack sudo[102381]: pam_unix(sudo:session): session closed for user root Sep 07 10:11:56 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-b8b44c68-f2b8-48bb-9d3c-59017a05ebb3 tempest-CreateVolumesFromSourceVolumeTest-159810001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-0bd914e7-035e-4d45-a484-bd1e4cd84906" returned: 0 in 0.376s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:11:56 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-b8b44c68-f2b8-48bb-9d3c-59017a05ebb3 tempest-CreateVolumesFromSourceVolumeTest-159810001 None] <== create_volume: return (1252ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'} {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 10:11:56 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-b8b44c68-f2b8-48bb-9d3c-59017a05ebb3 tempest-CreateVolumesFromSourceVolumeTest-159810001 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.257s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:11:56 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-40c34168-8599-492f-b423-a898b6ea250b tempest-CreateVolumesFromSourceVolumeTest-159810001 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.856s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:11:56 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-40c34168-8599-492f-b423-a898b6ea250b tempest-CreateVolumesFromSourceVolumeTest-159810001 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:11:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1306066007',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f38eae3-8745-4db8-8291-77c949cfcec4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2762d32eade4835aab2ef6424f5c9bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:11:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:11:56Z,use_quota=True,user_id='6f0a017cc53c4175b5cf36fce5c762ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3a092cd-7947-4cbf-abff-4ba9567becf0),volume_type_id=f3a092cd-7947-4cbf-abff-4ba9567becf0)}" {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 10:11:56 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-40c34168-8599-492f-b423-a898b6ea250b tempest-CreateVolumesFromSourceVolumeTest-159810001 None] Creating volume 8f38eae3-8745-4db8-8291-77c949cfcec4 {{(pid=87515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 10:11:56 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-40c34168-8599-492f-b423-a898b6ea250b tempest-CreateVolumesFromSourceVolumeTest-159810001 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:11:56 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-40c34168-8599-492f-b423-a898b6ea250b tempest-CreateVolumesFromSourceVolumeTest-159810001 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:11:56 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-40c34168-8599-492f-b423-a898b6ea250b tempest-CreateVolumesFromSourceVolumeTest-159810001 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:11:56 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-40c34168-8599-492f-b423-a898b6ea250b tempest-CreateVolumesFromSourceVolumeTest-159810001 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:11:56 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-40c34168-8599-492f-b423-a898b6ea250b tempest-CreateVolumesFromSourceVolumeTest-159810001 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:11:56 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-40c34168-8599-492f-b423-a898b6ea250b tempest-CreateVolumesFromSourceVolumeTest-159810001 None] Selected osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c as target Quobyte volume. {{(pid=87515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 10:11:56 devstack cinder-volume[87515]: INFO cinder.volume.drivers.remotefs [None req-40c34168-8599-492f-b423-a898b6ea250b tempest-CreateVolumesFromSourceVolumeTest-159810001 None] casted to osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c Sep 07 10:11:56 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-40c34168-8599-492f-b423-a898b6ea250b tempest-CreateVolumesFromSourceVolumeTest-159810001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-8f38eae3-8745-4db8-8291-77c949cfcec4 1073741824 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:11:56 devstack sudo[102384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-8f38eae3-8745-4db8-8291-77c949cfcec4 1073741824 Sep 07 10:11:56 devstack sudo[102384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:11:56 devstack cinder-volume[87515]: DEBUG cinder.volume.flows.manager.create_volume [None req-abb9feaa-1cca-4f14-88de-fada5121dbb1 tempest-CreateVolumesFromSourceVolumeTest-159810001 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 10:11:56 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-abb9feaa-1cca-4f14-88de-fada5121dbb1 tempest-CreateVolumesFromSourceVolumeTest-159810001 None] Flow 'volume_create_manager' (c64e09fe-2282-47f8-bbfe-239a75fb79d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:11:56 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-abb9feaa-1cca-4f14-88de-fada5121dbb1 tempest-CreateVolumesFromSourceVolumeTest-159810001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (036ee838-7787-4703-8700-cea6e70264b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:11:56 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-b8b44c68-f2b8-48bb-9d3c-59017a05ebb3 tempest-CreateVolumesFromSourceVolumeTest-159810001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8363bc94-6510-40b2-9542-1911a98da93a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0bd914e7-035e-4d45-a484-bd1e4cd84906', 'volume_size': 1}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:11:56 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-b8b44c68-f2b8-48bb-9d3c-59017a05ebb3 tempest-CreateVolumesFromSourceVolumeTest-159810001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb811842-6df7-4992-863e-c4ac89cc3473) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:11:56 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-abb9feaa-1cca-4f14-88de-fada5121dbb1 tempest-CreateVolumesFromSourceVolumeTest-159810001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (036ee838-7787-4703-8700-cea6e70264b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:11:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1816972702',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1fe4eb59-3ae5-47f7-ac3e-81ed53c7c88f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2762d32eade4835aab2ef6424f5c9bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:11:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:11:57Z,use_quota=True,user_id='6f0a017cc53c4175b5cf36fce5c762ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3a092cd-7947-4cbf-abff-4ba9567becf0),volume_type_id=f3a092cd-7947-4cbf-abff-4ba9567becf0)' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:11:56 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-abb9feaa-1cca-4f14-88de-fada5121dbb1 tempest-CreateVolumesFromSourceVolumeTest-159810001 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46f23e79-b3c2-4bea-8cca-1cb4e0c3391c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:11:56 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-abb9feaa-1cca-4f14-88de-fada5121dbb1 tempest-CreateVolumesFromSourceVolumeTest-159810001 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46f23e79-b3c2-4bea-8cca-1cb4e0c3391c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:11:56 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-abb9feaa-1cca-4f14-88de-fada5121dbb1 tempest-CreateVolumesFromSourceVolumeTest-159810001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7b4c8d8-4459-44f4-b5c0-0355e93857ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:11:56 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-abb9feaa-1cca-4f14-88de-fada5121dbb1 tempest-CreateVolumesFromSourceVolumeTest-159810001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7b4c8d8-4459-44f4-b5c0-0355e93857ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1fe4eb59-3ae5-47f7-ac3e-81ed53c7c88f', 'volume_name': 'volume-1fe4eb59-3ae5-47f7-ac3e-81ed53c7c88f', 'volume_size': 1}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:11:56 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-abb9feaa-1cca-4f14-88de-fada5121dbb1 tempest-CreateVolumesFromSourceVolumeTest-159810001 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96e9c4d2-1400-4492-80ec-c9aca4140697) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:11:56 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-abb9feaa-1cca-4f14-88de-fada5121dbb1 tempest-CreateVolumesFromSourceVolumeTest-159810001 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96e9c4d2-1400-4492-80ec-c9aca4140697) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:11:56 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-abb9feaa-1cca-4f14-88de-fada5121dbb1 tempest-CreateVolumesFromSourceVolumeTest-159810001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95ec21a7-f903-4774-880a-afd24096ae94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:11:56 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-abb9feaa-1cca-4f14-88de-fada5121dbb1 tempest-CreateVolumesFromSourceVolumeTest-159810001 None] Volume 1fe4eb59-3ae5-47f7-ac3e-81ed53c7c88f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1fe4eb59-3ae5-47f7-ac3e-81ed53c7c88f', 'volume_size': 1} Sep 07 10:11:56 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-abb9feaa-1cca-4f14-88de-fada5121dbb1 tempest-CreateVolumesFromSourceVolumeTest-159810001 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:11:56 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-b8b44c68-f2b8-48bb-9d3c-59017a05ebb3 tempest-CreateVolumesFromSourceVolumeTest-159810001 None] Volume volume-0bd914e7-035e-4d45-a484-bd1e4cd84906 (0bd914e7-035e-4d45-a484-bd1e4cd84906): created successfully Sep 07 10:11:56 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-b8b44c68-f2b8-48bb-9d3c-59017a05ebb3 tempest-CreateVolumesFromSourceVolumeTest-159810001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb811842-6df7-4992-863e-c4ac89cc3473) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:11:56 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-b8b44c68-f2b8-48bb-9d3c-59017a05ebb3 tempest-CreateVolumesFromSourceVolumeTest-159810001 None] Flow 'volume_create_manager' (fe948e89-3805-4363-b48b-03fc4783d8e0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:11:56 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-b8b44c68-f2b8-48bb-9d3c-59017a05ebb3 tempest-CreateVolumesFromSourceVolumeTest-159810001 None] Created volume successfully. Sep 07 10:11:57 devstack cinder-volume[87515]: DEBUG cinder.volume.flows.manager.create_volume [None req-f614a7bb-26ac-4795-9ce5-ea9dce16b53c tempest-CreateVolumesFromSourceVolumeTest-159810001 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 10:11:57 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-f614a7bb-26ac-4795-9ce5-ea9dce16b53c tempest-CreateVolumesFromSourceVolumeTest-159810001 None] Flow 'volume_create_manager' (8cd3eefe-108c-4187-a929-b90356406728) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:11:57 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-f614a7bb-26ac-4795-9ce5-ea9dce16b53c tempest-CreateVolumesFromSourceVolumeTest-159810001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c294618-5615-4c44-8ccc-1868493e2995) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:11:57 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-f614a7bb-26ac-4795-9ce5-ea9dce16b53c tempest-CreateVolumesFromSourceVolumeTest-159810001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c294618-5615-4c44-8ccc-1868493e2995) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:11:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-890248521',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2325ac21-2b13-49ec-9891-87d96e04cfb2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2762d32eade4835aab2ef6424f5c9bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:11:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:11:57Z,use_quota=True,user_id='6f0a017cc53c4175b5cf36fce5c762ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3a092cd-7947-4cbf-abff-4ba9567becf0),volume_type_id=f3a092cd-7947-4cbf-abff-4ba9567becf0)' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:11:57 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-f614a7bb-26ac-4795-9ce5-ea9dce16b53c tempest-CreateVolumesFromSourceVolumeTest-159810001 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (967f6d94-e3f1-4a4f-aabb-8db9ac9bea57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:11:57 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-f614a7bb-26ac-4795-9ce5-ea9dce16b53c tempest-CreateVolumesFromSourceVolumeTest-159810001 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (967f6d94-e3f1-4a4f-aabb-8db9ac9bea57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:11:57 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-f614a7bb-26ac-4795-9ce5-ea9dce16b53c tempest-CreateVolumesFromSourceVolumeTest-159810001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa9145ba-f368-4a96-bcfd-c64087e0cfdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:11:57 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-f614a7bb-26ac-4795-9ce5-ea9dce16b53c tempest-CreateVolumesFromSourceVolumeTest-159810001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa9145ba-f368-4a96-bcfd-c64087e0cfdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2325ac21-2b13-49ec-9891-87d96e04cfb2', 'volume_name': 'volume-2325ac21-2b13-49ec-9891-87d96e04cfb2', 'volume_size': 1}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:11:57 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-f614a7bb-26ac-4795-9ce5-ea9dce16b53c tempest-CreateVolumesFromSourceVolumeTest-159810001 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07bdb90a-9a32-4791-a76c-22a69b1c4558) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:11:57 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-f614a7bb-26ac-4795-9ce5-ea9dce16b53c tempest-CreateVolumesFromSourceVolumeTest-159810001 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07bdb90a-9a32-4791-a76c-22a69b1c4558) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:11:57 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-f614a7bb-26ac-4795-9ce5-ea9dce16b53c tempest-CreateVolumesFromSourceVolumeTest-159810001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4d84839-f726-4a64-aa07-e622c7918175) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:11:57 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-f614a7bb-26ac-4795-9ce5-ea9dce16b53c tempest-CreateVolumesFromSourceVolumeTest-159810001 None] Volume 2325ac21-2b13-49ec-9891-87d96e04cfb2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2325ac21-2b13-49ec-9891-87d96e04cfb2', 'volume_size': 1} Sep 07 10:11:57 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-f614a7bb-26ac-4795-9ce5-ea9dce16b53c tempest-CreateVolumesFromSourceVolumeTest-159810001 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:11:57 devstack sudo[102384]: pam_unix(sudo:session): session closed for user root Sep 07 10:11:57 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-40c34168-8599-492f-b423-a898b6ea250b tempest-CreateVolumesFromSourceVolumeTest-159810001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-8f38eae3-8745-4db8-8291-77c949cfcec4 1073741824" returned: 0 in 0.645s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:11:57 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-40c34168-8599-492f-b423-a898b6ea250b tempest-CreateVolumesFromSourceVolumeTest-159810001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-8f38eae3-8745-4db8-8291-77c949cfcec4 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:11:57 devstack sudo[102392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-8f38eae3-8745-4db8-8291-77c949cfcec4 Sep 07 10:11:57 devstack sudo[102392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:11:57 devstack sudo[102392]: pam_unix(sudo:session): session closed for user root Sep 07 10:11:57 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-40c34168-8599-492f-b423-a898b6ea250b tempest-CreateVolumesFromSourceVolumeTest-159810001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-8f38eae3-8745-4db8-8291-77c949cfcec4" returned: 0 in 0.297s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:11:57 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-40c34168-8599-492f-b423-a898b6ea250b tempest-CreateVolumesFromSourceVolumeTest-159810001 None] <== create_volume: return (993ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'} {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 10:11:57 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-40c34168-8599-492f-b423-a898b6ea250b tempest-CreateVolumesFromSourceVolumeTest-159810001 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.997s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:11:57 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-d0d2dc67-9768-4b41-808a-674f1b821a37 tempest-VolumesGetTest-329404913 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 1.853s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:11:57 devstack cinder-volume[87515]: INFO cinder.volume.drivers.remotefs [None req-d0d2dc67-9768-4b41-808a-674f1b821a37 tempest-VolumesGetTest-329404913 None] Cloning volume fa39d889-4a03-4588-8754-8fb05f5db852 to volume 8dd6f09f-6b66-4ef2-a4b6-4bbe3dbba227 Sep 07 10:11:57 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-40c34168-8599-492f-b423-a898b6ea250b tempest-CreateVolumesFromSourceVolumeTest-159810001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0db4e107-883d-4d1c-ad22-15dc168a4d28) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8f38eae3-8745-4db8-8291-77c949cfcec4', 'volume_size': 1}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:11:57 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-40c34168-8599-492f-b423-a898b6ea250b tempest-CreateVolumesFromSourceVolumeTest-159810001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (730dca4e-ae07-412c-b2e2-3e58ce82b050) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:11:57 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-40c34168-8599-492f-b423-a898b6ea250b tempest-CreateVolumesFromSourceVolumeTest-159810001 None] Volume volume-8f38eae3-8745-4db8-8291-77c949cfcec4 (8f38eae3-8745-4db8-8291-77c949cfcec4): created successfully Sep 07 10:11:57 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-40c34168-8599-492f-b423-a898b6ea250b tempest-CreateVolumesFromSourceVolumeTest-159810001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (730dca4e-ae07-412c-b2e2-3e58ce82b050) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:11:57 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-40c34168-8599-492f-b423-a898b6ea250b tempest-CreateVolumesFromSourceVolumeTest-159810001 None] Flow 'volume_create_manager' (58b413a0-bcb4-4893-9920-daca90c8c437) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:11:57 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-d0d2dc67-9768-4b41-808a-674f1b821a37 tempest-VolumesGetTest-329404913 None] Creating offline snapshot 8da451bc-1d41-4a8d-ac40-402196085964 of volume fa39d889-4a03-4588-8754-8fb05f5db852 {{(pid=87515) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 10:11:57 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-40c34168-8599-492f-b423-a898b6ea250b tempest-CreateVolumesFromSourceVolumeTest-159810001 None] Created volume successfully. Sep 07 10:11:57 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d6dd9c4-f6d6-4699-96ca-7767cf0bec00]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:11:57 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-d0d2dc67-9768-4b41-808a-674f1b821a37 tempest-VolumesGetTest-329404913 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-fa39d889-4a03-4588-8754-8fb05f5db852 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:11:57 devstack cinder-volume[87515]: INFO cinder.volume.manager [req-fd8ee5ff-2bc8-4f19-b15a-69b1eb799ea1 req-ca2409c6-48d2-4f13-85e1-e2c4c2e17ac3 tempest-TestMinimumBasicScenario-377324908 None] Terminate volume connection completed successfully. Sep 07 10:11:57 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [req-fd8ee5ff-2bc8-4f19-b15a-69b1eb799ea1 req-ca2409c6-48d2-4f13-85e1-e2c4c2e17ac3 tempest-TestMinimumBasicScenario-377324908 None] Deleting attachment bbcf63f0-14f9-4333-ba83-8b3b09155ae9. {{(pid=87515) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 07 10:11:57 devstack sudo[102395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-fa39d889-4a03-4588-8754-8fb05f5db852 Sep 07 10:11:57 devstack sudo[102395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:11:58 devstack sudo[102395]: pam_unix(sudo:session): session closed for user root Sep 07 10:11:58 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-d0d2dc67-9768-4b41-808a-674f1b821a37 tempest-VolumesGetTest-329404913 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-fa39d889-4a03-4588-8754-8fb05f5db852" returned: 0 in 0.404s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:11:58 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-d0d2dc67-9768-4b41-808a-674f1b821a37 tempest-VolumesGetTest-329404913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-fa39d889-4a03-4588-8754-8fb05f5db852,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-fa39d889-4a03-4588-8754-8fb05f5db852.8da451bc-1d41-4a8d-ac40-402196085964 1G {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:11:58 devstack sudo[102403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-fa39d889-4a03-4588-8754-8fb05f5db852,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-fa39d889-4a03-4588-8754-8fb05f5db852.8da451bc-1d41-4a8d-ac40-402196085964 1G Sep 07 10:11:58 devstack sudo[102403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:11:58 devstack sudo[102403]: pam_unix(sudo:session): session closed for user root Sep 07 10:11:58 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-d0d2dc67-9768-4b41-808a-674f1b821a37 tempest-VolumesGetTest-329404913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-fa39d889-4a03-4588-8754-8fb05f5db852,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-fa39d889-4a03-4588-8754-8fb05f5db852.8da451bc-1d41-4a8d-ac40-402196085964 1G" returned: 0 in 0.389s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:11:58 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-d0d2dc67-9768-4b41-808a-674f1b821a37 tempest-VolumesGetTest-329404913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fa39d889-4a03-4588-8754-8fb05f5db852 -F qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-fa39d889-4a03-4588-8754-8fb05f5db852.8da451bc-1d41-4a8d-ac40-402196085964 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:11:58 devstack sudo[102409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fa39d889-4a03-4588-8754-8fb05f5db852 -F qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-fa39d889-4a03-4588-8754-8fb05f5db852.8da451bc-1d41-4a8d-ac40-402196085964 Sep 07 10:11:58 devstack sudo[102409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:11:58 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-965ec590-17f3-4ec0-adca-ee386475ec4b tempest-TestMinimumBasicScenario-377324908 None] Acquiring lock "cinder-6e43b284-e13a-447a-99e5-88a736c2d8ec-delete_volume" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:11:58 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-965ec590-17f3-4ec0-adca-ee386475ec4b tempest-TestMinimumBasicScenario-377324908 None] Lock "cinder-6e43b284-e13a-447a-99e5-88a736c2d8ec-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:11:58 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-965ec590-17f3-4ec0-adca-ee386475ec4b tempest-TestMinimumBasicScenario-377324908 None] Acquiring lock "cinder-quobyte-6e43b284-e13a-447a-99e5-88a736c2d8ec" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:11:58 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-965ec590-17f3-4ec0-adca-ee386475ec4b tempest-TestMinimumBasicScenario-377324908 None] Lock "cinder-quobyte-6e43b284-e13a-447a-99e5-88a736c2d8ec" acquired by "delete_volume" :: waited 0.018s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:11:58 devstack sudo[102409]: pam_unix(sudo:session): session closed for user root Sep 07 10:11:58 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-d0d2dc67-9768-4b41-808a-674f1b821a37 tempest-VolumesGetTest-329404913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fa39d889-4a03-4588-8754-8fb05f5db852 -F qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-fa39d889-4a03-4588-8754-8fb05f5db852.8da451bc-1d41-4a8d-ac40-402196085964" returned: 0 in 0.354s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:11:58 devstack cinder-volume[87515]: WARNING cinder.volume.drivers.remotefs [None req-d0d2dc67-9768-4b41-808a-674f1b821a37 tempest-VolumesGetTest-329404913 None] /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-fa39d889-4a03-4588-8754-8fb05f5db852.8da451bc-1d41-4a8d-ac40-402196085964 is being set with open permissions: ugo+rw Sep 07 10:11:58 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-d0d2dc67-9768-4b41-808a-674f1b821a37 tempest-VolumesGetTest-329404913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-fa39d889-4a03-4588-8754-8fb05f5db852.8da451bc-1d41-4a8d-ac40-402196085964 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:11:58 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[10ae1625-56f4-49eb-b4f1-394640182665]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:11:58 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-965ec590-17f3-4ec0-adca-ee386475ec4b tempest-TestMinimumBasicScenario-377324908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-6e43b284-e13a-447a-99e5-88a736c2d8ec {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:11:58 devstack sudo[102414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-fa39d889-4a03-4588-8754-8fb05f5db852.8da451bc-1d41-4a8d-ac40-402196085964 Sep 07 10:11:58 devstack sudo[102414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:11:59 devstack sudo[102415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-6e43b284-e13a-447a-99e5-88a736c2d8ec Sep 07 10:11:59 devstack sudo[102415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:11:59 devstack sudo[102414]: pam_unix(sudo:session): session closed for user root Sep 07 10:11:59 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-d0d2dc67-9768-4b41-808a-674f1b821a37 tempest-VolumesGetTest-329404913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-fa39d889-4a03-4588-8754-8fb05f5db852.8da451bc-1d41-4a8d-ac40-402196085964" returned: 0 in 0.267s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:11:59 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-d0d2dc67-9768-4b41-808a-674f1b821a37 tempest-VolumesGetTest-329404913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-fa39d889-4a03-4588-8754-8fb05f5db852.info {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:11:59 devstack sudo[102420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-fa39d889-4a03-4588-8754-8fb05f5db852.info Sep 07 10:11:59 devstack sudo[102420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:11:59 devstack sudo[102415]: pam_unix(sudo:session): session closed for user root Sep 07 10:11:59 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-965ec590-17f3-4ec0-adca-ee386475ec4b tempest-TestMinimumBasicScenario-377324908 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-6e43b284-e13a-447a-99e5-88a736c2d8ec" returned: 0 in 0.388s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:11:59 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-965ec590-17f3-4ec0-adca-ee386475ec4b tempest-TestMinimumBasicScenario-377324908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-6e43b284-e13a-447a-99e5-88a736c2d8ec {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:11:59 devstack sudo[102425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-6e43b284-e13a-447a-99e5-88a736c2d8ec Sep 07 10:11:59 devstack sudo[102425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:11:59 devstack sudo[102420]: pam_unix(sudo:session): session closed for user root Sep 07 10:11:59 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-d0d2dc67-9768-4b41-808a-674f1b821a37 tempest-VolumesGetTest-329404913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-fa39d889-4a03-4588-8754-8fb05f5db852.info" returned: 0 in 0.276s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:11:59 devstack cinder-volume[87515]: WARNING cinder.volume.drivers.remotefs [None req-d0d2dc67-9768-4b41-808a-674f1b821a37 tempest-VolumesGetTest-329404913 None] /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-fa39d889-4a03-4588-8754-8fb05f5db852.info is being set with open permissions: ugo+rw Sep 07 10:11:59 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-d0d2dc67-9768-4b41-808a-674f1b821a37 tempest-VolumesGetTest-329404913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-fa39d889-4a03-4588-8754-8fb05f5db852.info {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:11:59 devstack sudo[102428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-fa39d889-4a03-4588-8754-8fb05f5db852.info Sep 07 10:11:59 devstack sudo[102428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:11:59 devstack sudo[102425]: pam_unix(sudo:session): session closed for user root Sep 07 10:11:59 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-965ec590-17f3-4ec0-adca-ee386475ec4b tempest-TestMinimumBasicScenario-377324908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-6e43b284-e13a-447a-99e5-88a736c2d8ec" returned: 0 in 0.244s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:11:59 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-965ec590-17f3-4ec0-adca-ee386475ec4b tempest-TestMinimumBasicScenario-377324908 None] Lock "cinder-quobyte-6e43b284-e13a-447a-99e5-88a736c2d8ec" released by "delete_volume" :: held 0.678s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:11:59 devstack cinder-volume[87515]: DEBUG cinder.quota [None req-965ec590-17f3-4ec0-adca-ee386475ec4b tempest-TestMinimumBasicScenario-377324908 None] Created reservations ['d16cdb1b-2516-4ccf-b555-1e64e956cbb7', '4dfbf2a4-1c66-42b3-8901-87700c309d23', '43ae5f65-d68d-4128-b502-0712e9ead158', 'ada41783-5fa2-4e6f-b26a-60b9648ddaa6'] {{(pid=87515) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:11:59 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-965ec590-17f3-4ec0-adca-ee386475ec4b tempest-TestMinimumBasicScenario-377324908 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:11:59 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-965ec590-17f3-4ec0-adca-ee386475ec4b tempest-TestMinimumBasicScenario-377324908 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:11:59 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-965ec590-17f3-4ec0-adca-ee386475ec4b tempest-TestMinimumBasicScenario-377324908 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:11:59 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-965ec590-17f3-4ec0-adca-ee386475ec4b tempest-TestMinimumBasicScenario-377324908 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:11:59 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-965ec590-17f3-4ec0-adca-ee386475ec4b tempest-TestMinimumBasicScenario-377324908 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:11:59 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-965ec590-17f3-4ec0-adca-ee386475ec4b tempest-TestMinimumBasicScenario-377324908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:11:59 devstack sudo[102431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a Sep 07 10:11:59 devstack sudo[102431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:11:59 devstack sudo[102428]: pam_unix(sudo:session): session closed for user root Sep 07 10:11:59 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-d0d2dc67-9768-4b41-808a-674f1b821a37 tempest-VolumesGetTest-329404913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-fa39d889-4a03-4588-8754-8fb05f5db852.info" returned: 0 in 0.268s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:11:59 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-d0d2dc67-9768-4b41-808a-674f1b821a37 tempest-VolumesGetTest-329404913 None] Acquiring lock "cinder-quobyte-8dd6f09f-6b66-4ef2-a4b6-4bbe3dbba227" by "_copy_volume_from_snapshot" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:11:59 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-d0d2dc67-9768-4b41-808a-674f1b821a37 tempest-VolumesGetTest-329404913 None] Lock "cinder-quobyte-8dd6f09f-6b66-4ef2-a4b6-4bbe3dbba227" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:11:59 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-d0d2dc67-9768-4b41-808a-674f1b821a37 tempest-VolumesGetTest-329404913 None] snapshot: 8da451bc-1d41-4a8d-ac40-402196085964, volume: 8dd6f09f-6b66-4ef2-a4b6-4bbe3dbba227, {{(pid=87515) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 07 10:11:59 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-d0d2dc67-9768-4b41-808a-674f1b821a37 tempest-VolumesGetTest-329404913 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:11:59 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-d0d2dc67-9768-4b41-808a-674f1b821a37 tempest-VolumesGetTest-329404913 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:11:59 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-d0d2dc67-9768-4b41-808a-674f1b821a37 tempest-VolumesGetTest-329404913 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:11:59 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-d0d2dc67-9768-4b41-808a-674f1b821a37 tempest-VolumesGetTest-329404913 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:11:59 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-d0d2dc67-9768-4b41-808a-674f1b821a37 tempest-VolumesGetTest-329404913 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:11:59 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7a81f59-906d-4f19-ad86-13e777ce3c16]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:11:59 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-d0d2dc67-9768-4b41-808a-674f1b821a37 tempest-VolumesGetTest-329404913 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-fa39d889-4a03-4588-8754-8fb05f5db852.8da451bc-1d41-4a8d-ac40-402196085964 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:11:59 devstack sudo[102434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-fa39d889-4a03-4588-8754-8fb05f5db852.8da451bc-1d41-4a8d-ac40-402196085964 Sep 07 10:11:59 devstack sudo[102434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:11:59 devstack sudo[102431]: pam_unix(sudo:session): session closed for user root Sep 07 10:11:59 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-965ec590-17f3-4ec0-adca-ee386475ec4b tempest-TestMinimumBasicScenario-377324908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a" returned: 0 in 0.275s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:11:59 devstack cinder-volume[87515]: DEBUG cinder.manager [None req-965ec590-17f3-4ec0-adca-ee386475ec4b tempest-TestMinimumBasicScenario-377324908 None] Notifying Schedulers of capabilities ... {{(pid=87515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:11:59 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-965ec590-17f3-4ec0-adca-ee386475ec4b tempest-TestMinimumBasicScenario-377324908 None] Deleted volume successfully. Sep 07 10:11:59 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-965ec590-17f3-4ec0-adca-ee386475ec4b tempest-TestMinimumBasicScenario-377324908 None] Lock "cinder-6e43b284-e13a-447a-99e5-88a736c2d8ec-delete_volume" released by "delete_volume" :: held 1.171s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:12:00 devstack sudo[102434]: pam_unix(sudo:session): session closed for user root Sep 07 10:12:00 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-d0d2dc67-9768-4b41-808a-674f1b821a37 tempest-VolumesGetTest-329404913 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-fa39d889-4a03-4588-8754-8fb05f5db852.8da451bc-1d41-4a8d-ac40-402196085964" returned: 0 in 0.451s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:12:00 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-d0d2dc67-9768-4b41-808a-674f1b821a37 tempest-VolumesGetTest-329404913 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fa39d889-4a03-4588-8754-8fb05f5db852(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87515) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 10:12:00 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[611ccb01-cf8b-4416-bb20-9da9bd66e006]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:12:00 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-d0d2dc67-9768-4b41-808a-674f1b821a37 tempest-VolumesGetTest-329404913 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-fa39d889-4a03-4588-8754-8fb05f5db852 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:12:00 devstack sudo[102441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-fa39d889-4a03-4588-8754-8fb05f5db852 Sep 07 10:12:00 devstack sudo[102441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:12:00 devstack sudo[102441]: pam_unix(sudo:session): session closed for user root Sep 07 10:12:00 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-d0d2dc67-9768-4b41-808a-674f1b821a37 tempest-VolumesGetTest-329404913 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-fa39d889-4a03-4588-8754-8fb05f5db852" returned: 0 in 0.513s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:12:00 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-d0d2dc67-9768-4b41-808a-674f1b821a37 tempest-VolumesGetTest-329404913 None] will copy from snapshot at /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-fa39d889-4a03-4588-8754-8fb05f5db852 {{(pid=87515) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 07 10:12:00 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-d0d2dc67-9768-4b41-808a-674f1b821a37 tempest-VolumesGetTest-329404913 None] Creating direct copy from snapshot {{(pid=87515) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 07 10:12:00 devstack cinder-volume[87515]: DEBUG cinder.utils [None req-d0d2dc67-9768-4b41-808a-674f1b821a37 tempest-VolumesGetTest-329404913 None] Path /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-8dd6f09f-6b66-4ef2-a4b6-4bbe3dbba227 not found in is_blk_device check {{(pid=87515) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 07 10:12:00 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-d0d2dc67-9768-4b41-808a-674f1b821a37 tempest-VolumesGetTest-329404913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-fa39d889-4a03-4588-8754-8fb05f5db852 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-8dd6f09f-6b66-4ef2-a4b6-4bbe3dbba227 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:12:00 devstack sudo[102465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-fa39d889-4a03-4588-8754-8fb05f5db852 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-8dd6f09f-6b66-4ef2-a4b6-4bbe3dbba227 Sep 07 10:12:00 devstack sudo[102465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:12:05 devstack sudo[102465]: pam_unix(sudo:session): session closed for user root Sep 07 10:12:05 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-d0d2dc67-9768-4b41-808a-674f1b821a37 tempest-VolumesGetTest-329404913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-fa39d889-4a03-4588-8754-8fb05f5db852 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-8dd6f09f-6b66-4ef2-a4b6-4bbe3dbba227" returned: 0 in 5.132s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:12:05 devstack cinder-volume[87515]: DEBUG cinder.image.image_utils [None req-d0d2dc67-9768-4b41-808a-674f1b821a37 tempest-VolumesGetTest-329404913 None] Image conversion details: src /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-fa39d889-4a03-4588-8754-8fb05f5db852, size 1024.00 MB, duration 5.13 sec, destination /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-8dd6f09f-6b66-4ef2-a4b6-4bbe3dbba227 {{(pid=87515) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 07 10:12:05 devstack cinder-volume[87515]: INFO cinder.image.image_utils [None req-d0d2dc67-9768-4b41-808a-674f1b821a37 tempest-VolumesGetTest-329404913 None] Converted 1024.00 MB image at 199.49 MB/s Sep 07 10:12:05 devstack cinder-volume[87515]: WARNING cinder.volume.drivers.remotefs [None req-d0d2dc67-9768-4b41-808a-674f1b821a37 tempest-VolumesGetTest-329404913 None] /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-8dd6f09f-6b66-4ef2-a4b6-4bbe3dbba227 is being set with open permissions: ugo+rw Sep 07 10:12:05 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-d0d2dc67-9768-4b41-808a-674f1b821a37 tempest-VolumesGetTest-329404913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-8dd6f09f-6b66-4ef2-a4b6-4bbe3dbba227 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:12:05 devstack sudo[102484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-8dd6f09f-6b66-4ef2-a4b6-4bbe3dbba227 Sep 07 10:12:05 devstack sudo[102484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:12:06 devstack sudo[102484]: pam_unix(sudo:session): session closed for user root Sep 07 10:12:06 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-d0d2dc67-9768-4b41-808a-674f1b821a37 tempest-VolumesGetTest-329404913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-8dd6f09f-6b66-4ef2-a4b6-4bbe3dbba227" returned: 0 in 0.260s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:12:06 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-d0d2dc67-9768-4b41-808a-674f1b821a37 tempest-VolumesGetTest-329404913 None] Lock "cinder-quobyte-8dd6f09f-6b66-4ef2-a4b6-4bbe3dbba227" released by "_copy_volume_from_snapshot" :: held 6.428s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:12:06 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-d0d2dc67-9768-4b41-808a-674f1b821a37 tempest-VolumesGetTest-329404913 None] Acquiring lock "cinder-quobyte-8da451bc-1d41-4a8d-ac40-402196085964" by "_delete_snapshot" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:12:06 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-d0d2dc67-9768-4b41-808a-674f1b821a37 tempest-VolumesGetTest-329404913 None] Lock "cinder-quobyte-8da451bc-1d41-4a8d-ac40-402196085964" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:12:06 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-d0d2dc67-9768-4b41-808a-674f1b821a37 tempest-VolumesGetTest-329404913 None] Deleting offline snapshot 8da451bc-1d41-4a8d-ac40-402196085964 of volume fa39d889-4a03-4588-8754-8fb05f5db852 {{(pid=87515) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 10:12:06 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-d0d2dc67-9768-4b41-808a-674f1b821a37 tempest-VolumesGetTest-329404913 None] snapshot_file for this snap is: volume-fa39d889-4a03-4588-8754-8fb05f5db852.8da451bc-1d41-4a8d-ac40-402196085964 {{(pid=87515) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 10:12:06 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1c05db6-c698-4029-ad86-2a1e2b8fb881]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:12:06 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-d0d2dc67-9768-4b41-808a-674f1b821a37 tempest-VolumesGetTest-329404913 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-fa39d889-4a03-4588-8754-8fb05f5db852.8da451bc-1d41-4a8d-ac40-402196085964 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:12:06 devstack sudo[102487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-fa39d889-4a03-4588-8754-8fb05f5db852.8da451bc-1d41-4a8d-ac40-402196085964 Sep 07 10:12:06 devstack sudo[102487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:12:06 devstack sudo[102487]: pam_unix(sudo:session): session closed for user root Sep 07 10:12:06 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-d0d2dc67-9768-4b41-808a-674f1b821a37 tempest-VolumesGetTest-329404913 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-fa39d889-4a03-4588-8754-8fb05f5db852.8da451bc-1d41-4a8d-ac40-402196085964" returned: 0 in 0.357s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:12:06 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-d0d2dc67-9768-4b41-808a-674f1b821a37 tempest-VolumesGetTest-329404913 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fa39d889-4a03-4588-8754-8fb05f5db852(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87515) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 10:12:06 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[e32d5bc8-a615-4500-a253-3deac2758051]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:12:06 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-d0d2dc67-9768-4b41-808a-674f1b821a37 tempest-VolumesGetTest-329404913 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-fa39d889-4a03-4588-8754-8fb05f5db852 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:12:06 devstack sudo[102492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-fa39d889-4a03-4588-8754-8fb05f5db852 Sep 07 10:12:06 devstack sudo[102492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:12:07 devstack sudo[102492]: pam_unix(sudo:session): session closed for user root Sep 07 10:12:07 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-d0d2dc67-9768-4b41-808a-674f1b821a37 tempest-VolumesGetTest-329404913 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-fa39d889-4a03-4588-8754-8fb05f5db852" returned: 0 in 0.603s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:12:07 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-d0d2dc67-9768-4b41-808a-674f1b821a37 tempest-VolumesGetTest-329404913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-fa39d889-4a03-4588-8754-8fb05f5db852.8da451bc-1d41-4a8d-ac40-402196085964 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:12:07 devstack sudo[102498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-fa39d889-4a03-4588-8754-8fb05f5db852.8da451bc-1d41-4a8d-ac40-402196085964 Sep 07 10:12:07 devstack sudo[102498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:12:07 devstack sudo[102498]: pam_unix(sudo:session): session closed for user root Sep 07 10:12:07 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-d0d2dc67-9768-4b41-808a-674f1b821a37 tempest-VolumesGetTest-329404913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-fa39d889-4a03-4588-8754-8fb05f5db852.8da451bc-1d41-4a8d-ac40-402196085964" returned: 0 in 0.349s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:12:07 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-d0d2dc67-9768-4b41-808a-674f1b821a37 tempest-VolumesGetTest-329404913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-fa39d889-4a03-4588-8754-8fb05f5db852.8da451bc-1d41-4a8d-ac40-402196085964 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:12:07 devstack sudo[102504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-fa39d889-4a03-4588-8754-8fb05f5db852.8da451bc-1d41-4a8d-ac40-402196085964 Sep 07 10:12:07 devstack sudo[102504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:12:07 devstack sudo[102504]: pam_unix(sudo:session): session closed for user root Sep 07 10:12:07 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-d0d2dc67-9768-4b41-808a-674f1b821a37 tempest-VolumesGetTest-329404913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-fa39d889-4a03-4588-8754-8fb05f5db852.8da451bc-1d41-4a8d-ac40-402196085964" returned: 0 in 0.275s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:12:07 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-d0d2dc67-9768-4b41-808a-674f1b821a37 tempest-VolumesGetTest-329404913 None] Lock "cinder-quobyte-8da451bc-1d41-4a8d-ac40-402196085964" released by "_delete_snapshot" :: held 1.681s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:12:07 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-d0d2dc67-9768-4b41-808a-674f1b821a37 tempest-VolumesGetTest-329404913 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 10.286s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:12:07 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-700fe18b-e2ce-49d2-b5b4-8aaa7bdbb55d tempest-CreateVolumesFromSourceVolumeTest-159810001 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.717s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:12:07 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-700fe18b-e2ce-49d2-b5b4-8aaa7bdbb55d tempest-CreateVolumesFromSourceVolumeTest-159810001 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:11:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1687614910',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45a34ed7-f197-4f57-8661-1cd59de12da6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2762d32eade4835aab2ef6424f5c9bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:11:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:11:56Z,use_quota=True,user_id='6f0a017cc53c4175b5cf36fce5c762ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3a092cd-7947-4cbf-abff-4ba9567becf0),volume_type_id=f3a092cd-7947-4cbf-abff-4ba9567becf0)}" {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 10:12:07 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-700fe18b-e2ce-49d2-b5b4-8aaa7bdbb55d tempest-CreateVolumesFromSourceVolumeTest-159810001 None] Creating volume 45a34ed7-f197-4f57-8661-1cd59de12da6 {{(pid=87515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 10:12:07 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-700fe18b-e2ce-49d2-b5b4-8aaa7bdbb55d tempest-CreateVolumesFromSourceVolumeTest-159810001 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:12:07 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-700fe18b-e2ce-49d2-b5b4-8aaa7bdbb55d tempest-CreateVolumesFromSourceVolumeTest-159810001 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:12:07 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-700fe18b-e2ce-49d2-b5b4-8aaa7bdbb55d tempest-CreateVolumesFromSourceVolumeTest-159810001 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:12:07 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-700fe18b-e2ce-49d2-b5b4-8aaa7bdbb55d tempest-CreateVolumesFromSourceVolumeTest-159810001 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:12:07 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-700fe18b-e2ce-49d2-b5b4-8aaa7bdbb55d tempest-CreateVolumesFromSourceVolumeTest-159810001 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:12:07 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-700fe18b-e2ce-49d2-b5b4-8aaa7bdbb55d tempest-CreateVolumesFromSourceVolumeTest-159810001 None] Selected osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c as target Quobyte volume. {{(pid=87515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 10:12:07 devstack cinder-volume[87515]: INFO cinder.volume.drivers.remotefs [None req-700fe18b-e2ce-49d2-b5b4-8aaa7bdbb55d tempest-CreateVolumesFromSourceVolumeTest-159810001 None] casted to osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c Sep 07 10:12:07 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-700fe18b-e2ce-49d2-b5b4-8aaa7bdbb55d tempest-CreateVolumesFromSourceVolumeTest-159810001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-45a34ed7-f197-4f57-8661-1cd59de12da6 1073741824 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:12:08 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-d0d2dc67-9768-4b41-808a-674f1b821a37 tempest-VolumesGetTest-329404913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9369ec18-1ec7-48d7-9287-cbbb94309f88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8dd6f09f-6b66-4ef2-a4b6-4bbe3dbba227', 'volume_size': 1, 'source_volid': 'fa39d889-4a03-4588-8754-8fb05f5db852', 'source_volstatus': 'available'}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:12:08 devstack sudo[102507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-45a34ed7-f197-4f57-8661-1cd59de12da6 1073741824 Sep 07 10:12:08 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-d0d2dc67-9768-4b41-808a-674f1b821a37 tempest-VolumesGetTest-329404913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2d7e546-8a9d-4748-ae19-0c1f90d96739) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:12:08 devstack sudo[102507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:12:08 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-d0d2dc67-9768-4b41-808a-674f1b821a37 tempest-VolumesGetTest-329404913 None] Volume volume-8dd6f09f-6b66-4ef2-a4b6-4bbe3dbba227 (8dd6f09f-6b66-4ef2-a4b6-4bbe3dbba227): created successfully Sep 07 10:12:08 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-d0d2dc67-9768-4b41-808a-674f1b821a37 tempest-VolumesGetTest-329404913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2d7e546-8a9d-4748-ae19-0c1f90d96739) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:12:08 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-d0d2dc67-9768-4b41-808a-674f1b821a37 tempest-VolumesGetTest-329404913 None] Flow 'volume_create_manager' (2fbad1b4-6ab1-4d0b-abd9-a80742848395) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:12:08 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-d0d2dc67-9768-4b41-808a-674f1b821a37 tempest-VolumesGetTest-329404913 None] Created volume successfully. Sep 07 10:12:08 devstack sudo[102507]: pam_unix(sudo:session): session closed for user root Sep 07 10:12:08 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-700fe18b-e2ce-49d2-b5b4-8aaa7bdbb55d tempest-CreateVolumesFromSourceVolumeTest-159810001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-45a34ed7-f197-4f57-8661-1cd59de12da6 1073741824" returned: 0 in 0.445s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:12:08 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-700fe18b-e2ce-49d2-b5b4-8aaa7bdbb55d tempest-CreateVolumesFromSourceVolumeTest-159810001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-45a34ed7-f197-4f57-8661-1cd59de12da6 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:12:08 devstack sudo[102513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-45a34ed7-f197-4f57-8661-1cd59de12da6 Sep 07 10:12:08 devstack sudo[102513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:12:08 devstack sudo[102513]: pam_unix(sudo:session): session closed for user root Sep 07 10:12:08 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-700fe18b-e2ce-49d2-b5b4-8aaa7bdbb55d tempest-CreateVolumesFromSourceVolumeTest-159810001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-45a34ed7-f197-4f57-8661-1cd59de12da6" returned: 0 in 0.282s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:12:08 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-700fe18b-e2ce-49d2-b5b4-8aaa7bdbb55d tempest-CreateVolumesFromSourceVolumeTest-159810001 None] <== create_volume: return (773ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'} {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 10:12:08 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-700fe18b-e2ce-49d2-b5b4-8aaa7bdbb55d tempest-CreateVolumesFromSourceVolumeTest-159810001 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.776s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:12:08 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-abb9feaa-1cca-4f14-88de-fada5121dbb1 tempest-CreateVolumesFromSourceVolumeTest-159810001 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.906s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:12:08 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-abb9feaa-1cca-4f14-88de-fada5121dbb1 tempest-CreateVolumesFromSourceVolumeTest-159810001 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:11:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1816972702',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1fe4eb59-3ae5-47f7-ac3e-81ed53c7c88f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2762d32eade4835aab2ef6424f5c9bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:11:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:11:57Z,use_quota=True,user_id='6f0a017cc53c4175b5cf36fce5c762ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3a092cd-7947-4cbf-abff-4ba9567becf0),volume_type_id=f3a092cd-7947-4cbf-abff-4ba9567becf0)}" {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 10:12:08 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-abb9feaa-1cca-4f14-88de-fada5121dbb1 tempest-CreateVolumesFromSourceVolumeTest-159810001 None] Creating volume 1fe4eb59-3ae5-47f7-ac3e-81ed53c7c88f {{(pid=87515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 10:12:08 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-abb9feaa-1cca-4f14-88de-fada5121dbb1 tempest-CreateVolumesFromSourceVolumeTest-159810001 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:12:08 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-abb9feaa-1cca-4f14-88de-fada5121dbb1 tempest-CreateVolumesFromSourceVolumeTest-159810001 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:12:08 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-abb9feaa-1cca-4f14-88de-fada5121dbb1 tempest-CreateVolumesFromSourceVolumeTest-159810001 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:12:08 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-abb9feaa-1cca-4f14-88de-fada5121dbb1 tempest-CreateVolumesFromSourceVolumeTest-159810001 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:12:08 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-abb9feaa-1cca-4f14-88de-fada5121dbb1 tempest-CreateVolumesFromSourceVolumeTest-159810001 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:12:08 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-abb9feaa-1cca-4f14-88de-fada5121dbb1 tempest-CreateVolumesFromSourceVolumeTest-159810001 None] Selected osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c as target Quobyte volume. {{(pid=87515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 10:12:08 devstack cinder-volume[87515]: INFO cinder.volume.drivers.remotefs [None req-abb9feaa-1cca-4f14-88de-fada5121dbb1 tempest-CreateVolumesFromSourceVolumeTest-159810001 None] casted to osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c Sep 07 10:12:08 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-abb9feaa-1cca-4f14-88de-fada5121dbb1 tempest-CreateVolumesFromSourceVolumeTest-159810001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-1fe4eb59-3ae5-47f7-ac3e-81ed53c7c88f 1073741824 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:12:08 devstack sudo[102516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-1fe4eb59-3ae5-47f7-ac3e-81ed53c7c88f 1073741824 Sep 07 10:12:08 devstack sudo[102516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:12:08 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-700fe18b-e2ce-49d2-b5b4-8aaa7bdbb55d tempest-CreateVolumesFromSourceVolumeTest-159810001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45a8acb7-2be1-4ba0-afb4-564a73f0fe2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-45a34ed7-f197-4f57-8661-1cd59de12da6', 'volume_size': 1}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:12:08 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-700fe18b-e2ce-49d2-b5b4-8aaa7bdbb55d tempest-CreateVolumesFromSourceVolumeTest-159810001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7eecd53e-e25e-47ae-b2d0-586ce4efb1be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:12:08 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-700fe18b-e2ce-49d2-b5b4-8aaa7bdbb55d tempest-CreateVolumesFromSourceVolumeTest-159810001 None] Volume volume-45a34ed7-f197-4f57-8661-1cd59de12da6 (45a34ed7-f197-4f57-8661-1cd59de12da6): created successfully Sep 07 10:12:08 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-700fe18b-e2ce-49d2-b5b4-8aaa7bdbb55d tempest-CreateVolumesFromSourceVolumeTest-159810001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7eecd53e-e25e-47ae-b2d0-586ce4efb1be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:12:08 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-700fe18b-e2ce-49d2-b5b4-8aaa7bdbb55d tempest-CreateVolumesFromSourceVolumeTest-159810001 None] Flow 'volume_create_manager' (38269942-4863-4f0e-bbe9-8f244a974196) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:12:08 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-700fe18b-e2ce-49d2-b5b4-8aaa7bdbb55d tempest-CreateVolumesFromSourceVolumeTest-159810001 None] Created volume successfully. Sep 07 10:12:09 devstack cinder-volume[87515]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f201dd6-9fab-4aeb-a585-6b001675fbf9 tempest-VolumesGetTest-329404913 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 10:12:09 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-1f201dd6-9fab-4aeb-a585-6b001675fbf9 tempest-VolumesGetTest-329404913 None] Flow 'volume_create_manager' (707d1144-49fc-4e07-a1f3-b612cd7f181c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:12:09 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-1f201dd6-9fab-4aeb-a585-6b001675fbf9 tempest-VolumesGetTest-329404913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46df14d6-7213-4c6f-b66f-b458c80214c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:12:09 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-1f201dd6-9fab-4aeb-a585-6b001675fbf9 tempest-VolumesGetTest-329404913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46df14d6-7213-4c6f-b66f-b458c80214c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:12:09Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1557062324',display_name='tempest-VolumesGetTest-Volume-618013198',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02476ca0-fb62-460d-9b7f-62efb5715303,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ecf34953525e4b9b81581ac36d4e0df0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:12:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:12:09Z,use_quota=True,user_id='680e26fefab8422488ad232f8032cf75',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3a092cd-7947-4cbf-abff-4ba9567becf0),volume_type_id=f3a092cd-7947-4cbf-abff-4ba9567becf0)' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:12:09 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-1f201dd6-9fab-4aeb-a585-6b001675fbf9 tempest-VolumesGetTest-329404913 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac93bfb6-ef6b-4bdb-ab89-ff53ee9da80b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:12:09 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-1f201dd6-9fab-4aeb-a585-6b001675fbf9 tempest-VolumesGetTest-329404913 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac93bfb6-ef6b-4bdb-ab89-ff53ee9da80b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:12:09 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-1f201dd6-9fab-4aeb-a585-6b001675fbf9 tempest-VolumesGetTest-329404913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db44af9b-fa34-490f-b024-c391e1c01cef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:12:09 devstack sudo[102516]: pam_unix(sudo:session): session closed for user root Sep 07 10:12:09 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-1f201dd6-9fab-4aeb-a585-6b001675fbf9 tempest-VolumesGetTest-329404913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db44af9b-fa34-490f-b024-c391e1c01cef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '02476ca0-fb62-460d-9b7f-62efb5715303', 'volume_name': 'volume-02476ca0-fb62-460d-9b7f-62efb5715303', 'volume_size': 1}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:12:09 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-1f201dd6-9fab-4aeb-a585-6b001675fbf9 tempest-VolumesGetTest-329404913 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8cefc290-1e36-4b04-a979-d5ac672a8d6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:12:09 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-1f201dd6-9fab-4aeb-a585-6b001675fbf9 tempest-VolumesGetTest-329404913 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8cefc290-1e36-4b04-a979-d5ac672a8d6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:12:09 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-1f201dd6-9fab-4aeb-a585-6b001675fbf9 tempest-VolumesGetTest-329404913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72f924f4-9093-4789-9922-074cae6f4602) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:12:09 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-1f201dd6-9fab-4aeb-a585-6b001675fbf9 tempest-VolumesGetTest-329404913 None] Volume 02476ca0-fb62-460d-9b7f-62efb5715303: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-02476ca0-fb62-460d-9b7f-62efb5715303', 'volume_size': 1} Sep 07 10:12:09 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-1f201dd6-9fab-4aeb-a585-6b001675fbf9 tempest-VolumesGetTest-329404913 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:12:09 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-abb9feaa-1cca-4f14-88de-fada5121dbb1 tempest-CreateVolumesFromSourceVolumeTest-159810001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-1fe4eb59-3ae5-47f7-ac3e-81ed53c7c88f 1073741824" returned: 0 in 0.697s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:12:09 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-abb9feaa-1cca-4f14-88de-fada5121dbb1 tempest-CreateVolumesFromSourceVolumeTest-159810001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-1fe4eb59-3ae5-47f7-ac3e-81ed53c7c88f {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:12:09 devstack sudo[102523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-1fe4eb59-3ae5-47f7-ac3e-81ed53c7c88f Sep 07 10:12:09 devstack sudo[102523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:12:09 devstack sudo[102523]: pam_unix(sudo:session): session closed for user root Sep 07 10:12:09 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-abb9feaa-1cca-4f14-88de-fada5121dbb1 tempest-CreateVolumesFromSourceVolumeTest-159810001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-1fe4eb59-3ae5-47f7-ac3e-81ed53c7c88f" returned: 0 in 0.289s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:12:09 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-abb9feaa-1cca-4f14-88de-fada5121dbb1 tempest-CreateVolumesFromSourceVolumeTest-159810001 None] <== create_volume: return (1031ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'} {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 10:12:09 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-abb9feaa-1cca-4f14-88de-fada5121dbb1 tempest-CreateVolumesFromSourceVolumeTest-159810001 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.035s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:12:09 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-f614a7bb-26ac-4795-9ce5-ea9dce16b53c tempest-CreateVolumesFromSourceVolumeTest-159810001 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.587s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:12:09 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-f614a7bb-26ac-4795-9ce5-ea9dce16b53c tempest-CreateVolumesFromSourceVolumeTest-159810001 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:11:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-890248521',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2325ac21-2b13-49ec-9891-87d96e04cfb2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2762d32eade4835aab2ef6424f5c9bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:11:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:11:57Z,use_quota=True,user_id='6f0a017cc53c4175b5cf36fce5c762ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3a092cd-7947-4cbf-abff-4ba9567becf0),volume_type_id=f3a092cd-7947-4cbf-abff-4ba9567becf0)}" {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 10:12:09 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-f614a7bb-26ac-4795-9ce5-ea9dce16b53c tempest-CreateVolumesFromSourceVolumeTest-159810001 None] Creating volume 2325ac21-2b13-49ec-9891-87d96e04cfb2 {{(pid=87515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 10:12:09 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-f614a7bb-26ac-4795-9ce5-ea9dce16b53c tempest-CreateVolumesFromSourceVolumeTest-159810001 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:12:09 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-f614a7bb-26ac-4795-9ce5-ea9dce16b53c tempest-CreateVolumesFromSourceVolumeTest-159810001 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:12:09 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-f614a7bb-26ac-4795-9ce5-ea9dce16b53c tempest-CreateVolumesFromSourceVolumeTest-159810001 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:12:09 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-f614a7bb-26ac-4795-9ce5-ea9dce16b53c tempest-CreateVolumesFromSourceVolumeTest-159810001 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:12:09 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-f614a7bb-26ac-4795-9ce5-ea9dce16b53c tempest-CreateVolumesFromSourceVolumeTest-159810001 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:12:09 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-f614a7bb-26ac-4795-9ce5-ea9dce16b53c tempest-CreateVolumesFromSourceVolumeTest-159810001 None] Selected osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c as target Quobyte volume. {{(pid=87515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 10:12:09 devstack cinder-volume[87515]: INFO cinder.volume.drivers.remotefs [None req-f614a7bb-26ac-4795-9ce5-ea9dce16b53c tempest-CreateVolumesFromSourceVolumeTest-159810001 None] casted to osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c Sep 07 10:12:09 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-f614a7bb-26ac-4795-9ce5-ea9dce16b53c tempest-CreateVolumesFromSourceVolumeTest-159810001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-2325ac21-2b13-49ec-9891-87d96e04cfb2 1073741824 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:12:09 devstack sudo[102526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-2325ac21-2b13-49ec-9891-87d96e04cfb2 1073741824 Sep 07 10:12:09 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-abb9feaa-1cca-4f14-88de-fada5121dbb1 tempest-CreateVolumesFromSourceVolumeTest-159810001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95ec21a7-f903-4774-880a-afd24096ae94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1fe4eb59-3ae5-47f7-ac3e-81ed53c7c88f', 'volume_size': 1}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:12:09 devstack sudo[102526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:12:09 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-abb9feaa-1cca-4f14-88de-fada5121dbb1 tempest-CreateVolumesFromSourceVolumeTest-159810001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3321208-a3d0-48e4-8ee1-cfe8971121dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:12:09 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-abb9feaa-1cca-4f14-88de-fada5121dbb1 tempest-CreateVolumesFromSourceVolumeTest-159810001 None] Volume volume-1fe4eb59-3ae5-47f7-ac3e-81ed53c7c88f (1fe4eb59-3ae5-47f7-ac3e-81ed53c7c88f): created successfully Sep 07 10:12:09 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-abb9feaa-1cca-4f14-88de-fada5121dbb1 tempest-CreateVolumesFromSourceVolumeTest-159810001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3321208-a3d0-48e4-8ee1-cfe8971121dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:12:09 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-abb9feaa-1cca-4f14-88de-fada5121dbb1 tempest-CreateVolumesFromSourceVolumeTest-159810001 None] Flow 'volume_create_manager' (c64e09fe-2282-47f8-bbfe-239a75fb79d9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:12:09 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-abb9feaa-1cca-4f14-88de-fada5121dbb1 tempest-CreateVolumesFromSourceVolumeTest-159810001 None] Created volume successfully. Sep 07 10:12:10 devstack sudo[102526]: pam_unix(sudo:session): session closed for user root Sep 07 10:12:10 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-f614a7bb-26ac-4795-9ce5-ea9dce16b53c tempest-CreateVolumesFromSourceVolumeTest-159810001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-2325ac21-2b13-49ec-9891-87d96e04cfb2 1073741824" returned: 0 in 0.473s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:12:10 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-f614a7bb-26ac-4795-9ce5-ea9dce16b53c tempest-CreateVolumesFromSourceVolumeTest-159810001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-2325ac21-2b13-49ec-9891-87d96e04cfb2 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:12:10 devstack sudo[102533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-2325ac21-2b13-49ec-9891-87d96e04cfb2 Sep 07 10:12:10 devstack sudo[102533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:12:10 devstack sudo[102533]: pam_unix(sudo:session): session closed for user root Sep 07 10:12:10 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-f614a7bb-26ac-4795-9ce5-ea9dce16b53c tempest-CreateVolumesFromSourceVolumeTest-159810001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-2325ac21-2b13-49ec-9891-87d96e04cfb2" returned: 0 in 0.268s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:12:10 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-f614a7bb-26ac-4795-9ce5-ea9dce16b53c tempest-CreateVolumesFromSourceVolumeTest-159810001 None] <== create_volume: return (801ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'} {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 10:12:10 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-f614a7bb-26ac-4795-9ce5-ea9dce16b53c tempest-CreateVolumesFromSourceVolumeTest-159810001 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.804s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:12:10 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-1f201dd6-9fab-4aeb-a585-6b001675fbf9 tempest-VolumesGetTest-329404913 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.136s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:12:10 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-1f201dd6-9fab-4aeb-a585-6b001675fbf9 tempest-VolumesGetTest-329404913 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:12:09Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1557062324',display_name='tempest-VolumesGetTest-Volume-618013198',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02476ca0-fb62-460d-9b7f-62efb5715303,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ecf34953525e4b9b81581ac36d4e0df0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:12:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:12:09Z,use_quota=True,user_id='680e26fefab8422488ad232f8032cf75',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3a092cd-7947-4cbf-abff-4ba9567becf0),volume_type_id=f3a092cd-7947-4cbf-abff-4ba9567becf0)}" {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 10:12:10 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-1f201dd6-9fab-4aeb-a585-6b001675fbf9 tempest-VolumesGetTest-329404913 None] Creating volume 02476ca0-fb62-460d-9b7f-62efb5715303 {{(pid=87515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 10:12:10 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-1f201dd6-9fab-4aeb-a585-6b001675fbf9 tempest-VolumesGetTest-329404913 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:12:10 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-1f201dd6-9fab-4aeb-a585-6b001675fbf9 tempest-VolumesGetTest-329404913 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:12:10 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-1f201dd6-9fab-4aeb-a585-6b001675fbf9 tempest-VolumesGetTest-329404913 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:12:10 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-1f201dd6-9fab-4aeb-a585-6b001675fbf9 tempest-VolumesGetTest-329404913 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:12:10 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-1f201dd6-9fab-4aeb-a585-6b001675fbf9 tempest-VolumesGetTest-329404913 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:12:10 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-1f201dd6-9fab-4aeb-a585-6b001675fbf9 tempest-VolumesGetTest-329404913 None] Selected osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c as target Quobyte volume. {{(pid=87515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 10:12:10 devstack cinder-volume[87515]: INFO cinder.volume.drivers.remotefs [None req-1f201dd6-9fab-4aeb-a585-6b001675fbf9 tempest-VolumesGetTest-329404913 None] casted to osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c Sep 07 10:12:10 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-1f201dd6-9fab-4aeb-a585-6b001675fbf9 tempest-VolumesGetTest-329404913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-02476ca0-fb62-460d-9b7f-62efb5715303 1073741824 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:12:10 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-f614a7bb-26ac-4795-9ce5-ea9dce16b53c tempest-CreateVolumesFromSourceVolumeTest-159810001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4d84839-f726-4a64-aa07-e622c7918175) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2325ac21-2b13-49ec-9891-87d96e04cfb2', 'volume_size': 1}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:12:10 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-f614a7bb-26ac-4795-9ce5-ea9dce16b53c tempest-CreateVolumesFromSourceVolumeTest-159810001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61b89708-6f0e-42ac-afec-ec279b007725) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:12:10 devstack sudo[102536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-02476ca0-fb62-460d-9b7f-62efb5715303 1073741824 Sep 07 10:12:10 devstack sudo[102536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:12:10 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-f614a7bb-26ac-4795-9ce5-ea9dce16b53c tempest-CreateVolumesFromSourceVolumeTest-159810001 None] Volume volume-2325ac21-2b13-49ec-9891-87d96e04cfb2 (2325ac21-2b13-49ec-9891-87d96e04cfb2): created successfully Sep 07 10:12:10 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-f614a7bb-26ac-4795-9ce5-ea9dce16b53c tempest-CreateVolumesFromSourceVolumeTest-159810001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61b89708-6f0e-42ac-afec-ec279b007725) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:12:10 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-f614a7bb-26ac-4795-9ce5-ea9dce16b53c tempest-CreateVolumesFromSourceVolumeTest-159810001 None] Flow 'volume_create_manager' (8cd3eefe-108c-4187-a929-b90356406728) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:12:10 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-f614a7bb-26ac-4795-9ce5-ea9dce16b53c tempest-CreateVolumesFromSourceVolumeTest-159810001 None] Created volume successfully. Sep 07 10:12:11 devstack sudo[102536]: pam_unix(sudo:session): session closed for user root Sep 07 10:12:11 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-1f201dd6-9fab-4aeb-a585-6b001675fbf9 tempest-VolumesGetTest-329404913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-02476ca0-fb62-460d-9b7f-62efb5715303 1073741824" returned: 0 in 0.445s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:12:11 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-1f201dd6-9fab-4aeb-a585-6b001675fbf9 tempest-VolumesGetTest-329404913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-02476ca0-fb62-460d-9b7f-62efb5715303 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:12:11 devstack sudo[102541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-02476ca0-fb62-460d-9b7f-62efb5715303 Sep 07 10:12:11 devstack sudo[102541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:12:11 devstack sudo[102541]: pam_unix(sudo:session): session closed for user root Sep 07 10:12:11 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-1f201dd6-9fab-4aeb-a585-6b001675fbf9 tempest-VolumesGetTest-329404913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-02476ca0-fb62-460d-9b7f-62efb5715303" returned: 0 in 0.275s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:12:11 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-1f201dd6-9fab-4aeb-a585-6b001675fbf9 tempest-VolumesGetTest-329404913 None] <== create_volume: return (763ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'} {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 10:12:11 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-1f201dd6-9fab-4aeb-a585-6b001675fbf9 tempest-VolumesGetTest-329404913 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.766s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:12:11 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-1f201dd6-9fab-4aeb-a585-6b001675fbf9 tempest-VolumesGetTest-329404913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72f924f4-9093-4789-9922-074cae6f4602) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-02476ca0-fb62-460d-9b7f-62efb5715303', 'volume_size': 1}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:12:11 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-1f201dd6-9fab-4aeb-a585-6b001675fbf9 tempest-VolumesGetTest-329404913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5cf461e5-e840-4699-9acd-61692e47a539) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:12:11 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-1f201dd6-9fab-4aeb-a585-6b001675fbf9 tempest-VolumesGetTest-329404913 None] Volume volume-02476ca0-fb62-460d-9b7f-62efb5715303 (02476ca0-fb62-460d-9b7f-62efb5715303): created successfully Sep 07 10:12:11 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-1f201dd6-9fab-4aeb-a585-6b001675fbf9 tempest-VolumesGetTest-329404913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5cf461e5-e840-4699-9acd-61692e47a539) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:12:11 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-1f201dd6-9fab-4aeb-a585-6b001675fbf9 tempest-VolumesGetTest-329404913 None] Flow 'volume_create_manager' (707d1144-49fc-4e07-a1f3-b612cd7f181c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:12:11 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-1f201dd6-9fab-4aeb-a585-6b001675fbf9 tempest-VolumesGetTest-329404913 None] Created volume successfully. Sep 07 10:12:11 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-5533d814-96c9-4841-811b-0a8c1a8f9eb2 tempest-CreateVolumesFromSourceVolumeTest-159810001 None] Acquiring lock "cinder-2325ac21-2b13-49ec-9891-87d96e04cfb2-delete_volume" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:12:11 devstack cinder-volume[87515]: DEBUG oslo_service.periodic_task [None req-cebd6a9d-3073-42a1-b65a-b38d444d85ed None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87515) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 10:12:11 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-cebd6a9d-3073-42a1-b65a-b38d444d85ed None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:12:11 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-cebd6a9d-3073-42a1-b65a-b38d444d85ed None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:12:11 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-cebd6a9d-3073-42a1-b65a-b38d444d85ed None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:12:11 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-cebd6a9d-3073-42a1-b65a-b38d444d85ed None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:12:11 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-cebd6a9d-3073-42a1-b65a-b38d444d85ed None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:12:11 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-cebd6a9d-3073-42a1-b65a-b38d444d85ed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:12:11 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-5533d814-96c9-4841-811b-0a8c1a8f9eb2 tempest-CreateVolumesFromSourceVolumeTest-159810001 None] Lock "cinder-2325ac21-2b13-49ec-9891-87d96e04cfb2-delete_volume" acquired by "delete_volume" :: waited 0.064s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:12:11 devstack sudo[102545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a Sep 07 10:12:11 devstack sudo[102545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:12:11 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-5533d814-96c9-4841-811b-0a8c1a8f9eb2 tempest-CreateVolumesFromSourceVolumeTest-159810001 None] Acquiring lock "cinder-quobyte-2325ac21-2b13-49ec-9891-87d96e04cfb2" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:12:11 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-5533d814-96c9-4841-811b-0a8c1a8f9eb2 tempest-CreateVolumesFromSourceVolumeTest-159810001 None] Lock "cinder-quobyte-2325ac21-2b13-49ec-9891-87d96e04cfb2" acquired by "delete_volume" :: waited 0.021s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:12:11 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf571fc6-f15b-472a-9e0a-2b603047833c]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:12:11 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-5533d814-96c9-4841-811b-0a8c1a8f9eb2 tempest-CreateVolumesFromSourceVolumeTest-159810001 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-2325ac21-2b13-49ec-9891-87d96e04cfb2 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:12:11 devstack sudo[102547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-2325ac21-2b13-49ec-9891-87d96e04cfb2 Sep 07 10:12:11 devstack sudo[102547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:12:11 devstack sudo[102545]: pam_unix(sudo:session): session closed for user root Sep 07 10:12:11 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-cebd6a9d-3073-42a1-b65a-b38d444d85ed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a" returned: 0 in 0.272s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:12:11 devstack cinder-volume[87515]: DEBUG cinder.manager [None req-cebd6a9d-3073-42a1-b65a-b38d444d85ed None None] Notifying Schedulers of capabilities ... {{(pid=87515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:12:11 devstack cinder-volume[87515]: DEBUG oslo_service.periodic_task [None req-cebd6a9d-3073-42a1-b65a-b38d444d85ed None None] Running periodic task VolumeManager._thread_info {{(pid=87515) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 10:12:11 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-cebd6a9d-3073-42a1-b65a-b38d444d85ed None None] thread count: 29 {{(pid=87515) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 07 10:12:11 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-cebd6a9d-3073-42a1-b65a-b38d444d85ed None None] thread info: [<_MainThread(MainThread, started 131647121809536)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87515) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 07 10:12:12 devstack sudo[102547]: pam_unix(sudo:session): session closed for user root Sep 07 10:12:12 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-5533d814-96c9-4841-811b-0a8c1a8f9eb2 tempest-CreateVolumesFromSourceVolumeTest-159810001 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-2325ac21-2b13-49ec-9891-87d96e04cfb2" returned: 0 in 0.365s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:12:12 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-5533d814-96c9-4841-811b-0a8c1a8f9eb2 tempest-CreateVolumesFromSourceVolumeTest-159810001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-2325ac21-2b13-49ec-9891-87d96e04cfb2 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:12:12 devstack sudo[102553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-2325ac21-2b13-49ec-9891-87d96e04cfb2 Sep 07 10:12:12 devstack sudo[102553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:12:12 devstack sudo[102553]: pam_unix(sudo:session): session closed for user root Sep 07 10:12:12 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-5533d814-96c9-4841-811b-0a8c1a8f9eb2 tempest-CreateVolumesFromSourceVolumeTest-159810001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-2325ac21-2b13-49ec-9891-87d96e04cfb2" returned: 0 in 0.252s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:12:12 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-5533d814-96c9-4841-811b-0a8c1a8f9eb2 tempest-CreateVolumesFromSourceVolumeTest-159810001 None] Lock "cinder-quobyte-2325ac21-2b13-49ec-9891-87d96e04cfb2" released by "delete_volume" :: held 0.662s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:12:12 devstack cinder-volume[87515]: DEBUG cinder.quota [None req-5533d814-96c9-4841-811b-0a8c1a8f9eb2 tempest-CreateVolumesFromSourceVolumeTest-159810001 None] Created reservations ['74c56d61-5ab9-4ce8-8e7e-bd3bdf430716', '4bfbaa5c-2f29-4d08-a424-a7f41944addf', 'b30ca55b-7d4c-4178-8b53-12c24b57d45a', '7d6b58dc-12b3-4597-a141-567c9ca977c2'] {{(pid=87515) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:12:12 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-5533d814-96c9-4841-811b-0a8c1a8f9eb2 tempest-CreateVolumesFromSourceVolumeTest-159810001 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:12:12 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-5533d814-96c9-4841-811b-0a8c1a8f9eb2 tempest-CreateVolumesFromSourceVolumeTest-159810001 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:12:12 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-5533d814-96c9-4841-811b-0a8c1a8f9eb2 tempest-CreateVolumesFromSourceVolumeTest-159810001 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:12:12 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-5533d814-96c9-4841-811b-0a8c1a8f9eb2 tempest-CreateVolumesFromSourceVolumeTest-159810001 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:12:12 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-5533d814-96c9-4841-811b-0a8c1a8f9eb2 tempest-CreateVolumesFromSourceVolumeTest-159810001 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:12:12 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-5533d814-96c9-4841-811b-0a8c1a8f9eb2 tempest-CreateVolumesFromSourceVolumeTest-159810001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:12:12 devstack sudo[102556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a Sep 07 10:12:12 devstack sudo[102556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:12:12 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-ffe5e85b-69ad-4631-98a8-53b34466778d tempest-VolumesGetTest-329404913 None] Acquiring lock "cinder-02476ca0-fb62-460d-9b7f-62efb5715303-delete_volume" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:12:12 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-1458b892-ca5c-4972-8cf7-796d60d483e9 tempest-CreateVolumesFromSourceVolumeTest-159810001 None] Acquiring lock "cinder-1fe4eb59-3ae5-47f7-ac3e-81ed53c7c88f-delete_volume" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:12:12 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-ffe5e85b-69ad-4631-98a8-53b34466778d tempest-VolumesGetTest-329404913 None] Lock "cinder-02476ca0-fb62-460d-9b7f-62efb5715303-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:12:12 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-1458b892-ca5c-4972-8cf7-796d60d483e9 tempest-CreateVolumesFromSourceVolumeTest-159810001 None] Lock "cinder-1fe4eb59-3ae5-47f7-ac3e-81ed53c7c88f-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:12:12 devstack sudo[102556]: pam_unix(sudo:session): session closed for user root Sep 07 10:12:12 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-5533d814-96c9-4841-811b-0a8c1a8f9eb2 tempest-CreateVolumesFromSourceVolumeTest-159810001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a" returned: 0 in 0.352s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:12:12 devstack cinder-volume[87515]: DEBUG cinder.manager [None req-5533d814-96c9-4841-811b-0a8c1a8f9eb2 tempest-CreateVolumesFromSourceVolumeTest-159810001 None] Notifying Schedulers of capabilities ... {{(pid=87515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:12:12 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-ffe5e85b-69ad-4631-98a8-53b34466778d tempest-VolumesGetTest-329404913 None] Acquiring lock "cinder-quobyte-02476ca0-fb62-460d-9b7f-62efb5715303" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:12:12 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-5533d814-96c9-4841-811b-0a8c1a8f9eb2 tempest-CreateVolumesFromSourceVolumeTest-159810001 None] Deleted volume successfully. Sep 07 10:12:12 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-1458b892-ca5c-4972-8cf7-796d60d483e9 tempest-CreateVolumesFromSourceVolumeTest-159810001 None] Acquiring lock "cinder-quobyte-1fe4eb59-3ae5-47f7-ac3e-81ed53c7c88f" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:12:12 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-ffe5e85b-69ad-4631-98a8-53b34466778d tempest-VolumesGetTest-329404913 None] Lock "cinder-quobyte-02476ca0-fb62-460d-9b7f-62efb5715303" acquired by "delete_volume" :: waited 0.028s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:12:12 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-1458b892-ca5c-4972-8cf7-796d60d483e9 tempest-CreateVolumesFromSourceVolumeTest-159810001 None] Lock "cinder-quobyte-1fe4eb59-3ae5-47f7-ac3e-81ed53c7c88f" acquired by "delete_volume" :: waited 0.031s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:12:12 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0992505-c7b8-4b87-8b57-487e1f29d161]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:12:12 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-5533d814-96c9-4841-811b-0a8c1a8f9eb2 tempest-CreateVolumesFromSourceVolumeTest-159810001 None] Lock "cinder-2325ac21-2b13-49ec-9891-87d96e04cfb2-delete_volume" released by "delete_volume" :: held 1.303s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:12:12 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-ffe5e85b-69ad-4631-98a8-53b34466778d tempest-VolumesGetTest-329404913 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-02476ca0-fb62-460d-9b7f-62efb5715303 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:12:12 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d77b1da-0b22-408d-843f-a00522f098b5]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:12:12 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-1458b892-ca5c-4972-8cf7-796d60d483e9 tempest-CreateVolumesFromSourceVolumeTest-159810001 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-1fe4eb59-3ae5-47f7-ac3e-81ed53c7c88f {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:12:13 devstack sudo[102559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-02476ca0-fb62-460d-9b7f-62efb5715303 Sep 07 10:12:13 devstack sudo[102559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:12:13 devstack sudo[102560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-1fe4eb59-3ae5-47f7-ac3e-81ed53c7c88f Sep 07 10:12:13 devstack sudo[102560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:12:13 devstack sudo[102559]: pam_unix(sudo:session): session closed for user root Sep 07 10:12:13 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-ffe5e85b-69ad-4631-98a8-53b34466778d tempest-VolumesGetTest-329404913 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-02476ca0-fb62-460d-9b7f-62efb5715303" returned: 0 in 0.374s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:12:13 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-ffe5e85b-69ad-4631-98a8-53b34466778d tempest-VolumesGetTest-329404913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-02476ca0-fb62-460d-9b7f-62efb5715303 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:12:13 devstack sudo[102560]: pam_unix(sudo:session): session closed for user root Sep 07 10:12:13 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-1458b892-ca5c-4972-8cf7-796d60d483e9 tempest-CreateVolumesFromSourceVolumeTest-159810001 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-1fe4eb59-3ae5-47f7-ac3e-81ed53c7c88f" returned: 0 in 0.374s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:12:13 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-1458b892-ca5c-4972-8cf7-796d60d483e9 tempest-CreateVolumesFromSourceVolumeTest-159810001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-1fe4eb59-3ae5-47f7-ac3e-81ed53c7c88f {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:12:13 devstack sudo[102569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-02476ca0-fb62-460d-9b7f-62efb5715303 Sep 07 10:12:13 devstack sudo[102569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:12:13 devstack sudo[102570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-1fe4eb59-3ae5-47f7-ac3e-81ed53c7c88f Sep 07 10:12:13 devstack sudo[102570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:12:13 devstack sudo[102569]: pam_unix(sudo:session): session closed for user root Sep 07 10:12:13 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-ffe5e85b-69ad-4631-98a8-53b34466778d tempest-VolumesGetTest-329404913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-02476ca0-fb62-460d-9b7f-62efb5715303" returned: 0 in 0.319s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:12:13 devstack sudo[102570]: pam_unix(sudo:session): session closed for user root Sep 07 10:12:13 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-1458b892-ca5c-4972-8cf7-796d60d483e9 tempest-CreateVolumesFromSourceVolumeTest-159810001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-1fe4eb59-3ae5-47f7-ac3e-81ed53c7c88f" returned: 0 in 0.332s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:12:13 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-ffe5e85b-69ad-4631-98a8-53b34466778d tempest-VolumesGetTest-329404913 None] Lock "cinder-quobyte-02476ca0-fb62-460d-9b7f-62efb5715303" released by "delete_volume" :: held 0.769s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:12:13 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-1458b892-ca5c-4972-8cf7-796d60d483e9 tempest-CreateVolumesFromSourceVolumeTest-159810001 None] Lock "cinder-quobyte-1fe4eb59-3ae5-47f7-ac3e-81ed53c7c88f" released by "delete_volume" :: held 0.770s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:12:13 devstack cinder-volume[87515]: DEBUG cinder.quota [None req-ffe5e85b-69ad-4631-98a8-53b34466778d tempest-VolumesGetTest-329404913 None] Created reservations ['47c627ea-55b0-489e-a051-a2dce925bd66', '24882abf-01ab-4af5-9a07-540533b1deb7', 'fe942c62-7fd8-455d-93b4-9b8b15394247', 'c7e2613b-0535-44f7-b0ec-bec14e472386'] {{(pid=87515) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:12:13 devstack cinder-volume[87515]: DEBUG cinder.quota [None req-1458b892-ca5c-4972-8cf7-796d60d483e9 tempest-CreateVolumesFromSourceVolumeTest-159810001 None] Created reservations ['11fad348-6e38-4fda-bf31-2bb18f5b4259', '4a818c61-1074-46f7-bf3a-cec594aff950', 'f38ea36d-ca4f-400f-b9b1-cd7c96834016', 'e5b75247-9cb2-4545-b6b5-2f6870fbde04'] {{(pid=87515) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:12:13 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-ffe5e85b-69ad-4631-98a8-53b34466778d tempest-VolumesGetTest-329404913 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:12:13 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-ffe5e85b-69ad-4631-98a8-53b34466778d tempest-VolumesGetTest-329404913 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:12:13 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-ffe5e85b-69ad-4631-98a8-53b34466778d tempest-VolumesGetTest-329404913 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:12:13 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-ffe5e85b-69ad-4631-98a8-53b34466778d tempest-VolumesGetTest-329404913 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:12:13 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-ffe5e85b-69ad-4631-98a8-53b34466778d tempest-VolumesGetTest-329404913 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:12:13 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-ffe5e85b-69ad-4631-98a8-53b34466778d tempest-VolumesGetTest-329404913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:12:13 devstack sudo[102575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a Sep 07 10:12:13 devstack sudo[102575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:12:13 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-1458b892-ca5c-4972-8cf7-796d60d483e9 tempest-CreateVolumesFromSourceVolumeTest-159810001 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:12:13 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-1458b892-ca5c-4972-8cf7-796d60d483e9 tempest-CreateVolumesFromSourceVolumeTest-159810001 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:12:13 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-1458b892-ca5c-4972-8cf7-796d60d483e9 tempest-CreateVolumesFromSourceVolumeTest-159810001 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:12:13 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-1458b892-ca5c-4972-8cf7-796d60d483e9 tempest-CreateVolumesFromSourceVolumeTest-159810001 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:12:13 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-1458b892-ca5c-4972-8cf7-796d60d483e9 tempest-CreateVolumesFromSourceVolumeTest-159810001 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:12:13 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-1458b892-ca5c-4972-8cf7-796d60d483e9 tempest-CreateVolumesFromSourceVolumeTest-159810001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:12:13 devstack sudo[102577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a Sep 07 10:12:13 devstack sudo[102577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:12:14 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-3ff5d11d-2ecc-440b-b9bc-e2d8f7fc515b tempest-CreateVolumesFromSourceVolumeTest-159810001 None] Acquiring lock "cinder-45a34ed7-f197-4f57-8661-1cd59de12da6-delete_volume" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:12:14 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-5669619a-49e5-4d7a-adcc-1e89ae21d048 tempest-VolumesGetTest-329404913 None] Acquiring lock "cinder-8dd6f09f-6b66-4ef2-a4b6-4bbe3dbba227-delete_volume" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:12:14 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-3ff5d11d-2ecc-440b-b9bc-e2d8f7fc515b tempest-CreateVolumesFromSourceVolumeTest-159810001 None] Lock "cinder-45a34ed7-f197-4f57-8661-1cd59de12da6-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:12:14 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-5669619a-49e5-4d7a-adcc-1e89ae21d048 tempest-VolumesGetTest-329404913 None] Lock "cinder-8dd6f09f-6b66-4ef2-a4b6-4bbe3dbba227-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:12:14 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-3ff5d11d-2ecc-440b-b9bc-e2d8f7fc515b tempest-CreateVolumesFromSourceVolumeTest-159810001 None] Acquiring lock "cinder-quobyte-45a34ed7-f197-4f57-8661-1cd59de12da6" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:12:14 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-5669619a-49e5-4d7a-adcc-1e89ae21d048 tempest-VolumesGetTest-329404913 None] Acquiring lock "cinder-quobyte-8dd6f09f-6b66-4ef2-a4b6-4bbe3dbba227" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:12:14 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-5669619a-49e5-4d7a-adcc-1e89ae21d048 tempest-VolumesGetTest-329404913 None] Lock "cinder-quobyte-8dd6f09f-6b66-4ef2-a4b6-4bbe3dbba227" acquired by "delete_volume" :: waited 0.022s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:12:14 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-3ff5d11d-2ecc-440b-b9bc-e2d8f7fc515b tempest-CreateVolumesFromSourceVolumeTest-159810001 None] Lock "cinder-quobyte-45a34ed7-f197-4f57-8661-1cd59de12da6" acquired by "delete_volume" :: waited 0.048s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:12:14 devstack sudo[102577]: pam_unix(sudo:session): session closed for user root Sep 07 10:12:14 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-1458b892-ca5c-4972-8cf7-796d60d483e9 tempest-CreateVolumesFromSourceVolumeTest-159810001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a" returned: 0 in 0.361s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:12:14 devstack cinder-volume[87515]: DEBUG cinder.manager [None req-1458b892-ca5c-4972-8cf7-796d60d483e9 tempest-CreateVolumesFromSourceVolumeTest-159810001 None] Notifying Schedulers of capabilities ... {{(pid=87515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:12:14 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a18a0de-9ca2-44d8-bffe-98f6c9900774]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:12:14 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-5669619a-49e5-4d7a-adcc-1e89ae21d048 tempest-VolumesGetTest-329404913 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-8dd6f09f-6b66-4ef2-a4b6-4bbe3dbba227 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:12:14 devstack sudo[102575]: pam_unix(sudo:session): session closed for user root Sep 07 10:12:14 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-1458b892-ca5c-4972-8cf7-796d60d483e9 tempest-CreateVolumesFromSourceVolumeTest-159810001 None] Deleted volume successfully. Sep 07 10:12:14 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd0901df-bca5-4723-bcda-60a7462d6ecb]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:12:14 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-3ff5d11d-2ecc-440b-b9bc-e2d8f7fc515b tempest-CreateVolumesFromSourceVolumeTest-159810001 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-45a34ed7-f197-4f57-8661-1cd59de12da6 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:12:14 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-ffe5e85b-69ad-4631-98a8-53b34466778d tempest-VolumesGetTest-329404913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a" returned: 0 in 0.464s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:12:14 devstack cinder-volume[87515]: DEBUG cinder.manager [None req-ffe5e85b-69ad-4631-98a8-53b34466778d tempest-VolumesGetTest-329404913 None] Notifying Schedulers of capabilities ... {{(pid=87515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:12:14 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-ffe5e85b-69ad-4631-98a8-53b34466778d tempest-VolumesGetTest-329404913 None] Deleted volume successfully. Sep 07 10:12:14 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-1458b892-ca5c-4972-8cf7-796d60d483e9 tempest-CreateVolumesFromSourceVolumeTest-159810001 None] Lock "cinder-1fe4eb59-3ae5-47f7-ac3e-81ed53c7c88f-delete_volume" released by "delete_volume" :: held 1.494s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:12:14 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-ffe5e85b-69ad-4631-98a8-53b34466778d tempest-VolumesGetTest-329404913 None] Lock "cinder-02476ca0-fb62-460d-9b7f-62efb5715303-delete_volume" released by "delete_volume" :: held 1.518s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:12:14 devstack sudo[102581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-8dd6f09f-6b66-4ef2-a4b6-4bbe3dbba227 Sep 07 10:12:14 devstack sudo[102581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:12:14 devstack sudo[102582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-45a34ed7-f197-4f57-8661-1cd59de12da6 Sep 07 10:12:14 devstack sudo[102582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:12:14 devstack sudo[102581]: pam_unix(sudo:session): session closed for user root Sep 07 10:12:14 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-5669619a-49e5-4d7a-adcc-1e89ae21d048 tempest-VolumesGetTest-329404913 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-8dd6f09f-6b66-4ef2-a4b6-4bbe3dbba227" returned: 0 in 0.456s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:12:14 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-5669619a-49e5-4d7a-adcc-1e89ae21d048 tempest-VolumesGetTest-329404913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-8dd6f09f-6b66-4ef2-a4b6-4bbe3dbba227 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:12:14 devstack sudo[102592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-8dd6f09f-6b66-4ef2-a4b6-4bbe3dbba227 Sep 07 10:12:14 devstack sudo[102592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:12:14 devstack sudo[102582]: pam_unix(sudo:session): session closed for user root Sep 07 10:12:14 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-3ff5d11d-2ecc-440b-b9bc-e2d8f7fc515b tempest-CreateVolumesFromSourceVolumeTest-159810001 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-45a34ed7-f197-4f57-8661-1cd59de12da6" returned: 0 in 0.502s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:12:14 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-3ff5d11d-2ecc-440b-b9bc-e2d8f7fc515b tempest-CreateVolumesFromSourceVolumeTest-159810001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-45a34ed7-f197-4f57-8661-1cd59de12da6 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:12:14 devstack sudo[102594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-45a34ed7-f197-4f57-8661-1cd59de12da6 Sep 07 10:12:14 devstack sudo[102594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:12:14 devstack sudo[102592]: pam_unix(sudo:session): session closed for user root Sep 07 10:12:14 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-5669619a-49e5-4d7a-adcc-1e89ae21d048 tempest-VolumesGetTest-329404913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-8dd6f09f-6b66-4ef2-a4b6-4bbe3dbba227" returned: 0 in 0.277s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:12:14 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-5669619a-49e5-4d7a-adcc-1e89ae21d048 tempest-VolumesGetTest-329404913 None] Lock "cinder-quobyte-8dd6f09f-6b66-4ef2-a4b6-4bbe3dbba227" released by "delete_volume" :: held 0.787s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:12:15 devstack sudo[102594]: pam_unix(sudo:session): session closed for user root Sep 07 10:12:15 devstack cinder-volume[87515]: DEBUG cinder.quota [None req-5669619a-49e5-4d7a-adcc-1e89ae21d048 tempest-VolumesGetTest-329404913 None] Created reservations ['807dc1f7-9c9b-4e23-9ffa-1fb28d55ede8', 'e0c2ef39-0875-4e2c-aff2-7b4566c1b745', 'f7b2d5b8-a3ab-434c-8778-4751dd7975a0', '6c545f08-e5c2-4af3-9c3c-9069c6b1f87b'] {{(pid=87515) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:12:15 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-3ff5d11d-2ecc-440b-b9bc-e2d8f7fc515b tempest-CreateVolumesFromSourceVolumeTest-159810001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-45a34ed7-f197-4f57-8661-1cd59de12da6" returned: 0 in 0.284s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:12:15 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-3ff5d11d-2ecc-440b-b9bc-e2d8f7fc515b tempest-CreateVolumesFromSourceVolumeTest-159810001 None] Lock "cinder-quobyte-45a34ed7-f197-4f57-8661-1cd59de12da6" released by "delete_volume" :: held 0.856s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:12:15 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-5669619a-49e5-4d7a-adcc-1e89ae21d048 tempest-VolumesGetTest-329404913 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:12:15 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-5669619a-49e5-4d7a-adcc-1e89ae21d048 tempest-VolumesGetTest-329404913 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:12:15 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-5669619a-49e5-4d7a-adcc-1e89ae21d048 tempest-VolumesGetTest-329404913 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:12:15 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-5669619a-49e5-4d7a-adcc-1e89ae21d048 tempest-VolumesGetTest-329404913 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:12:15 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-5669619a-49e5-4d7a-adcc-1e89ae21d048 tempest-VolumesGetTest-329404913 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:12:15 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-5669619a-49e5-4d7a-adcc-1e89ae21d048 tempest-VolumesGetTest-329404913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:12:15 devstack cinder-volume[87515]: DEBUG cinder.quota [None req-3ff5d11d-2ecc-440b-b9bc-e2d8f7fc515b tempest-CreateVolumesFromSourceVolumeTest-159810001 None] Created reservations ['3336f140-6d25-4064-9664-47d4e463e0bf', '0aa06b2f-d896-45c3-8c7e-c15069ba90aa', '7f06a8c5-eb8f-47d2-a770-c984b4e395a3', 'ef97b352-9e75-4c79-a9ac-32f21fd75420'] {{(pid=87515) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:12:15 devstack sudo[102598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a Sep 07 10:12:15 devstack sudo[102598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:12:15 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-3ff5d11d-2ecc-440b-b9bc-e2d8f7fc515b tempest-CreateVolumesFromSourceVolumeTest-159810001 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:12:15 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-3ff5d11d-2ecc-440b-b9bc-e2d8f7fc515b tempest-CreateVolumesFromSourceVolumeTest-159810001 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:12:15 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-3ff5d11d-2ecc-440b-b9bc-e2d8f7fc515b tempest-CreateVolumesFromSourceVolumeTest-159810001 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:12:15 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-3ff5d11d-2ecc-440b-b9bc-e2d8f7fc515b tempest-CreateVolumesFromSourceVolumeTest-159810001 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:12:15 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-3ff5d11d-2ecc-440b-b9bc-e2d8f7fc515b tempest-CreateVolumesFromSourceVolumeTest-159810001 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:12:15 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-3ff5d11d-2ecc-440b-b9bc-e2d8f7fc515b tempest-CreateVolumesFromSourceVolumeTest-159810001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:12:15 devstack sudo[102600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a Sep 07 10:12:15 devstack sudo[102600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:12:15 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-1861273b-f2a4-4287-8656-70b6375509a5 tempest-VolumesGetTest-329404913 None] Acquiring lock "cinder-fa39d889-4a03-4588-8754-8fb05f5db852-delete_volume" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:12:15 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-1861273b-f2a4-4287-8656-70b6375509a5 tempest-VolumesGetTest-329404913 None] Lock "cinder-fa39d889-4a03-4588-8754-8fb05f5db852-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:12:15 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-1861273b-f2a4-4287-8656-70b6375509a5 tempest-VolumesGetTest-329404913 None] Acquiring lock "cinder-quobyte-fa39d889-4a03-4588-8754-8fb05f5db852" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:12:15 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-1861273b-f2a4-4287-8656-70b6375509a5 tempest-VolumesGetTest-329404913 None] Lock "cinder-quobyte-fa39d889-4a03-4588-8754-8fb05f5db852" acquired by "delete_volume" :: waited 0.025s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:12:15 devstack sudo[102598]: pam_unix(sudo:session): session closed for user root Sep 07 10:12:15 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[d32844c4-8cae-4ad4-ab54-5256375abc2b]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:12:15 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-5669619a-49e5-4d7a-adcc-1e89ae21d048 tempest-VolumesGetTest-329404913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a" returned: 0 in 0.342s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:12:15 devstack cinder-volume[87515]: DEBUG cinder.manager [None req-5669619a-49e5-4d7a-adcc-1e89ae21d048 tempest-VolumesGetTest-329404913 None] Notifying Schedulers of capabilities ... {{(pid=87515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:12:15 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-1861273b-f2a4-4287-8656-70b6375509a5 tempest-VolumesGetTest-329404913 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-fa39d889-4a03-4588-8754-8fb05f5db852 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:12:15 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-5669619a-49e5-4d7a-adcc-1e89ae21d048 tempest-VolumesGetTest-329404913 None] Deleted volume successfully. Sep 07 10:12:15 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-5669619a-49e5-4d7a-adcc-1e89ae21d048 tempest-VolumesGetTest-329404913 None] Lock "cinder-8dd6f09f-6b66-4ef2-a4b6-4bbe3dbba227-delete_volume" released by "delete_volume" :: held 1.462s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:12:15 devstack sudo[102604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-fa39d889-4a03-4588-8754-8fb05f5db852 Sep 07 10:12:15 devstack sudo[102604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:12:15 devstack sudo[102600]: pam_unix(sudo:session): session closed for user root Sep 07 10:12:15 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-3ff5d11d-2ecc-440b-b9bc-e2d8f7fc515b tempest-CreateVolumesFromSourceVolumeTest-159810001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a" returned: 0 in 0.360s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:12:15 devstack cinder-volume[87515]: DEBUG cinder.manager [None req-3ff5d11d-2ecc-440b-b9bc-e2d8f7fc515b tempest-CreateVolumesFromSourceVolumeTest-159810001 None] Notifying Schedulers of capabilities ... {{(pid=87515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:12:15 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-3ff5d11d-2ecc-440b-b9bc-e2d8f7fc515b tempest-CreateVolumesFromSourceVolumeTest-159810001 None] Deleted volume successfully. Sep 07 10:12:15 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-3ff5d11d-2ecc-440b-b9bc-e2d8f7fc515b tempest-CreateVolumesFromSourceVolumeTest-159810001 None] Lock "cinder-45a34ed7-f197-4f57-8661-1cd59de12da6-delete_volume" released by "delete_volume" :: held 1.632s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:12:15 devstack sudo[102604]: pam_unix(sudo:session): session closed for user root Sep 07 10:12:15 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-1861273b-f2a4-4287-8656-70b6375509a5 tempest-VolumesGetTest-329404913 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-fa39d889-4a03-4588-8754-8fb05f5db852" returned: 0 in 0.436s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:12:15 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-1861273b-f2a4-4287-8656-70b6375509a5 tempest-VolumesGetTest-329404913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-fa39d889-4a03-4588-8754-8fb05f5db852 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:12:15 devstack sudo[102610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-fa39d889-4a03-4588-8754-8fb05f5db852 Sep 07 10:12:15 devstack sudo[102610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:12:16 devstack sudo[102610]: pam_unix(sudo:session): session closed for user root Sep 07 10:12:16 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-1861273b-f2a4-4287-8656-70b6375509a5 tempest-VolumesGetTest-329404913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-fa39d889-4a03-4588-8754-8fb05f5db852" returned: 0 in 0.256s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:12:16 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-1861273b-f2a4-4287-8656-70b6375509a5 tempest-VolumesGetTest-329404913 None] Lock "cinder-quobyte-fa39d889-4a03-4588-8754-8fb05f5db852" released by "delete_volume" :: held 0.765s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:12:16 devstack cinder-volume[87515]: DEBUG cinder.quota [None req-1861273b-f2a4-4287-8656-70b6375509a5 tempest-VolumesGetTest-329404913 None] Created reservations ['b2af6b80-e030-4340-83bb-6451522d6098', '669691f1-a3a2-46ce-9b47-afc5153e571d', '696cf8c7-3e9a-4015-95ff-cb06da7b5006', '43fad664-1ef1-40d0-bd32-f1545e24bea3'] {{(pid=87515) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:12:16 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-bc39aa06-366a-411b-9e36-cd392f980f99 tempest-CreateVolumesFromSourceVolumeTest-159810001 None] Acquiring lock "cinder-8f38eae3-8745-4db8-8291-77c949cfcec4-delete_volume" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:12:16 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-bc39aa06-366a-411b-9e36-cd392f980f99 tempest-CreateVolumesFromSourceVolumeTest-159810001 None] Lock "cinder-8f38eae3-8745-4db8-8291-77c949cfcec4-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:12:16 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-bc39aa06-366a-411b-9e36-cd392f980f99 tempest-CreateVolumesFromSourceVolumeTest-159810001 None] Acquiring lock "cinder-quobyte-8f38eae3-8745-4db8-8291-77c949cfcec4" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:12:16 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-1861273b-f2a4-4287-8656-70b6375509a5 tempest-VolumesGetTest-329404913 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:12:16 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-1861273b-f2a4-4287-8656-70b6375509a5 tempest-VolumesGetTest-329404913 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:12:16 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-1861273b-f2a4-4287-8656-70b6375509a5 tempest-VolumesGetTest-329404913 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:12:16 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-1861273b-f2a4-4287-8656-70b6375509a5 tempest-VolumesGetTest-329404913 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:12:16 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-1861273b-f2a4-4287-8656-70b6375509a5 tempest-VolumesGetTest-329404913 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:12:16 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-1861273b-f2a4-4287-8656-70b6375509a5 tempest-VolumesGetTest-329404913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:12:16 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-bc39aa06-366a-411b-9e36-cd392f980f99 tempest-CreateVolumesFromSourceVolumeTest-159810001 None] Lock "cinder-quobyte-8f38eae3-8745-4db8-8291-77c949cfcec4" acquired by "delete_volume" :: waited 0.041s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:12:16 devstack sudo[102613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a Sep 07 10:12:16 devstack sudo[102613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:12:16 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[71ba5c19-d137-498f-abb4-13b4d5de5155]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:12:16 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-bc39aa06-366a-411b-9e36-cd392f980f99 tempest-CreateVolumesFromSourceVolumeTest-159810001 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-8f38eae3-8745-4db8-8291-77c949cfcec4 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:12:16 devstack sudo[102615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-8f38eae3-8745-4db8-8291-77c949cfcec4 Sep 07 10:12:16 devstack sudo[102615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:12:16 devstack sudo[102613]: pam_unix(sudo:session): session closed for user root Sep 07 10:12:16 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-1861273b-f2a4-4287-8656-70b6375509a5 tempest-VolumesGetTest-329404913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a" returned: 0 in 0.355s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:12:16 devstack cinder-volume[87515]: DEBUG cinder.manager [None req-1861273b-f2a4-4287-8656-70b6375509a5 tempest-VolumesGetTest-329404913 None] Notifying Schedulers of capabilities ... {{(pid=87515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:12:16 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-1861273b-f2a4-4287-8656-70b6375509a5 tempest-VolumesGetTest-329404913 None] Deleted volume successfully. Sep 07 10:12:16 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-1861273b-f2a4-4287-8656-70b6375509a5 tempest-VolumesGetTest-329404913 None] Lock "cinder-fa39d889-4a03-4588-8754-8fb05f5db852-delete_volume" released by "delete_volume" :: held 1.427s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:12:16 devstack sudo[102615]: pam_unix(sudo:session): session closed for user root Sep 07 10:12:16 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-bc39aa06-366a-411b-9e36-cd392f980f99 tempest-CreateVolumesFromSourceVolumeTest-159810001 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-8f38eae3-8745-4db8-8291-77c949cfcec4" returned: 0 in 0.461s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:12:16 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-bc39aa06-366a-411b-9e36-cd392f980f99 tempest-CreateVolumesFromSourceVolumeTest-159810001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-8f38eae3-8745-4db8-8291-77c949cfcec4 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:12:16 devstack sudo[102622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-8f38eae3-8745-4db8-8291-77c949cfcec4 Sep 07 10:12:16 devstack sudo[102622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:12:17 devstack sudo[102622]: pam_unix(sudo:session): session closed for user root Sep 07 10:12:17 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-bc39aa06-366a-411b-9e36-cd392f980f99 tempest-CreateVolumesFromSourceVolumeTest-159810001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-8f38eae3-8745-4db8-8291-77c949cfcec4" returned: 0 in 0.265s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:12:17 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-bc39aa06-366a-411b-9e36-cd392f980f99 tempest-CreateVolumesFromSourceVolumeTest-159810001 None] Lock "cinder-quobyte-8f38eae3-8745-4db8-8291-77c949cfcec4" released by "delete_volume" :: held 0.797s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:12:17 devstack cinder-volume[87515]: DEBUG cinder.quota [None req-bc39aa06-366a-411b-9e36-cd392f980f99 tempest-CreateVolumesFromSourceVolumeTest-159810001 None] Created reservations ['53811a9f-ee60-4a0c-bfd2-99f36642e367', '72887d9b-8592-4f4a-ac84-ae435af7f89a', '54a84a31-2055-4721-825d-65e79f52650b', '98867695-d1cc-4c33-a01a-ec54d840f4ca'] {{(pid=87515) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:12:17 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-bc39aa06-366a-411b-9e36-cd392f980f99 tempest-CreateVolumesFromSourceVolumeTest-159810001 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:12:17 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-bc39aa06-366a-411b-9e36-cd392f980f99 tempest-CreateVolumesFromSourceVolumeTest-159810001 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:12:17 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-bc39aa06-366a-411b-9e36-cd392f980f99 tempest-CreateVolumesFromSourceVolumeTest-159810001 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:12:17 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-bc39aa06-366a-411b-9e36-cd392f980f99 tempest-CreateVolumesFromSourceVolumeTest-159810001 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:12:17 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-bc39aa06-366a-411b-9e36-cd392f980f99 tempest-CreateVolumesFromSourceVolumeTest-159810001 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:12:17 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-bc39aa06-366a-411b-9e36-cd392f980f99 tempest-CreateVolumesFromSourceVolumeTest-159810001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:12:17 devstack sudo[102625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a Sep 07 10:12:17 devstack sudo[102625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:12:17 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-78d5e983-5806-4c96-bf72-7f2207b7fa10 tempest-CreateVolumesFromSourceVolumeTest-159810001 None] Acquiring lock "cinder-0bd914e7-035e-4d45-a484-bd1e4cd84906-delete_volume" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:12:17 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-78d5e983-5806-4c96-bf72-7f2207b7fa10 tempest-CreateVolumesFromSourceVolumeTest-159810001 None] Lock "cinder-0bd914e7-035e-4d45-a484-bd1e4cd84906-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:12:17 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-78d5e983-5806-4c96-bf72-7f2207b7fa10 tempest-CreateVolumesFromSourceVolumeTest-159810001 None] Acquiring lock "cinder-quobyte-0bd914e7-035e-4d45-a484-bd1e4cd84906" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:12:17 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-78d5e983-5806-4c96-bf72-7f2207b7fa10 tempest-CreateVolumesFromSourceVolumeTest-159810001 None] Lock "cinder-quobyte-0bd914e7-035e-4d45-a484-bd1e4cd84906" acquired by "delete_volume" :: waited 0.018s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:12:17 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f110d09-c6a4-4223-acd3-9ee10b21f7f8]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:12:17 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-78d5e983-5806-4c96-bf72-7f2207b7fa10 tempest-CreateVolumesFromSourceVolumeTest-159810001 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-0bd914e7-035e-4d45-a484-bd1e4cd84906 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:12:17 devstack sudo[102625]: pam_unix(sudo:session): session closed for user root Sep 07 10:12:17 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-bc39aa06-366a-411b-9e36-cd392f980f99 tempest-CreateVolumesFromSourceVolumeTest-159810001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a" returned: 0 in 0.363s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:12:17 devstack cinder-volume[87515]: DEBUG cinder.manager [None req-bc39aa06-366a-411b-9e36-cd392f980f99 tempest-CreateVolumesFromSourceVolumeTest-159810001 None] Notifying Schedulers of capabilities ... {{(pid=87515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:12:17 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-bc39aa06-366a-411b-9e36-cd392f980f99 tempest-CreateVolumesFromSourceVolumeTest-159810001 None] Deleted volume successfully. Sep 07 10:12:17 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-bc39aa06-366a-411b-9e36-cd392f980f99 tempest-CreateVolumesFromSourceVolumeTest-159810001 None] Lock "cinder-8f38eae3-8745-4db8-8291-77c949cfcec4-delete_volume" released by "delete_volume" :: held 1.406s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:12:17 devstack cinder-volume[87515]: DEBUG cinder.volume.flows.manager.create_volume [None req-51b2a685-197c-4439-badb-ce40134b225c tempest-VolumesGetTest-329404913 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 10:12:17 devstack sudo[102628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-0bd914e7-035e-4d45-a484-bd1e4cd84906 Sep 07 10:12:17 devstack sudo[102628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:12:17 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-51b2a685-197c-4439-badb-ce40134b225c tempest-VolumesGetTest-329404913 None] Flow 'volume_create_manager' (1c2536d6-c30c-4a96-9f5d-8323370347f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:12:17 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-51b2a685-197c-4439-badb-ce40134b225c tempest-VolumesGetTest-329404913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21250cf2-53d7-4ff8-9408-2f2927085f59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:12:17 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-51b2a685-197c-4439-badb-ce40134b225c tempest-VolumesGetTest-329404913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21250cf2-53d7-4ff8-9408-2f2927085f59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:12:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-2016171686',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e78e34cd-f362-46c3-8f8d-e31767df0b0f,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='ecf34953525e4b9b81581ac36d4e0df0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:12:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:12:18Z,use_quota=True,user_id='680e26fefab8422488ad232f8032cf75',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3a092cd-7947-4cbf-abff-4ba9567becf0),volume_type_id=f3a092cd-7947-4cbf-abff-4ba9567becf0)' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:12:17 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-51b2a685-197c-4439-badb-ce40134b225c tempest-VolumesGetTest-329404913 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d10e2f13-dff8-4835-853f-cd0f14e7edd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:12:17 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-51b2a685-197c-4439-badb-ce40134b225c tempest-VolumesGetTest-329404913 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d10e2f13-dff8-4835-853f-cd0f14e7edd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:12:17 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-51b2a685-197c-4439-badb-ce40134b225c tempest-VolumesGetTest-329404913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28af11cf-5714-409e-8882-c895025c8361) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:12:17 devstack cinder-volume[87515]: DEBUG cinder.image.glance [None req-51b2a685-197c-4439-badb-ce40134b225c tempest-VolumesGetTest-329404913 None] Creating Keystone auth plugin from conf {{(pid=87515) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 07 10:12:18 devstack sudo[102628]: pam_unix(sudo:session): session closed for user root Sep 07 10:12:18 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-78d5e983-5806-4c96-bf72-7f2207b7fa10 tempest-CreateVolumesFromSourceVolumeTest-159810001 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-0bd914e7-035e-4d45-a484-bd1e4cd84906" returned: 0 in 0.392s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:12:18 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-78d5e983-5806-4c96-bf72-7f2207b7fa10 tempest-CreateVolumesFromSourceVolumeTest-159810001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-0bd914e7-035e-4d45-a484-bd1e4cd84906 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:12:18 devstack sudo[102634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-0bd914e7-035e-4d45-a484-bd1e4cd84906 Sep 07 10:12:18 devstack sudo[102634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:12:18 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-51b2a685-197c-4439-badb-ce40134b225c tempest-VolumesGetTest-329404913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28af11cf-5714-409e-8882-c895025c8361) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'e78e34cd-f362-46c3-8f8d-e31767df0b0f', 'volume_name': 'volume-e78e34cd-f362-46c3-8f8d-e31767df0b0f', 'volume_size': 1, 'image_id': '26019e10-1e1f-4514-b191-397ccf1d59e6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/26019e10-1e1f-4514-b191-397ccf1d59e6', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4765956d565c46c2a4a703c5a550ca58', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '26019e10-1e1f-4514-b191-397ccf1d59e6', 'created_at': datetime.datetime(2026, 9, 7, 7, 52, 21, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 7, 7, 52, 22, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/26019e10-1e1f-4514-b191-397ccf1d59e6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:12:18 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-51b2a685-197c-4439-badb-ce40134b225c tempest-VolumesGetTest-329404913 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93b0b355-24b1-4e7f-9446-326eb2829b72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:12:18 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-51b2a685-197c-4439-badb-ce40134b225c tempest-VolumesGetTest-329404913 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93b0b355-24b1-4e7f-9446-326eb2829b72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:12:18 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-51b2a685-197c-4439-badb-ce40134b225c tempest-VolumesGetTest-329404913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8bd84116-290f-4780-b6d6-fa837b11bba1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:12:18 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-51b2a685-197c-4439-badb-ce40134b225c tempest-VolumesGetTest-329404913 None] Volume e78e34cd-f362-46c3-8f8d-e31767df0b0f: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-e78e34cd-f362-46c3-8f8d-e31767df0b0f', 'volume_size': 1, 'image_id': '26019e10-1e1f-4514-b191-397ccf1d59e6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/26019e10-1e1f-4514-b191-397ccf1d59e6', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4765956d565c46c2a4a703c5a550ca58', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '26019e10-1e1f-4514-b191-397ccf1d59e6', 'created_at': datetime.datetime(2026, 9, 7, 7, 52, 21, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 7, 7, 52, 22, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/26019e10-1e1f-4514-b191-397ccf1d59e6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 07 10:12:18 devstack cinder-volume[87515]: DEBUG cinder.volume.flows.manager.create_volume [None req-51b2a685-197c-4439-badb-ce40134b225c tempest-VolumesGetTest-329404913 None] Trying to clone e78e34cd-f362-46c3-8f8d-e31767df0b0f from image 26019e10-1e1f-4514-b191-397ccf1d59e6 at location (None, [{'url': 'file:///opt/stack/data/glance/images/26019e10-1e1f-4514-b191-397ccf1d59e6', 'metadata': {}}]). {{(pid=87515) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 07 10:12:18 devstack sudo[102634]: pam_unix(sudo:session): session closed for user root Sep 07 10:12:18 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-78d5e983-5806-4c96-bf72-7f2207b7fa10 tempest-CreateVolumesFromSourceVolumeTest-159810001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-0bd914e7-035e-4d45-a484-bd1e4cd84906" returned: 0 in 0.287s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:12:18 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-78d5e983-5806-4c96-bf72-7f2207b7fa10 tempest-CreateVolumesFromSourceVolumeTest-159810001 None] Lock "cinder-quobyte-0bd914e7-035e-4d45-a484-bd1e4cd84906" released by "delete_volume" :: held 0.761s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:12:18 devstack cinder-volume[87515]: DEBUG cinder.quota [None req-78d5e983-5806-4c96-bf72-7f2207b7fa10 tempest-CreateVolumesFromSourceVolumeTest-159810001 None] Created reservations ['df4c1b8f-c5ad-40f3-a669-db63f9e122e2', 'ae0dc7a5-8313-4b1c-a2f9-8d347e214a34', '9cd4408d-211e-43f2-9d86-137b9f468b33', '196403f6-997e-44a2-9613-c386175a89e1'] {{(pid=87515) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:12:18 devstack cinder-volume[87515]: DEBUG cinder.image.image_utils [None req-51b2a685-197c-4439-badb-ce40134b225c tempest-VolumesGetTest-329404913 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_26019e10-1e1f-4514-b191-397ccf1d59e6_63v45c4ddevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87515) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 07 10:12:18 devstack cinder-volume[87515]: INFO cinder.image.image_utils [None req-51b2a685-197c-4439-badb-ce40134b225c tempest-VolumesGetTest-329404913 None] Image download 20.69 MB at 20.69 MB/s Sep 07 10:12:18 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-78d5e983-5806-4c96-bf72-7f2207b7fa10 tempest-CreateVolumesFromSourceVolumeTest-159810001 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:12:18 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-78d5e983-5806-4c96-bf72-7f2207b7fa10 tempest-CreateVolumesFromSourceVolumeTest-159810001 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:12:18 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-78d5e983-5806-4c96-bf72-7f2207b7fa10 tempest-CreateVolumesFromSourceVolumeTest-159810001 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:12:18 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-78d5e983-5806-4c96-bf72-7f2207b7fa10 tempest-CreateVolumesFromSourceVolumeTest-159810001 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:12:18 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-78d5e983-5806-4c96-bf72-7f2207b7fa10 tempest-CreateVolumesFromSourceVolumeTest-159810001 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:12:18 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-78d5e983-5806-4c96-bf72-7f2207b7fa10 tempest-CreateVolumesFromSourceVolumeTest-159810001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:12:18 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-f5094dee-6920-4031-a418-60697b66cc8b tempest-CreateVolumesFromSourceVolumeTest-159810001 None] Acquiring lock "cinder-108a6609-d936-45bb-8573-634f69a9aee8-delete_volume" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:12:18 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8ce566c-e248-4eb5-9a7b-0d584f6f3163]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:12:18 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-51b2a685-197c-4439-badb-ce40134b225c tempest-VolumesGetTest-329404913 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_26019e10-1e1f-4514-b191-397ccf1d59e6_63v45c4ddevstack@QuobyteHD {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:12:18 devstack sudo[102638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a Sep 07 10:12:18 devstack sudo[102638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:12:18 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-f5094dee-6920-4031-a418-60697b66cc8b tempest-CreateVolumesFromSourceVolumeTest-159810001 None] Lock "cinder-108a6609-d936-45bb-8573-634f69a9aee8-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:12:18 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-f5094dee-6920-4031-a418-60697b66cc8b tempest-CreateVolumesFromSourceVolumeTest-159810001 None] Acquiring lock "cinder-quobyte-108a6609-d936-45bb-8573-634f69a9aee8" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:12:18 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-f5094dee-6920-4031-a418-60697b66cc8b tempest-CreateVolumesFromSourceVolumeTest-159810001 None] Lock "cinder-quobyte-108a6609-d936-45bb-8573-634f69a9aee8" acquired by "delete_volume" :: waited 0.023s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:12:18 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[28599baf-9588-43e8-9141-99e7ccfe2deb]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:12:18 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-f5094dee-6920-4031-a418-60697b66cc8b tempest-CreateVolumesFromSourceVolumeTest-159810001 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-108a6609-d936-45bb-8573-634f69a9aee8 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:12:18 devstack sudo[102639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_26019e10-1e1f-4514-b191-397ccf1d59e6_63v45c4ddevstack@QuobyteHD Sep 07 10:12:18 devstack sudo[102639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:12:19 devstack sudo[102638]: pam_unix(sudo:session): session closed for user root Sep 07 10:12:19 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-78d5e983-5806-4c96-bf72-7f2207b7fa10 tempest-CreateVolumesFromSourceVolumeTest-159810001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a" returned: 0 in 0.320s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:12:19 devstack cinder-volume[87515]: DEBUG cinder.manager [None req-78d5e983-5806-4c96-bf72-7f2207b7fa10 tempest-CreateVolumesFromSourceVolumeTest-159810001 None] Notifying Schedulers of capabilities ... {{(pid=87515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:12:19 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-78d5e983-5806-4c96-bf72-7f2207b7fa10 tempest-CreateVolumesFromSourceVolumeTest-159810001 None] Deleted volume successfully. Sep 07 10:12:19 devstack sudo[102641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-108a6609-d936-45bb-8573-634f69a9aee8 Sep 07 10:12:19 devstack sudo[102641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:12:19 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-78d5e983-5806-4c96-bf72-7f2207b7fa10 tempest-CreateVolumesFromSourceVolumeTest-159810001 None] Lock "cinder-0bd914e7-035e-4d45-a484-bd1e4cd84906-delete_volume" released by "delete_volume" :: held 1.521s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:12:19 devstack sudo[102639]: pam_unix(sudo:session): session closed for user root Sep 07 10:12:19 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-51b2a685-197c-4439-badb-ce40134b225c tempest-VolumesGetTest-329404913 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_26019e10-1e1f-4514-b191-397ccf1d59e6_63v45c4ddevstack@QuobyteHD" returned: 0 in 0.442s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:12:19 devstack cinder-volume[87515]: DEBUG cinder.image.image_utils [None req-51b2a685-197c-4439-badb-ce40134b225c tempest-VolumesGetTest-329404913 None] Temporary image 26019e10-1e1f-4514-b191-397ccf1d59e6 is fetched for user 680e26fefab8422488ad232f8032cf75. {{(pid=87515) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 07 10:12:19 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[b61b3ef8-eb04-45b6-a722-7632014e1789]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:12:19 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-51b2a685-197c-4439-badb-ce40134b225c tempest-VolumesGetTest-329404913 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_26019e10-1e1f-4514-b191-397ccf1d59e6_63v45c4ddevstack@QuobyteHD {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:12:19 devstack sudo[102641]: pam_unix(sudo:session): session closed for user root Sep 07 10:12:19 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-f5094dee-6920-4031-a418-60697b66cc8b tempest-CreateVolumesFromSourceVolumeTest-159810001 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-108a6609-d936-45bb-8573-634f69a9aee8" returned: 0 in 0.432s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:12:19 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-f5094dee-6920-4031-a418-60697b66cc8b tempest-CreateVolumesFromSourceVolumeTest-159810001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-108a6609-d936-45bb-8573-634f69a9aee8 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:12:19 devstack sudo[102653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-108a6609-d936-45bb-8573-634f69a9aee8 Sep 07 10:12:19 devstack sudo[102653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:12:19 devstack sudo[102652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_26019e10-1e1f-4514-b191-397ccf1d59e6_63v45c4ddevstack@QuobyteHD Sep 07 10:12:19 devstack sudo[102652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:12:19 devstack sudo[102652]: pam_unix(sudo:session): session closed for user root Sep 07 10:12:19 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-51b2a685-197c-4439-badb-ce40134b225c tempest-VolumesGetTest-329404913 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_26019e10-1e1f-4514-b191-397ccf1d59e6_63v45c4ddevstack@QuobyteHD" returned: 0 in 0.378s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:12:19 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-51b2a685-197c-4439-badb-ce40134b225c tempest-VolumesGetTest-329404913 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:12:19 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-51b2a685-197c-4439-badb-ce40134b225c tempest-VolumesGetTest-329404913 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:12:19 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-51b2a685-197c-4439-badb-ce40134b225c tempest-VolumesGetTest-329404913 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:12:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-2016171686',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e78e34cd-f362-46c3-8f8d-e31767df0b0f,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='ecf34953525e4b9b81581ac36d4e0df0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:12:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:12:18Z,use_quota=True,user_id='680e26fefab8422488ad232f8032cf75',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3a092cd-7947-4cbf-abff-4ba9567becf0),volume_type_id=f3a092cd-7947-4cbf-abff-4ba9567becf0)}" {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 10:12:19 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-51b2a685-197c-4439-badb-ce40134b225c tempest-VolumesGetTest-329404913 None] Creating volume e78e34cd-f362-46c3-8f8d-e31767df0b0f {{(pid=87515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 10:12:19 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-51b2a685-197c-4439-badb-ce40134b225c tempest-VolumesGetTest-329404913 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:12:19 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-51b2a685-197c-4439-badb-ce40134b225c tempest-VolumesGetTest-329404913 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:12:19 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-51b2a685-197c-4439-badb-ce40134b225c tempest-VolumesGetTest-329404913 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:12:19 devstack sudo[102653]: pam_unix(sudo:session): session closed for user root Sep 07 10:12:19 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-51b2a685-197c-4439-badb-ce40134b225c tempest-VolumesGetTest-329404913 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:12:19 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-51b2a685-197c-4439-badb-ce40134b225c tempest-VolumesGetTest-329404913 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:12:19 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-51b2a685-197c-4439-badb-ce40134b225c tempest-VolumesGetTest-329404913 None] Selected osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c as target Quobyte volume. {{(pid=87515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 10:12:19 devstack cinder-volume[87515]: INFO cinder.volume.drivers.remotefs [None req-51b2a685-197c-4439-badb-ce40134b225c tempest-VolumesGetTest-329404913 None] casted to osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c Sep 07 10:12:19 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-51b2a685-197c-4439-badb-ce40134b225c tempest-VolumesGetTest-329404913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-e78e34cd-f362-46c3-8f8d-e31767df0b0f 1073741824 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:12:19 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-f5094dee-6920-4031-a418-60697b66cc8b tempest-CreateVolumesFromSourceVolumeTest-159810001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-108a6609-d936-45bb-8573-634f69a9aee8" returned: 0 in 0.335s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:12:19 devstack sudo[102660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-e78e34cd-f362-46c3-8f8d-e31767df0b0f 1073741824 Sep 07 10:12:19 devstack sudo[102660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:12:19 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-f5094dee-6920-4031-a418-60697b66cc8b tempest-CreateVolumesFromSourceVolumeTest-159810001 None] Lock "cinder-quobyte-108a6609-d936-45bb-8573-634f69a9aee8" released by "delete_volume" :: held 0.843s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:12:19 devstack cinder-volume[87515]: DEBUG cinder.quota [None req-f5094dee-6920-4031-a418-60697b66cc8b tempest-CreateVolumesFromSourceVolumeTest-159810001 None] Created reservations ['009bc41c-c607-47a5-bf08-0816e628811b', 'f07ee0e6-d332-437d-9e9a-f5fe3eaa5b18', '54bdb32e-02b8-4fbb-9506-29b2e2cc03f9', '65ff21e1-775c-4dd7-915c-264e04e0d1c5'] {{(pid=87515) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:12:19 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-f5094dee-6920-4031-a418-60697b66cc8b tempest-CreateVolumesFromSourceVolumeTest-159810001 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:12:19 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-f5094dee-6920-4031-a418-60697b66cc8b tempest-CreateVolumesFromSourceVolumeTest-159810001 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:12:19 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-f5094dee-6920-4031-a418-60697b66cc8b tempest-CreateVolumesFromSourceVolumeTest-159810001 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:12:19 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-f5094dee-6920-4031-a418-60697b66cc8b tempest-CreateVolumesFromSourceVolumeTest-159810001 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:12:19 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-f5094dee-6920-4031-a418-60697b66cc8b tempest-CreateVolumesFromSourceVolumeTest-159810001 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:12:19 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-f5094dee-6920-4031-a418-60697b66cc8b tempest-CreateVolumesFromSourceVolumeTest-159810001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:12:19 devstack sudo[102662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a Sep 07 10:12:19 devstack sudo[102662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:12:20 devstack sudo[102662]: pam_unix(sudo:session): session closed for user root Sep 07 10:12:20 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-f5094dee-6920-4031-a418-60697b66cc8b tempest-CreateVolumesFromSourceVolumeTest-159810001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a" returned: 0 in 0.292s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:12:20 devstack cinder-volume[87515]: DEBUG cinder.manager [None req-f5094dee-6920-4031-a418-60697b66cc8b tempest-CreateVolumesFromSourceVolumeTest-159810001 None] Notifying Schedulers of capabilities ... {{(pid=87515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:12:20 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-f5094dee-6920-4031-a418-60697b66cc8b tempest-CreateVolumesFromSourceVolumeTest-159810001 None] Deleted volume successfully. Sep 07 10:12:20 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-f5094dee-6920-4031-a418-60697b66cc8b tempest-CreateVolumesFromSourceVolumeTest-159810001 None] Lock "cinder-108a6609-d936-45bb-8573-634f69a9aee8-delete_volume" released by "delete_volume" :: held 1.394s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:12:20 devstack sudo[102660]: pam_unix(sudo:session): session closed for user root Sep 07 10:12:20 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-51b2a685-197c-4439-badb-ce40134b225c tempest-VolumesGetTest-329404913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-e78e34cd-f362-46c3-8f8d-e31767df0b0f 1073741824" returned: 0 in 0.564s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:12:20 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-51b2a685-197c-4439-badb-ce40134b225c tempest-VolumesGetTest-329404913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-e78e34cd-f362-46c3-8f8d-e31767df0b0f {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:12:20 devstack sudo[102669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-e78e34cd-f362-46c3-8f8d-e31767df0b0f Sep 07 10:12:20 devstack sudo[102669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:12:20 devstack sudo[102669]: pam_unix(sudo:session): session closed for user root Sep 07 10:12:20 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-51b2a685-197c-4439-badb-ce40134b225c tempest-VolumesGetTest-329404913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-e78e34cd-f362-46c3-8f8d-e31767df0b0f" returned: 0 in 0.270s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:12:20 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-51b2a685-197c-4439-badb-ce40134b225c tempest-VolumesGetTest-329404913 None] <== create_volume: return (884ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'} {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 10:12:20 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-51b2a685-197c-4439-badb-ce40134b225c tempest-VolumesGetTest-329404913 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.888s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:12:20 devstack cinder-volume[87515]: DEBUG cinder.volume.volume_utils [None req-51b2a685-197c-4439-badb-ce40134b225c tempest-VolumesGetTest-329404913 None] Attempting download of 26019e10-1e1f-4514-b191-397ccf1d59e6 ((None, [{'url': 'file:///opt/stack/data/glance/images/26019e10-1e1f-4514-b191-397ccf1d59e6', 'metadata': {}}])) to volume e78e34cd-f362-46c3-8f8d-e31767df0b0f. {{(pid=87515) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 07 10:12:20 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2714bb2-7d5d-4a23-a951-fc933eed8584]: (4, 'raw') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:12:20 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-51b2a685-197c-4439-badb-ce40134b225c tempest-VolumesGetTest-329404913 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_26019e10-1e1f-4514-b191-397ccf1d59e6_z4m5p_ez {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:12:20 devstack sudo[102672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_26019e10-1e1f-4514-b191-397ccf1d59e6_z4m5p_ez Sep 07 10:12:20 devstack sudo[102672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:12:21 devstack sudo[102672]: pam_unix(sudo:session): session closed for user root Sep 07 10:12:21 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-51b2a685-197c-4439-badb-ce40134b225c tempest-VolumesGetTest-329404913 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_26019e10-1e1f-4514-b191-397ccf1d59e6_z4m5p_ez" returned: 0 in 0.424s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:12:21 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-51b2a685-197c-4439-badb-ce40134b225c tempest-VolumesGetTest-329404913 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_26019e10-1e1f-4514-b191-397ccf1d59e6_z4m5p_ez {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:12:21 devstack sudo[102676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_26019e10-1e1f-4514-b191-397ccf1d59e6_z4m5p_ez Sep 07 10:12:21 devstack sudo[102676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:12:21 devstack sudo[102676]: pam_unix(sudo:session): session closed for user root Sep 07 10:12:21 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-51b2a685-197c-4439-badb-ce40134b225c tempest-VolumesGetTest-329404913 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_26019e10-1e1f-4514-b191-397ccf1d59e6_z4m5p_ez" returned: 1 in 0.368s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:12:21 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-51b2a685-197c-4439-badb-ce40134b225c tempest-VolumesGetTest-329404913 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_26019e10-1e1f-4514-b191-397ccf1d59e6_z4m5p_ez' failed. Not Retrying. {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 07 10:12:21 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e20f4c7-d43d-459b-b3f0-eae83e62df28]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:12:21 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-51b2a685-197c-4439-badb-ce40134b225c tempest-VolumesGetTest-329404913 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_26019e10-1e1f-4514-b191-397ccf1d59e6_63v45c4ddevstack@QuobyteHD {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:12:21 devstack sudo[102680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_26019e10-1e1f-4514-b191-397ccf1d59e6_63v45c4ddevstack@QuobyteHD Sep 07 10:12:21 devstack sudo[102680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:12:21 devstack sudo[102680]: pam_unix(sudo:session): session closed for user root Sep 07 10:12:21 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-51b2a685-197c-4439-badb-ce40134b225c tempest-VolumesGetTest-329404913 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_26019e10-1e1f-4514-b191-397ccf1d59e6_63v45c4ddevstack@QuobyteHD" returned: 0 in 0.370s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:12:21 devstack cinder-volume[87515]: DEBUG cinder.image.image_utils [None req-51b2a685-197c-4439-badb-ce40134b225c tempest-VolumesGetTest-329404913 None] 26019e10-1e1f-4514-b191-397ccf1d59e6 was qcow2, converting to qcow2 {{(pid=87515) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 07 10:12:21 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-51b2a685-197c-4439-badb-ce40134b225c tempest-VolumesGetTest-329404913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_26019e10-1e1f-4514-b191-397ccf1d59e6_63v45c4ddevstack@QuobyteHD /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-e78e34cd-f362-46c3-8f8d-e31767df0b0f {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:12:21 devstack sudo[102685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_26019e10-1e1f-4514-b191-397ccf1d59e6_63v45c4ddevstack@QuobyteHD /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-e78e34cd-f362-46c3-8f8d-e31767df0b0f Sep 07 10:12:21 devstack sudo[102685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:12:23 devstack cinder-volume[87515]: DEBUG cinder.volume.flows.manager.create_volume [None req-296f50a4-61f3-44bd-838e-c4f1a692af3c tempest-VolumeDependencyTests-738066002 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 10:12:23 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-296f50a4-61f3-44bd-838e-c4f1a692af3c tempest-VolumeDependencyTests-738066002 None] Flow 'volume_create_manager' (f1277866-c2a4-4903-8684-b00df0c7d6f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:12:23 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-296f50a4-61f3-44bd-838e-c4f1a692af3c tempest-VolumeDependencyTests-738066002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebed3b6b-3607-4e5a-96ae-05c6385bf254) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:12:23 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-296f50a4-61f3-44bd-838e-c4f1a692af3c tempest-VolumeDependencyTests-738066002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebed3b6b-3607-4e5a-96ae-05c6385bf254) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:12:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-554533476',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35815792-df58-4e4a-bf0f-8d808b7556c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='594e10562cfd489482009279a733acb5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:12:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:12:24Z,use_quota=True,user_id='dbadaa379baa408195ebeb8a62330f00',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3a092cd-7947-4cbf-abff-4ba9567becf0),volume_type_id=f3a092cd-7947-4cbf-abff-4ba9567becf0)' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:12:23 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-296f50a4-61f3-44bd-838e-c4f1a692af3c tempest-VolumeDependencyTests-738066002 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9ea47da-3be3-4d00-ab2c-542fb7984239) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:12:23 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-296f50a4-61f3-44bd-838e-c4f1a692af3c tempest-VolumeDependencyTests-738066002 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9ea47da-3be3-4d00-ab2c-542fb7984239) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:12:23 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-296f50a4-61f3-44bd-838e-c4f1a692af3c tempest-VolumeDependencyTests-738066002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e2c4730-c834-4663-9d64-d7c4019b7502) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:12:23 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-296f50a4-61f3-44bd-838e-c4f1a692af3c tempest-VolumeDependencyTests-738066002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e2c4730-c834-4663-9d64-d7c4019b7502) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '35815792-df58-4e4a-bf0f-8d808b7556c0', 'volume_name': 'volume-35815792-df58-4e4a-bf0f-8d808b7556c0', 'volume_size': 1}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:12:23 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-296f50a4-61f3-44bd-838e-c4f1a692af3c tempest-VolumeDependencyTests-738066002 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b526667-16cb-4cc4-bbdd-944f87096900) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:12:23 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-296f50a4-61f3-44bd-838e-c4f1a692af3c tempest-VolumeDependencyTests-738066002 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b526667-16cb-4cc4-bbdd-944f87096900) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:12:23 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-296f50a4-61f3-44bd-838e-c4f1a692af3c tempest-VolumeDependencyTests-738066002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86c41844-1424-463e-970f-b6a502924a82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:12:23 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-296f50a4-61f3-44bd-838e-c4f1a692af3c tempest-VolumeDependencyTests-738066002 None] Volume 35815792-df58-4e4a-bf0f-8d808b7556c0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-35815792-df58-4e4a-bf0f-8d808b7556c0', 'volume_size': 1} Sep 07 10:12:23 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-296f50a4-61f3-44bd-838e-c4f1a692af3c tempest-VolumeDependencyTests-738066002 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:12:23 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-296f50a4-61f3-44bd-838e-c4f1a692af3c tempest-VolumeDependencyTests-738066002 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:12:23 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-296f50a4-61f3-44bd-838e-c4f1a692af3c tempest-VolumeDependencyTests-738066002 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:12:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-554533476',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35815792-df58-4e4a-bf0f-8d808b7556c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='594e10562cfd489482009279a733acb5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:12:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:12:24Z,use_quota=True,user_id='dbadaa379baa408195ebeb8a62330f00',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3a092cd-7947-4cbf-abff-4ba9567becf0),volume_type_id=f3a092cd-7947-4cbf-abff-4ba9567becf0)}" {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 10:12:23 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-296f50a4-61f3-44bd-838e-c4f1a692af3c tempest-VolumeDependencyTests-738066002 None] Creating volume 35815792-df58-4e4a-bf0f-8d808b7556c0 {{(pid=87515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 10:12:23 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-296f50a4-61f3-44bd-838e-c4f1a692af3c tempest-VolumeDependencyTests-738066002 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:12:23 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-296f50a4-61f3-44bd-838e-c4f1a692af3c tempest-VolumeDependencyTests-738066002 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:12:23 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-296f50a4-61f3-44bd-838e-c4f1a692af3c tempest-VolumeDependencyTests-738066002 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:12:23 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-296f50a4-61f3-44bd-838e-c4f1a692af3c tempest-VolumeDependencyTests-738066002 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:12:23 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-296f50a4-61f3-44bd-838e-c4f1a692af3c tempest-VolumeDependencyTests-738066002 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:12:23 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-296f50a4-61f3-44bd-838e-c4f1a692af3c tempest-VolumeDependencyTests-738066002 None] Selected osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c as target Quobyte volume. {{(pid=87515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 10:12:23 devstack cinder-volume[87515]: INFO cinder.volume.drivers.remotefs [None req-296f50a4-61f3-44bd-838e-c4f1a692af3c tempest-VolumeDependencyTests-738066002 None] casted to osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c Sep 07 10:12:23 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-296f50a4-61f3-44bd-838e-c4f1a692af3c tempest-VolumeDependencyTests-738066002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-35815792-df58-4e4a-bf0f-8d808b7556c0 1073741824 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:12:23 devstack sudo[102693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-35815792-df58-4e4a-bf0f-8d808b7556c0 1073741824 Sep 07 10:12:23 devstack sudo[102693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:12:23 devstack sudo[102685]: pam_unix(sudo:session): session closed for user root Sep 07 10:12:23 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-51b2a685-197c-4439-badb-ce40134b225c tempest-VolumesGetTest-329404913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_26019e10-1e1f-4514-b191-397ccf1d59e6_63v45c4ddevstack@QuobyteHD /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-e78e34cd-f362-46c3-8f8d-e31767df0b0f" returned: 0 in 2.127s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:12:23 devstack cinder-volume[87515]: DEBUG cinder.image.image_utils [None req-51b2a685-197c-4439-badb-ce40134b225c tempest-VolumesGetTest-329404913 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_26019e10-1e1f-4514-b191-397ccf1d59e6_63v45c4ddevstack@QuobyteHD, size 112.00 MB, duration 2.13 sec, destination /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-e78e34cd-f362-46c3-8f8d-e31767df0b0f {{(pid=87515) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 07 10:12:23 devstack cinder-volume[87515]: INFO cinder.image.image_utils [None req-51b2a685-197c-4439-badb-ce40134b225c tempest-VolumesGetTest-329404913 None] Converted 112.00 MB image at 52.62 MB/s Sep 07 10:12:23 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-51b2a685-197c-4439-badb-ce40134b225c tempest-VolumesGetTest-329404913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-e78e34cd-f362-46c3-8f8d-e31767df0b0f 1G {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:12:24 devstack sudo[102732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-e78e34cd-f362-46c3-8f8d-e31767df0b0f 1G Sep 07 10:12:24 devstack sudo[102732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:12:24 devstack sudo[102693]: pam_unix(sudo:session): session closed for user root Sep 07 10:12:24 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-296f50a4-61f3-44bd-838e-c4f1a692af3c tempest-VolumeDependencyTests-738066002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-35815792-df58-4e4a-bf0f-8d808b7556c0 1073741824" returned: 0 in 0.561s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:12:24 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-296f50a4-61f3-44bd-838e-c4f1a692af3c tempest-VolumeDependencyTests-738066002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-35815792-df58-4e4a-bf0f-8d808b7556c0 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:12:24 devstack sudo[102736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-35815792-df58-4e4a-bf0f-8d808b7556c0 Sep 07 10:12:24 devstack sudo[102736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:12:24 devstack sudo[102732]: pam_unix(sudo:session): session closed for user root Sep 07 10:12:24 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-51b2a685-197c-4439-badb-ce40134b225c tempest-VolumesGetTest-329404913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-e78e34cd-f362-46c3-8f8d-e31767df0b0f 1G" returned: 0 in 0.538s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:12:24 devstack cinder-volume[87515]: DEBUG cinder.volume.volume_utils [None req-51b2a685-197c-4439-badb-ce40134b225c tempest-VolumesGetTest-329404913 None] Downloaded image 26019e10-1e1f-4514-b191-397ccf1d59e6 ((None, [{'url': 'file:///opt/stack/data/glance/images/26019e10-1e1f-4514-b191-397ccf1d59e6', 'metadata': {}}])) to volume e78e34cd-f362-46c3-8f8d-e31767df0b0f successfully. {{(pid=87515) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 07 10:12:24 devstack cinder-volume[87515]: DEBUG cinder.image.image_utils [None req-51b2a685-197c-4439-badb-ce40134b225c tempest-VolumesGetTest-329404913 None] Temporary image 26019e10-1e1f-4514-b191-397ccf1d59e6 for user 680e26fefab8422488ad232f8032cf75 is deleted. {{(pid=87515) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 07 10:12:24 devstack cinder-volume[87515]: DEBUG cinder.volume.volume_utils [None req-51b2a685-197c-4439-badb-ce40134b225c tempest-VolumesGetTest-329404913 None] Marking volume e78e34cd-f362-46c3-8f8d-e31767df0b0f as bootable. {{(pid=87515) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 07 10:12:24 devstack cinder-volume[87515]: DEBUG cinder.volume.flows.manager.create_volume [None req-51b2a685-197c-4439-badb-ce40134b225c tempest-VolumesGetTest-329404913 None] Copying metadata from image 26019e10-1e1f-4514-b191-397ccf1d59e6 to e78e34cd-f362-46c3-8f8d-e31767df0b0f. {{(pid=87515) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 07 10:12:24 devstack cinder-volume[87515]: DEBUG cinder.volume.flows.manager.create_volume [None req-51b2a685-197c-4439-badb-ce40134b225c tempest-VolumesGetTest-329404913 None] Creating volume glance metadata for volume e78e34cd-f362-46c3-8f8d-e31767df0b0f backed by image 26019e10-1e1f-4514-b191-397ccf1d59e6 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '26019e10-1e1f-4514-b191-397ccf1d59e6', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87515) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 07 10:12:24 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-51b2a685-197c-4439-badb-ce40134b225c tempest-VolumesGetTest-329404913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8bd84116-290f-4780-b6d6-fa837b11bba1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e78e34cd-f362-46c3-8f8d-e31767df0b0f', 'volume_size': 1, 'image_id': '26019e10-1e1f-4514-b191-397ccf1d59e6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/26019e10-1e1f-4514-b191-397ccf1d59e6', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4765956d565c46c2a4a703c5a550ca58', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '26019e10-1e1f-4514-b191-397ccf1d59e6', 'created_at': datetime.datetime(2026, 9, 7, 7, 52, 21, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 7, 7, 52, 22, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/26019e10-1e1f-4514-b191-397ccf1d59e6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:12:24 devstack sudo[102736]: pam_unix(sudo:session): session closed for user root Sep 07 10:12:24 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-51b2a685-197c-4439-badb-ce40134b225c tempest-VolumesGetTest-329404913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c651e6c-8913-418c-b5dc-9da499ddc997) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:12:24 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-296f50a4-61f3-44bd-838e-c4f1a692af3c tempest-VolumeDependencyTests-738066002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-35815792-df58-4e4a-bf0f-8d808b7556c0" returned: 0 in 0.389s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:12:24 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-296f50a4-61f3-44bd-838e-c4f1a692af3c tempest-VolumeDependencyTests-738066002 None] <== create_volume: return (1055ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'} {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 10:12:24 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-296f50a4-61f3-44bd-838e-c4f1a692af3c tempest-VolumeDependencyTests-738066002 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.058s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:12:24 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-51b2a685-197c-4439-badb-ce40134b225c tempest-VolumesGetTest-329404913 None] Volume volume-e78e34cd-f362-46c3-8f8d-e31767df0b0f (e78e34cd-f362-46c3-8f8d-e31767df0b0f): created successfully Sep 07 10:12:24 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-51b2a685-197c-4439-badb-ce40134b225c tempest-VolumesGetTest-329404913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c651e6c-8913-418c-b5dc-9da499ddc997) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:12:24 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-51b2a685-197c-4439-badb-ce40134b225c tempest-VolumesGetTest-329404913 None] Flow 'volume_create_manager' (1c2536d6-c30c-4a96-9f5d-8323370347f9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:12:24 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-296f50a4-61f3-44bd-838e-c4f1a692af3c tempest-VolumeDependencyTests-738066002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86c41844-1424-463e-970f-b6a502924a82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-35815792-df58-4e4a-bf0f-8d808b7556c0', 'volume_size': 1}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:12:24 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-296f50a4-61f3-44bd-838e-c4f1a692af3c tempest-VolumeDependencyTests-738066002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ccf4748-ac67-41b3-829d-92a3f16fb87f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:12:24 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-51b2a685-197c-4439-badb-ce40134b225c tempest-VolumesGetTest-329404913 None] Created volume successfully. Sep 07 10:12:24 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-296f50a4-61f3-44bd-838e-c4f1a692af3c tempest-VolumeDependencyTests-738066002 None] Volume volume-35815792-df58-4e4a-bf0f-8d808b7556c0 (35815792-df58-4e4a-bf0f-8d808b7556c0): created successfully Sep 07 10:12:24 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-296f50a4-61f3-44bd-838e-c4f1a692af3c tempest-VolumeDependencyTests-738066002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ccf4748-ac67-41b3-829d-92a3f16fb87f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:12:24 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-296f50a4-61f3-44bd-838e-c4f1a692af3c tempest-VolumeDependencyTests-738066002 None] Flow 'volume_create_manager' (f1277866-c2a4-4903-8684-b00df0c7d6f9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:12:24 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-296f50a4-61f3-44bd-838e-c4f1a692af3c tempest-VolumeDependencyTests-738066002 None] Created volume successfully. Sep 07 10:12:26 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-944cc601-517d-4330-8f35-dddce76279f5 tempest-VolumeDependencyTests-738066002 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:12:26 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-944cc601-517d-4330-8f35-dddce76279f5 tempest-VolumeDependencyTests-738066002 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:12:26 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-944cc601-517d-4330-8f35-dddce76279f5 tempest-VolumeDependencyTests-738066002 None] Creating offline snapshot d46f5d22-4ee6-4c17-9617-dd0dad465435 of volume 35815792-df58-4e4a-bf0f-8d808b7556c0 {{(pid=87515) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 10:12:26 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[56f1edd9-a61d-4006-a066-63d921902964]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:12:26 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-944cc601-517d-4330-8f35-dddce76279f5 tempest-VolumeDependencyTests-738066002 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-35815792-df58-4e4a-bf0f-8d808b7556c0 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:12:26 devstack sudo[102742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-35815792-df58-4e4a-bf0f-8d808b7556c0 Sep 07 10:12:26 devstack sudo[102742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:12:26 devstack cinder-volume[87515]: DEBUG cinder.volume.flows.manager.create_volume [None req-f3f769cc-3c3c-4a2d-be46-e9b0151c8c88 tempest-VolumesGetTest-329404913 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 10:12:26 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-f3f769cc-3c3c-4a2d-be46-e9b0151c8c88 tempest-VolumesGetTest-329404913 None] Flow 'volume_create_manager' (2da15466-f368-421c-addb-463b9966b77e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:12:26 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-f3f769cc-3c3c-4a2d-be46-e9b0151c8c88 tempest-VolumesGetTest-329404913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1157806e-a640-4181-a556-b444f598634a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:12:26 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-f3f769cc-3c3c-4a2d-be46-e9b0151c8c88 tempest-VolumesGetTest-329404913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1157806e-a640-4181-a556-b444f598634a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:12:26Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-419605429',display_name='tempest-VolumesGetTest-Volume-1467270562',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be536735-7ad6-4fd8-8c48-d8f20fef2a5f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ecf34953525e4b9b81581ac36d4e0df0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:12:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:12:26Z,use_quota=True,user_id='680e26fefab8422488ad232f8032cf75',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3a092cd-7947-4cbf-abff-4ba9567becf0),volume_type_id=f3a092cd-7947-4cbf-abff-4ba9567becf0)' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:12:26 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-f3f769cc-3c3c-4a2d-be46-e9b0151c8c88 tempest-VolumesGetTest-329404913 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe594b5f-c89e-4315-98b6-2a8864a14d15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:12:26 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-f3f769cc-3c3c-4a2d-be46-e9b0151c8c88 tempest-VolumesGetTest-329404913 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe594b5f-c89e-4315-98b6-2a8864a14d15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:12:26 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-f3f769cc-3c3c-4a2d-be46-e9b0151c8c88 tempest-VolumesGetTest-329404913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b232d4d-dd1c-400a-8f1c-a5a9fe81e2fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:12:26 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-f3f769cc-3c3c-4a2d-be46-e9b0151c8c88 tempest-VolumesGetTest-329404913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b232d4d-dd1c-400a-8f1c-a5a9fe81e2fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'be536735-7ad6-4fd8-8c48-d8f20fef2a5f', 'volume_name': 'volume-be536735-7ad6-4fd8-8c48-d8f20fef2a5f', 'volume_size': 1}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:12:26 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-f3f769cc-3c3c-4a2d-be46-e9b0151c8c88 tempest-VolumesGetTest-329404913 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e411496-1a5c-4d55-92ee-9530f47e3f0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:12:26 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-f3f769cc-3c3c-4a2d-be46-e9b0151c8c88 tempest-VolumesGetTest-329404913 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e411496-1a5c-4d55-92ee-9530f47e3f0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:12:26 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-f3f769cc-3c3c-4a2d-be46-e9b0151c8c88 tempest-VolumesGetTest-329404913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a07d96f-3a15-49b9-bb53-1c5459e33dc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:12:26 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-f3f769cc-3c3c-4a2d-be46-e9b0151c8c88 tempest-VolumesGetTest-329404913 None] Volume be536735-7ad6-4fd8-8c48-d8f20fef2a5f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-be536735-7ad6-4fd8-8c48-d8f20fef2a5f', 'volume_size': 1} Sep 07 10:12:26 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-f3f769cc-3c3c-4a2d-be46-e9b0151c8c88 tempest-VolumesGetTest-329404913 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:12:26 devstack sudo[102742]: pam_unix(sudo:session): session closed for user root Sep 07 10:12:26 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-944cc601-517d-4330-8f35-dddce76279f5 tempest-VolumeDependencyTests-738066002 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-35815792-df58-4e4a-bf0f-8d808b7556c0" returned: 0 in 0.551s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:12:26 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-944cc601-517d-4330-8f35-dddce76279f5 tempest-VolumeDependencyTests-738066002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-35815792-df58-4e4a-bf0f-8d808b7556c0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-35815792-df58-4e4a-bf0f-8d808b7556c0.d46f5d22-4ee6-4c17-9617-dd0dad465435 1G {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:12:26 devstack sudo[102747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-35815792-df58-4e4a-bf0f-8d808b7556c0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-35815792-df58-4e4a-bf0f-8d808b7556c0.d46f5d22-4ee6-4c17-9617-dd0dad465435 1G Sep 07 10:12:26 devstack sudo[102747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:12:27 devstack sudo[102747]: pam_unix(sudo:session): session closed for user root Sep 07 10:12:27 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-944cc601-517d-4330-8f35-dddce76279f5 tempest-VolumeDependencyTests-738066002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-35815792-df58-4e4a-bf0f-8d808b7556c0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-35815792-df58-4e4a-bf0f-8d808b7556c0.d46f5d22-4ee6-4c17-9617-dd0dad465435 1G" returned: 0 in 0.503s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:12:27 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-944cc601-517d-4330-8f35-dddce76279f5 tempest-VolumeDependencyTests-738066002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-35815792-df58-4e4a-bf0f-8d808b7556c0 -F qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-35815792-df58-4e4a-bf0f-8d808b7556c0.d46f5d22-4ee6-4c17-9617-dd0dad465435 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:12:27 devstack sudo[102754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-35815792-df58-4e4a-bf0f-8d808b7556c0 -F qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-35815792-df58-4e4a-bf0f-8d808b7556c0.d46f5d22-4ee6-4c17-9617-dd0dad465435 Sep 07 10:12:27 devstack sudo[102754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:12:27 devstack sudo[102754]: pam_unix(sudo:session): session closed for user root Sep 07 10:12:27 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-944cc601-517d-4330-8f35-dddce76279f5 tempest-VolumeDependencyTests-738066002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-35815792-df58-4e4a-bf0f-8d808b7556c0 -F qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-35815792-df58-4e4a-bf0f-8d808b7556c0.d46f5d22-4ee6-4c17-9617-dd0dad465435" returned: 0 in 0.388s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:12:27 devstack cinder-volume[87515]: WARNING cinder.volume.drivers.remotefs [None req-944cc601-517d-4330-8f35-dddce76279f5 tempest-VolumeDependencyTests-738066002 None] /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-35815792-df58-4e4a-bf0f-8d808b7556c0.d46f5d22-4ee6-4c17-9617-dd0dad465435 is being set with open permissions: ugo+rw Sep 07 10:12:27 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-944cc601-517d-4330-8f35-dddce76279f5 tempest-VolumeDependencyTests-738066002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-35815792-df58-4e4a-bf0f-8d808b7556c0.d46f5d22-4ee6-4c17-9617-dd0dad465435 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:12:27 devstack sudo[102759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-35815792-df58-4e4a-bf0f-8d808b7556c0.d46f5d22-4ee6-4c17-9617-dd0dad465435 Sep 07 10:12:27 devstack sudo[102759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:12:27 devstack sudo[102759]: pam_unix(sudo:session): session closed for user root Sep 07 10:12:27 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-944cc601-517d-4330-8f35-dddce76279f5 tempest-VolumeDependencyTests-738066002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-35815792-df58-4e4a-bf0f-8d808b7556c0.d46f5d22-4ee6-4c17-9617-dd0dad465435" returned: 0 in 0.303s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:12:27 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-944cc601-517d-4330-8f35-dddce76279f5 tempest-VolumeDependencyTests-738066002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-35815792-df58-4e4a-bf0f-8d808b7556c0.info {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:12:27 devstack sudo[102762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-35815792-df58-4e4a-bf0f-8d808b7556c0.info Sep 07 10:12:27 devstack sudo[102762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:12:28 devstack sudo[102762]: pam_unix(sudo:session): session closed for user root Sep 07 10:12:28 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-944cc601-517d-4330-8f35-dddce76279f5 tempest-VolumeDependencyTests-738066002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-35815792-df58-4e4a-bf0f-8d808b7556c0.info" returned: 0 in 0.320s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:12:28 devstack cinder-volume[87515]: WARNING cinder.volume.drivers.remotefs [None req-944cc601-517d-4330-8f35-dddce76279f5 tempest-VolumeDependencyTests-738066002 None] /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-35815792-df58-4e4a-bf0f-8d808b7556c0.info is being set with open permissions: ugo+rw Sep 07 10:12:28 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-944cc601-517d-4330-8f35-dddce76279f5 tempest-VolumeDependencyTests-738066002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-35815792-df58-4e4a-bf0f-8d808b7556c0.info {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:12:28 devstack sudo[102765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-35815792-df58-4e4a-bf0f-8d808b7556c0.info Sep 07 10:12:28 devstack sudo[102765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:12:28 devstack sudo[102765]: pam_unix(sudo:session): session closed for user root Sep 07 10:12:28 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-944cc601-517d-4330-8f35-dddce76279f5 tempest-VolumeDependencyTests-738066002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-35815792-df58-4e4a-bf0f-8d808b7556c0.info" returned: 0 in 0.294s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:12:28 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-944cc601-517d-4330-8f35-dddce76279f5 tempest-VolumeDependencyTests-738066002 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.487s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:12:28 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-f3f769cc-3c3c-4a2d-be46-e9b0151c8c88 tempest-VolumesGetTest-329404913 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.931s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:12:28 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-f3f769cc-3c3c-4a2d-be46-e9b0151c8c88 tempest-VolumesGetTest-329404913 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:12:26Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-419605429',display_name='tempest-VolumesGetTest-Volume-1467270562',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be536735-7ad6-4fd8-8c48-d8f20fef2a5f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ecf34953525e4b9b81581ac36d4e0df0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:12:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:12:26Z,use_quota=True,user_id='680e26fefab8422488ad232f8032cf75',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3a092cd-7947-4cbf-abff-4ba9567becf0),volume_type_id=f3a092cd-7947-4cbf-abff-4ba9567becf0)}" {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 10:12:28 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-f3f769cc-3c3c-4a2d-be46-e9b0151c8c88 tempest-VolumesGetTest-329404913 None] Creating volume be536735-7ad6-4fd8-8c48-d8f20fef2a5f {{(pid=87515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 10:12:28 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-f3f769cc-3c3c-4a2d-be46-e9b0151c8c88 tempest-VolumesGetTest-329404913 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:12:28 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-f3f769cc-3c3c-4a2d-be46-e9b0151c8c88 tempest-VolumesGetTest-329404913 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:12:28 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-f3f769cc-3c3c-4a2d-be46-e9b0151c8c88 tempest-VolumesGetTest-329404913 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:12:28 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-f3f769cc-3c3c-4a2d-be46-e9b0151c8c88 tempest-VolumesGetTest-329404913 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:12:28 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-f3f769cc-3c3c-4a2d-be46-e9b0151c8c88 tempest-VolumesGetTest-329404913 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:12:28 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-f3f769cc-3c3c-4a2d-be46-e9b0151c8c88 tempest-VolumesGetTest-329404913 None] Selected osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c as target Quobyte volume. {{(pid=87515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 10:12:28 devstack cinder-volume[87515]: INFO cinder.volume.drivers.remotefs [None req-f3f769cc-3c3c-4a2d-be46-e9b0151c8c88 tempest-VolumesGetTest-329404913 None] casted to osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c Sep 07 10:12:28 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-f3f769cc-3c3c-4a2d-be46-e9b0151c8c88 tempest-VolumesGetTest-329404913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-be536735-7ad6-4fd8-8c48-d8f20fef2a5f 1073741824 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:12:28 devstack sudo[102768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-be536735-7ad6-4fd8-8c48-d8f20fef2a5f 1073741824 Sep 07 10:12:28 devstack sudo[102768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:12:28 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-944cc601-517d-4330-8f35-dddce76279f5 tempest-VolumeDependencyTests-738066002 None] Create snapshot completed successfully Sep 07 10:12:29 devstack sudo[102768]: pam_unix(sudo:session): session closed for user root Sep 07 10:12:29 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-f3f769cc-3c3c-4a2d-be46-e9b0151c8c88 tempest-VolumesGetTest-329404913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-be536735-7ad6-4fd8-8c48-d8f20fef2a5f 1073741824" returned: 0 in 0.454s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:12:29 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-f3f769cc-3c3c-4a2d-be46-e9b0151c8c88 tempest-VolumesGetTest-329404913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-be536735-7ad6-4fd8-8c48-d8f20fef2a5f {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:12:29 devstack sudo[102774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-be536735-7ad6-4fd8-8c48-d8f20fef2a5f Sep 07 10:12:29 devstack sudo[102774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:12:29 devstack sudo[102774]: pam_unix(sudo:session): session closed for user root Sep 07 10:12:29 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-f3f769cc-3c3c-4a2d-be46-e9b0151c8c88 tempest-VolumesGetTest-329404913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-be536735-7ad6-4fd8-8c48-d8f20fef2a5f" returned: 0 in 0.287s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:12:29 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-f3f769cc-3c3c-4a2d-be46-e9b0151c8c88 tempest-VolumesGetTest-329404913 None] <== create_volume: return (782ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'} {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 10:12:29 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-f3f769cc-3c3c-4a2d-be46-e9b0151c8c88 tempest-VolumesGetTest-329404913 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.789s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:12:29 devstack cinder-volume[87515]: DEBUG dbcounter [-] [87515] Writing DB stats cinder:UPDATE=167,cinder:INSERT=36,cinder:DELETE=17,cinder:SELECT=122 {{(pid=87515) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 10:12:29 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-f3f769cc-3c3c-4a2d-be46-e9b0151c8c88 tempest-VolumesGetTest-329404913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a07d96f-3a15-49b9-bb53-1c5459e33dc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-be536735-7ad6-4fd8-8c48-d8f20fef2a5f', 'volume_size': 1}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:12:29 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-f3f769cc-3c3c-4a2d-be46-e9b0151c8c88 tempest-VolumesGetTest-329404913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef3f2f5f-4552-4131-98d9-a4208f6fc7d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:12:29 devstack cinder-volume[87515]: DEBUG dbcounter [-] [87515] Writing DB stats cinder:SELECT=107,cinder:UPDATE=155,cinder:INSERT=51,cinder:DELETE=12 {{(pid=87515) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 10:12:29 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-f3f769cc-3c3c-4a2d-be46-e9b0151c8c88 tempest-VolumesGetTest-329404913 None] Volume volume-be536735-7ad6-4fd8-8c48-d8f20fef2a5f (be536735-7ad6-4fd8-8c48-d8f20fef2a5f): created successfully Sep 07 10:12:29 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-f3f769cc-3c3c-4a2d-be46-e9b0151c8c88 tempest-VolumesGetTest-329404913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef3f2f5f-4552-4131-98d9-a4208f6fc7d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:12:29 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-f3f769cc-3c3c-4a2d-be46-e9b0151c8c88 tempest-VolumesGetTest-329404913 None] Flow 'volume_create_manager' (2da15466-f368-421c-addb-463b9966b77e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:12:29 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-f3f769cc-3c3c-4a2d-be46-e9b0151c8c88 tempest-VolumesGetTest-329404913 None] Created volume successfully. Sep 07 10:12:29 devstack cinder-volume[87515]: DEBUG cinder.volume.flows.manager.create_volume [None req-8d489047-0380-4266-90a6-2c900c240e55 tempest-VolumeDependencyTests-738066002 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 10:12:29 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-8d489047-0380-4266-90a6-2c900c240e55 tempest-VolumeDependencyTests-738066002 None] Flow 'volume_create_manager' (6707d2f0-00b6-476b-80e2-98d2b86f871e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:12:29 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-8d489047-0380-4266-90a6-2c900c240e55 tempest-VolumeDependencyTests-738066002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4015de77-fe1a-49b1-a7b2-80cb6f9f86df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:12:29 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-ccc1af9e-df9a-44d3-936e-d7d54b07e462 tempest-VolumesGetTest-329404913 None] Acquiring lock "cinder-be536735-7ad6-4fd8-8c48-d8f20fef2a5f-delete_volume" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:12:29 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-8d489047-0380-4266-90a6-2c900c240e55 tempest-VolumeDependencyTests-738066002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4015de77-fe1a-49b1-a7b2-80cb6f9f86df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:12:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-81555165',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0c8657d-a55d-4ca7-a230-f755fac06743,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='594e10562cfd489482009279a733acb5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:12:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=d46f5d22-4ee6-4c17-9617-dd0dad465435,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:12:30Z,use_quota=True,user_id='dbadaa379baa408195ebeb8a62330f00',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3a092cd-7947-4cbf-abff-4ba9567becf0),volume_type_id=f3a092cd-7947-4cbf-abff-4ba9567becf0)' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:12:29 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-8d489047-0380-4266-90a6-2c900c240e55 tempest-VolumeDependencyTests-738066002 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f83dd5da-4875-42e9-ac9d-47d1b978bd67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:12:29 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-8d489047-0380-4266-90a6-2c900c240e55 tempest-VolumeDependencyTests-738066002 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f83dd5da-4875-42e9-ac9d-47d1b978bd67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:12:29 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-8d489047-0380-4266-90a6-2c900c240e55 tempest-VolumeDependencyTests-738066002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c285e9f-93b9-49bc-8674-8c6958e666f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:12:29 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-8d489047-0380-4266-90a6-2c900c240e55 tempest-VolumeDependencyTests-738066002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c285e9f-93b9-49bc-8674-8c6958e666f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'b0c8657d-a55d-4ca7-a230-f755fac06743', 'volume_name': 'volume-b0c8657d-a55d-4ca7-a230-f755fac06743', 'volume_size': 1, 'snapshot_id': 'd46f5d22-4ee6-4c17-9617-dd0dad465435'}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:12:30 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-8d489047-0380-4266-90a6-2c900c240e55 tempest-VolumeDependencyTests-738066002 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc4a5254-ad47-4190-96d0-9f28f0c45396) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:12:30 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-8d489047-0380-4266-90a6-2c900c240e55 tempest-VolumeDependencyTests-738066002 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc4a5254-ad47-4190-96d0-9f28f0c45396) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:12:30 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-8d489047-0380-4266-90a6-2c900c240e55 tempest-VolumeDependencyTests-738066002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a944203-16ef-4590-a612-cc035ab0a75f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:12:30 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-8d489047-0380-4266-90a6-2c900c240e55 tempest-VolumeDependencyTests-738066002 None] Volume b0c8657d-a55d-4ca7-a230-f755fac06743: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-b0c8657d-a55d-4ca7-a230-f755fac06743', 'volume_size': 1, 'snapshot_id': 'd46f5d22-4ee6-4c17-9617-dd0dad465435'} Sep 07 10:12:30 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-ccc1af9e-df9a-44d3-936e-d7d54b07e462 tempest-VolumesGetTest-329404913 None] Lock "cinder-be536735-7ad6-4fd8-8c48-d8f20fef2a5f-delete_volume" acquired by "delete_volume" :: waited 0.077s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:12:30 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-8d489047-0380-4266-90a6-2c900c240e55 tempest-VolumeDependencyTests-738066002 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:12:30 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-8d489047-0380-4266-90a6-2c900c240e55 tempest-VolumeDependencyTests-738066002 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:12:30 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-8d489047-0380-4266-90a6-2c900c240e55 tempest-VolumeDependencyTests-738066002 None] Acquiring lock "cinder-quobyte-d46f5d22-4ee6-4c17-9617-dd0dad465435-b0c8657d-a55d-4ca7-a230-f755fac06743" by "_create_volume_from_snapshot" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:12:30 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-8d489047-0380-4266-90a6-2c900c240e55 tempest-VolumeDependencyTests-738066002 None] Lock "cinder-quobyte-d46f5d22-4ee6-4c17-9617-dd0dad465435-b0c8657d-a55d-4ca7-a230-f755fac06743" acquired by "_create_volume_from_snapshot" :: waited 0.025s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:12:30 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-8d489047-0380-4266-90a6-2c900c240e55 tempest-VolumeDependencyTests-738066002 None] Creating volume b0c8657d-a55d-4ca7-a230-f755fac06743 from snapshot d46f5d22-4ee6-4c17-9617-dd0dad465435 {{(pid=87515) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 07 10:12:30 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-8d489047-0380-4266-90a6-2c900c240e55 tempest-VolumeDependencyTests-738066002 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:12:30 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-8d489047-0380-4266-90a6-2c900c240e55 tempest-VolumeDependencyTests-738066002 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:12:30 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-8d489047-0380-4266-90a6-2c900c240e55 tempest-VolumeDependencyTests-738066002 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:12:30 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-8d489047-0380-4266-90a6-2c900c240e55 tempest-VolumeDependencyTests-738066002 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:12:30 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-8d489047-0380-4266-90a6-2c900c240e55 tempest-VolumeDependencyTests-738066002 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:12:30 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-8d489047-0380-4266-90a6-2c900c240e55 tempest-VolumeDependencyTests-738066002 None] Selected osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c as target Quobyte volume. {{(pid=87515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 10:12:30 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-8d489047-0380-4266-90a6-2c900c240e55 tempest-VolumeDependencyTests-738066002 None] Acquiring lock "cinder-quobyte-b0c8657d-a55d-4ca7-a230-f755fac06743" by "_copy_volume_from_snapshot" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:12:30 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-ccc1af9e-df9a-44d3-936e-d7d54b07e462 tempest-VolumesGetTest-329404913 None] Acquiring lock "cinder-quobyte-be536735-7ad6-4fd8-8c48-d8f20fef2a5f" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:12:30 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-8d489047-0380-4266-90a6-2c900c240e55 tempest-VolumeDependencyTests-738066002 None] Lock "cinder-quobyte-b0c8657d-a55d-4ca7-a230-f755fac06743" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:12:30 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-8d489047-0380-4266-90a6-2c900c240e55 tempest-VolumeDependencyTests-738066002 None] snapshot: d46f5d22-4ee6-4c17-9617-dd0dad465435, volume: b0c8657d-a55d-4ca7-a230-f755fac06743, {{(pid=87515) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 07 10:12:30 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-8d489047-0380-4266-90a6-2c900c240e55 tempest-VolumeDependencyTests-738066002 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:12:30 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-8d489047-0380-4266-90a6-2c900c240e55 tempest-VolumeDependencyTests-738066002 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:12:30 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-8d489047-0380-4266-90a6-2c900c240e55 tempest-VolumeDependencyTests-738066002 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:12:30 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-8d489047-0380-4266-90a6-2c900c240e55 tempest-VolumeDependencyTests-738066002 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:12:30 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-8d489047-0380-4266-90a6-2c900c240e55 tempest-VolumeDependencyTests-738066002 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:12:30 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-ccc1af9e-df9a-44d3-936e-d7d54b07e462 tempest-VolumesGetTest-329404913 None] Lock "cinder-quobyte-be536735-7ad6-4fd8-8c48-d8f20fef2a5f" acquired by "delete_volume" :: waited 0.054s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:12:30 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d951693-96f8-45b3-879e-6291678ddb28]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:12:30 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-8d489047-0380-4266-90a6-2c900c240e55 tempest-VolumeDependencyTests-738066002 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-35815792-df58-4e4a-bf0f-8d808b7556c0.d46f5d22-4ee6-4c17-9617-dd0dad465435 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:12:30 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d12ea7f-92b1-4c95-9800-c6b00f12abec]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:12:30 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-ccc1af9e-df9a-44d3-936e-d7d54b07e462 tempest-VolumesGetTest-329404913 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-be536735-7ad6-4fd8-8c48-d8f20fef2a5f {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:12:30 devstack sudo[102778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-35815792-df58-4e4a-bf0f-8d808b7556c0.d46f5d22-4ee6-4c17-9617-dd0dad465435 Sep 07 10:12:30 devstack sudo[102778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:12:30 devstack sudo[102779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-be536735-7ad6-4fd8-8c48-d8f20fef2a5f Sep 07 10:12:30 devstack sudo[102779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:12:30 devstack sudo[102778]: pam_unix(sudo:session): session closed for user root Sep 07 10:12:30 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-8d489047-0380-4266-90a6-2c900c240e55 tempest-VolumeDependencyTests-738066002 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-35815792-df58-4e4a-bf0f-8d808b7556c0.d46f5d22-4ee6-4c17-9617-dd0dad465435" returned: 0 in 0.415s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:12:30 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-8d489047-0380-4266-90a6-2c900c240e55 tempest-VolumeDependencyTests-738066002 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-35815792-df58-4e4a-bf0f-8d808b7556c0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87515) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 10:12:30 devstack sudo[102779]: pam_unix(sudo:session): session closed for user root Sep 07 10:12:30 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-ccc1af9e-df9a-44d3-936e-d7d54b07e462 tempest-VolumesGetTest-329404913 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-be536735-7ad6-4fd8-8c48-d8f20fef2a5f" returned: 0 in 0.410s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:12:30 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-ccc1af9e-df9a-44d3-936e-d7d54b07e462 tempest-VolumesGetTest-329404913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-be536735-7ad6-4fd8-8c48-d8f20fef2a5f {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:12:30 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f543f6f-98e6-487d-99e5-2d409940d3e1]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:12:30 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-8d489047-0380-4266-90a6-2c900c240e55 tempest-VolumeDependencyTests-738066002 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-35815792-df58-4e4a-bf0f-8d808b7556c0 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:12:30 devstack sudo[102789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-be536735-7ad6-4fd8-8c48-d8f20fef2a5f Sep 07 10:12:30 devstack sudo[102789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:12:30 devstack sudo[102790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-35815792-df58-4e4a-bf0f-8d808b7556c0 Sep 07 10:12:30 devstack sudo[102790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:12:30 devstack sudo[102789]: pam_unix(sudo:session): session closed for user root Sep 07 10:12:30 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-ccc1af9e-df9a-44d3-936e-d7d54b07e462 tempest-VolumesGetTest-329404913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-be536735-7ad6-4fd8-8c48-d8f20fef2a5f" returned: 0 in 0.265s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:12:30 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-ccc1af9e-df9a-44d3-936e-d7d54b07e462 tempest-VolumesGetTest-329404913 None] Lock "cinder-quobyte-be536735-7ad6-4fd8-8c48-d8f20fef2a5f" released by "delete_volume" :: held 0.720s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:12:30 devstack cinder-volume[87515]: DEBUG cinder.quota [None req-ccc1af9e-df9a-44d3-936e-d7d54b07e462 tempest-VolumesGetTest-329404913 None] Created reservations ['04f145cf-5209-4010-80a2-f249abd20c99', '78674e5e-239e-425d-b680-aa3655081e36', '58c49d80-9737-4ea3-936f-3877816c7559', '13f4303a-d287-41d8-b7a2-13ad3bd85afc'] {{(pid=87515) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:12:30 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-ccc1af9e-df9a-44d3-936e-d7d54b07e462 tempest-VolumesGetTest-329404913 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:12:30 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-ccc1af9e-df9a-44d3-936e-d7d54b07e462 tempest-VolumesGetTest-329404913 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:12:30 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-ccc1af9e-df9a-44d3-936e-d7d54b07e462 tempest-VolumesGetTest-329404913 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:12:31 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-ccc1af9e-df9a-44d3-936e-d7d54b07e462 tempest-VolumesGetTest-329404913 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:12:31 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-ccc1af9e-df9a-44d3-936e-d7d54b07e462 tempest-VolumesGetTest-329404913 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:12:31 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-ccc1af9e-df9a-44d3-936e-d7d54b07e462 tempest-VolumesGetTest-329404913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:12:31 devstack sudo[102790]: pam_unix(sudo:session): session closed for user root Sep 07 10:12:31 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-8d489047-0380-4266-90a6-2c900c240e55 tempest-VolumeDependencyTests-738066002 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-35815792-df58-4e4a-bf0f-8d808b7556c0" returned: 0 in 0.425s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:12:31 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-8d489047-0380-4266-90a6-2c900c240e55 tempest-VolumeDependencyTests-738066002 None] will copy from snapshot at /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-35815792-df58-4e4a-bf0f-8d808b7556c0 {{(pid=87515) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 07 10:12:31 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-8d489047-0380-4266-90a6-2c900c240e55 tempest-VolumeDependencyTests-738066002 None] Creating direct copy from snapshot {{(pid=87515) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 07 10:12:31 devstack cinder-volume[87515]: DEBUG cinder.utils [None req-8d489047-0380-4266-90a6-2c900c240e55 tempest-VolumeDependencyTests-738066002 None] Path /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-b0c8657d-a55d-4ca7-a230-f755fac06743 not found in is_blk_device check {{(pid=87515) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 07 10:12:31 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-8d489047-0380-4266-90a6-2c900c240e55 tempest-VolumeDependencyTests-738066002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-35815792-df58-4e4a-bf0f-8d808b7556c0 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-b0c8657d-a55d-4ca7-a230-f755fac06743 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:12:31 devstack sudo[102798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a Sep 07 10:12:31 devstack sudo[102798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:12:31 devstack sudo[102800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-35815792-df58-4e4a-bf0f-8d808b7556c0 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-b0c8657d-a55d-4ca7-a230-f755fac06743 Sep 07 10:12:31 devstack sudo[102800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:12:31 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-f9138c3e-16d9-4e8f-b355-c336e990e71c tempest-VolumesGetTest-329404913 None] Acquiring lock "cinder-e78e34cd-f362-46c3-8f8d-e31767df0b0f-delete_volume" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:12:31 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-f9138c3e-16d9-4e8f-b355-c336e990e71c tempest-VolumesGetTest-329404913 None] Lock "cinder-e78e34cd-f362-46c3-8f8d-e31767df0b0f-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:12:31 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-f9138c3e-16d9-4e8f-b355-c336e990e71c tempest-VolumesGetTest-329404913 None] Acquiring lock "cinder-quobyte-e78e34cd-f362-46c3-8f8d-e31767df0b0f" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:12:31 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-f9138c3e-16d9-4e8f-b355-c336e990e71c tempest-VolumesGetTest-329404913 None] Lock "cinder-quobyte-e78e34cd-f362-46c3-8f8d-e31767df0b0f" acquired by "delete_volume" :: waited 0.029s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:12:31 devstack sudo[102798]: pam_unix(sudo:session): session closed for user root Sep 07 10:12:31 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-ccc1af9e-df9a-44d3-936e-d7d54b07e462 tempest-VolumesGetTest-329404913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a" returned: 0 in 0.363s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:12:31 devstack cinder-volume[87515]: DEBUG cinder.manager [None req-ccc1af9e-df9a-44d3-936e-d7d54b07e462 tempest-VolumesGetTest-329404913 None] Notifying Schedulers of capabilities ... {{(pid=87515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:12:31 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa4330d7-eecd-4e33-8399-c8d4abff82c3]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:12:31 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-f9138c3e-16d9-4e8f-b355-c336e990e71c tempest-VolumesGetTest-329404913 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-e78e34cd-f362-46c3-8f8d-e31767df0b0f {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:12:31 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-ccc1af9e-df9a-44d3-936e-d7d54b07e462 tempest-VolumesGetTest-329404913 None] Deleted volume successfully. Sep 07 10:12:31 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-ccc1af9e-df9a-44d3-936e-d7d54b07e462 tempest-VolumesGetTest-329404913 None] Lock "cinder-be536735-7ad6-4fd8-8c48-d8f20fef2a5f-delete_volume" released by "delete_volume" :: held 1.404s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:12:31 devstack sudo[102805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-e78e34cd-f362-46c3-8f8d-e31767df0b0f Sep 07 10:12:31 devstack sudo[102805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:12:32 devstack sudo[102805]: pam_unix(sudo:session): session closed for user root Sep 07 10:12:32 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-f9138c3e-16d9-4e8f-b355-c336e990e71c tempest-VolumesGetTest-329404913 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-e78e34cd-f362-46c3-8f8d-e31767df0b0f" returned: 0 in 0.734s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:12:32 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-f9138c3e-16d9-4e8f-b355-c336e990e71c tempest-VolumesGetTest-329404913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-e78e34cd-f362-46c3-8f8d-e31767df0b0f {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:12:32 devstack sudo[102819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-e78e34cd-f362-46c3-8f8d-e31767df0b0f Sep 07 10:12:32 devstack sudo[102819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:12:32 devstack sudo[102819]: pam_unix(sudo:session): session closed for user root Sep 07 10:12:32 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-f9138c3e-16d9-4e8f-b355-c336e990e71c tempest-VolumesGetTest-329404913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-e78e34cd-f362-46c3-8f8d-e31767df0b0f" returned: 0 in 0.594s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:12:32 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-f9138c3e-16d9-4e8f-b355-c336e990e71c tempest-VolumesGetTest-329404913 None] Lock "cinder-quobyte-e78e34cd-f362-46c3-8f8d-e31767df0b0f" released by "delete_volume" :: held 1.420s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:12:32 devstack cinder-volume[87515]: DEBUG cinder.quota [None req-f9138c3e-16d9-4e8f-b355-c336e990e71c tempest-VolumesGetTest-329404913 None] Created reservations ['8c444c55-ceb4-4a47-8e23-cd72c4f946c3', 'aacdadb2-7f68-46e8-b7b2-858223545ea6', 'e2404f2b-19f8-4336-b980-2fd1a62b0fff', '49058733-f601-4fa1-a288-003d63da13ca'] {{(pid=87515) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:12:33 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-f9138c3e-16d9-4e8f-b355-c336e990e71c tempest-VolumesGetTest-329404913 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:12:33 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-f9138c3e-16d9-4e8f-b355-c336e990e71c tempest-VolumesGetTest-329404913 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:12:33 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-f9138c3e-16d9-4e8f-b355-c336e990e71c tempest-VolumesGetTest-329404913 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:12:33 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-f9138c3e-16d9-4e8f-b355-c336e990e71c tempest-VolumesGetTest-329404913 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:12:33 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-f9138c3e-16d9-4e8f-b355-c336e990e71c tempest-VolumesGetTest-329404913 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:12:33 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-f9138c3e-16d9-4e8f-b355-c336e990e71c tempest-VolumesGetTest-329404913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:12:33 devstack sudo[102823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a Sep 07 10:12:33 devstack sudo[102823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:12:33 devstack sudo[102823]: pam_unix(sudo:session): session closed for user root Sep 07 10:12:33 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-f9138c3e-16d9-4e8f-b355-c336e990e71c tempest-VolumesGetTest-329404913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a" returned: 0 in 0.707s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:12:33 devstack cinder-volume[87515]: DEBUG cinder.manager [None req-f9138c3e-16d9-4e8f-b355-c336e990e71c tempest-VolumesGetTest-329404913 None] Notifying Schedulers of capabilities ... {{(pid=87515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:12:33 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-f9138c3e-16d9-4e8f-b355-c336e990e71c tempest-VolumesGetTest-329404913 None] Deleted volume successfully. Sep 07 10:12:33 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-f9138c3e-16d9-4e8f-b355-c336e990e71c tempest-VolumesGetTest-329404913 None] Lock "cinder-e78e34cd-f362-46c3-8f8d-e31767df0b0f-delete_volume" released by "delete_volume" :: held 2.657s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:12:36 devstack sudo[102800]: pam_unix(sudo:session): session closed for user root Sep 07 10:12:36 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-8d489047-0380-4266-90a6-2c900c240e55 tempest-VolumeDependencyTests-738066002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-35815792-df58-4e4a-bf0f-8d808b7556c0 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-b0c8657d-a55d-4ca7-a230-f755fac06743" returned: 0 in 5.744s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:12:36 devstack cinder-volume[87515]: DEBUG cinder.image.image_utils [None req-8d489047-0380-4266-90a6-2c900c240e55 tempest-VolumeDependencyTests-738066002 None] Image conversion details: src /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-35815792-df58-4e4a-bf0f-8d808b7556c0, size 1024.00 MB, duration 5.75 sec, destination /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-b0c8657d-a55d-4ca7-a230-f755fac06743 {{(pid=87515) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 07 10:12:36 devstack cinder-volume[87515]: INFO cinder.image.image_utils [None req-8d489047-0380-4266-90a6-2c900c240e55 tempest-VolumeDependencyTests-738066002 None] Converted 1024.00 MB image at 178.23 MB/s Sep 07 10:12:36 devstack cinder-volume[87515]: WARNING cinder.volume.drivers.remotefs [None req-8d489047-0380-4266-90a6-2c900c240e55 tempest-VolumeDependencyTests-738066002 None] /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-b0c8657d-a55d-4ca7-a230-f755fac06743 is being set with open permissions: ugo+rw Sep 07 10:12:36 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-8d489047-0380-4266-90a6-2c900c240e55 tempest-VolumeDependencyTests-738066002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-b0c8657d-a55d-4ca7-a230-f755fac06743 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:12:36 devstack sudo[102826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-b0c8657d-a55d-4ca7-a230-f755fac06743 Sep 07 10:12:36 devstack sudo[102826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:12:37 devstack sudo[102826]: pam_unix(sudo:session): session closed for user root Sep 07 10:12:37 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-8d489047-0380-4266-90a6-2c900c240e55 tempest-VolumeDependencyTests-738066002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-b0c8657d-a55d-4ca7-a230-f755fac06743" returned: 0 in 0.259s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:12:37 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-8d489047-0380-4266-90a6-2c900c240e55 tempest-VolumeDependencyTests-738066002 None] Lock "cinder-quobyte-b0c8657d-a55d-4ca7-a230-f755fac06743" released by "_copy_volume_from_snapshot" :: held 6.958s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:12:37 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-8d489047-0380-4266-90a6-2c900c240e55 tempest-VolumeDependencyTests-738066002 None] Lock "cinder-quobyte-d46f5d22-4ee6-4c17-9617-dd0dad465435-b0c8657d-a55d-4ca7-a230-f755fac06743" released by "_create_volume_from_snapshot" :: held 7.041s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:12:37 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-8d489047-0380-4266-90a6-2c900c240e55 tempest-VolumeDependencyTests-738066002 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.067s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:12:37 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-8d489047-0380-4266-90a6-2c900c240e55 tempest-VolumeDependencyTests-738066002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a944203-16ef-4590-a612-cc035ab0a75f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b0c8657d-a55d-4ca7-a230-f755fac06743', 'volume_size': 1, 'snapshot_id': 'd46f5d22-4ee6-4c17-9617-dd0dad465435'}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:12:37 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-8d489047-0380-4266-90a6-2c900c240e55 tempest-VolumeDependencyTests-738066002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c9ac58f-ba42-43bf-bbce-baf0ab4c15b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:12:37 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-8d489047-0380-4266-90a6-2c900c240e55 tempest-VolumeDependencyTests-738066002 None] Volume volume-b0c8657d-a55d-4ca7-a230-f755fac06743 (b0c8657d-a55d-4ca7-a230-f755fac06743): created successfully Sep 07 10:12:37 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-8d489047-0380-4266-90a6-2c900c240e55 tempest-VolumeDependencyTests-738066002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c9ac58f-ba42-43bf-bbce-baf0ab4c15b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:12:37 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-8d489047-0380-4266-90a6-2c900c240e55 tempest-VolumeDependencyTests-738066002 None] Flow 'volume_create_manager' (6707d2f0-00b6-476b-80e2-98d2b86f871e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:12:37 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-8d489047-0380-4266-90a6-2c900c240e55 tempest-VolumeDependencyTests-738066002 None] Created volume successfully. Sep 07 10:12:37 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-c433ab3b-df27-4912-bab1-7a38970b9d15 tempest-VolumeDependencyTests-738066002 None] Acquiring lock "cinder-d46f5d22-4ee6-4c17-9617-dd0dad465435-delete_snapshot" by "delete_snapshot" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:12:37 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-c433ab3b-df27-4912-bab1-7a38970b9d15 tempest-VolumeDependencyTests-738066002 None] Lock "cinder-d46f5d22-4ee6-4c17-9617-dd0dad465435-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:12:37 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-c433ab3b-df27-4912-bab1-7a38970b9d15 tempest-VolumeDependencyTests-738066002 None] Acquiring lock "cinder-quobyte-35815792-df58-4e4a-bf0f-8d808b7556c0" by "delete_snapshot" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:12:37 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-c433ab3b-df27-4912-bab1-7a38970b9d15 tempest-VolumeDependencyTests-738066002 None] Lock "cinder-quobyte-35815792-df58-4e4a-bf0f-8d808b7556c0" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:12:37 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-c433ab3b-df27-4912-bab1-7a38970b9d15 tempest-VolumeDependencyTests-738066002 None] Acquiring lock "cinder-quobyte-d46f5d22-4ee6-4c17-9617-dd0dad465435" by "_delete_snapshot" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:12:37 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-c433ab3b-df27-4912-bab1-7a38970b9d15 tempest-VolumeDependencyTests-738066002 None] Lock "cinder-quobyte-d46f5d22-4ee6-4c17-9617-dd0dad465435" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:12:37 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-c433ab3b-df27-4912-bab1-7a38970b9d15 tempest-VolumeDependencyTests-738066002 None] Deleting offline snapshot d46f5d22-4ee6-4c17-9617-dd0dad465435 of volume 35815792-df58-4e4a-bf0f-8d808b7556c0 {{(pid=87515) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 10:12:38 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-c433ab3b-df27-4912-bab1-7a38970b9d15 tempest-VolumeDependencyTests-738066002 None] snapshot_file for this snap is: volume-35815792-df58-4e4a-bf0f-8d808b7556c0.d46f5d22-4ee6-4c17-9617-dd0dad465435 {{(pid=87515) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 10:12:38 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2827be0-0cac-4994-98ea-0860116a0591]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:12:38 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-c433ab3b-df27-4912-bab1-7a38970b9d15 tempest-VolumeDependencyTests-738066002 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-35815792-df58-4e4a-bf0f-8d808b7556c0.d46f5d22-4ee6-4c17-9617-dd0dad465435 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:12:38 devstack sudo[102835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-35815792-df58-4e4a-bf0f-8d808b7556c0.d46f5d22-4ee6-4c17-9617-dd0dad465435 Sep 07 10:12:38 devstack sudo[102835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:12:38 devstack sudo[102835]: pam_unix(sudo:session): session closed for user root Sep 07 10:12:38 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-c433ab3b-df27-4912-bab1-7a38970b9d15 tempest-VolumeDependencyTests-738066002 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-35815792-df58-4e4a-bf0f-8d808b7556c0.d46f5d22-4ee6-4c17-9617-dd0dad465435" returned: 0 in 0.508s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:12:38 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-c433ab3b-df27-4912-bab1-7a38970b9d15 tempest-VolumeDependencyTests-738066002 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-35815792-df58-4e4a-bf0f-8d808b7556c0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87515) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 10:12:38 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[46249831-be28-4358-9d3c-24fab8bb2644]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:12:38 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-c433ab3b-df27-4912-bab1-7a38970b9d15 tempest-VolumeDependencyTests-738066002 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-35815792-df58-4e4a-bf0f-8d808b7556c0 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:12:38 devstack sudo[102841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-35815792-df58-4e4a-bf0f-8d808b7556c0 Sep 07 10:12:38 devstack sudo[102841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:12:39 devstack sudo[102841]: pam_unix(sudo:session): session closed for user root Sep 07 10:12:39 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-c433ab3b-df27-4912-bab1-7a38970b9d15 tempest-VolumeDependencyTests-738066002 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-35815792-df58-4e4a-bf0f-8d808b7556c0" returned: 0 in 0.755s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:12:39 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-c433ab3b-df27-4912-bab1-7a38970b9d15 tempest-VolumeDependencyTests-738066002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-35815792-df58-4e4a-bf0f-8d808b7556c0.d46f5d22-4ee6-4c17-9617-dd0dad465435 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:12:39 devstack sudo[102847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-35815792-df58-4e4a-bf0f-8d808b7556c0.d46f5d22-4ee6-4c17-9617-dd0dad465435 Sep 07 10:12:39 devstack sudo[102847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:12:39 devstack sudo[102847]: pam_unix(sudo:session): session closed for user root Sep 07 10:12:39 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-c433ab3b-df27-4912-bab1-7a38970b9d15 tempest-VolumeDependencyTests-738066002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-35815792-df58-4e4a-bf0f-8d808b7556c0.d46f5d22-4ee6-4c17-9617-dd0dad465435" returned: 0 in 0.507s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:12:39 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-c433ab3b-df27-4912-bab1-7a38970b9d15 tempest-VolumeDependencyTests-738066002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-35815792-df58-4e4a-bf0f-8d808b7556c0.d46f5d22-4ee6-4c17-9617-dd0dad465435 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:12:39 devstack sudo[102852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-35815792-df58-4e4a-bf0f-8d808b7556c0.d46f5d22-4ee6-4c17-9617-dd0dad465435 Sep 07 10:12:39 devstack sudo[102852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:12:40 devstack sudo[102852]: pam_unix(sudo:session): session closed for user root Sep 07 10:12:40 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-c433ab3b-df27-4912-bab1-7a38970b9d15 tempest-VolumeDependencyTests-738066002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-35815792-df58-4e4a-bf0f-8d808b7556c0.d46f5d22-4ee6-4c17-9617-dd0dad465435" returned: 0 in 0.283s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:12:40 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-c433ab3b-df27-4912-bab1-7a38970b9d15 tempest-VolumeDependencyTests-738066002 None] Lock "cinder-quobyte-d46f5d22-4ee6-4c17-9617-dd0dad465435" released by "_delete_snapshot" :: held 2.222s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:12:40 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-c433ab3b-df27-4912-bab1-7a38970b9d15 tempest-VolumeDependencyTests-738066002 None] Lock "cinder-quobyte-35815792-df58-4e4a-bf0f-8d808b7556c0" released by "delete_snapshot" :: held 2.255s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:12:40 devstack cinder-volume[87515]: DEBUG cinder.quota [None req-c433ab3b-df27-4912-bab1-7a38970b9d15 tempest-VolumeDependencyTests-738066002 None] Created reservations ['bc9510a8-4bc2-4185-8ef8-f9dde5c88461', '5c13dbf8-4fe6-4976-b195-a5b47c10c3cb', '892ce7c1-7a41-4171-8a55-c97c00a7ca85', '56207f12-cf78-44d0-b17f-033c0afe3b89'] {{(pid=87515) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:12:40 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-c433ab3b-df27-4912-bab1-7a38970b9d15 tempest-VolumeDependencyTests-738066002 None] Delete snapshot completed successfully. Sep 07 10:12:40 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-c433ab3b-df27-4912-bab1-7a38970b9d15 tempest-VolumeDependencyTests-738066002 None] Lock "cinder-d46f5d22-4ee6-4c17-9617-dd0dad465435-delete_snapshot" released by "delete_snapshot" :: held 2.441s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:12:41 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-5cddd7a5-65eb-474c-b7e5-0648cd1aa9f4 tempest-VolumeDependencyTests-738066002 None] Acquiring lock "cinder-35815792-df58-4e4a-bf0f-8d808b7556c0-delete_volume" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:12:41 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-5cddd7a5-65eb-474c-b7e5-0648cd1aa9f4 tempest-VolumeDependencyTests-738066002 None] Lock "cinder-35815792-df58-4e4a-bf0f-8d808b7556c0-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:12:41 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-5cddd7a5-65eb-474c-b7e5-0648cd1aa9f4 tempest-VolumeDependencyTests-738066002 None] Acquiring lock "cinder-quobyte-35815792-df58-4e4a-bf0f-8d808b7556c0" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:12:41 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-5cddd7a5-65eb-474c-b7e5-0648cd1aa9f4 tempest-VolumeDependencyTests-738066002 None] Lock "cinder-quobyte-35815792-df58-4e4a-bf0f-8d808b7556c0" acquired by "delete_volume" :: waited 0.019s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:12:41 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[2946f83e-b037-4a53-9b35-9a595eccfd08]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:12:41 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-5cddd7a5-65eb-474c-b7e5-0648cd1aa9f4 tempest-VolumeDependencyTests-738066002 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-35815792-df58-4e4a-bf0f-8d808b7556c0 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:12:41 devstack sudo[102855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-35815792-df58-4e4a-bf0f-8d808b7556c0 Sep 07 10:12:41 devstack sudo[102855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:12:41 devstack sudo[102855]: pam_unix(sudo:session): session closed for user root Sep 07 10:12:41 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-5cddd7a5-65eb-474c-b7e5-0648cd1aa9f4 tempest-VolumeDependencyTests-738066002 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-35815792-df58-4e4a-bf0f-8d808b7556c0" returned: 0 in 0.494s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:12:41 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-5cddd7a5-65eb-474c-b7e5-0648cd1aa9f4 tempest-VolumeDependencyTests-738066002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-35815792-df58-4e4a-bf0f-8d808b7556c0 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:12:41 devstack sudo[102860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-35815792-df58-4e4a-bf0f-8d808b7556c0 Sep 07 10:12:41 devstack sudo[102860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:12:42 devstack sudo[102860]: pam_unix(sudo:session): session closed for user root Sep 07 10:12:42 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-5cddd7a5-65eb-474c-b7e5-0648cd1aa9f4 tempest-VolumeDependencyTests-738066002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-35815792-df58-4e4a-bf0f-8d808b7556c0" returned: 0 in 0.339s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:12:42 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-5cddd7a5-65eb-474c-b7e5-0648cd1aa9f4 tempest-VolumeDependencyTests-738066002 None] Lock "cinder-quobyte-35815792-df58-4e4a-bf0f-8d808b7556c0" released by "delete_volume" :: held 0.909s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:12:42 devstack cinder-volume[87515]: DEBUG cinder.quota [None req-5cddd7a5-65eb-474c-b7e5-0648cd1aa9f4 tempest-VolumeDependencyTests-738066002 None] Created reservations ['e0b2f456-0ff4-496f-ac28-4b97cab97941', '587fe09d-718f-428b-b3f4-fa4743e407aa', 'f9696462-5af6-4bc3-b100-acabbcf55992', '5e69286a-1ff6-47e0-8b24-282417990435'] {{(pid=87515) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:12:42 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-5cddd7a5-65eb-474c-b7e5-0648cd1aa9f4 tempest-VolumeDependencyTests-738066002 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:12:42 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-5cddd7a5-65eb-474c-b7e5-0648cd1aa9f4 tempest-VolumeDependencyTests-738066002 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:12:42 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-5cddd7a5-65eb-474c-b7e5-0648cd1aa9f4 tempest-VolumeDependencyTests-738066002 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:12:42 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-5cddd7a5-65eb-474c-b7e5-0648cd1aa9f4 tempest-VolumeDependencyTests-738066002 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:12:42 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-5cddd7a5-65eb-474c-b7e5-0648cd1aa9f4 tempest-VolumeDependencyTests-738066002 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:12:42 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-5cddd7a5-65eb-474c-b7e5-0648cd1aa9f4 tempest-VolumeDependencyTests-738066002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:12:42 devstack sudo[102864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a Sep 07 10:12:42 devstack sudo[102864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:12:42 devstack sudo[102864]: pam_unix(sudo:session): session closed for user root Sep 07 10:12:42 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-5cddd7a5-65eb-474c-b7e5-0648cd1aa9f4 tempest-VolumeDependencyTests-738066002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a" returned: 0 in 0.301s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:12:42 devstack cinder-volume[87515]: DEBUG cinder.manager [None req-5cddd7a5-65eb-474c-b7e5-0648cd1aa9f4 tempest-VolumeDependencyTests-738066002 None] Notifying Schedulers of capabilities ... {{(pid=87515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:12:42 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-5cddd7a5-65eb-474c-b7e5-0648cd1aa9f4 tempest-VolumeDependencyTests-738066002 None] Deleted volume successfully. Sep 07 10:12:42 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-5cddd7a5-65eb-474c-b7e5-0648cd1aa9f4 tempest-VolumeDependencyTests-738066002 None] Lock "cinder-35815792-df58-4e4a-bf0f-8d808b7556c0-delete_volume" released by "delete_volume" :: held 1.495s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:12:43 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-d359889f-002c-423d-b416-f2d4ffaef83b tempest-VolumeDependencyTests-738066002 None] Acquiring lock "cinder-b0c8657d-a55d-4ca7-a230-f755fac06743-delete_volume" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:12:43 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-d359889f-002c-423d-b416-f2d4ffaef83b tempest-VolumeDependencyTests-738066002 None] Lock "cinder-b0c8657d-a55d-4ca7-a230-f755fac06743-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:12:43 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-d359889f-002c-423d-b416-f2d4ffaef83b tempest-VolumeDependencyTests-738066002 None] Acquiring lock "cinder-quobyte-b0c8657d-a55d-4ca7-a230-f755fac06743" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:12:43 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-d359889f-002c-423d-b416-f2d4ffaef83b tempest-VolumeDependencyTests-738066002 None] Lock "cinder-quobyte-b0c8657d-a55d-4ca7-a230-f755fac06743" acquired by "delete_volume" :: waited 0.022s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:12:43 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2baa11c-c86b-4733-9366-18eafa496db0]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:12:43 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-d359889f-002c-423d-b416-f2d4ffaef83b tempest-VolumeDependencyTests-738066002 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-b0c8657d-a55d-4ca7-a230-f755fac06743 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:12:43 devstack sudo[102867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-b0c8657d-a55d-4ca7-a230-f755fac06743 Sep 07 10:12:43 devstack sudo[102867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:12:43 devstack sudo[102867]: pam_unix(sudo:session): session closed for user root Sep 07 10:12:43 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-d359889f-002c-423d-b416-f2d4ffaef83b tempest-VolumeDependencyTests-738066002 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-b0c8657d-a55d-4ca7-a230-f755fac06743" returned: 0 in 0.394s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:12:43 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-d359889f-002c-423d-b416-f2d4ffaef83b tempest-VolumeDependencyTests-738066002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-b0c8657d-a55d-4ca7-a230-f755fac06743 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:12:43 devstack sudo[102873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-b0c8657d-a55d-4ca7-a230-f755fac06743 Sep 07 10:12:43 devstack sudo[102873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:12:44 devstack sudo[102873]: pam_unix(sudo:session): session closed for user root Sep 07 10:12:44 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-d359889f-002c-423d-b416-f2d4ffaef83b tempest-VolumeDependencyTests-738066002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-b0c8657d-a55d-4ca7-a230-f755fac06743" returned: 0 in 0.286s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:12:44 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-d359889f-002c-423d-b416-f2d4ffaef83b tempest-VolumeDependencyTests-738066002 None] Lock "cinder-quobyte-b0c8657d-a55d-4ca7-a230-f755fac06743" released by "delete_volume" :: held 0.742s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:12:44 devstack cinder-volume[87515]: DEBUG cinder.quota [None req-d359889f-002c-423d-b416-f2d4ffaef83b tempest-VolumeDependencyTests-738066002 None] Created reservations ['e05e73e5-1604-4096-9b02-234ba5c98ef4', 'da53a6a9-6c69-4034-9c05-0a130597821d', '86af510a-929d-46a7-9391-37582b4c4648', '9c65079b-3e5e-4ea5-b5cd-6136f8a4a974'] {{(pid=87515) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:12:44 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-d359889f-002c-423d-b416-f2d4ffaef83b tempest-VolumeDependencyTests-738066002 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:12:44 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-d359889f-002c-423d-b416-f2d4ffaef83b tempest-VolumeDependencyTests-738066002 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:12:44 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-d359889f-002c-423d-b416-f2d4ffaef83b tempest-VolumeDependencyTests-738066002 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:12:44 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-d359889f-002c-423d-b416-f2d4ffaef83b tempest-VolumeDependencyTests-738066002 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:12:44 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-d359889f-002c-423d-b416-f2d4ffaef83b tempest-VolumeDependencyTests-738066002 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:12:44 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-d359889f-002c-423d-b416-f2d4ffaef83b tempest-VolumeDependencyTests-738066002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:12:44 devstack sudo[102876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a Sep 07 10:12:44 devstack sudo[102876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:12:44 devstack sudo[102876]: pam_unix(sudo:session): session closed for user root Sep 07 10:12:44 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-d359889f-002c-423d-b416-f2d4ffaef83b tempest-VolumeDependencyTests-738066002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a" returned: 0 in 0.296s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:12:44 devstack cinder-volume[87515]: DEBUG cinder.manager [None req-d359889f-002c-423d-b416-f2d4ffaef83b tempest-VolumeDependencyTests-738066002 None] Notifying Schedulers of capabilities ... {{(pid=87515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:12:44 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-d359889f-002c-423d-b416-f2d4ffaef83b tempest-VolumeDependencyTests-738066002 None] Deleted volume successfully. Sep 07 10:12:44 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-d359889f-002c-423d-b416-f2d4ffaef83b tempest-VolumeDependencyTests-738066002 None] Lock "cinder-b0c8657d-a55d-4ca7-a230-f755fac06743-delete_volume" released by "delete_volume" :: held 1.295s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:12:45 devstack cinder-volume[87515]: DEBUG cinder.volume.flows.manager.create_volume [None req-ea6fc2b7-d38c-4ca1-95cf-545e9279aa24 tempest-VolumesNegativeTest-1022966118 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 10:12:45 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-ea6fc2b7-d38c-4ca1-95cf-545e9279aa24 tempest-VolumesNegativeTest-1022966118 None] Flow 'volume_create_manager' (e955d577-4bf5-4017-a8c7-1259f197d9e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:12:45 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-ea6fc2b7-d38c-4ca1-95cf-545e9279aa24 tempest-VolumesNegativeTest-1022966118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d0bc607-4dce-4104-aa13-d6f0dabca915) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:12:45 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-ea6fc2b7-d38c-4ca1-95cf-545e9279aa24 tempest-VolumesNegativeTest-1022966118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d0bc607-4dce-4104-aa13-d6f0dabca915) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:12:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-735025128',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b7207a8-9de0-492a-a7df-004ab2fe2969,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9f7d77670794092ad89ebb1022e505f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:12:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:12:45Z,use_quota=True,user_id='7c23938a4a0e4786a2b50b269283e3aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3a092cd-7947-4cbf-abff-4ba9567becf0),volume_type_id=f3a092cd-7947-4cbf-abff-4ba9567becf0)' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:12:45 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-ea6fc2b7-d38c-4ca1-95cf-545e9279aa24 tempest-VolumesNegativeTest-1022966118 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b6a545f-53c2-4893-a64d-08078c898451) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:12:45 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-ea6fc2b7-d38c-4ca1-95cf-545e9279aa24 tempest-VolumesNegativeTest-1022966118 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b6a545f-53c2-4893-a64d-08078c898451) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:12:45 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-ea6fc2b7-d38c-4ca1-95cf-545e9279aa24 tempest-VolumesNegativeTest-1022966118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30138866-1219-43d4-ac57-66685ab671f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:12:45 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-ea6fc2b7-d38c-4ca1-95cf-545e9279aa24 tempest-VolumesNegativeTest-1022966118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30138866-1219-43d4-ac57-66685ab671f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3b7207a8-9de0-492a-a7df-004ab2fe2969', 'volume_name': 'volume-3b7207a8-9de0-492a-a7df-004ab2fe2969', 'volume_size': 1}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:12:45 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-ea6fc2b7-d38c-4ca1-95cf-545e9279aa24 tempest-VolumesNegativeTest-1022966118 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee9e6cc6-cdf2-4ef8-a322-9d668bc66ce3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:12:45 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-ea6fc2b7-d38c-4ca1-95cf-545e9279aa24 tempest-VolumesNegativeTest-1022966118 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee9e6cc6-cdf2-4ef8-a322-9d668bc66ce3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:12:45 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-ea6fc2b7-d38c-4ca1-95cf-545e9279aa24 tempest-VolumesNegativeTest-1022966118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2cabca1-2dd0-411c-813e-716bd7f365b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:12:45 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-ea6fc2b7-d38c-4ca1-95cf-545e9279aa24 tempest-VolumesNegativeTest-1022966118 None] Volume 3b7207a8-9de0-492a-a7df-004ab2fe2969: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3b7207a8-9de0-492a-a7df-004ab2fe2969', 'volume_size': 1} Sep 07 10:12:45 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-ea6fc2b7-d38c-4ca1-95cf-545e9279aa24 tempest-VolumesNegativeTest-1022966118 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:12:45 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-ea6fc2b7-d38c-4ca1-95cf-545e9279aa24 tempest-VolumesNegativeTest-1022966118 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:12:45 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-ea6fc2b7-d38c-4ca1-95cf-545e9279aa24 tempest-VolumesNegativeTest-1022966118 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:12:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-735025128',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b7207a8-9de0-492a-a7df-004ab2fe2969,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9f7d77670794092ad89ebb1022e505f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:12:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:12:45Z,use_quota=True,user_id='7c23938a4a0e4786a2b50b269283e3aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3a092cd-7947-4cbf-abff-4ba9567becf0),volume_type_id=f3a092cd-7947-4cbf-abff-4ba9567becf0)}" {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 10:12:45 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-ea6fc2b7-d38c-4ca1-95cf-545e9279aa24 tempest-VolumesNegativeTest-1022966118 None] Creating volume 3b7207a8-9de0-492a-a7df-004ab2fe2969 {{(pid=87515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 10:12:45 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-ea6fc2b7-d38c-4ca1-95cf-545e9279aa24 tempest-VolumesNegativeTest-1022966118 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:12:45 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-ea6fc2b7-d38c-4ca1-95cf-545e9279aa24 tempest-VolumesNegativeTest-1022966118 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:12:45 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-ea6fc2b7-d38c-4ca1-95cf-545e9279aa24 tempest-VolumesNegativeTest-1022966118 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:12:45 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-ea6fc2b7-d38c-4ca1-95cf-545e9279aa24 tempest-VolumesNegativeTest-1022966118 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:12:45 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-ea6fc2b7-d38c-4ca1-95cf-545e9279aa24 tempest-VolumesNegativeTest-1022966118 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:12:45 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-ea6fc2b7-d38c-4ca1-95cf-545e9279aa24 tempest-VolumesNegativeTest-1022966118 None] Selected osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c as target Quobyte volume. {{(pid=87515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 10:12:45 devstack cinder-volume[87515]: INFO cinder.volume.drivers.remotefs [None req-ea6fc2b7-d38c-4ca1-95cf-545e9279aa24 tempest-VolumesNegativeTest-1022966118 None] casted to osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c Sep 07 10:12:45 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-ea6fc2b7-d38c-4ca1-95cf-545e9279aa24 tempest-VolumesNegativeTest-1022966118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-3b7207a8-9de0-492a-a7df-004ab2fe2969 1073741824 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:12:45 devstack sudo[102882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-3b7207a8-9de0-492a-a7df-004ab2fe2969 1073741824 Sep 07 10:12:45 devstack sudo[102882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:12:45 devstack sudo[102882]: pam_unix(sudo:session): session closed for user root Sep 07 10:12:45 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-ea6fc2b7-d38c-4ca1-95cf-545e9279aa24 tempest-VolumesNegativeTest-1022966118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-3b7207a8-9de0-492a-a7df-004ab2fe2969 1073741824" returned: 0 in 0.591s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:12:45 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-ea6fc2b7-d38c-4ca1-95cf-545e9279aa24 tempest-VolumesNegativeTest-1022966118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-3b7207a8-9de0-492a-a7df-004ab2fe2969 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:12:45 devstack sudo[102888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-3b7207a8-9de0-492a-a7df-004ab2fe2969 Sep 07 10:12:45 devstack sudo[102888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:12:46 devstack sudo[102888]: pam_unix(sudo:session): session closed for user root Sep 07 10:12:46 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-ea6fc2b7-d38c-4ca1-95cf-545e9279aa24 tempest-VolumesNegativeTest-1022966118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-3b7207a8-9de0-492a-a7df-004ab2fe2969" returned: 0 in 0.289s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:12:46 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-ea6fc2b7-d38c-4ca1-95cf-545e9279aa24 tempest-VolumesNegativeTest-1022966118 None] <== create_volume: return (935ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'} {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 10:12:46 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-ea6fc2b7-d38c-4ca1-95cf-545e9279aa24 tempest-VolumesNegativeTest-1022966118 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.940s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:12:46 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-ea6fc2b7-d38c-4ca1-95cf-545e9279aa24 tempest-VolumesNegativeTest-1022966118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2cabca1-2dd0-411c-813e-716bd7f365b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3b7207a8-9de0-492a-a7df-004ab2fe2969', 'volume_size': 1}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:12:46 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-ea6fc2b7-d38c-4ca1-95cf-545e9279aa24 tempest-VolumesNegativeTest-1022966118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90d5361d-9dd7-4b06-9e00-9e9755c738d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:12:46 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-ea6fc2b7-d38c-4ca1-95cf-545e9279aa24 tempest-VolumesNegativeTest-1022966118 None] Volume volume-3b7207a8-9de0-492a-a7df-004ab2fe2969 (3b7207a8-9de0-492a-a7df-004ab2fe2969): created successfully Sep 07 10:12:46 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-ea6fc2b7-d38c-4ca1-95cf-545e9279aa24 tempest-VolumesNegativeTest-1022966118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90d5361d-9dd7-4b06-9e00-9e9755c738d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:12:46 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-ea6fc2b7-d38c-4ca1-95cf-545e9279aa24 tempest-VolumesNegativeTest-1022966118 None] Flow 'volume_create_manager' (e955d577-4bf5-4017-a8c7-1259f197d9e6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:12:46 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-ea6fc2b7-d38c-4ca1-95cf-545e9279aa24 tempest-VolumesNegativeTest-1022966118 None] Created volume successfully. Sep 07 10:12:55 devstack cinder-volume[87515]: DEBUG cinder.volume.flows.manager.create_volume [None req-7650b8f3-1c20-4635-83e8-36f761be878a tempest-VolumeImageDependencyTests-1340467103 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 10:12:55 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-7650b8f3-1c20-4635-83e8-36f761be878a tempest-VolumeImageDependencyTests-1340467103 None] Flow 'volume_create_manager' (c24cce1a-0c4f-4afe-ac60-0dfc2bcc6a8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:12:55 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-7650b8f3-1c20-4635-83e8-36f761be878a tempest-VolumeImageDependencyTests-1340467103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4517564b-a2a4-46b1-93a9-b9ecb5de11fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:12:55 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-7650b8f3-1c20-4635-83e8-36f761be878a tempest-VolumeImageDependencyTests-1340467103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4517564b-a2a4-46b1-93a9-b9ecb5de11fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:12:53Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=739933f0-89f9-4c4c-baf1-62016504bc16,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5bfb5ef4f7f4ca49e7b3afa7b32d48f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:12:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:12:56Z,use_quota=True,user_id='73c28f2f320e491fb580db8622d59945',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3a092cd-7947-4cbf-abff-4ba9567becf0),volume_type_id=f3a092cd-7947-4cbf-abff-4ba9567becf0)' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:12:55 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-7650b8f3-1c20-4635-83e8-36f761be878a tempest-VolumeImageDependencyTests-1340467103 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff3a748b-189b-4202-aeff-cef9ed04b220) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:12:55 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-7650b8f3-1c20-4635-83e8-36f761be878a tempest-VolumeImageDependencyTests-1340467103 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff3a748b-189b-4202-aeff-cef9ed04b220) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:12:55 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-7650b8f3-1c20-4635-83e8-36f761be878a tempest-VolumeImageDependencyTests-1340467103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfe82b56-6531-4718-bb87-d74ddf177dbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:12:55 devstack cinder-volume[87515]: DEBUG cinder.image.glance [None req-7650b8f3-1c20-4635-83e8-36f761be878a tempest-VolumeImageDependencyTests-1340467103 None] Creating Keystone auth plugin from conf {{(pid=87515) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 07 10:12:56 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-7650b8f3-1c20-4635-83e8-36f761be878a tempest-VolumeImageDependencyTests-1340467103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfe82b56-6531-4718-bb87-d74ddf177dbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '739933f0-89f9-4c4c-baf1-62016504bc16', 'volume_name': 'volume-739933f0-89f9-4c4c-baf1-62016504bc16', 'volume_size': 1, 'image_id': '19392b3b-c7ec-45c3-800f-66044e971f36', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/19392b3b-c7ec-45c3-800f-66044e971f36', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '31bce7b45ac5ba9406cf2ca3a4d7aa39', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'b5bfb5ef4f7f4ca49e7b3afa7b32d48f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9b9360775a99a6b09a45fd8a0493b53ef7c2d324515eb1de23e2ffe42bfabc48d018c043c8151ca64107d4657230dc776f772c545169dd1cb2d4123db3c13a97', 'id': '19392b3b-c7ec-45c3-800f-66044e971f36', 'created_at': datetime.datetime(2026, 9, 7, 8, 12, 49, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 7, 8, 12, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/19392b3b-c7ec-45c3-800f-66044e971f36/file', 'properties': {}}, 'image_service': }' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:12:56 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-7650b8f3-1c20-4635-83e8-36f761be878a tempest-VolumeImageDependencyTests-1340467103 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c29f3b7-7a51-4bd6-b48e-a49d7c6f2456) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:12:56 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-7650b8f3-1c20-4635-83e8-36f761be878a tempest-VolumeImageDependencyTests-1340467103 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c29f3b7-7a51-4bd6-b48e-a49d7c6f2456) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:12:56 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-7650b8f3-1c20-4635-83e8-36f761be878a tempest-VolumeImageDependencyTests-1340467103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bdaab15d-c035-45a5-a6e7-0105b7bd4610) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:12:56 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-7650b8f3-1c20-4635-83e8-36f761be878a tempest-VolumeImageDependencyTests-1340467103 None] Volume 739933f0-89f9-4c4c-baf1-62016504bc16: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-739933f0-89f9-4c4c-baf1-62016504bc16', 'volume_size': 1, 'image_id': '19392b3b-c7ec-45c3-800f-66044e971f36', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/19392b3b-c7ec-45c3-800f-66044e971f36', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '31bce7b45ac5ba9406cf2ca3a4d7aa39', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'b5bfb5ef4f7f4ca49e7b3afa7b32d48f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9b9360775a99a6b09a45fd8a0493b53ef7c2d324515eb1de23e2ffe42bfabc48d018c043c8151ca64107d4657230dc776f772c545169dd1cb2d4123db3c13a97', 'id': '19392b3b-c7ec-45c3-800f-66044e971f36', 'created_at': datetime.datetime(2026, 9, 7, 8, 12, 49, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 7, 8, 12, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/19392b3b-c7ec-45c3-800f-66044e971f36/file', 'properties': {}}, 'image_service': } Sep 07 10:12:56 devstack cinder-volume[87515]: DEBUG cinder.volume.flows.manager.create_volume [None req-7650b8f3-1c20-4635-83e8-36f761be878a tempest-VolumeImageDependencyTests-1340467103 None] Trying to clone 739933f0-89f9-4c4c-baf1-62016504bc16 from image 19392b3b-c7ec-45c3-800f-66044e971f36 at location (None, [{'url': 'file:///opt/stack/data/glance/images/19392b3b-c7ec-45c3-800f-66044e971f36', 'metadata': {}}]). {{(pid=87515) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 07 10:12:56 devstack cinder-volume[87515]: DEBUG cinder.image.image_utils [None req-7650b8f3-1c20-4635-83e8-36f761be878a tempest-VolumeImageDependencyTests-1340467103 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_19392b3b-c7ec-45c3-800f-66044e971f36_s04b02rsdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87515) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 07 10:12:56 devstack cinder-volume[87515]: INFO cinder.image.image_utils [None req-7650b8f3-1c20-4635-83e8-36f761be878a tempest-VolumeImageDependencyTests-1340467103 None] Image download 0.00 MB at 0.00 MB/s Sep 07 10:12:56 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[424b75a1-1a94-4a21-9dbf-1956413e1b94]: (4, 'raw') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:12:56 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-7650b8f3-1c20-4635-83e8-36f761be878a tempest-VolumeImageDependencyTests-1340467103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_19392b3b-c7ec-45c3-800f-66044e971f36_s04b02rsdevstack@QuobyteHD {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:12:56 devstack sudo[103003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_19392b3b-c7ec-45c3-800f-66044e971f36_s04b02rsdevstack@QuobyteHD Sep 07 10:12:56 devstack sudo[103003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:12:56 devstack sudo[103003]: pam_unix(sudo:session): session closed for user root Sep 07 10:12:56 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-7650b8f3-1c20-4635-83e8-36f761be878a tempest-VolumeImageDependencyTests-1340467103 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_19392b3b-c7ec-45c3-800f-66044e971f36_s04b02rsdevstack@QuobyteHD" returned: 0 in 0.430s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:12:56 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-7650b8f3-1c20-4635-83e8-36f761be878a tempest-VolumeImageDependencyTests-1340467103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_19392b3b-c7ec-45c3-800f-66044e971f36_s04b02rsdevstack@QuobyteHD {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:12:56 devstack sudo[103008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_19392b3b-c7ec-45c3-800f-66044e971f36_s04b02rsdevstack@QuobyteHD Sep 07 10:12:56 devstack sudo[103008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:12:57 devstack sudo[103008]: pam_unix(sudo:session): session closed for user root Sep 07 10:12:57 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-7650b8f3-1c20-4635-83e8-36f761be878a tempest-VolumeImageDependencyTests-1340467103 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_19392b3b-c7ec-45c3-800f-66044e971f36_s04b02rsdevstack@QuobyteHD" returned: 1 in 0.484s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:12:57 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-7650b8f3-1c20-4635-83e8-36f761be878a tempest-VolumeImageDependencyTests-1340467103 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_19392b3b-c7ec-45c3-800f-66044e971f36_s04b02rsdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 07 10:12:57 devstack cinder-volume[87515]: DEBUG cinder.image.image_utils [None req-7650b8f3-1c20-4635-83e8-36f761be878a tempest-VolumeImageDependencyTests-1340467103 None] Temporary image 19392b3b-c7ec-45c3-800f-66044e971f36 is fetched for user 73c28f2f320e491fb580db8622d59945. {{(pid=87515) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 07 10:12:57 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[83d975b2-7010-4b77-8dc2-408f7d45d12d]: (4, 'raw') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:12:57 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-7650b8f3-1c20-4635-83e8-36f761be878a tempest-VolumeImageDependencyTests-1340467103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_19392b3b-c7ec-45c3-800f-66044e971f36_s04b02rsdevstack@QuobyteHD {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:12:57 devstack sudo[103013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_19392b3b-c7ec-45c3-800f-66044e971f36_s04b02rsdevstack@QuobyteHD Sep 07 10:12:57 devstack sudo[103013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:12:58 devstack sudo[103013]: pam_unix(sudo:session): session closed for user root Sep 07 10:12:58 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-7650b8f3-1c20-4635-83e8-36f761be878a tempest-VolumeImageDependencyTests-1340467103 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_19392b3b-c7ec-45c3-800f-66044e971f36_s04b02rsdevstack@QuobyteHD" returned: 0 in 0.925s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:12:58 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-7650b8f3-1c20-4635-83e8-36f761be878a tempest-VolumeImageDependencyTests-1340467103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_19392b3b-c7ec-45c3-800f-66044e971f36_s04b02rsdevstack@QuobyteHD {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:12:58 devstack sudo[103054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_19392b3b-c7ec-45c3-800f-66044e971f36_s04b02rsdevstack@QuobyteHD Sep 07 10:12:58 devstack sudo[103054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:12:59 devstack sudo[103054]: pam_unix(sudo:session): session closed for user root Sep 07 10:12:59 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-7650b8f3-1c20-4635-83e8-36f761be878a tempest-VolumeImageDependencyTests-1340467103 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_19392b3b-c7ec-45c3-800f-66044e971f36_s04b02rsdevstack@QuobyteHD" returned: 1 in 0.941s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:12:59 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-7650b8f3-1c20-4635-83e8-36f761be878a tempest-VolumeImageDependencyTests-1340467103 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_19392b3b-c7ec-45c3-800f-66044e971f36_s04b02rsdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 07 10:12:59 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-7650b8f3-1c20-4635-83e8-36f761be878a tempest-VolumeImageDependencyTests-1340467103 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:12:59 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-7650b8f3-1c20-4635-83e8-36f761be878a tempest-VolumeImageDependencyTests-1340467103 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.013s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:12:59 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-7650b8f3-1c20-4635-83e8-36f761be878a tempest-VolumeImageDependencyTests-1340467103 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:12:53Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=739933f0-89f9-4c4c-baf1-62016504bc16,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5bfb5ef4f7f4ca49e7b3afa7b32d48f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:12:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:12:56Z,use_quota=True,user_id='73c28f2f320e491fb580db8622d59945',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3a092cd-7947-4cbf-abff-4ba9567becf0),volume_type_id=f3a092cd-7947-4cbf-abff-4ba9567becf0)}" {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 10:12:59 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-7650b8f3-1c20-4635-83e8-36f761be878a tempest-VolumeImageDependencyTests-1340467103 None] Creating volume 739933f0-89f9-4c4c-baf1-62016504bc16 {{(pid=87515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 10:12:59 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-7650b8f3-1c20-4635-83e8-36f761be878a tempest-VolumeImageDependencyTests-1340467103 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:12:59 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-7650b8f3-1c20-4635-83e8-36f761be878a tempest-VolumeImageDependencyTests-1340467103 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:12:59 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-7650b8f3-1c20-4635-83e8-36f761be878a tempest-VolumeImageDependencyTests-1340467103 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:12:59 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-7650b8f3-1c20-4635-83e8-36f761be878a tempest-VolumeImageDependencyTests-1340467103 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:12:59 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-7650b8f3-1c20-4635-83e8-36f761be878a tempest-VolumeImageDependencyTests-1340467103 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:12:59 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-7650b8f3-1c20-4635-83e8-36f761be878a tempest-VolumeImageDependencyTests-1340467103 None] Selected osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c as target Quobyte volume. {{(pid=87515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 10:12:59 devstack cinder-volume[87515]: INFO cinder.volume.drivers.remotefs [None req-7650b8f3-1c20-4635-83e8-36f761be878a tempest-VolumeImageDependencyTests-1340467103 None] casted to osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c Sep 07 10:12:59 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-7650b8f3-1c20-4635-83e8-36f761be878a tempest-VolumeImageDependencyTests-1340467103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-739933f0-89f9-4c4c-baf1-62016504bc16 1073741824 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:12:59 devstack sudo[103087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-739933f0-89f9-4c4c-baf1-62016504bc16 1073741824 Sep 07 10:12:59 devstack sudo[103087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:13:00 devstack sudo[103087]: pam_unix(sudo:session): session closed for user root Sep 07 10:13:00 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-7650b8f3-1c20-4635-83e8-36f761be878a tempest-VolumeImageDependencyTests-1340467103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-739933f0-89f9-4c4c-baf1-62016504bc16 1073741824" returned: 0 in 0.848s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:13:00 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-7650b8f3-1c20-4635-83e8-36f761be878a tempest-VolumeImageDependencyTests-1340467103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-739933f0-89f9-4c4c-baf1-62016504bc16 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:13:00 devstack sudo[103099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-739933f0-89f9-4c4c-baf1-62016504bc16 Sep 07 10:13:00 devstack sudo[103099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:13:00 devstack sudo[103099]: pam_unix(sudo:session): session closed for user root Sep 07 10:13:00 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-7650b8f3-1c20-4635-83e8-36f761be878a tempest-VolumeImageDependencyTests-1340467103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-739933f0-89f9-4c4c-baf1-62016504bc16" returned: 0 in 0.679s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:13:00 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-7650b8f3-1c20-4635-83e8-36f761be878a tempest-VolumeImageDependencyTests-1340467103 None] <== create_volume: return (1658ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'} {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 10:13:00 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-7650b8f3-1c20-4635-83e8-36f761be878a tempest-VolumeImageDependencyTests-1340467103 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.667s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:13:00 devstack cinder-volume[87515]: DEBUG cinder.volume.volume_utils [None req-7650b8f3-1c20-4635-83e8-36f761be878a tempest-VolumeImageDependencyTests-1340467103 None] Attempting download of 19392b3b-c7ec-45c3-800f-66044e971f36 ((None, [{'url': 'file:///opt/stack/data/glance/images/19392b3b-c7ec-45c3-800f-66044e971f36', 'metadata': {}}])) to volume 739933f0-89f9-4c4c-baf1-62016504bc16. {{(pid=87515) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 07 10:13:01 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb98de45-c284-4859-81fe-a80597dce72e]: (4, 'raw') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:13:01 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-7650b8f3-1c20-4635-83e8-36f761be878a tempest-VolumeImageDependencyTests-1340467103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_19392b3b-c7ec-45c3-800f-66044e971f36_7ir0rgdv {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:13:01 devstack sudo[103103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_19392b3b-c7ec-45c3-800f-66044e971f36_7ir0rgdv Sep 07 10:13:01 devstack sudo[103103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:13:01 devstack sudo[103103]: pam_unix(sudo:session): session closed for user root Sep 07 10:13:01 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-7650b8f3-1c20-4635-83e8-36f761be878a tempest-VolumeImageDependencyTests-1340467103 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_19392b3b-c7ec-45c3-800f-66044e971f36_7ir0rgdv" returned: 0 in 0.541s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:13:01 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-7650b8f3-1c20-4635-83e8-36f761be878a tempest-VolumeImageDependencyTests-1340467103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_19392b3b-c7ec-45c3-800f-66044e971f36_7ir0rgdv {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:13:01 devstack sudo[103111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_19392b3b-c7ec-45c3-800f-66044e971f36_7ir0rgdv Sep 07 10:13:01 devstack sudo[103111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:13:01 devstack sudo[103111]: pam_unix(sudo:session): session closed for user root Sep 07 10:13:02 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-7650b8f3-1c20-4635-83e8-36f761be878a tempest-VolumeImageDependencyTests-1340467103 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_19392b3b-c7ec-45c3-800f-66044e971f36_7ir0rgdv" returned: 1 in 0.370s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:13:02 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-7650b8f3-1c20-4635-83e8-36f761be878a tempest-VolumeImageDependencyTests-1340467103 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_19392b3b-c7ec-45c3-800f-66044e971f36_7ir0rgdv' failed. Not Retrying. {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 07 10:13:02 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[286dd43f-6a83-4fae-a048-6bf26b16e5c6]: (4, 'raw') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:13:02 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-7650b8f3-1c20-4635-83e8-36f761be878a tempest-VolumeImageDependencyTests-1340467103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_19392b3b-c7ec-45c3-800f-66044e971f36_s04b02rsdevstack@QuobyteHD {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:13:02 devstack sudo[103125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_19392b3b-c7ec-45c3-800f-66044e971f36_s04b02rsdevstack@QuobyteHD Sep 07 10:13:02 devstack sudo[103125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:13:02 devstack sudo[103125]: pam_unix(sudo:session): session closed for user root Sep 07 10:13:02 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-7650b8f3-1c20-4635-83e8-36f761be878a tempest-VolumeImageDependencyTests-1340467103 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_19392b3b-c7ec-45c3-800f-66044e971f36_s04b02rsdevstack@QuobyteHD" returned: 0 in 0.524s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:13:02 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-7650b8f3-1c20-4635-83e8-36f761be878a tempest-VolumeImageDependencyTests-1340467103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_19392b3b-c7ec-45c3-800f-66044e971f36_s04b02rsdevstack@QuobyteHD {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:13:02 devstack sudo[103130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_19392b3b-c7ec-45c3-800f-66044e971f36_s04b02rsdevstack@QuobyteHD Sep 07 10:13:02 devstack sudo[103130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:13:03 devstack sudo[103130]: pam_unix(sudo:session): session closed for user root Sep 07 10:13:03 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-7650b8f3-1c20-4635-83e8-36f761be878a tempest-VolumeImageDependencyTests-1340467103 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_19392b3b-c7ec-45c3-800f-66044e971f36_s04b02rsdevstack@QuobyteHD" returned: 1 in 0.473s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:13:03 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-7650b8f3-1c20-4635-83e8-36f761be878a tempest-VolumeImageDependencyTests-1340467103 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_19392b3b-c7ec-45c3-800f-66044e971f36_s04b02rsdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 07 10:13:03 devstack cinder-volume[87515]: DEBUG cinder.image.image_utils [None req-7650b8f3-1c20-4635-83e8-36f761be878a tempest-VolumeImageDependencyTests-1340467103 None] 19392b3b-c7ec-45c3-800f-66044e971f36 was raw, converting to qcow2 {{(pid=87515) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 07 10:13:03 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-7650b8f3-1c20-4635-83e8-36f761be878a tempest-VolumeImageDependencyTests-1340467103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_19392b3b-c7ec-45c3-800f-66044e971f36_s04b02rsdevstack@QuobyteHD /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-739933f0-89f9-4c4c-baf1-62016504bc16 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:13:03 devstack sudo[103136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_19392b3b-c7ec-45c3-800f-66044e971f36_s04b02rsdevstack@QuobyteHD /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-739933f0-89f9-4c4c-baf1-62016504bc16 Sep 07 10:13:03 devstack sudo[103136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:13:03 devstack sudo[103136]: pam_unix(sudo:session): session closed for user root Sep 07 10:13:03 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-7650b8f3-1c20-4635-83e8-36f761be878a tempest-VolumeImageDependencyTests-1340467103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_19392b3b-c7ec-45c3-800f-66044e971f36_s04b02rsdevstack@QuobyteHD /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-739933f0-89f9-4c4c-baf1-62016504bc16" returned: 0 in 0.686s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:13:03 devstack cinder-volume[87515]: DEBUG cinder.image.image_utils [None req-7650b8f3-1c20-4635-83e8-36f761be878a tempest-VolumeImageDependencyTests-1340467103 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_19392b3b-c7ec-45c3-800f-66044e971f36_s04b02rsdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-739933f0-89f9-4c4c-baf1-62016504bc16 {{(pid=87515) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 07 10:13:03 devstack cinder-volume[87515]: INFO cinder.image.image_utils [None req-7650b8f3-1c20-4635-83e8-36f761be878a tempest-VolumeImageDependencyTests-1340467103 None] Converted 0.00 MB image at 0.00 MB/s Sep 07 10:13:03 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-7650b8f3-1c20-4635-83e8-36f761be878a tempest-VolumeImageDependencyTests-1340467103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-739933f0-89f9-4c4c-baf1-62016504bc16 1G {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:13:03 devstack sudo[103163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-739933f0-89f9-4c4c-baf1-62016504bc16 1G Sep 07 10:13:03 devstack sudo[103163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:13:04 devstack sudo[103163]: pam_unix(sudo:session): session closed for user root Sep 07 10:13:04 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-7650b8f3-1c20-4635-83e8-36f761be878a tempest-VolumeImageDependencyTests-1340467103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-739933f0-89f9-4c4c-baf1-62016504bc16 1G" returned: 0 in 0.397s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:13:04 devstack cinder-volume[87515]: DEBUG cinder.volume.volume_utils [None req-7650b8f3-1c20-4635-83e8-36f761be878a tempest-VolumeImageDependencyTests-1340467103 None] Downloaded image 19392b3b-c7ec-45c3-800f-66044e971f36 ((None, [{'url': 'file:///opt/stack/data/glance/images/19392b3b-c7ec-45c3-800f-66044e971f36', 'metadata': {}}])) to volume 739933f0-89f9-4c4c-baf1-62016504bc16 successfully. {{(pid=87515) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 07 10:13:04 devstack cinder-volume[87515]: DEBUG cinder.image.image_utils [None req-7650b8f3-1c20-4635-83e8-36f761be878a tempest-VolumeImageDependencyTests-1340467103 None] Temporary image 19392b3b-c7ec-45c3-800f-66044e971f36 for user 73c28f2f320e491fb580db8622d59945 is deleted. {{(pid=87515) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 07 10:13:04 devstack cinder-volume[87515]: DEBUG cinder.volume.volume_utils [None req-7650b8f3-1c20-4635-83e8-36f761be878a tempest-VolumeImageDependencyTests-1340467103 None] Marking volume 739933f0-89f9-4c4c-baf1-62016504bc16 as bootable. {{(pid=87515) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 07 10:13:04 devstack cinder-volume[87515]: DEBUG cinder.volume.flows.manager.create_volume [None req-7650b8f3-1c20-4635-83e8-36f761be878a tempest-VolumeImageDependencyTests-1340467103 None] Copying metadata from image 19392b3b-c7ec-45c3-800f-66044e971f36 to 739933f0-89f9-4c4c-baf1-62016504bc16. {{(pid=87515) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 07 10:13:04 devstack cinder-volume[87515]: DEBUG cinder.volume.flows.manager.create_volume [None req-7650b8f3-1c20-4635-83e8-36f761be878a tempest-VolumeImageDependencyTests-1340467103 None] Creating volume glance metadata for volume 739933f0-89f9-4c4c-baf1-62016504bc16 backed by image 19392b3b-c7ec-45c3-800f-66044e971f36 with: {'image_id': '19392b3b-c7ec-45c3-800f-66044e971f36', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '31bce7b45ac5ba9406cf2ca3a4d7aa39', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87515) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 07 10:13:04 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-7650b8f3-1c20-4635-83e8-36f761be878a tempest-VolumeImageDependencyTests-1340467103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bdaab15d-c035-45a5-a6e7-0105b7bd4610) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-739933f0-89f9-4c4c-baf1-62016504bc16', 'volume_size': 1, 'image_id': '19392b3b-c7ec-45c3-800f-66044e971f36', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/19392b3b-c7ec-45c3-800f-66044e971f36', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '31bce7b45ac5ba9406cf2ca3a4d7aa39', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'b5bfb5ef4f7f4ca49e7b3afa7b32d48f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9b9360775a99a6b09a45fd8a0493b53ef7c2d324515eb1de23e2ffe42bfabc48d018c043c8151ca64107d4657230dc776f772c545169dd1cb2d4123db3c13a97', 'id': '19392b3b-c7ec-45c3-800f-66044e971f36', 'created_at': datetime.datetime(2026, 9, 7, 8, 12, 49, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 7, 8, 12, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/19392b3b-c7ec-45c3-800f-66044e971f36/file', 'properties': {}}, 'image_service': }' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:13:04 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-7650b8f3-1c20-4635-83e8-36f761be878a tempest-VolumeImageDependencyTests-1340467103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5bd96b2b-4544-4e90-aaf7-ee179a1f9232) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:13:04 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-7650b8f3-1c20-4635-83e8-36f761be878a tempest-VolumeImageDependencyTests-1340467103 None] Volume volume-739933f0-89f9-4c4c-baf1-62016504bc16 (739933f0-89f9-4c4c-baf1-62016504bc16): created successfully Sep 07 10:13:04 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-7650b8f3-1c20-4635-83e8-36f761be878a tempest-VolumeImageDependencyTests-1340467103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5bd96b2b-4544-4e90-aaf7-ee179a1f9232) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:13:04 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-7650b8f3-1c20-4635-83e8-36f761be878a tempest-VolumeImageDependencyTests-1340467103 None] Flow 'volume_create_manager' (c24cce1a-0c4f-4afe-ac60-0dfc2bcc6a8c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:13:04 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-7650b8f3-1c20-4635-83e8-36f761be878a tempest-VolumeImageDependencyTests-1340467103 None] Created volume successfully. Sep 07 10:13:05 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-ab3bc8c4-57d3-46b6-9f69-07678ebe0fda tempest-VolumeImageDependencyTests-1340467103 None] Acquiring lock "cinder-739933f0-89f9-4c4c-baf1-62016504bc16-delete_volume" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:13:05 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-ab3bc8c4-57d3-46b6-9f69-07678ebe0fda tempest-VolumeImageDependencyTests-1340467103 None] Lock "cinder-739933f0-89f9-4c4c-baf1-62016504bc16-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:13:05 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-ab3bc8c4-57d3-46b6-9f69-07678ebe0fda tempest-VolumeImageDependencyTests-1340467103 None] Acquiring lock "cinder-quobyte-739933f0-89f9-4c4c-baf1-62016504bc16" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:13:05 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-ab3bc8c4-57d3-46b6-9f69-07678ebe0fda tempest-VolumeImageDependencyTests-1340467103 None] Lock "cinder-quobyte-739933f0-89f9-4c4c-baf1-62016504bc16" acquired by "delete_volume" :: waited 0.019s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:13:05 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e9be08c-7dd2-4177-9975-131741223392]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:13:05 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-ab3bc8c4-57d3-46b6-9f69-07678ebe0fda tempest-VolumeImageDependencyTests-1340467103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-739933f0-89f9-4c4c-baf1-62016504bc16 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:13:05 devstack sudo[103186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-739933f0-89f9-4c4c-baf1-62016504bc16 Sep 07 10:13:05 devstack sudo[103186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:13:05 devstack sudo[103186]: pam_unix(sudo:session): session closed for user root Sep 07 10:13:05 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-ab3bc8c4-57d3-46b6-9f69-07678ebe0fda tempest-VolumeImageDependencyTests-1340467103 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-739933f0-89f9-4c4c-baf1-62016504bc16" returned: 0 in 0.399s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:13:05 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-ab3bc8c4-57d3-46b6-9f69-07678ebe0fda tempest-VolumeImageDependencyTests-1340467103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-739933f0-89f9-4c4c-baf1-62016504bc16 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:13:05 devstack sudo[103191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-739933f0-89f9-4c4c-baf1-62016504bc16 Sep 07 10:13:05 devstack sudo[103191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:13:05 devstack sudo[103191]: pam_unix(sudo:session): session closed for user root Sep 07 10:13:05 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-ab3bc8c4-57d3-46b6-9f69-07678ebe0fda tempest-VolumeImageDependencyTests-1340467103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-739933f0-89f9-4c4c-baf1-62016504bc16" returned: 0 in 0.252s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:13:05 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-ab3bc8c4-57d3-46b6-9f69-07678ebe0fda tempest-VolumeImageDependencyTests-1340467103 None] Lock "cinder-quobyte-739933f0-89f9-4c4c-baf1-62016504bc16" released by "delete_volume" :: held 0.710s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:13:06 devstack cinder-volume[87515]: DEBUG cinder.quota [None req-ab3bc8c4-57d3-46b6-9f69-07678ebe0fda tempest-VolumeImageDependencyTests-1340467103 None] Created reservations ['3c509ff5-abe5-43ce-8878-a2329ff59205', '1bc5220b-7aab-4f0c-823d-5d763388aad1', 'be059a87-c64f-44b6-8d34-1d7557b16867', 'a132fb7e-5bcf-44c7-b4e2-5e96a056a25b'] {{(pid=87515) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:13:06 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-ab3bc8c4-57d3-46b6-9f69-07678ebe0fda tempest-VolumeImageDependencyTests-1340467103 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:13:06 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-ab3bc8c4-57d3-46b6-9f69-07678ebe0fda tempest-VolumeImageDependencyTests-1340467103 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:13:06 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-ab3bc8c4-57d3-46b6-9f69-07678ebe0fda tempest-VolumeImageDependencyTests-1340467103 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:13:06 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-ab3bc8c4-57d3-46b6-9f69-07678ebe0fda tempest-VolumeImageDependencyTests-1340467103 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:13:06 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-ab3bc8c4-57d3-46b6-9f69-07678ebe0fda tempest-VolumeImageDependencyTests-1340467103 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:13:06 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-ab3bc8c4-57d3-46b6-9f69-07678ebe0fda tempest-VolumeImageDependencyTests-1340467103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:13:06 devstack sudo[103194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a Sep 07 10:13:06 devstack sudo[103194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:13:06 devstack sudo[103194]: pam_unix(sudo:session): session closed for user root Sep 07 10:13:06 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-ab3bc8c4-57d3-46b6-9f69-07678ebe0fda tempest-VolumeImageDependencyTests-1340467103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a" returned: 0 in 0.274s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:13:06 devstack cinder-volume[87515]: DEBUG cinder.manager [None req-ab3bc8c4-57d3-46b6-9f69-07678ebe0fda tempest-VolumeImageDependencyTests-1340467103 None] Notifying Schedulers of capabilities ... {{(pid=87515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:13:06 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-ab3bc8c4-57d3-46b6-9f69-07678ebe0fda tempest-VolumeImageDependencyTests-1340467103 None] Deleted volume successfully. Sep 07 10:13:06 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-ab3bc8c4-57d3-46b6-9f69-07678ebe0fda tempest-VolumeImageDependencyTests-1340467103 None] Lock "cinder-739933f0-89f9-4c4c-baf1-62016504bc16-delete_volume" released by "delete_volume" :: held 1.287s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:13:11 devstack cinder-volume[87515]: DEBUG oslo_service.periodic_task [None req-cebd6a9d-3073-42a1-b65a-b38d444d85ed None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87515) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 10:13:11 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-cebd6a9d-3073-42a1-b65a-b38d444d85ed None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:13:11 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-cebd6a9d-3073-42a1-b65a-b38d444d85ed None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:13:11 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-cebd6a9d-3073-42a1-b65a-b38d444d85ed None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:13:11 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-cebd6a9d-3073-42a1-b65a-b38d444d85ed None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:13:11 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-cebd6a9d-3073-42a1-b65a-b38d444d85ed None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:13:11 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-cebd6a9d-3073-42a1-b65a-b38d444d85ed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:13:11 devstack sudo[103200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a Sep 07 10:13:11 devstack sudo[103200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:13:11 devstack sudo[103200]: pam_unix(sudo:session): session closed for user root Sep 07 10:13:11 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-cebd6a9d-3073-42a1-b65a-b38d444d85ed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a" returned: 0 in 0.309s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:13:11 devstack cinder-volume[87515]: DEBUG cinder.manager [None req-cebd6a9d-3073-42a1-b65a-b38d444d85ed None None] Notifying Schedulers of capabilities ... {{(pid=87515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:13:11 devstack cinder-volume[87515]: DEBUG oslo_service.periodic_task [None req-cebd6a9d-3073-42a1-b65a-b38d444d85ed None None] Running periodic task VolumeManager._thread_info {{(pid=87515) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 10:13:11 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-cebd6a9d-3073-42a1-b65a-b38d444d85ed None None] thread count: 29 {{(pid=87515) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 07 10:13:11 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-cebd6a9d-3073-42a1-b65a-b38d444d85ed None None] thread info: [<_MainThread(MainThread, started 131647121809536)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87515) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 07 10:13:13 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-6ea69a7c-f9a1-41bb-90e1-e5865d7f9426 tempest-VolumesNegativeTest-1022966118 None] Acquiring lock "cinder-3b7207a8-9de0-492a-a7df-004ab2fe2969-delete_volume" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:13:13 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-6ea69a7c-f9a1-41bb-90e1-e5865d7f9426 tempest-VolumesNegativeTest-1022966118 None] Lock "cinder-3b7207a8-9de0-492a-a7df-004ab2fe2969-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:13:13 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-6ea69a7c-f9a1-41bb-90e1-e5865d7f9426 tempest-VolumesNegativeTest-1022966118 None] Acquiring lock "cinder-quobyte-3b7207a8-9de0-492a-a7df-004ab2fe2969" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:13:13 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-6ea69a7c-f9a1-41bb-90e1-e5865d7f9426 tempest-VolumesNegativeTest-1022966118 None] Lock "cinder-quobyte-3b7207a8-9de0-492a-a7df-004ab2fe2969" acquired by "delete_volume" :: waited 0.013s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:13:13 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[37352201-bbf1-47f5-85b0-0156d062d528]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:13:13 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-6ea69a7c-f9a1-41bb-90e1-e5865d7f9426 tempest-VolumesNegativeTest-1022966118 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-3b7207a8-9de0-492a-a7df-004ab2fe2969 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:13:13 devstack sudo[103203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-3b7207a8-9de0-492a-a7df-004ab2fe2969 Sep 07 10:13:13 devstack sudo[103203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:13:13 devstack sudo[103203]: pam_unix(sudo:session): session closed for user root Sep 07 10:13:13 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-6ea69a7c-f9a1-41bb-90e1-e5865d7f9426 tempest-VolumesNegativeTest-1022966118 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-3b7207a8-9de0-492a-a7df-004ab2fe2969" returned: 0 in 0.365s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:13:14 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-6ea69a7c-f9a1-41bb-90e1-e5865d7f9426 tempest-VolumesNegativeTest-1022966118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-3b7207a8-9de0-492a-a7df-004ab2fe2969 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:13:14 devstack sudo[103208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-3b7207a8-9de0-492a-a7df-004ab2fe2969 Sep 07 10:13:14 devstack sudo[103208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:13:14 devstack sudo[103208]: pam_unix(sudo:session): session closed for user root Sep 07 10:13:14 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-6ea69a7c-f9a1-41bb-90e1-e5865d7f9426 tempest-VolumesNegativeTest-1022966118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-3b7207a8-9de0-492a-a7df-004ab2fe2969" returned: 0 in 0.258s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:13:14 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-6ea69a7c-f9a1-41bb-90e1-e5865d7f9426 tempest-VolumesNegativeTest-1022966118 None] Lock "cinder-quobyte-3b7207a8-9de0-492a-a7df-004ab2fe2969" released by "delete_volume" :: held 0.661s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:13:14 devstack cinder-volume[87515]: DEBUG cinder.quota [None req-6ea69a7c-f9a1-41bb-90e1-e5865d7f9426 tempest-VolumesNegativeTest-1022966118 None] Created reservations ['1f2b7e92-a2f3-4148-bfad-a2e37c971071', 'db6aaa20-e6df-4c40-873b-3988a6e319eb', '0d8cef36-8309-4fce-a179-ee0e9b33eb9e', '6006f879-9f1d-4ddb-90d4-b13acced13ec'] {{(pid=87515) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:13:14 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-6ea69a7c-f9a1-41bb-90e1-e5865d7f9426 tempest-VolumesNegativeTest-1022966118 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:13:14 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-6ea69a7c-f9a1-41bb-90e1-e5865d7f9426 tempest-VolumesNegativeTest-1022966118 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:13:14 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-6ea69a7c-f9a1-41bb-90e1-e5865d7f9426 tempest-VolumesNegativeTest-1022966118 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:13:14 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-6ea69a7c-f9a1-41bb-90e1-e5865d7f9426 tempest-VolumesNegativeTest-1022966118 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:13:14 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-6ea69a7c-f9a1-41bb-90e1-e5865d7f9426 tempest-VolumesNegativeTest-1022966118 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:13:14 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-6ea69a7c-f9a1-41bb-90e1-e5865d7f9426 tempest-VolumesNegativeTest-1022966118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:13:14 devstack sudo[103211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a Sep 07 10:13:14 devstack sudo[103211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:13:14 devstack sudo[103211]: pam_unix(sudo:session): session closed for user root Sep 07 10:13:14 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-6ea69a7c-f9a1-41bb-90e1-e5865d7f9426 tempest-VolumesNegativeTest-1022966118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a" returned: 0 in 0.244s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:13:14 devstack cinder-volume[87515]: DEBUG cinder.manager [None req-6ea69a7c-f9a1-41bb-90e1-e5865d7f9426 tempest-VolumesNegativeTest-1022966118 None] Notifying Schedulers of capabilities ... {{(pid=87515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:13:14 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-6ea69a7c-f9a1-41bb-90e1-e5865d7f9426 tempest-VolumesNegativeTest-1022966118 None] Deleted volume successfully. Sep 07 10:13:14 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-6ea69a7c-f9a1-41bb-90e1-e5865d7f9426 tempest-VolumesNegativeTest-1022966118 None] Lock "cinder-3b7207a8-9de0-492a-a7df-004ab2fe2969-delete_volume" released by "delete_volume" :: held 1.084s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:13:20 devstack cinder-volume[87515]: DEBUG cinder.volume.flows.manager.create_volume [None req-d695dc30-cf54-4173-97f1-bd0db7cbbeda tempest-TestServerVolumeAttachScenarioOldVersion-937541080 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 10:13:20 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-d695dc30-cf54-4173-97f1-bd0db7cbbeda tempest-TestServerVolumeAttachScenarioOldVersion-937541080 None] Flow 'volume_create_manager' (336eb442-09fc-4295-bb77-a74cee9a7469) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:13:20 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-d695dc30-cf54-4173-97f1-bd0db7cbbeda tempest-TestServerVolumeAttachScenarioOldVersion-937541080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36c5a490-a0bd-4b4d-850c-cf8a65e5bfb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:13:20 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-d695dc30-cf54-4173-97f1-bd0db7cbbeda tempest-TestServerVolumeAttachScenarioOldVersion-937541080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36c5a490-a0bd-4b4d-850c-cf8a65e5bfb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:13:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1252026708',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d293e940-b551-4889-b9e3-a0180da502bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='debf4881617d4a4f9b12c17e8402c695',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:13:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:13:21Z,use_quota=True,user_id='b6aef58e78514f1db62712cad2650d72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3a092cd-7947-4cbf-abff-4ba9567becf0),volume_type_id=f3a092cd-7947-4cbf-abff-4ba9567becf0)' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:13:20 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-d695dc30-cf54-4173-97f1-bd0db7cbbeda tempest-TestServerVolumeAttachScenarioOldVersion-937541080 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27e7b469-2e55-4d4e-8338-2371b339d299) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:13:20 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-d695dc30-cf54-4173-97f1-bd0db7cbbeda tempest-TestServerVolumeAttachScenarioOldVersion-937541080 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27e7b469-2e55-4d4e-8338-2371b339d299) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:13:20 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-d695dc30-cf54-4173-97f1-bd0db7cbbeda tempest-TestServerVolumeAttachScenarioOldVersion-937541080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2b3500a-934e-4dcf-aa48-33a154bb288c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:13:20 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-d695dc30-cf54-4173-97f1-bd0db7cbbeda tempest-TestServerVolumeAttachScenarioOldVersion-937541080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2b3500a-934e-4dcf-aa48-33a154bb288c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd293e940-b551-4889-b9e3-a0180da502bd', 'volume_name': 'volume-d293e940-b551-4889-b9e3-a0180da502bd', 'volume_size': 1}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:13:20 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-d695dc30-cf54-4173-97f1-bd0db7cbbeda tempest-TestServerVolumeAttachScenarioOldVersion-937541080 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3bca15ea-e43b-40a8-9c06-b0a263c9f0e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:13:20 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-d695dc30-cf54-4173-97f1-bd0db7cbbeda tempest-TestServerVolumeAttachScenarioOldVersion-937541080 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3bca15ea-e43b-40a8-9c06-b0a263c9f0e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:13:20 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-d695dc30-cf54-4173-97f1-bd0db7cbbeda tempest-TestServerVolumeAttachScenarioOldVersion-937541080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1cffcac3-bc6e-4166-8756-edd5f4dea708) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:13:20 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-d695dc30-cf54-4173-97f1-bd0db7cbbeda tempest-TestServerVolumeAttachScenarioOldVersion-937541080 None] Volume d293e940-b551-4889-b9e3-a0180da502bd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d293e940-b551-4889-b9e3-a0180da502bd', 'volume_size': 1} Sep 07 10:13:20 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-d695dc30-cf54-4173-97f1-bd0db7cbbeda tempest-TestServerVolumeAttachScenarioOldVersion-937541080 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:13:20 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-d695dc30-cf54-4173-97f1-bd0db7cbbeda tempest-TestServerVolumeAttachScenarioOldVersion-937541080 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:13:20 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-d695dc30-cf54-4173-97f1-bd0db7cbbeda tempest-TestServerVolumeAttachScenarioOldVersion-937541080 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:13:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1252026708',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d293e940-b551-4889-b9e3-a0180da502bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='debf4881617d4a4f9b12c17e8402c695',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:13:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:13:21Z,use_quota=True,user_id='b6aef58e78514f1db62712cad2650d72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3a092cd-7947-4cbf-abff-4ba9567becf0),volume_type_id=f3a092cd-7947-4cbf-abff-4ba9567becf0)}" {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 10:13:20 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-d695dc30-cf54-4173-97f1-bd0db7cbbeda tempest-TestServerVolumeAttachScenarioOldVersion-937541080 None] Creating volume d293e940-b551-4889-b9e3-a0180da502bd {{(pid=87515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 10:13:20 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-d695dc30-cf54-4173-97f1-bd0db7cbbeda tempest-TestServerVolumeAttachScenarioOldVersion-937541080 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:13:20 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-d695dc30-cf54-4173-97f1-bd0db7cbbeda tempest-TestServerVolumeAttachScenarioOldVersion-937541080 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:13:20 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-d695dc30-cf54-4173-97f1-bd0db7cbbeda tempest-TestServerVolumeAttachScenarioOldVersion-937541080 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:13:20 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-d695dc30-cf54-4173-97f1-bd0db7cbbeda tempest-TestServerVolumeAttachScenarioOldVersion-937541080 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:13:20 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-d695dc30-cf54-4173-97f1-bd0db7cbbeda tempest-TestServerVolumeAttachScenarioOldVersion-937541080 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:13:20 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-d695dc30-cf54-4173-97f1-bd0db7cbbeda tempest-TestServerVolumeAttachScenarioOldVersion-937541080 None] Selected osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c as target Quobyte volume. {{(pid=87515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 10:13:20 devstack cinder-volume[87515]: INFO cinder.volume.drivers.remotefs [None req-d695dc30-cf54-4173-97f1-bd0db7cbbeda tempest-TestServerVolumeAttachScenarioOldVersion-937541080 None] casted to osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c Sep 07 10:13:20 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-d695dc30-cf54-4173-97f1-bd0db7cbbeda tempest-TestServerVolumeAttachScenarioOldVersion-937541080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-d293e940-b551-4889-b9e3-a0180da502bd 1073741824 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:13:21 devstack sudo[103218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-d293e940-b551-4889-b9e3-a0180da502bd 1073741824 Sep 07 10:13:21 devstack sudo[103218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:13:21 devstack sudo[103218]: pam_unix(sudo:session): session closed for user root Sep 07 10:13:21 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-d695dc30-cf54-4173-97f1-bd0db7cbbeda tempest-TestServerVolumeAttachScenarioOldVersion-937541080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-d293e940-b551-4889-b9e3-a0180da502bd 1073741824" returned: 0 in 0.525s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:13:21 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-d695dc30-cf54-4173-97f1-bd0db7cbbeda tempest-TestServerVolumeAttachScenarioOldVersion-937541080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-d293e940-b551-4889-b9e3-a0180da502bd {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:13:21 devstack sudo[103224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-d293e940-b551-4889-b9e3-a0180da502bd Sep 07 10:13:21 devstack sudo[103224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:13:21 devstack sudo[103224]: pam_unix(sudo:session): session closed for user root Sep 07 10:13:21 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-d695dc30-cf54-4173-97f1-bd0db7cbbeda tempest-TestServerVolumeAttachScenarioOldVersion-937541080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-d293e940-b551-4889-b9e3-a0180da502bd" returned: 0 in 0.275s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:13:21 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-d695dc30-cf54-4173-97f1-bd0db7cbbeda tempest-TestServerVolumeAttachScenarioOldVersion-937541080 None] <== create_volume: return (878ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'} {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 10:13:21 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-d695dc30-cf54-4173-97f1-bd0db7cbbeda tempest-TestServerVolumeAttachScenarioOldVersion-937541080 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.886s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:13:21 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-d695dc30-cf54-4173-97f1-bd0db7cbbeda tempest-TestServerVolumeAttachScenarioOldVersion-937541080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1cffcac3-bc6e-4166-8756-edd5f4dea708) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d293e940-b551-4889-b9e3-a0180da502bd', 'volume_size': 1}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:13:21 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-d695dc30-cf54-4173-97f1-bd0db7cbbeda tempest-TestServerVolumeAttachScenarioOldVersion-937541080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46b40041-c5d6-4973-be64-d586e09b0d19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:13:21 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-d695dc30-cf54-4173-97f1-bd0db7cbbeda tempest-TestServerVolumeAttachScenarioOldVersion-937541080 None] Volume volume-d293e940-b551-4889-b9e3-a0180da502bd (d293e940-b551-4889-b9e3-a0180da502bd): created successfully Sep 07 10:13:21 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-d695dc30-cf54-4173-97f1-bd0db7cbbeda tempest-TestServerVolumeAttachScenarioOldVersion-937541080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46b40041-c5d6-4973-be64-d586e09b0d19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:13:21 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-d695dc30-cf54-4173-97f1-bd0db7cbbeda tempest-TestServerVolumeAttachScenarioOldVersion-937541080 None] Flow 'volume_create_manager' (336eb442-09fc-4295-bb77-a74cee9a7469) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:13:21 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-d695dc30-cf54-4173-97f1-bd0db7cbbeda tempest-TestServerVolumeAttachScenarioOldVersion-937541080 None] Created volume successfully. Sep 07 10:13:23 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [req-ac7b0f84-73ff-4e1c-b240-a276a517ab24 req-c28d2806-4fc8-41bc-b5db-0568b869de82 tempest-TestServerVolumeAttachScenarioOldVersion-937541080 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:13:23 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [req-ac7b0f84-73ff-4e1c-b240-a276a517ab24 req-c28d2806-4fc8-41bc-b5db-0568b869de82 tempest-TestServerVolumeAttachScenarioOldVersion-937541080 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:13:23 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [req-ac7b0f84-73ff-4e1c-b240-a276a517ab24 req-c28d2806-4fc8-41bc-b5db-0568b869de82 tempest-TestServerVolumeAttachScenarioOldVersion-937541080 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:13:24 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [req-ac7b0f84-73ff-4e1c-b240-a276a517ab24 req-c28d2806-4fc8-41bc-b5db-0568b869de82 tempest-TestServerVolumeAttachScenarioOldVersion-937541080 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c', 'name': 'volume-d293e940-b551-4889-b9e3-a0180da502bd', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'dbf6927a-807d-4e1b-862c-28eb2a27c730', 'enforce_multipath': True} {{(pid=87515) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 07 10:13:24 devstack cinder-volume[87515]: INFO cinder.volume.manager [req-ac7b0f84-73ff-4e1c-b240-a276a517ab24 req-c28d2806-4fc8-41bc-b5db-0568b869de82 tempest-TestServerVolumeAttachScenarioOldVersion-937541080 None] attachment_update completed successfully. Sep 07 10:13:27 devstack cinder-volume[87515]: INFO cinder.volume.manager [req-04cb7194-8524-4480-8b48-986ded7312b9 req-d070b2a2-e65e-4037-8648-df18d410da89 tempest-TestServerVolumeAttachScenarioOldVersion-937541080 None] Terminate volume connection completed successfully. Sep 07 10:13:27 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [req-04cb7194-8524-4480-8b48-986ded7312b9 req-d070b2a2-e65e-4037-8648-df18d410da89 tempest-TestServerVolumeAttachScenarioOldVersion-937541080 None] Deleting attachment dbf6927a-807d-4e1b-862c-28eb2a27c730. {{(pid=87515) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 07 10:13:28 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-745516be-cf47-4448-91c0-8ca65d3fe5e9 tempest-TestServerVolumeAttachScenarioOldVersion-937541080 None] Acquiring lock "cinder-d293e940-b551-4889-b9e3-a0180da502bd-delete_volume" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:13:28 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-745516be-cf47-4448-91c0-8ca65d3fe5e9 tempest-TestServerVolumeAttachScenarioOldVersion-937541080 None] Lock "cinder-d293e940-b551-4889-b9e3-a0180da502bd-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:13:28 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-745516be-cf47-4448-91c0-8ca65d3fe5e9 tempest-TestServerVolumeAttachScenarioOldVersion-937541080 None] Acquiring lock "cinder-quobyte-d293e940-b551-4889-b9e3-a0180da502bd" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:13:28 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-745516be-cf47-4448-91c0-8ca65d3fe5e9 tempest-TestServerVolumeAttachScenarioOldVersion-937541080 None] Lock "cinder-quobyte-d293e940-b551-4889-b9e3-a0180da502bd" acquired by "delete_volume" :: waited 0.024s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:13:28 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[6433756f-669d-4cfb-becd-9626842d0c6b]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:13:28 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-745516be-cf47-4448-91c0-8ca65d3fe5e9 tempest-TestServerVolumeAttachScenarioOldVersion-937541080 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-d293e940-b551-4889-b9e3-a0180da502bd {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:13:28 devstack sudo[103689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-d293e940-b551-4889-b9e3-a0180da502bd Sep 07 10:13:28 devstack sudo[103689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:13:28 devstack sudo[103689]: pam_unix(sudo:session): session closed for user root Sep 07 10:13:28 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-745516be-cf47-4448-91c0-8ca65d3fe5e9 tempest-TestServerVolumeAttachScenarioOldVersion-937541080 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-d293e940-b551-4889-b9e3-a0180da502bd" returned: 0 in 0.401s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:13:28 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-745516be-cf47-4448-91c0-8ca65d3fe5e9 tempest-TestServerVolumeAttachScenarioOldVersion-937541080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-d293e940-b551-4889-b9e3-a0180da502bd {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:13:28 devstack sudo[103694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-d293e940-b551-4889-b9e3-a0180da502bd Sep 07 10:13:28 devstack sudo[103694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:13:29 devstack sudo[103694]: pam_unix(sudo:session): session closed for user root Sep 07 10:13:29 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-745516be-cf47-4448-91c0-8ca65d3fe5e9 tempest-TestServerVolumeAttachScenarioOldVersion-937541080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-d293e940-b551-4889-b9e3-a0180da502bd" returned: 0 in 0.262s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:13:29 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-745516be-cf47-4448-91c0-8ca65d3fe5e9 tempest-TestServerVolumeAttachScenarioOldVersion-937541080 None] Lock "cinder-quobyte-d293e940-b551-4889-b9e3-a0180da502bd" released by "delete_volume" :: held 0.705s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:13:29 devstack cinder-volume[87515]: DEBUG cinder.quota [None req-745516be-cf47-4448-91c0-8ca65d3fe5e9 tempest-TestServerVolumeAttachScenarioOldVersion-937541080 None] Created reservations ['06a47b85-5577-4ccc-9003-9f857e4ed9cd', '7fc5cc97-81e3-47c4-9ce4-cffc42342565', '4857f65b-20e3-4478-bc7a-140a60b72596', '7e1f443d-aa50-46a7-849e-8d6813d494a3'] {{(pid=87515) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:13:29 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-745516be-cf47-4448-91c0-8ca65d3fe5e9 tempest-TestServerVolumeAttachScenarioOldVersion-937541080 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:13:29 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-745516be-cf47-4448-91c0-8ca65d3fe5e9 tempest-TestServerVolumeAttachScenarioOldVersion-937541080 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:13:29 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-745516be-cf47-4448-91c0-8ca65d3fe5e9 tempest-TestServerVolumeAttachScenarioOldVersion-937541080 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:13:29 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-745516be-cf47-4448-91c0-8ca65d3fe5e9 tempest-TestServerVolumeAttachScenarioOldVersion-937541080 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:13:29 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-745516be-cf47-4448-91c0-8ca65d3fe5e9 tempest-TestServerVolumeAttachScenarioOldVersion-937541080 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:13:29 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-745516be-cf47-4448-91c0-8ca65d3fe5e9 tempest-TestServerVolumeAttachScenarioOldVersion-937541080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:13:29 devstack sudo[103698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a Sep 07 10:13:29 devstack sudo[103698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:13:29 devstack sudo[103698]: pam_unix(sudo:session): session closed for user root Sep 07 10:13:29 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-745516be-cf47-4448-91c0-8ca65d3fe5e9 tempest-TestServerVolumeAttachScenarioOldVersion-937541080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a" returned: 0 in 0.266s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:13:29 devstack cinder-volume[87515]: DEBUG cinder.manager [None req-745516be-cf47-4448-91c0-8ca65d3fe5e9 tempest-TestServerVolumeAttachScenarioOldVersion-937541080 None] Notifying Schedulers of capabilities ... {{(pid=87515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:13:29 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-745516be-cf47-4448-91c0-8ca65d3fe5e9 tempest-TestServerVolumeAttachScenarioOldVersion-937541080 None] Deleted volume successfully. Sep 07 10:13:29 devstack cinder-volume[87515]: DEBUG dbcounter [-] [87515] Writing DB stats cinder:UPDATE=82,cinder:DELETE=9,cinder:SELECT=64,cinder:INSERT=27 {{(pid=87515) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 10:13:29 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-745516be-cf47-4448-91c0-8ca65d3fe5e9 tempest-TestServerVolumeAttachScenarioOldVersion-937541080 None] Lock "cinder-d293e940-b551-4889-b9e3-a0180da502bd-delete_volume" released by "delete_volume" :: held 1.206s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:13:38 devstack cinder-volume[87515]: DEBUG cinder.volume.flows.manager.create_volume [None req-fbcbf68c-1b26-41c5-8a68-a2fdec3b0d6d tempest-TestShelveInstance-858685255 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 10:13:39 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-fbcbf68c-1b26-41c5-8a68-a2fdec3b0d6d tempest-TestShelveInstance-858685255 None] Flow 'volume_create_manager' (0524e3eb-68fd-4a31-a93a-4cf5d19f5afd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:13:39 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-fbcbf68c-1b26-41c5-8a68-a2fdec3b0d6d tempest-TestShelveInstance-858685255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (697b17bf-22aa-4d6d-b3d4-b89d8dd4685f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:13:39 devstack cinder-volume[87515]: DEBUG dbcounter [-] [87515] Writing DB stats cinder:SELECT=64,cinder:INSERT=18,cinder:UPDATE=73,cinder:DELETE=3 {{(pid=87515) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 10:13:39 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-fbcbf68c-1b26-41c5-8a68-a2fdec3b0d6d tempest-TestShelveInstance-858685255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (697b17bf-22aa-4d6d-b3d4-b89d8dd4685f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:13:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-317725955',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57317039-d395-4460-ba64-a04d0baf2864,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f127304c00041d6908a3c276ad520c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:13:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:13:39Z,use_quota=True,user_id='7125bde1cc7e4de69c38c031d70ae72e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3a092cd-7947-4cbf-abff-4ba9567becf0),volume_type_id=f3a092cd-7947-4cbf-abff-4ba9567becf0)' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:13:39 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-fbcbf68c-1b26-41c5-8a68-a2fdec3b0d6d tempest-TestShelveInstance-858685255 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b185b13-2bb4-44da-962a-2451689d79d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:13:39 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-fbcbf68c-1b26-41c5-8a68-a2fdec3b0d6d tempest-TestShelveInstance-858685255 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b185b13-2bb4-44da-962a-2451689d79d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:13:39 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-fbcbf68c-1b26-41c5-8a68-a2fdec3b0d6d tempest-TestShelveInstance-858685255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76e431c4-ad06-4181-8c63-83f8e872d0d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:13:39 devstack cinder-volume[87515]: DEBUG cinder.image.glance [None req-fbcbf68c-1b26-41c5-8a68-a2fdec3b0d6d tempest-TestShelveInstance-858685255 None] Creating Keystone auth plugin from conf {{(pid=87515) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 07 10:13:39 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-fbcbf68c-1b26-41c5-8a68-a2fdec3b0d6d tempest-TestShelveInstance-858685255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76e431c4-ad06-4181-8c63-83f8e872d0d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '57317039-d395-4460-ba64-a04d0baf2864', 'volume_name': 'volume-57317039-d395-4460-ba64-a04d0baf2864', 'volume_size': 1, 'image_id': '26019e10-1e1f-4514-b191-397ccf1d59e6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/26019e10-1e1f-4514-b191-397ccf1d59e6', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4765956d565c46c2a4a703c5a550ca58', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '26019e10-1e1f-4514-b191-397ccf1d59e6', 'created_at': datetime.datetime(2026, 9, 7, 7, 52, 21, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 7, 7, 52, 22, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/26019e10-1e1f-4514-b191-397ccf1d59e6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:13:39 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-fbcbf68c-1b26-41c5-8a68-a2fdec3b0d6d tempest-TestShelveInstance-858685255 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0beee609-67a5-487d-ae13-5b46378393e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:13:39 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-fbcbf68c-1b26-41c5-8a68-a2fdec3b0d6d tempest-TestShelveInstance-858685255 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0beee609-67a5-487d-ae13-5b46378393e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:13:39 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-fbcbf68c-1b26-41c5-8a68-a2fdec3b0d6d tempest-TestShelveInstance-858685255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4af28ff8-8183-4172-aa17-da720b1572d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:13:39 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-fbcbf68c-1b26-41c5-8a68-a2fdec3b0d6d tempest-TestShelveInstance-858685255 None] Volume 57317039-d395-4460-ba64-a04d0baf2864: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-57317039-d395-4460-ba64-a04d0baf2864', 'volume_size': 1, 'image_id': '26019e10-1e1f-4514-b191-397ccf1d59e6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/26019e10-1e1f-4514-b191-397ccf1d59e6', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4765956d565c46c2a4a703c5a550ca58', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '26019e10-1e1f-4514-b191-397ccf1d59e6', 'created_at': datetime.datetime(2026, 9, 7, 7, 52, 21, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 7, 7, 52, 22, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/26019e10-1e1f-4514-b191-397ccf1d59e6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 07 10:13:39 devstack cinder-volume[87515]: DEBUG cinder.volume.flows.manager.create_volume [None req-fbcbf68c-1b26-41c5-8a68-a2fdec3b0d6d tempest-TestShelveInstance-858685255 None] Trying to clone 57317039-d395-4460-ba64-a04d0baf2864 from image 26019e10-1e1f-4514-b191-397ccf1d59e6 at location (None, [{'url': 'file:///opt/stack/data/glance/images/26019e10-1e1f-4514-b191-397ccf1d59e6', 'metadata': {}}]). {{(pid=87515) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 07 10:13:39 devstack cinder-volume[87515]: DEBUG cinder.image.image_utils [None req-fbcbf68c-1b26-41c5-8a68-a2fdec3b0d6d tempest-TestShelveInstance-858685255 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_26019e10-1e1f-4514-b191-397ccf1d59e6_l0p5k1twdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87515) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 07 10:13:39 devstack cinder-volume[87515]: INFO cinder.image.image_utils [None req-fbcbf68c-1b26-41c5-8a68-a2fdec3b0d6d tempest-TestShelveInstance-858685255 None] Image download 20.69 MB at 20.69 MB/s Sep 07 10:13:39 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[5edb481d-5ab7-4f95-a167-b601707e25e7]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:13:39 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-fbcbf68c-1b26-41c5-8a68-a2fdec3b0d6d tempest-TestShelveInstance-858685255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_26019e10-1e1f-4514-b191-397ccf1d59e6_l0p5k1twdevstack@QuobyteHD {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:13:39 devstack sudo[103735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_26019e10-1e1f-4514-b191-397ccf1d59e6_l0p5k1twdevstack@QuobyteHD Sep 07 10:13:40 devstack sudo[103735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:13:40 devstack sudo[103735]: pam_unix(sudo:session): session closed for user root Sep 07 10:13:40 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-fbcbf68c-1b26-41c5-8a68-a2fdec3b0d6d tempest-TestShelveInstance-858685255 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_26019e10-1e1f-4514-b191-397ccf1d59e6_l0p5k1twdevstack@QuobyteHD" returned: 0 in 0.345s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:13:40 devstack cinder-volume[87515]: DEBUG cinder.image.image_utils [None req-fbcbf68c-1b26-41c5-8a68-a2fdec3b0d6d tempest-TestShelveInstance-858685255 None] Temporary image 26019e10-1e1f-4514-b191-397ccf1d59e6 is fetched for user 7125bde1cc7e4de69c38c031d70ae72e. {{(pid=87515) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 07 10:13:40 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ad40eba-8564-4c52-b1c9-9b152ae6c1a2]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:13:40 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-fbcbf68c-1b26-41c5-8a68-a2fdec3b0d6d tempest-TestShelveInstance-858685255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_26019e10-1e1f-4514-b191-397ccf1d59e6_l0p5k1twdevstack@QuobyteHD {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:13:40 devstack sudo[103740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_26019e10-1e1f-4514-b191-397ccf1d59e6_l0p5k1twdevstack@QuobyteHD Sep 07 10:13:40 devstack sudo[103740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:13:40 devstack sudo[103740]: pam_unix(sudo:session): session closed for user root Sep 07 10:13:40 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-fbcbf68c-1b26-41c5-8a68-a2fdec3b0d6d tempest-TestShelveInstance-858685255 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_26019e10-1e1f-4514-b191-397ccf1d59e6_l0p5k1twdevstack@QuobyteHD" returned: 0 in 0.360s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:13:40 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-fbcbf68c-1b26-41c5-8a68-a2fdec3b0d6d tempest-TestShelveInstance-858685255 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:13:40 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-fbcbf68c-1b26-41c5-8a68-a2fdec3b0d6d tempest-TestShelveInstance-858685255 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:13:40 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-fbcbf68c-1b26-41c5-8a68-a2fdec3b0d6d tempest-TestShelveInstance-858685255 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:13:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-317725955',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57317039-d395-4460-ba64-a04d0baf2864,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f127304c00041d6908a3c276ad520c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:13:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:13:39Z,use_quota=True,user_id='7125bde1cc7e4de69c38c031d70ae72e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3a092cd-7947-4cbf-abff-4ba9567becf0),volume_type_id=f3a092cd-7947-4cbf-abff-4ba9567becf0)}" {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 10:13:40 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-fbcbf68c-1b26-41c5-8a68-a2fdec3b0d6d tempest-TestShelveInstance-858685255 None] Creating volume 57317039-d395-4460-ba64-a04d0baf2864 {{(pid=87515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 10:13:40 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-fbcbf68c-1b26-41c5-8a68-a2fdec3b0d6d tempest-TestShelveInstance-858685255 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:13:40 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-fbcbf68c-1b26-41c5-8a68-a2fdec3b0d6d tempest-TestShelveInstance-858685255 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:13:40 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-fbcbf68c-1b26-41c5-8a68-a2fdec3b0d6d tempest-TestShelveInstance-858685255 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:13:40 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-fbcbf68c-1b26-41c5-8a68-a2fdec3b0d6d tempest-TestShelveInstance-858685255 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:13:40 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-fbcbf68c-1b26-41c5-8a68-a2fdec3b0d6d tempest-TestShelveInstance-858685255 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:13:40 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-fbcbf68c-1b26-41c5-8a68-a2fdec3b0d6d tempest-TestShelveInstance-858685255 None] Selected osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c as target Quobyte volume. {{(pid=87515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 10:13:40 devstack cinder-volume[87515]: INFO cinder.volume.drivers.remotefs [None req-fbcbf68c-1b26-41c5-8a68-a2fdec3b0d6d tempest-TestShelveInstance-858685255 None] casted to osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c Sep 07 10:13:40 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-fbcbf68c-1b26-41c5-8a68-a2fdec3b0d6d tempest-TestShelveInstance-858685255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-57317039-d395-4460-ba64-a04d0baf2864 1073741824 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:13:40 devstack sudo[103745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-57317039-d395-4460-ba64-a04d0baf2864 1073741824 Sep 07 10:13:40 devstack sudo[103745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:13:41 devstack sudo[103745]: pam_unix(sudo:session): session closed for user root Sep 07 10:13:41 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-fbcbf68c-1b26-41c5-8a68-a2fdec3b0d6d tempest-TestShelveInstance-858685255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-57317039-d395-4460-ba64-a04d0baf2864 1073741824" returned: 0 in 0.442s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:13:41 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-fbcbf68c-1b26-41c5-8a68-a2fdec3b0d6d tempest-TestShelveInstance-858685255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-57317039-d395-4460-ba64-a04d0baf2864 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:13:41 devstack sudo[103751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-57317039-d395-4460-ba64-a04d0baf2864 Sep 07 10:13:41 devstack sudo[103751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:13:41 devstack sudo[103751]: pam_unix(sudo:session): session closed for user root Sep 07 10:13:41 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-fbcbf68c-1b26-41c5-8a68-a2fdec3b0d6d tempest-TestShelveInstance-858685255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-57317039-d395-4460-ba64-a04d0baf2864" returned: 0 in 0.279s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:13:41 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-fbcbf68c-1b26-41c5-8a68-a2fdec3b0d6d tempest-TestShelveInstance-858685255 None] <== create_volume: return (766ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'} {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 10:13:41 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-fbcbf68c-1b26-41c5-8a68-a2fdec3b0d6d tempest-TestShelveInstance-858685255 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.770s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:13:41 devstack cinder-volume[87515]: DEBUG cinder.volume.volume_utils [None req-fbcbf68c-1b26-41c5-8a68-a2fdec3b0d6d tempest-TestShelveInstance-858685255 None] Attempting download of 26019e10-1e1f-4514-b191-397ccf1d59e6 ((None, [{'url': 'file:///opt/stack/data/glance/images/26019e10-1e1f-4514-b191-397ccf1d59e6', 'metadata': {}}])) to volume 57317039-d395-4460-ba64-a04d0baf2864. {{(pid=87515) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 07 10:13:41 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9c8094e-03a8-4da0-b776-e496d928e133]: (4, 'raw') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:13:41 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-fbcbf68c-1b26-41c5-8a68-a2fdec3b0d6d tempest-TestShelveInstance-858685255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_26019e10-1e1f-4514-b191-397ccf1d59e6_6nnfix59 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:13:41 devstack sudo[103755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_26019e10-1e1f-4514-b191-397ccf1d59e6_6nnfix59 Sep 07 10:13:41 devstack sudo[103755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:13:41 devstack sudo[103755]: pam_unix(sudo:session): session closed for user root Sep 07 10:13:41 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-fbcbf68c-1b26-41c5-8a68-a2fdec3b0d6d tempest-TestShelveInstance-858685255 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_26019e10-1e1f-4514-b191-397ccf1d59e6_6nnfix59" returned: 0 in 0.325s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:13:41 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-fbcbf68c-1b26-41c5-8a68-a2fdec3b0d6d tempest-TestShelveInstance-858685255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_26019e10-1e1f-4514-b191-397ccf1d59e6_6nnfix59 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:13:41 devstack sudo[103759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_26019e10-1e1f-4514-b191-397ccf1d59e6_6nnfix59 Sep 07 10:13:41 devstack sudo[103759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:13:42 devstack sudo[103759]: pam_unix(sudo:session): session closed for user root Sep 07 10:13:42 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-fbcbf68c-1b26-41c5-8a68-a2fdec3b0d6d tempest-TestShelveInstance-858685255 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_26019e10-1e1f-4514-b191-397ccf1d59e6_6nnfix59" returned: 1 in 0.339s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:13:42 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-fbcbf68c-1b26-41c5-8a68-a2fdec3b0d6d tempest-TestShelveInstance-858685255 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_26019e10-1e1f-4514-b191-397ccf1d59e6_6nnfix59' failed. Not Retrying. {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 07 10:13:42 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c024b02-ebbd-433a-af32-1c1d50b3f5cb]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:13:42 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-fbcbf68c-1b26-41c5-8a68-a2fdec3b0d6d tempest-TestShelveInstance-858685255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_26019e10-1e1f-4514-b191-397ccf1d59e6_l0p5k1twdevstack@QuobyteHD {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:13:42 devstack sudo[103763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_26019e10-1e1f-4514-b191-397ccf1d59e6_l0p5k1twdevstack@QuobyteHD Sep 07 10:13:42 devstack sudo[103763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:13:42 devstack sudo[103763]: pam_unix(sudo:session): session closed for user root Sep 07 10:13:42 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-fbcbf68c-1b26-41c5-8a68-a2fdec3b0d6d tempest-TestShelveInstance-858685255 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_26019e10-1e1f-4514-b191-397ccf1d59e6_l0p5k1twdevstack@QuobyteHD" returned: 0 in 0.342s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:13:42 devstack cinder-volume[87515]: DEBUG cinder.image.image_utils [None req-fbcbf68c-1b26-41c5-8a68-a2fdec3b0d6d tempest-TestShelveInstance-858685255 None] 26019e10-1e1f-4514-b191-397ccf1d59e6 was qcow2, converting to qcow2 {{(pid=87515) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 07 10:13:42 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-fbcbf68c-1b26-41c5-8a68-a2fdec3b0d6d tempest-TestShelveInstance-858685255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_26019e10-1e1f-4514-b191-397ccf1d59e6_l0p5k1twdevstack@QuobyteHD /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-57317039-d395-4460-ba64-a04d0baf2864 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:13:42 devstack sudo[103769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_26019e10-1e1f-4514-b191-397ccf1d59e6_l0p5k1twdevstack@QuobyteHD /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-57317039-d395-4460-ba64-a04d0baf2864 Sep 07 10:13:42 devstack sudo[103769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:13:44 devstack sudo[103769]: pam_unix(sudo:session): session closed for user root Sep 07 10:13:44 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-fbcbf68c-1b26-41c5-8a68-a2fdec3b0d6d tempest-TestShelveInstance-858685255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_26019e10-1e1f-4514-b191-397ccf1d59e6_l0p5k1twdevstack@QuobyteHD /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-57317039-d395-4460-ba64-a04d0baf2864" returned: 0 in 1.811s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:13:44 devstack cinder-volume[87515]: DEBUG cinder.image.image_utils [None req-fbcbf68c-1b26-41c5-8a68-a2fdec3b0d6d tempest-TestShelveInstance-858685255 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_26019e10-1e1f-4514-b191-397ccf1d59e6_l0p5k1twdevstack@QuobyteHD, size 112.00 MB, duration 1.81 sec, destination /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-57317039-d395-4460-ba64-a04d0baf2864 {{(pid=87515) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 07 10:13:44 devstack cinder-volume[87515]: INFO cinder.image.image_utils [None req-fbcbf68c-1b26-41c5-8a68-a2fdec3b0d6d tempest-TestShelveInstance-858685255 None] Converted 112.00 MB image at 61.73 MB/s Sep 07 10:13:44 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-fbcbf68c-1b26-41c5-8a68-a2fdec3b0d6d tempest-TestShelveInstance-858685255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-57317039-d395-4460-ba64-a04d0baf2864 1G {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:13:44 devstack sudo[103781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-57317039-d395-4460-ba64-a04d0baf2864 1G Sep 07 10:13:44 devstack sudo[103781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:13:44 devstack sudo[103781]: pam_unix(sudo:session): session closed for user root Sep 07 10:13:44 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-fbcbf68c-1b26-41c5-8a68-a2fdec3b0d6d tempest-TestShelveInstance-858685255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-57317039-d395-4460-ba64-a04d0baf2864 1G" returned: 0 in 0.346s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:13:44 devstack cinder-volume[87515]: DEBUG cinder.volume.volume_utils [None req-fbcbf68c-1b26-41c5-8a68-a2fdec3b0d6d tempest-TestShelveInstance-858685255 None] Downloaded image 26019e10-1e1f-4514-b191-397ccf1d59e6 ((None, [{'url': 'file:///opt/stack/data/glance/images/26019e10-1e1f-4514-b191-397ccf1d59e6', 'metadata': {}}])) to volume 57317039-d395-4460-ba64-a04d0baf2864 successfully. {{(pid=87515) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 07 10:13:44 devstack cinder-volume[87515]: DEBUG cinder.image.image_utils [None req-fbcbf68c-1b26-41c5-8a68-a2fdec3b0d6d tempest-TestShelveInstance-858685255 None] Temporary image 26019e10-1e1f-4514-b191-397ccf1d59e6 for user 7125bde1cc7e4de69c38c031d70ae72e is deleted. {{(pid=87515) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 07 10:13:44 devstack cinder-volume[87515]: DEBUG cinder.volume.volume_utils [None req-fbcbf68c-1b26-41c5-8a68-a2fdec3b0d6d tempest-TestShelveInstance-858685255 None] Marking volume 57317039-d395-4460-ba64-a04d0baf2864 as bootable. {{(pid=87515) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 07 10:13:44 devstack cinder-volume[87515]: DEBUG cinder.volume.flows.manager.create_volume [None req-fbcbf68c-1b26-41c5-8a68-a2fdec3b0d6d tempest-TestShelveInstance-858685255 None] Copying metadata from image 26019e10-1e1f-4514-b191-397ccf1d59e6 to 57317039-d395-4460-ba64-a04d0baf2864. {{(pid=87515) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 07 10:13:44 devstack cinder-volume[87515]: DEBUG cinder.volume.flows.manager.create_volume [None req-fbcbf68c-1b26-41c5-8a68-a2fdec3b0d6d tempest-TestShelveInstance-858685255 None] Creating volume glance metadata for volume 57317039-d395-4460-ba64-a04d0baf2864 backed by image 26019e10-1e1f-4514-b191-397ccf1d59e6 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '26019e10-1e1f-4514-b191-397ccf1d59e6', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87515) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 07 10:13:44 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-fbcbf68c-1b26-41c5-8a68-a2fdec3b0d6d tempest-TestShelveInstance-858685255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4af28ff8-8183-4172-aa17-da720b1572d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-57317039-d395-4460-ba64-a04d0baf2864', 'volume_size': 1, 'image_id': '26019e10-1e1f-4514-b191-397ccf1d59e6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/26019e10-1e1f-4514-b191-397ccf1d59e6', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4765956d565c46c2a4a703c5a550ca58', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '26019e10-1e1f-4514-b191-397ccf1d59e6', 'created_at': datetime.datetime(2026, 9, 7, 7, 52, 21, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 7, 7, 52, 22, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/26019e10-1e1f-4514-b191-397ccf1d59e6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:13:44 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-fbcbf68c-1b26-41c5-8a68-a2fdec3b0d6d tempest-TestShelveInstance-858685255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37961b65-e631-4caa-b62c-02b365776132) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:13:44 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-fbcbf68c-1b26-41c5-8a68-a2fdec3b0d6d tempest-TestShelveInstance-858685255 None] Volume volume-57317039-d395-4460-ba64-a04d0baf2864 (57317039-d395-4460-ba64-a04d0baf2864): created successfully Sep 07 10:13:44 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-fbcbf68c-1b26-41c5-8a68-a2fdec3b0d6d tempest-TestShelveInstance-858685255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37961b65-e631-4caa-b62c-02b365776132) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:13:44 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-fbcbf68c-1b26-41c5-8a68-a2fdec3b0d6d tempest-TestShelveInstance-858685255 None] Flow 'volume_create_manager' (0524e3eb-68fd-4a31-a93a-4cf5d19f5afd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:13:44 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-fbcbf68c-1b26-41c5-8a68-a2fdec3b0d6d tempest-TestShelveInstance-858685255 None] Created volume successfully. Sep 07 10:13:47 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [req-0cf1cc5c-da9f-45e2-b59b-52b21effa2b9 req-1656c3f2-c73f-46c2-a6b6-19b53b2bd0a5 tempest-TestShelveInstance-858685255 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:13:47 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [req-0cf1cc5c-da9f-45e2-b59b-52b21effa2b9 req-1656c3f2-c73f-46c2-a6b6-19b53b2bd0a5 tempest-TestShelveInstance-858685255 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:13:47 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [req-0cf1cc5c-da9f-45e2-b59b-52b21effa2b9 req-1656c3f2-c73f-46c2-a6b6-19b53b2bd0a5 tempest-TestShelveInstance-858685255 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:13:47 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [req-0cf1cc5c-da9f-45e2-b59b-52b21effa2b9 req-1656c3f2-c73f-46c2-a6b6-19b53b2bd0a5 tempest-TestShelveInstance-858685255 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c', 'name': 'volume-57317039-d395-4460-ba64-a04d0baf2864', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '40a19fe4-3366-448a-96ed-1a06e1de7cfe', 'enforce_multipath': True} {{(pid=87515) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 07 10:13:47 devstack cinder-volume[87515]: INFO cinder.volume.manager [req-0cf1cc5c-da9f-45e2-b59b-52b21effa2b9 req-1656c3f2-c73f-46c2-a6b6-19b53b2bd0a5 tempest-TestShelveInstance-858685255 None] attachment_update completed successfully. Sep 07 10:13:53 devstack cinder-volume[87515]: DEBUG cinder.volume.flows.manager.create_volume [None req-a6bd1a59-0287-464e-94f8-56d07dfed4d9 tempest-ProjectReaderTests-1199679064 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 10:13:53 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-a6bd1a59-0287-464e-94f8-56d07dfed4d9 tempest-ProjectReaderTests-1199679064 None] Flow 'volume_create_manager' (efa25f0f-a945-4d0a-9158-232899ebaddb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:13:53 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-a6bd1a59-0287-464e-94f8-56d07dfed4d9 tempest-ProjectReaderTests-1199679064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4298f233-1f0e-4e42-94e0-0c5c69841eed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:13:53 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-a6bd1a59-0287-464e-94f8-56d07dfed4d9 tempest-ProjectReaderTests-1199679064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4298f233-1f0e-4e42-94e0-0c5c69841eed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:13:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1274820917',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f97d4180-4366-41b5-ae78-29bc5e040458,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e8627eee12e480f8364ab2f206f64e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:13:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:13:53Z,use_quota=True,user_id='af427c09ef1f4ee08a2a983aa3292891',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3a092cd-7947-4cbf-abff-4ba9567becf0),volume_type_id=f3a092cd-7947-4cbf-abff-4ba9567becf0)' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:13:53 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-a6bd1a59-0287-464e-94f8-56d07dfed4d9 tempest-ProjectReaderTests-1199679064 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18d17274-4ec9-4104-8d93-3aa0e3dc5cb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:13:53 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-a6bd1a59-0287-464e-94f8-56d07dfed4d9 tempest-ProjectReaderTests-1199679064 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18d17274-4ec9-4104-8d93-3aa0e3dc5cb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:13:53 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-a6bd1a59-0287-464e-94f8-56d07dfed4d9 tempest-ProjectReaderTests-1199679064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a075707-a484-4afe-9480-8f6d0bd089b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:13:53 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-a6bd1a59-0287-464e-94f8-56d07dfed4d9 tempest-ProjectReaderTests-1199679064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a075707-a484-4afe-9480-8f6d0bd089b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f97d4180-4366-41b5-ae78-29bc5e040458', 'volume_name': 'volume-f97d4180-4366-41b5-ae78-29bc5e040458', 'volume_size': 1}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:13:53 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-a6bd1a59-0287-464e-94f8-56d07dfed4d9 tempest-ProjectReaderTests-1199679064 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ca36aaf-33c8-473d-b1af-496835efdcac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:13:53 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-a6bd1a59-0287-464e-94f8-56d07dfed4d9 tempest-ProjectReaderTests-1199679064 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ca36aaf-33c8-473d-b1af-496835efdcac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:13:53 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-a6bd1a59-0287-464e-94f8-56d07dfed4d9 tempest-ProjectReaderTests-1199679064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9f257e3-7db9-45b7-a6b2-4080b4695766) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:13:53 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-a6bd1a59-0287-464e-94f8-56d07dfed4d9 tempest-ProjectReaderTests-1199679064 None] Volume f97d4180-4366-41b5-ae78-29bc5e040458: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f97d4180-4366-41b5-ae78-29bc5e040458', 'volume_size': 1} Sep 07 10:13:53 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-a6bd1a59-0287-464e-94f8-56d07dfed4d9 tempest-ProjectReaderTests-1199679064 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:13:53 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-a6bd1a59-0287-464e-94f8-56d07dfed4d9 tempest-ProjectReaderTests-1199679064 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:13:53 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-a6bd1a59-0287-464e-94f8-56d07dfed4d9 tempest-ProjectReaderTests-1199679064 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:13:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1274820917',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f97d4180-4366-41b5-ae78-29bc5e040458,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e8627eee12e480f8364ab2f206f64e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:13:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:13:53Z,use_quota=True,user_id='af427c09ef1f4ee08a2a983aa3292891',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3a092cd-7947-4cbf-abff-4ba9567becf0),volume_type_id=f3a092cd-7947-4cbf-abff-4ba9567becf0)}" {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 10:13:53 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-a6bd1a59-0287-464e-94f8-56d07dfed4d9 tempest-ProjectReaderTests-1199679064 None] Creating volume f97d4180-4366-41b5-ae78-29bc5e040458 {{(pid=87515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 10:13:53 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-a6bd1a59-0287-464e-94f8-56d07dfed4d9 tempest-ProjectReaderTests-1199679064 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:13:53 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-a6bd1a59-0287-464e-94f8-56d07dfed4d9 tempest-ProjectReaderTests-1199679064 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:13:53 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-a6bd1a59-0287-464e-94f8-56d07dfed4d9 tempest-ProjectReaderTests-1199679064 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:13:53 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-a6bd1a59-0287-464e-94f8-56d07dfed4d9 tempest-ProjectReaderTests-1199679064 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:13:53 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-a6bd1a59-0287-464e-94f8-56d07dfed4d9 tempest-ProjectReaderTests-1199679064 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:13:53 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-a6bd1a59-0287-464e-94f8-56d07dfed4d9 tempest-ProjectReaderTests-1199679064 None] Selected osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c as target Quobyte volume. {{(pid=87515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 10:13:53 devstack cinder-volume[87515]: INFO cinder.volume.drivers.remotefs [None req-a6bd1a59-0287-464e-94f8-56d07dfed4d9 tempest-ProjectReaderTests-1199679064 None] casted to osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c Sep 07 10:13:53 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-a6bd1a59-0287-464e-94f8-56d07dfed4d9 tempest-ProjectReaderTests-1199679064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-f97d4180-4366-41b5-ae78-29bc5e040458 1073741824 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:13:53 devstack sudo[104249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-f97d4180-4366-41b5-ae78-29bc5e040458 1073741824 Sep 07 10:13:53 devstack sudo[104249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:13:54 devstack sudo[104249]: pam_unix(sudo:session): session closed for user root Sep 07 10:13:54 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-a6bd1a59-0287-464e-94f8-56d07dfed4d9 tempest-ProjectReaderTests-1199679064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-f97d4180-4366-41b5-ae78-29bc5e040458 1073741824" returned: 0 in 0.475s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:13:54 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-a6bd1a59-0287-464e-94f8-56d07dfed4d9 tempest-ProjectReaderTests-1199679064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-f97d4180-4366-41b5-ae78-29bc5e040458 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:13:54 devstack sudo[104255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-f97d4180-4366-41b5-ae78-29bc5e040458 Sep 07 10:13:54 devstack sudo[104255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:13:54 devstack sudo[104255]: pam_unix(sudo:session): session closed for user root Sep 07 10:13:54 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-a6bd1a59-0287-464e-94f8-56d07dfed4d9 tempest-ProjectReaderTests-1199679064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-f97d4180-4366-41b5-ae78-29bc5e040458" returned: 0 in 0.322s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:13:54 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-a6bd1a59-0287-464e-94f8-56d07dfed4d9 tempest-ProjectReaderTests-1199679064 None] <== create_volume: return (859ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'} {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 10:13:54 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-a6bd1a59-0287-464e-94f8-56d07dfed4d9 tempest-ProjectReaderTests-1199679064 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.863s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:13:54 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-a6bd1a59-0287-464e-94f8-56d07dfed4d9 tempest-ProjectReaderTests-1199679064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9f257e3-7db9-45b7-a6b2-4080b4695766) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f97d4180-4366-41b5-ae78-29bc5e040458', 'volume_size': 1}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:13:54 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-a6bd1a59-0287-464e-94f8-56d07dfed4d9 tempest-ProjectReaderTests-1199679064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (beac165c-8ac3-4b07-94e6-4d8f0ba54c99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:13:54 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-a6bd1a59-0287-464e-94f8-56d07dfed4d9 tempest-ProjectReaderTests-1199679064 None] Volume volume-f97d4180-4366-41b5-ae78-29bc5e040458 (f97d4180-4366-41b5-ae78-29bc5e040458): created successfully Sep 07 10:13:54 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-a6bd1a59-0287-464e-94f8-56d07dfed4d9 tempest-ProjectReaderTests-1199679064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (beac165c-8ac3-4b07-94e6-4d8f0ba54c99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:13:54 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-a6bd1a59-0287-464e-94f8-56d07dfed4d9 tempest-ProjectReaderTests-1199679064 None] Flow 'volume_create_manager' (efa25f0f-a945-4d0a-9158-232899ebaddb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:13:54 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-a6bd1a59-0287-464e-94f8-56d07dfed4d9 tempest-ProjectReaderTests-1199679064 None] Created volume successfully. Sep 07 10:13:55 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-c013a8d1-040a-4b29-95cc-4284e55b5d7d tempest-ProjectReaderTests-1199679064 None] Acquiring lock "cinder-f97d4180-4366-41b5-ae78-29bc5e040458-delete_volume" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:13:55 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-c013a8d1-040a-4b29-95cc-4284e55b5d7d tempest-ProjectReaderTests-1199679064 None] Lock "cinder-f97d4180-4366-41b5-ae78-29bc5e040458-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:13:55 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-c013a8d1-040a-4b29-95cc-4284e55b5d7d tempest-ProjectReaderTests-1199679064 None] Acquiring lock "cinder-quobyte-f97d4180-4366-41b5-ae78-29bc5e040458" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:13:55 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-c013a8d1-040a-4b29-95cc-4284e55b5d7d tempest-ProjectReaderTests-1199679064 None] Lock "cinder-quobyte-f97d4180-4366-41b5-ae78-29bc5e040458" acquired by "delete_volume" :: waited 0.019s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:13:55 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7dd6fe2-87eb-4b25-abcb-10665408bf01]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:13:55 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-c013a8d1-040a-4b29-95cc-4284e55b5d7d tempest-ProjectReaderTests-1199679064 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-f97d4180-4366-41b5-ae78-29bc5e040458 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:13:56 devstack sudo[104260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-f97d4180-4366-41b5-ae78-29bc5e040458 Sep 07 10:13:56 devstack sudo[104260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:13:56 devstack sudo[104260]: pam_unix(sudo:session): session closed for user root Sep 07 10:13:56 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-c013a8d1-040a-4b29-95cc-4284e55b5d7d tempest-ProjectReaderTests-1199679064 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-f97d4180-4366-41b5-ae78-29bc5e040458" returned: 0 in 0.429s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:13:56 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-c013a8d1-040a-4b29-95cc-4284e55b5d7d tempest-ProjectReaderTests-1199679064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-f97d4180-4366-41b5-ae78-29bc5e040458 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:13:56 devstack sudo[104265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-f97d4180-4366-41b5-ae78-29bc5e040458 Sep 07 10:13:56 devstack sudo[104265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:13:56 devstack sudo[104265]: pam_unix(sudo:session): session closed for user root Sep 07 10:13:56 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-c013a8d1-040a-4b29-95cc-4284e55b5d7d tempest-ProjectReaderTests-1199679064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-f97d4180-4366-41b5-ae78-29bc5e040458" returned: 0 in 0.284s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:13:56 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-c013a8d1-040a-4b29-95cc-4284e55b5d7d tempest-ProjectReaderTests-1199679064 None] Lock "cinder-quobyte-f97d4180-4366-41b5-ae78-29bc5e040458" released by "delete_volume" :: held 0.770s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:13:56 devstack cinder-volume[87515]: DEBUG cinder.quota [None req-c013a8d1-040a-4b29-95cc-4284e55b5d7d tempest-ProjectReaderTests-1199679064 None] Created reservations ['b0f81a1e-c119-4e58-beee-69378d7b41ac', '722a2aee-032d-4ba5-98eb-95ce07a0a7dc', '25f6b68f-6b79-4c48-a102-4ed27fd5f355', '2f6b2b15-dd67-4146-bf3c-52f375ca3dc9'] {{(pid=87515) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:13:56 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-c013a8d1-040a-4b29-95cc-4284e55b5d7d tempest-ProjectReaderTests-1199679064 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:13:56 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-c013a8d1-040a-4b29-95cc-4284e55b5d7d tempest-ProjectReaderTests-1199679064 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:13:56 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-c013a8d1-040a-4b29-95cc-4284e55b5d7d tempest-ProjectReaderTests-1199679064 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:13:56 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-c013a8d1-040a-4b29-95cc-4284e55b5d7d tempest-ProjectReaderTests-1199679064 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:13:56 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-c013a8d1-040a-4b29-95cc-4284e55b5d7d tempest-ProjectReaderTests-1199679064 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:13:56 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-c013a8d1-040a-4b29-95cc-4284e55b5d7d tempest-ProjectReaderTests-1199679064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:13:56 devstack sudo[104268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a Sep 07 10:13:56 devstack sudo[104268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:13:57 devstack sudo[104268]: pam_unix(sudo:session): session closed for user root Sep 07 10:13:57 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-c013a8d1-040a-4b29-95cc-4284e55b5d7d tempest-ProjectReaderTests-1199679064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a" returned: 0 in 0.273s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:13:57 devstack cinder-volume[87515]: DEBUG cinder.manager [None req-c013a8d1-040a-4b29-95cc-4284e55b5d7d tempest-ProjectReaderTests-1199679064 None] Notifying Schedulers of capabilities ... {{(pid=87515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:13:57 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-c013a8d1-040a-4b29-95cc-4284e55b5d7d tempest-ProjectReaderTests-1199679064 None] Deleted volume successfully. Sep 07 10:13:57 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-c013a8d1-040a-4b29-95cc-4284e55b5d7d tempest-ProjectReaderTests-1199679064 None] Lock "cinder-f97d4180-4366-41b5-ae78-29bc5e040458-delete_volume" released by "delete_volume" :: held 1.314s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:13:57 devstack cinder-volume[87515]: DEBUG cinder.volume.flows.manager.create_volume [None req-b9c79a84-afc6-4d64-8a90-9fd13c8847aa tempest-ProjectReaderTests-1199679064 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 10:13:57 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-b9c79a84-afc6-4d64-8a90-9fd13c8847aa tempest-ProjectReaderTests-1199679064 None] Flow 'volume_create_manager' (13c426f6-8916-49b1-b4fd-ef5d47bf8244) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:13:57 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-b9c79a84-afc6-4d64-8a90-9fd13c8847aa tempest-ProjectReaderTests-1199679064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e81b005e-283e-45db-9109-ee2dc40eed49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:13:57 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-b9c79a84-afc6-4d64-8a90-9fd13c8847aa tempest-ProjectReaderTests-1199679064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e81b005e-283e-45db-9109-ee2dc40eed49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:13:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1670398375',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8ef051a-3e92-4815-964b-324f9700228c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e8627eee12e480f8364ab2f206f64e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:13:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:13:57Z,use_quota=True,user_id='af427c09ef1f4ee08a2a983aa3292891',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3a092cd-7947-4cbf-abff-4ba9567becf0),volume_type_id=f3a092cd-7947-4cbf-abff-4ba9567becf0)' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:13:57 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-b9c79a84-afc6-4d64-8a90-9fd13c8847aa tempest-ProjectReaderTests-1199679064 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d4ecedc-2d8e-491d-b4d0-4c6da7cf4011) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:13:57 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-b9c79a84-afc6-4d64-8a90-9fd13c8847aa tempest-ProjectReaderTests-1199679064 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d4ecedc-2d8e-491d-b4d0-4c6da7cf4011) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:13:57 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-b9c79a84-afc6-4d64-8a90-9fd13c8847aa tempest-ProjectReaderTests-1199679064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65048809-10dc-47ad-968d-a09168bdc3d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:13:57 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-b9c79a84-afc6-4d64-8a90-9fd13c8847aa tempest-ProjectReaderTests-1199679064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65048809-10dc-47ad-968d-a09168bdc3d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a8ef051a-3e92-4815-964b-324f9700228c', 'volume_name': 'volume-a8ef051a-3e92-4815-964b-324f9700228c', 'volume_size': 1}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:13:57 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-b9c79a84-afc6-4d64-8a90-9fd13c8847aa tempest-ProjectReaderTests-1199679064 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6cd3161f-6026-487a-897c-cab48da76921) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:13:57 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-b9c79a84-afc6-4d64-8a90-9fd13c8847aa tempest-ProjectReaderTests-1199679064 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6cd3161f-6026-487a-897c-cab48da76921) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:13:57 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-b9c79a84-afc6-4d64-8a90-9fd13c8847aa tempest-ProjectReaderTests-1199679064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (abfbb463-9b6d-4f4d-bc2d-ea3292427142) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:13:57 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-b9c79a84-afc6-4d64-8a90-9fd13c8847aa tempest-ProjectReaderTests-1199679064 None] Volume a8ef051a-3e92-4815-964b-324f9700228c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a8ef051a-3e92-4815-964b-324f9700228c', 'volume_size': 1} Sep 07 10:13:57 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-b9c79a84-afc6-4d64-8a90-9fd13c8847aa tempest-ProjectReaderTests-1199679064 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:13:57 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-b9c79a84-afc6-4d64-8a90-9fd13c8847aa tempest-ProjectReaderTests-1199679064 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:13:57 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-b9c79a84-afc6-4d64-8a90-9fd13c8847aa tempest-ProjectReaderTests-1199679064 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:13:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1670398375',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8ef051a-3e92-4815-964b-324f9700228c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e8627eee12e480f8364ab2f206f64e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:13:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:13:57Z,use_quota=True,user_id='af427c09ef1f4ee08a2a983aa3292891',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3a092cd-7947-4cbf-abff-4ba9567becf0),volume_type_id=f3a092cd-7947-4cbf-abff-4ba9567becf0)}" {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 10:13:57 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-b9c79a84-afc6-4d64-8a90-9fd13c8847aa tempest-ProjectReaderTests-1199679064 None] Creating volume a8ef051a-3e92-4815-964b-324f9700228c {{(pid=87515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 10:13:57 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-b9c79a84-afc6-4d64-8a90-9fd13c8847aa tempest-ProjectReaderTests-1199679064 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:13:57 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-b9c79a84-afc6-4d64-8a90-9fd13c8847aa tempest-ProjectReaderTests-1199679064 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:13:57 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-b9c79a84-afc6-4d64-8a90-9fd13c8847aa tempest-ProjectReaderTests-1199679064 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:13:57 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-b9c79a84-afc6-4d64-8a90-9fd13c8847aa tempest-ProjectReaderTests-1199679064 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:13:57 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-b9c79a84-afc6-4d64-8a90-9fd13c8847aa tempest-ProjectReaderTests-1199679064 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:13:57 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-b9c79a84-afc6-4d64-8a90-9fd13c8847aa tempest-ProjectReaderTests-1199679064 None] Selected osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c as target Quobyte volume. {{(pid=87515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 10:13:57 devstack cinder-volume[87515]: INFO cinder.volume.drivers.remotefs [None req-b9c79a84-afc6-4d64-8a90-9fd13c8847aa tempest-ProjectReaderTests-1199679064 None] casted to osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c Sep 07 10:13:57 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-b9c79a84-afc6-4d64-8a90-9fd13c8847aa tempest-ProjectReaderTests-1199679064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-a8ef051a-3e92-4815-964b-324f9700228c 1073741824 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:13:57 devstack sudo[104271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-a8ef051a-3e92-4815-964b-324f9700228c 1073741824 Sep 07 10:13:57 devstack sudo[104271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:13:57 devstack sudo[104271]: pam_unix(sudo:session): session closed for user root Sep 07 10:13:57 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-b9c79a84-afc6-4d64-8a90-9fd13c8847aa tempest-ProjectReaderTests-1199679064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-a8ef051a-3e92-4815-964b-324f9700228c 1073741824" returned: 0 in 0.408s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:13:57 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-b9c79a84-afc6-4d64-8a90-9fd13c8847aa tempest-ProjectReaderTests-1199679064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-a8ef051a-3e92-4815-964b-324f9700228c {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:13:57 devstack sudo[104276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-a8ef051a-3e92-4815-964b-324f9700228c Sep 07 10:13:57 devstack sudo[104276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:13:58 devstack sudo[104276]: pam_unix(sudo:session): session closed for user root Sep 07 10:13:58 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-b9c79a84-afc6-4d64-8a90-9fd13c8847aa tempest-ProjectReaderTests-1199679064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-a8ef051a-3e92-4815-964b-324f9700228c" returned: 0 in 0.239s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:13:58 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-b9c79a84-afc6-4d64-8a90-9fd13c8847aa tempest-ProjectReaderTests-1199679064 None] <== create_volume: return (688ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'} {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 10:13:58 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-b9c79a84-afc6-4d64-8a90-9fd13c8847aa tempest-ProjectReaderTests-1199679064 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.691s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:13:58 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-b9c79a84-afc6-4d64-8a90-9fd13c8847aa tempest-ProjectReaderTests-1199679064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (abfbb463-9b6d-4f4d-bc2d-ea3292427142) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a8ef051a-3e92-4815-964b-324f9700228c', 'volume_size': 1}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:13:58 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-b9c79a84-afc6-4d64-8a90-9fd13c8847aa tempest-ProjectReaderTests-1199679064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43b5fb13-8ecc-4bc4-98a7-ef5dc4330c18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:13:58 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-b9c79a84-afc6-4d64-8a90-9fd13c8847aa tempest-ProjectReaderTests-1199679064 None] Volume volume-a8ef051a-3e92-4815-964b-324f9700228c (a8ef051a-3e92-4815-964b-324f9700228c): created successfully Sep 07 10:13:58 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-b9c79a84-afc6-4d64-8a90-9fd13c8847aa tempest-ProjectReaderTests-1199679064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43b5fb13-8ecc-4bc4-98a7-ef5dc4330c18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:13:58 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-b9c79a84-afc6-4d64-8a90-9fd13c8847aa tempest-ProjectReaderTests-1199679064 None] Flow 'volume_create_manager' (13c426f6-8916-49b1-b4fd-ef5d47bf8244) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:13:58 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-b9c79a84-afc6-4d64-8a90-9fd13c8847aa tempest-ProjectReaderTests-1199679064 None] Created volume successfully. Sep 07 10:13:58 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-6f280130-f300-4b08-a1d1-bfafb835fc0a tempest-ProjectReaderTests-1199679064 None] Acquiring lock "cinder-a8ef051a-3e92-4815-964b-324f9700228c-delete_volume" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:13:58 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-6f280130-f300-4b08-a1d1-bfafb835fc0a tempest-ProjectReaderTests-1199679064 None] Lock "cinder-a8ef051a-3e92-4815-964b-324f9700228c-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:13:58 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-6f280130-f300-4b08-a1d1-bfafb835fc0a tempest-ProjectReaderTests-1199679064 None] Acquiring lock "cinder-quobyte-a8ef051a-3e92-4815-964b-324f9700228c" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:13:58 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-6f280130-f300-4b08-a1d1-bfafb835fc0a tempest-ProjectReaderTests-1199679064 None] Lock "cinder-quobyte-a8ef051a-3e92-4815-964b-324f9700228c" acquired by "delete_volume" :: waited 0.015s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:13:58 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0c826bc-b811-4675-9cc8-b823d3672402]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:13:58 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-6f280130-f300-4b08-a1d1-bfafb835fc0a tempest-ProjectReaderTests-1199679064 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-a8ef051a-3e92-4815-964b-324f9700228c {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:13:58 devstack sudo[104279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-a8ef051a-3e92-4815-964b-324f9700228c Sep 07 10:13:58 devstack sudo[104279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:13:58 devstack sudo[104279]: pam_unix(sudo:session): session closed for user root Sep 07 10:13:58 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-6f280130-f300-4b08-a1d1-bfafb835fc0a tempest-ProjectReaderTests-1199679064 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-a8ef051a-3e92-4815-964b-324f9700228c" returned: 0 in 0.362s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:13:58 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-6f280130-f300-4b08-a1d1-bfafb835fc0a tempest-ProjectReaderTests-1199679064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-a8ef051a-3e92-4815-964b-324f9700228c {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:13:58 devstack sudo[104284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-a8ef051a-3e92-4815-964b-324f9700228c Sep 07 10:13:58 devstack sudo[104284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:13:59 devstack sudo[104284]: pam_unix(sudo:session): session closed for user root Sep 07 10:13:59 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-6f280130-f300-4b08-a1d1-bfafb835fc0a tempest-ProjectReaderTests-1199679064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-a8ef051a-3e92-4815-964b-324f9700228c" returned: 0 in 0.240s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:13:59 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-6f280130-f300-4b08-a1d1-bfafb835fc0a tempest-ProjectReaderTests-1199679064 None] Lock "cinder-quobyte-a8ef051a-3e92-4815-964b-324f9700228c" released by "delete_volume" :: held 0.649s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:13:59 devstack cinder-volume[87515]: DEBUG cinder.quota [None req-6f280130-f300-4b08-a1d1-bfafb835fc0a tempest-ProjectReaderTests-1199679064 None] Created reservations ['7f741c49-b9d5-4ffd-be6e-88852fe82a16', '41d98cdb-6643-49b6-9595-87ac53974949', 'd94ba493-3d24-4572-a804-449c7a8bf199', '99ed5863-446c-4bce-ab0c-f2e58acb13bd'] {{(pid=87515) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:13:59 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-6f280130-f300-4b08-a1d1-bfafb835fc0a tempest-ProjectReaderTests-1199679064 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:13:59 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-6f280130-f300-4b08-a1d1-bfafb835fc0a tempest-ProjectReaderTests-1199679064 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:13:59 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-6f280130-f300-4b08-a1d1-bfafb835fc0a tempest-ProjectReaderTests-1199679064 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:13:59 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-6f280130-f300-4b08-a1d1-bfafb835fc0a tempest-ProjectReaderTests-1199679064 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:13:59 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-6f280130-f300-4b08-a1d1-bfafb835fc0a tempest-ProjectReaderTests-1199679064 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:13:59 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-6f280130-f300-4b08-a1d1-bfafb835fc0a tempest-ProjectReaderTests-1199679064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:13:59 devstack sudo[104288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a Sep 07 10:13:59 devstack sudo[104288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:13:59 devstack sudo[104288]: pam_unix(sudo:session): session closed for user root Sep 07 10:13:59 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-6f280130-f300-4b08-a1d1-bfafb835fc0a tempest-ProjectReaderTests-1199679064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a" returned: 0 in 0.270s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:13:59 devstack cinder-volume[87515]: DEBUG cinder.manager [None req-6f280130-f300-4b08-a1d1-bfafb835fc0a tempest-ProjectReaderTests-1199679064 None] Notifying Schedulers of capabilities ... {{(pid=87515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:13:59 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-6f280130-f300-4b08-a1d1-bfafb835fc0a tempest-ProjectReaderTests-1199679064 None] Deleted volume successfully. Sep 07 10:13:59 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-6f280130-f300-4b08-a1d1-bfafb835fc0a tempest-ProjectReaderTests-1199679064 None] Lock "cinder-a8ef051a-3e92-4815-964b-324f9700228c-delete_volume" released by "delete_volume" :: held 1.133s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:14:00 devstack cinder-volume[87515]: DEBUG cinder.volume.flows.manager.create_volume [None req-2254df76-0eb3-4e4c-8e79-4530bd3705d1 tempest-ProjectReaderTests-1199679064 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 10:14:00 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-2254df76-0eb3-4e4c-8e79-4530bd3705d1 tempest-ProjectReaderTests-1199679064 None] Flow 'volume_create_manager' (d137eec5-b6fc-4c78-9a90-ff27dafd5369) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:14:00 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-2254df76-0eb3-4e4c-8e79-4530bd3705d1 tempest-ProjectReaderTests-1199679064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dcfb4f1c-f3df-42cb-9faa-1384dc57bad9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:14:00 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-2254df76-0eb3-4e4c-8e79-4530bd3705d1 tempest-ProjectReaderTests-1199679064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dcfb4f1c-f3df-42cb-9faa-1384dc57bad9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:14:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-974755632',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ccc63eb-88b0-4628-93c1-60b0286aba47,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e8627eee12e480f8364ab2f206f64e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:14:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:14:00Z,use_quota=True,user_id='af427c09ef1f4ee08a2a983aa3292891',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3a092cd-7947-4cbf-abff-4ba9567becf0),volume_type_id=f3a092cd-7947-4cbf-abff-4ba9567becf0)' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:14:00 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-2254df76-0eb3-4e4c-8e79-4530bd3705d1 tempest-ProjectReaderTests-1199679064 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62eb6169-9951-4dcd-b0f7-992a163c09bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:14:00 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-2254df76-0eb3-4e4c-8e79-4530bd3705d1 tempest-ProjectReaderTests-1199679064 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62eb6169-9951-4dcd-b0f7-992a163c09bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:14:00 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-2254df76-0eb3-4e4c-8e79-4530bd3705d1 tempest-ProjectReaderTests-1199679064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (704000c8-112a-4a5d-8b12-f630da22ed3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:14:00 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-2254df76-0eb3-4e4c-8e79-4530bd3705d1 tempest-ProjectReaderTests-1199679064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (704000c8-112a-4a5d-8b12-f630da22ed3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4ccc63eb-88b0-4628-93c1-60b0286aba47', 'volume_name': 'volume-4ccc63eb-88b0-4628-93c1-60b0286aba47', 'volume_size': 1}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:14:00 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-2254df76-0eb3-4e4c-8e79-4530bd3705d1 tempest-ProjectReaderTests-1199679064 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b04d4bc6-d19d-4103-a4a0-8e08b05c2e69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:14:00 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-2254df76-0eb3-4e4c-8e79-4530bd3705d1 tempest-ProjectReaderTests-1199679064 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b04d4bc6-d19d-4103-a4a0-8e08b05c2e69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:14:00 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-2254df76-0eb3-4e4c-8e79-4530bd3705d1 tempest-ProjectReaderTests-1199679064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df14ea51-e7fe-4494-891f-c5fcc13a9ca0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:14:00 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-2254df76-0eb3-4e4c-8e79-4530bd3705d1 tempest-ProjectReaderTests-1199679064 None] Volume 4ccc63eb-88b0-4628-93c1-60b0286aba47: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4ccc63eb-88b0-4628-93c1-60b0286aba47', 'volume_size': 1} Sep 07 10:14:00 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-2254df76-0eb3-4e4c-8e79-4530bd3705d1 tempest-ProjectReaderTests-1199679064 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:14:00 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-2254df76-0eb3-4e4c-8e79-4530bd3705d1 tempest-ProjectReaderTests-1199679064 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:14:00 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-2254df76-0eb3-4e4c-8e79-4530bd3705d1 tempest-ProjectReaderTests-1199679064 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:14:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-974755632',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ccc63eb-88b0-4628-93c1-60b0286aba47,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e8627eee12e480f8364ab2f206f64e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:14:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:14:00Z,use_quota=True,user_id='af427c09ef1f4ee08a2a983aa3292891',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3a092cd-7947-4cbf-abff-4ba9567becf0),volume_type_id=f3a092cd-7947-4cbf-abff-4ba9567becf0)}" {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 10:14:00 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-2254df76-0eb3-4e4c-8e79-4530bd3705d1 tempest-ProjectReaderTests-1199679064 None] Creating volume 4ccc63eb-88b0-4628-93c1-60b0286aba47 {{(pid=87515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 10:14:00 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-2254df76-0eb3-4e4c-8e79-4530bd3705d1 tempest-ProjectReaderTests-1199679064 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:14:00 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-2254df76-0eb3-4e4c-8e79-4530bd3705d1 tempest-ProjectReaderTests-1199679064 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:14:00 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-2254df76-0eb3-4e4c-8e79-4530bd3705d1 tempest-ProjectReaderTests-1199679064 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:14:00 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-2254df76-0eb3-4e4c-8e79-4530bd3705d1 tempest-ProjectReaderTests-1199679064 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:14:00 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-2254df76-0eb3-4e4c-8e79-4530bd3705d1 tempest-ProjectReaderTests-1199679064 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:14:00 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-2254df76-0eb3-4e4c-8e79-4530bd3705d1 tempest-ProjectReaderTests-1199679064 None] Selected osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c as target Quobyte volume. {{(pid=87515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 10:14:00 devstack cinder-volume[87515]: INFO cinder.volume.drivers.remotefs [None req-2254df76-0eb3-4e4c-8e79-4530bd3705d1 tempest-ProjectReaderTests-1199679064 None] casted to osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c Sep 07 10:14:00 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-2254df76-0eb3-4e4c-8e79-4530bd3705d1 tempest-ProjectReaderTests-1199679064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-4ccc63eb-88b0-4628-93c1-60b0286aba47 1073741824 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:14:00 devstack sudo[104291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-4ccc63eb-88b0-4628-93c1-60b0286aba47 1073741824 Sep 07 10:14:00 devstack sudo[104291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:14:00 devstack sudo[104291]: pam_unix(sudo:session): session closed for user root Sep 07 10:14:00 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-2254df76-0eb3-4e4c-8e79-4530bd3705d1 tempest-ProjectReaderTests-1199679064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-4ccc63eb-88b0-4628-93c1-60b0286aba47 1073741824" returned: 0 in 0.409s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:14:00 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-2254df76-0eb3-4e4c-8e79-4530bd3705d1 tempest-ProjectReaderTests-1199679064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-4ccc63eb-88b0-4628-93c1-60b0286aba47 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:14:00 devstack sudo[104297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-4ccc63eb-88b0-4628-93c1-60b0286aba47 Sep 07 10:14:00 devstack sudo[104297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:14:00 devstack sudo[104297]: pam_unix(sudo:session): session closed for user root Sep 07 10:14:00 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-2254df76-0eb3-4e4c-8e79-4530bd3705d1 tempest-ProjectReaderTests-1199679064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-4ccc63eb-88b0-4628-93c1-60b0286aba47" returned: 0 in 0.242s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:14:00 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-2254df76-0eb3-4e4c-8e79-4530bd3705d1 tempest-ProjectReaderTests-1199679064 None] <== create_volume: return (694ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'} {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 10:14:00 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-2254df76-0eb3-4e4c-8e79-4530bd3705d1 tempest-ProjectReaderTests-1199679064 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.697s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:14:00 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-2254df76-0eb3-4e4c-8e79-4530bd3705d1 tempest-ProjectReaderTests-1199679064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df14ea51-e7fe-4494-891f-c5fcc13a9ca0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4ccc63eb-88b0-4628-93c1-60b0286aba47', 'volume_size': 1}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:14:00 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-2254df76-0eb3-4e4c-8e79-4530bd3705d1 tempest-ProjectReaderTests-1199679064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb23216b-df8b-4372-aab7-83452a31b560) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:14:00 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-2254df76-0eb3-4e4c-8e79-4530bd3705d1 tempest-ProjectReaderTests-1199679064 None] Volume volume-4ccc63eb-88b0-4628-93c1-60b0286aba47 (4ccc63eb-88b0-4628-93c1-60b0286aba47): created successfully Sep 07 10:14:00 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-2254df76-0eb3-4e4c-8e79-4530bd3705d1 tempest-ProjectReaderTests-1199679064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb23216b-df8b-4372-aab7-83452a31b560) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:14:00 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-2254df76-0eb3-4e4c-8e79-4530bd3705d1 tempest-ProjectReaderTests-1199679064 None] Flow 'volume_create_manager' (d137eec5-b6fc-4c78-9a90-ff27dafd5369) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:14:00 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-2254df76-0eb3-4e4c-8e79-4530bd3705d1 tempest-ProjectReaderTests-1199679064 None] Created volume successfully. Sep 07 10:14:01 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-6b3c46e1-36f4-4986-90d9-253ddec6711d tempest-ProjectReaderTests-1199679064 None] Acquiring lock "cinder-4ccc63eb-88b0-4628-93c1-60b0286aba47-delete_volume" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:14:01 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-6b3c46e1-36f4-4986-90d9-253ddec6711d tempest-ProjectReaderTests-1199679064 None] Lock "cinder-4ccc63eb-88b0-4628-93c1-60b0286aba47-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:14:01 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-6b3c46e1-36f4-4986-90d9-253ddec6711d tempest-ProjectReaderTests-1199679064 None] Acquiring lock "cinder-quobyte-4ccc63eb-88b0-4628-93c1-60b0286aba47" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:14:01 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-6b3c46e1-36f4-4986-90d9-253ddec6711d tempest-ProjectReaderTests-1199679064 None] Lock "cinder-quobyte-4ccc63eb-88b0-4628-93c1-60b0286aba47" acquired by "delete_volume" :: waited 0.023s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:14:01 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[81f56d87-5a43-43a7-9926-1f5a3529be5e]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:14:01 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-6b3c46e1-36f4-4986-90d9-253ddec6711d tempest-ProjectReaderTests-1199679064 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-4ccc63eb-88b0-4628-93c1-60b0286aba47 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:14:01 devstack sudo[104302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-4ccc63eb-88b0-4628-93c1-60b0286aba47 Sep 07 10:14:01 devstack sudo[104302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:14:01 devstack sudo[104302]: pam_unix(sudo:session): session closed for user root Sep 07 10:14:01 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-6b3c46e1-36f4-4986-90d9-253ddec6711d tempest-ProjectReaderTests-1199679064 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-4ccc63eb-88b0-4628-93c1-60b0286aba47" returned: 0 in 0.375s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:14:01 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-6b3c46e1-36f4-4986-90d9-253ddec6711d tempest-ProjectReaderTests-1199679064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-4ccc63eb-88b0-4628-93c1-60b0286aba47 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:14:01 devstack sudo[104307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-4ccc63eb-88b0-4628-93c1-60b0286aba47 Sep 07 10:14:01 devstack sudo[104307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:14:02 devstack sudo[104307]: pam_unix(sudo:session): session closed for user root Sep 07 10:14:02 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-6b3c46e1-36f4-4986-90d9-253ddec6711d tempest-ProjectReaderTests-1199679064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-4ccc63eb-88b0-4628-93c1-60b0286aba47" returned: 0 in 0.254s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:14:02 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-6b3c46e1-36f4-4986-90d9-253ddec6711d tempest-ProjectReaderTests-1199679064 None] Lock "cinder-quobyte-4ccc63eb-88b0-4628-93c1-60b0286aba47" released by "delete_volume" :: held 0.670s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:14:02 devstack cinder-volume[87515]: DEBUG cinder.quota [None req-6b3c46e1-36f4-4986-90d9-253ddec6711d tempest-ProjectReaderTests-1199679064 None] Created reservations ['6d65cf58-b082-4959-8712-3dd0afbf2f1f', '68639386-50b6-43bb-816f-e2d57ace8018', 'f25dd487-ce36-4012-acb6-97830372ac3e', '47debc5d-f1cc-4165-8226-e3a93768f693'] {{(pid=87515) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:14:02 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-6b3c46e1-36f4-4986-90d9-253ddec6711d tempest-ProjectReaderTests-1199679064 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:14:02 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-6b3c46e1-36f4-4986-90d9-253ddec6711d tempest-ProjectReaderTests-1199679064 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:14:02 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-6b3c46e1-36f4-4986-90d9-253ddec6711d tempest-ProjectReaderTests-1199679064 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:14:02 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-6b3c46e1-36f4-4986-90d9-253ddec6711d tempest-ProjectReaderTests-1199679064 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:14:02 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-6b3c46e1-36f4-4986-90d9-253ddec6711d tempest-ProjectReaderTests-1199679064 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:14:02 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-6b3c46e1-36f4-4986-90d9-253ddec6711d tempest-ProjectReaderTests-1199679064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:14:02 devstack sudo[104310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a Sep 07 10:14:02 devstack sudo[104310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:14:02 devstack sudo[104310]: pam_unix(sudo:session): session closed for user root Sep 07 10:14:02 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-6b3c46e1-36f4-4986-90d9-253ddec6711d tempest-ProjectReaderTests-1199679064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a" returned: 0 in 0.243s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:14:02 devstack cinder-volume[87515]: DEBUG cinder.manager [None req-6b3c46e1-36f4-4986-90d9-253ddec6711d tempest-ProjectReaderTests-1199679064 None] Notifying Schedulers of capabilities ... {{(pid=87515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:14:02 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-6b3c46e1-36f4-4986-90d9-253ddec6711d tempest-ProjectReaderTests-1199679064 None] Deleted volume successfully. Sep 07 10:14:02 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-6b3c46e1-36f4-4986-90d9-253ddec6711d tempest-ProjectReaderTests-1199679064 None] Lock "cinder-4ccc63eb-88b0-4628-93c1-60b0286aba47-delete_volume" released by "delete_volume" :: held 1.152s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:14:02 devstack cinder-volume[87515]: DEBUG cinder.volume.flows.manager.create_volume [None req-076c301e-04d9-4bf6-ae08-2fcb12b3ef77 tempest-ProjectReaderTests-1199679064 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 10:14:02 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-076c301e-04d9-4bf6-ae08-2fcb12b3ef77 tempest-ProjectReaderTests-1199679064 None] Flow 'volume_create_manager' (3c18a6cb-46a2-458d-82ef-deafc93ec8cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:14:02 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-076c301e-04d9-4bf6-ae08-2fcb12b3ef77 tempest-ProjectReaderTests-1199679064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b710a85-524e-4860-ba99-f0da73e8e675) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:14:02 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-076c301e-04d9-4bf6-ae08-2fcb12b3ef77 tempest-ProjectReaderTests-1199679064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b710a85-524e-4860-ba99-f0da73e8e675) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:14:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-810918864',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=842ed4df-9b11-47c5-9e0e-fe2235e223e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e8627eee12e480f8364ab2f206f64e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:14:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:14:03Z,use_quota=True,user_id='af427c09ef1f4ee08a2a983aa3292891',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3a092cd-7947-4cbf-abff-4ba9567becf0),volume_type_id=f3a092cd-7947-4cbf-abff-4ba9567becf0)' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:14:02 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-076c301e-04d9-4bf6-ae08-2fcb12b3ef77 tempest-ProjectReaderTests-1199679064 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b8c9c99-524d-4127-81b1-d864799eb74f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:14:02 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-076c301e-04d9-4bf6-ae08-2fcb12b3ef77 tempest-ProjectReaderTests-1199679064 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b8c9c99-524d-4127-81b1-d864799eb74f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:14:02 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-076c301e-04d9-4bf6-ae08-2fcb12b3ef77 tempest-ProjectReaderTests-1199679064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da153c7f-c667-4ce9-980d-07e373ebd7e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:14:02 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-076c301e-04d9-4bf6-ae08-2fcb12b3ef77 tempest-ProjectReaderTests-1199679064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da153c7f-c667-4ce9-980d-07e373ebd7e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '842ed4df-9b11-47c5-9e0e-fe2235e223e2', 'volume_name': 'volume-842ed4df-9b11-47c5-9e0e-fe2235e223e2', 'volume_size': 1}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:14:02 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-076c301e-04d9-4bf6-ae08-2fcb12b3ef77 tempest-ProjectReaderTests-1199679064 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (016496f1-0847-4c1e-9e9e-1806e8ec0be0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:14:02 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-076c301e-04d9-4bf6-ae08-2fcb12b3ef77 tempest-ProjectReaderTests-1199679064 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (016496f1-0847-4c1e-9e9e-1806e8ec0be0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:14:02 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-076c301e-04d9-4bf6-ae08-2fcb12b3ef77 tempest-ProjectReaderTests-1199679064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a500914c-95e3-4132-aecb-baef87579d67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:14:02 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-076c301e-04d9-4bf6-ae08-2fcb12b3ef77 tempest-ProjectReaderTests-1199679064 None] Volume 842ed4df-9b11-47c5-9e0e-fe2235e223e2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-842ed4df-9b11-47c5-9e0e-fe2235e223e2', 'volume_size': 1} Sep 07 10:14:02 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-076c301e-04d9-4bf6-ae08-2fcb12b3ef77 tempest-ProjectReaderTests-1199679064 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:14:02 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-076c301e-04d9-4bf6-ae08-2fcb12b3ef77 tempest-ProjectReaderTests-1199679064 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:14:02 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-076c301e-04d9-4bf6-ae08-2fcb12b3ef77 tempest-ProjectReaderTests-1199679064 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:14:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-810918864',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=842ed4df-9b11-47c5-9e0e-fe2235e223e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e8627eee12e480f8364ab2f206f64e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:14:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:14:03Z,use_quota=True,user_id='af427c09ef1f4ee08a2a983aa3292891',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3a092cd-7947-4cbf-abff-4ba9567becf0),volume_type_id=f3a092cd-7947-4cbf-abff-4ba9567becf0)}" {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 10:14:02 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-076c301e-04d9-4bf6-ae08-2fcb12b3ef77 tempest-ProjectReaderTests-1199679064 None] Creating volume 842ed4df-9b11-47c5-9e0e-fe2235e223e2 {{(pid=87515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 10:14:02 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-076c301e-04d9-4bf6-ae08-2fcb12b3ef77 tempest-ProjectReaderTests-1199679064 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:14:02 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-076c301e-04d9-4bf6-ae08-2fcb12b3ef77 tempest-ProjectReaderTests-1199679064 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:14:02 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-076c301e-04d9-4bf6-ae08-2fcb12b3ef77 tempest-ProjectReaderTests-1199679064 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:14:02 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-076c301e-04d9-4bf6-ae08-2fcb12b3ef77 tempest-ProjectReaderTests-1199679064 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:14:02 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-076c301e-04d9-4bf6-ae08-2fcb12b3ef77 tempest-ProjectReaderTests-1199679064 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:14:02 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-076c301e-04d9-4bf6-ae08-2fcb12b3ef77 tempest-ProjectReaderTests-1199679064 None] Selected osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c as target Quobyte volume. {{(pid=87515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 10:14:02 devstack cinder-volume[87515]: INFO cinder.volume.drivers.remotefs [None req-076c301e-04d9-4bf6-ae08-2fcb12b3ef77 tempest-ProjectReaderTests-1199679064 None] casted to osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c Sep 07 10:14:03 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-076c301e-04d9-4bf6-ae08-2fcb12b3ef77 tempest-ProjectReaderTests-1199679064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-842ed4df-9b11-47c5-9e0e-fe2235e223e2 1073741824 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:14:03 devstack sudo[104313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-842ed4df-9b11-47c5-9e0e-fe2235e223e2 1073741824 Sep 07 10:14:03 devstack sudo[104313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:14:03 devstack sudo[104313]: pam_unix(sudo:session): session closed for user root Sep 07 10:14:03 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-076c301e-04d9-4bf6-ae08-2fcb12b3ef77 tempest-ProjectReaderTests-1199679064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-842ed4df-9b11-47c5-9e0e-fe2235e223e2 1073741824" returned: 0 in 0.418s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:14:03 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-076c301e-04d9-4bf6-ae08-2fcb12b3ef77 tempest-ProjectReaderTests-1199679064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-842ed4df-9b11-47c5-9e0e-fe2235e223e2 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:14:03 devstack sudo[104318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-842ed4df-9b11-47c5-9e0e-fe2235e223e2 Sep 07 10:14:03 devstack sudo[104318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:14:03 devstack sudo[104318]: pam_unix(sudo:session): session closed for user root Sep 07 10:14:03 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-076c301e-04d9-4bf6-ae08-2fcb12b3ef77 tempest-ProjectReaderTests-1199679064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-842ed4df-9b11-47c5-9e0e-fe2235e223e2" returned: 0 in 0.256s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:14:03 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-076c301e-04d9-4bf6-ae08-2fcb12b3ef77 tempest-ProjectReaderTests-1199679064 None] <== create_volume: return (713ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'} {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 10:14:03 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-076c301e-04d9-4bf6-ae08-2fcb12b3ef77 tempest-ProjectReaderTests-1199679064 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.715s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:14:03 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-076c301e-04d9-4bf6-ae08-2fcb12b3ef77 tempest-ProjectReaderTests-1199679064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a500914c-95e3-4132-aecb-baef87579d67) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-842ed4df-9b11-47c5-9e0e-fe2235e223e2', 'volume_size': 1}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:14:03 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-076c301e-04d9-4bf6-ae08-2fcb12b3ef77 tempest-ProjectReaderTests-1199679064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d363102-40de-43f0-8310-bc6ff400b8ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:14:03 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-076c301e-04d9-4bf6-ae08-2fcb12b3ef77 tempest-ProjectReaderTests-1199679064 None] Volume volume-842ed4df-9b11-47c5-9e0e-fe2235e223e2 (842ed4df-9b11-47c5-9e0e-fe2235e223e2): created successfully Sep 07 10:14:03 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-076c301e-04d9-4bf6-ae08-2fcb12b3ef77 tempest-ProjectReaderTests-1199679064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d363102-40de-43f0-8310-bc6ff400b8ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:14:03 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-076c301e-04d9-4bf6-ae08-2fcb12b3ef77 tempest-ProjectReaderTests-1199679064 None] Flow 'volume_create_manager' (3c18a6cb-46a2-458d-82ef-deafc93ec8cf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:14:03 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-076c301e-04d9-4bf6-ae08-2fcb12b3ef77 tempest-ProjectReaderTests-1199679064 None] Created volume successfully. Sep 07 10:14:03 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-d3d655fe-bd51-44d8-8a17-931c9b8eae42 tempest-ProjectReaderTests-1199679064 None] Acquiring lock "cinder-842ed4df-9b11-47c5-9e0e-fe2235e223e2-delete_volume" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:14:03 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-d3d655fe-bd51-44d8-8a17-931c9b8eae42 tempest-ProjectReaderTests-1199679064 None] Lock "cinder-842ed4df-9b11-47c5-9e0e-fe2235e223e2-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:14:04 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-d3d655fe-bd51-44d8-8a17-931c9b8eae42 tempest-ProjectReaderTests-1199679064 None] Acquiring lock "cinder-quobyte-842ed4df-9b11-47c5-9e0e-fe2235e223e2" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:14:04 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-d3d655fe-bd51-44d8-8a17-931c9b8eae42 tempest-ProjectReaderTests-1199679064 None] Lock "cinder-quobyte-842ed4df-9b11-47c5-9e0e-fe2235e223e2" acquired by "delete_volume" :: waited 0.018s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:14:04 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba7f34af-9253-44c5-b04d-02d978d410f6]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:14:04 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-d3d655fe-bd51-44d8-8a17-931c9b8eae42 tempest-ProjectReaderTests-1199679064 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-842ed4df-9b11-47c5-9e0e-fe2235e223e2 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:14:04 devstack sudo[104321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-842ed4df-9b11-47c5-9e0e-fe2235e223e2 Sep 07 10:14:04 devstack sudo[104321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:14:04 devstack sudo[104321]: pam_unix(sudo:session): session closed for user root Sep 07 10:14:04 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-d3d655fe-bd51-44d8-8a17-931c9b8eae42 tempest-ProjectReaderTests-1199679064 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-842ed4df-9b11-47c5-9e0e-fe2235e223e2" returned: 0 in 0.363s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:14:04 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-d3d655fe-bd51-44d8-8a17-931c9b8eae42 tempest-ProjectReaderTests-1199679064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-842ed4df-9b11-47c5-9e0e-fe2235e223e2 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:14:04 devstack sudo[104327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-842ed4df-9b11-47c5-9e0e-fe2235e223e2 Sep 07 10:14:04 devstack sudo[104327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:14:04 devstack sudo[104327]: pam_unix(sudo:session): session closed for user root Sep 07 10:14:04 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-d3d655fe-bd51-44d8-8a17-931c9b8eae42 tempest-ProjectReaderTests-1199679064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-842ed4df-9b11-47c5-9e0e-fe2235e223e2" returned: 0 in 0.254s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:14:04 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-d3d655fe-bd51-44d8-8a17-931c9b8eae42 tempest-ProjectReaderTests-1199679064 None] Lock "cinder-quobyte-842ed4df-9b11-47c5-9e0e-fe2235e223e2" released by "delete_volume" :: held 0.656s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:14:04 devstack cinder-volume[87515]: DEBUG cinder.quota [None req-d3d655fe-bd51-44d8-8a17-931c9b8eae42 tempest-ProjectReaderTests-1199679064 None] Created reservations ['dfd55fb8-a997-477b-a004-69d19afe1449', 'f8cc0816-3ec2-4b0c-9cff-526458d45a3f', '48ead6e2-259a-47d6-842b-027093540a91', 'e88c9072-ae9f-4a29-a9fb-e69c42656a5f'] {{(pid=87515) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:14:04 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-d3d655fe-bd51-44d8-8a17-931c9b8eae42 tempest-ProjectReaderTests-1199679064 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:14:04 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-d3d655fe-bd51-44d8-8a17-931c9b8eae42 tempest-ProjectReaderTests-1199679064 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:14:04 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-d3d655fe-bd51-44d8-8a17-931c9b8eae42 tempest-ProjectReaderTests-1199679064 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:14:04 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-d3d655fe-bd51-44d8-8a17-931c9b8eae42 tempest-ProjectReaderTests-1199679064 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:14:04 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-d3d655fe-bd51-44d8-8a17-931c9b8eae42 tempest-ProjectReaderTests-1199679064 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:14:04 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-d3d655fe-bd51-44d8-8a17-931c9b8eae42 tempest-ProjectReaderTests-1199679064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:14:04 devstack sudo[104330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a Sep 07 10:14:04 devstack sudo[104330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:14:05 devstack sudo[104330]: pam_unix(sudo:session): session closed for user root Sep 07 10:14:05 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-d3d655fe-bd51-44d8-8a17-931c9b8eae42 tempest-ProjectReaderTests-1199679064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a" returned: 0 in 0.289s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:14:05 devstack cinder-volume[87515]: DEBUG cinder.manager [None req-d3d655fe-bd51-44d8-8a17-931c9b8eae42 tempest-ProjectReaderTests-1199679064 None] Notifying Schedulers of capabilities ... {{(pid=87515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:14:05 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-d3d655fe-bd51-44d8-8a17-931c9b8eae42 tempest-ProjectReaderTests-1199679064 None] Deleted volume successfully. Sep 07 10:14:05 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-d3d655fe-bd51-44d8-8a17-931c9b8eae42 tempest-ProjectReaderTests-1199679064 None] Lock "cinder-842ed4df-9b11-47c5-9e0e-fe2235e223e2-delete_volume" released by "delete_volume" :: held 1.176s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:14:11 devstack cinder-volume[87515]: DEBUG oslo_service.periodic_task [None req-cebd6a9d-3073-42a1-b65a-b38d444d85ed None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87515) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 10:14:11 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-cebd6a9d-3073-42a1-b65a-b38d444d85ed None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:14:11 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-cebd6a9d-3073-42a1-b65a-b38d444d85ed None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:14:11 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-cebd6a9d-3073-42a1-b65a-b38d444d85ed None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:14:11 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-cebd6a9d-3073-42a1-b65a-b38d444d85ed None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:14:11 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-cebd6a9d-3073-42a1-b65a-b38d444d85ed None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:14:11 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-cebd6a9d-3073-42a1-b65a-b38d444d85ed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:14:11 devstack sudo[104372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a Sep 07 10:14:11 devstack sudo[104372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:14:11 devstack sudo[104372]: pam_unix(sudo:session): session closed for user root Sep 07 10:14:11 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-cebd6a9d-3073-42a1-b65a-b38d444d85ed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a" returned: 0 in 0.244s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:14:11 devstack cinder-volume[87515]: DEBUG cinder.manager [None req-cebd6a9d-3073-42a1-b65a-b38d444d85ed None None] Notifying Schedulers of capabilities ... {{(pid=87515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:14:11 devstack cinder-volume[87515]: DEBUG oslo_service.periodic_task [None req-cebd6a9d-3073-42a1-b65a-b38d444d85ed None None] Running periodic task VolumeManager._thread_info {{(pid=87515) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 10:14:11 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-cebd6a9d-3073-42a1-b65a-b38d444d85ed None None] thread count: 29 {{(pid=87515) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 07 10:14:11 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-cebd6a9d-3073-42a1-b65a-b38d444d85ed None None] thread info: [<_MainThread(MainThread, started 131647121809536)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87515) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 07 10:14:14 devstack cinder-volume[87515]: DEBUG dbcounter [-] [87515] Writing DB stats cinder:SELECT=41,cinder:UPDATE=51,cinder:INSERT=20,cinder:DELETE=2 {{(pid=87515) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 10:14:15 devstack cinder-volume[87515]: DEBUG dbcounter [-] [87515] Writing DB stats cinder:SELECT=46,cinder:INSERT=14,cinder:UPDATE=49,cinder:DELETE=7 {{(pid=87515) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 10:14:19 devstack cinder-volume[87515]: INFO cinder.volume.manager [req-f8bd4436-1ed3-4cbf-a047-ad60293adb75 req-4dd7c0cf-ad56-4bf7-a21b-568c4e241adf tempest-TestShelveInstance-858685255 None] Terminate volume connection completed successfully. Sep 07 10:14:19 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [req-f8bd4436-1ed3-4cbf-a047-ad60293adb75 req-4dd7c0cf-ad56-4bf7-a21b-568c4e241adf tempest-TestShelveInstance-858685255 None] Deleting attachment 40a19fe4-3366-448a-96ed-1a06e1de7cfe. {{(pid=87515) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 07 10:14:21 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [req-8e9ec875-6952-496c-af22-027bfe6e85ac req-7a421570-ea80-48d9-9a5a-c369b2e22770 tempest-TestShelveInstance-858685255 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:14:21 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [req-8e9ec875-6952-496c-af22-027bfe6e85ac req-7a421570-ea80-48d9-9a5a-c369b2e22770 tempest-TestShelveInstance-858685255 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:14:21 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [req-8e9ec875-6952-496c-af22-027bfe6e85ac req-7a421570-ea80-48d9-9a5a-c369b2e22770 tempest-TestShelveInstance-858685255 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.011s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:14:22 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [req-8e9ec875-6952-496c-af22-027bfe6e85ac req-7a421570-ea80-48d9-9a5a-c369b2e22770 tempest-TestShelveInstance-858685255 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c', 'name': 'volume-57317039-d395-4460-ba64-a04d0baf2864', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5fcd6afe-bd35-4fc2-9756-cbe59a9dff42', 'enforce_multipath': True} {{(pid=87515) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 07 10:14:22 devstack cinder-volume[87515]: INFO cinder.volume.manager [req-8e9ec875-6952-496c-af22-027bfe6e85ac req-7a421570-ea80-48d9-9a5a-c369b2e22770 tempest-TestShelveInstance-858685255 None] attachment_update completed successfully. Sep 07 10:14:32 devstack cinder-volume[87515]: DEBUG dbcounter [-] [87515] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=87515) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 10:14:32 devstack cinder-volume[87515]: DEBUG dbcounter [-] [87515] Writing DB stats cinder:SELECT=8,cinder:UPDATE=2 {{(pid=87515) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 10:14:49 devstack cinder-volume[87515]: INFO cinder.volume.manager [req-fcd6f47a-7b64-4886-8c08-66fb75e278ee req-59300fdc-83b0-4325-b5c1-b73d3e80febf tempest-TestShelveInstance-858685255 None] Terminate volume connection completed successfully. Sep 07 10:14:49 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [req-fcd6f47a-7b64-4886-8c08-66fb75e278ee req-59300fdc-83b0-4325-b5c1-b73d3e80febf tempest-TestShelveInstance-858685255 None] Deleting attachment 5fcd6afe-bd35-4fc2-9756-cbe59a9dff42. {{(pid=87515) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 07 10:14:49 devstack cinder-volume[87515]: DEBUG cinder.coordination [req-fcd6f47a-7b64-4886-8c08-66fb75e278ee req-50d87465-0adb-461d-a14d-007f2d20744b tempest-TestShelveInstance-858685255 None] Acquiring lock "cinder-57317039-d395-4460-ba64-a04d0baf2864-delete_volume" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:14:49 devstack cinder-volume[87515]: DEBUG cinder.coordination [req-fcd6f47a-7b64-4886-8c08-66fb75e278ee req-50d87465-0adb-461d-a14d-007f2d20744b tempest-TestShelveInstance-858685255 None] Lock "cinder-57317039-d395-4460-ba64-a04d0baf2864-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:14:49 devstack cinder-volume[87515]: DEBUG cinder.coordination [req-fcd6f47a-7b64-4886-8c08-66fb75e278ee req-50d87465-0adb-461d-a14d-007f2d20744b tempest-TestShelveInstance-858685255 None] Acquiring lock "cinder-quobyte-57317039-d395-4460-ba64-a04d0baf2864" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:14:49 devstack cinder-volume[87515]: DEBUG cinder.coordination [req-fcd6f47a-7b64-4886-8c08-66fb75e278ee req-50d87465-0adb-461d-a14d-007f2d20744b tempest-TestShelveInstance-858685255 None] Lock "cinder-quobyte-57317039-d395-4460-ba64-a04d0baf2864" acquired by "delete_volume" :: waited 0.017s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:14:49 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[45d63c20-b9a9-4d7a-8b72-c9ebed6574f5]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:14:49 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [req-fcd6f47a-7b64-4886-8c08-66fb75e278ee req-50d87465-0adb-461d-a14d-007f2d20744b tempest-TestShelveInstance-858685255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-57317039-d395-4460-ba64-a04d0baf2864 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:14:49 devstack sudo[104983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-57317039-d395-4460-ba64-a04d0baf2864 Sep 07 10:14:49 devstack sudo[104983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:14:49 devstack sudo[104983]: pam_unix(sudo:session): session closed for user root Sep 07 10:14:49 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [req-fcd6f47a-7b64-4886-8c08-66fb75e278ee req-50d87465-0adb-461d-a14d-007f2d20744b tempest-TestShelveInstance-858685255 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-57317039-d395-4460-ba64-a04d0baf2864" returned: 0 in 0.371s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:14:49 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [req-fcd6f47a-7b64-4886-8c08-66fb75e278ee req-50d87465-0adb-461d-a14d-007f2d20744b tempest-TestShelveInstance-858685255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-57317039-d395-4460-ba64-a04d0baf2864 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:14:49 devstack sudo[104989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-57317039-d395-4460-ba64-a04d0baf2864 Sep 07 10:14:49 devstack sudo[104989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:14:50 devstack sudo[104989]: pam_unix(sudo:session): session closed for user root Sep 07 10:14:50 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [req-fcd6f47a-7b64-4886-8c08-66fb75e278ee req-50d87465-0adb-461d-a14d-007f2d20744b tempest-TestShelveInstance-858685255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-57317039-d395-4460-ba64-a04d0baf2864" returned: 0 in 0.241s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:14:50 devstack cinder-volume[87515]: DEBUG cinder.coordination [req-fcd6f47a-7b64-4886-8c08-66fb75e278ee req-50d87465-0adb-461d-a14d-007f2d20744b tempest-TestShelveInstance-858685255 None] Lock "cinder-quobyte-57317039-d395-4460-ba64-a04d0baf2864" released by "delete_volume" :: held 0.656s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:14:50 devstack cinder-volume[87515]: DEBUG cinder.quota [req-fcd6f47a-7b64-4886-8c08-66fb75e278ee req-50d87465-0adb-461d-a14d-007f2d20744b tempest-TestShelveInstance-858685255 None] Created reservations ['28123b93-2eea-4498-9f9d-16e6e48da3ed', '9bc8c67e-0178-47c1-bde9-1a5e2b7ba8da', '94a5f0b9-52bf-4295-b188-6124158ad41a', '69763649-d1d0-4fd9-9341-f26c4f2d4a97'] {{(pid=87515) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:14:50 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [req-fcd6f47a-7b64-4886-8c08-66fb75e278ee req-50d87465-0adb-461d-a14d-007f2d20744b tempest-TestShelveInstance-858685255 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:14:50 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [req-fcd6f47a-7b64-4886-8c08-66fb75e278ee req-50d87465-0adb-461d-a14d-007f2d20744b tempest-TestShelveInstance-858685255 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:14:50 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [req-fcd6f47a-7b64-4886-8c08-66fb75e278ee req-50d87465-0adb-461d-a14d-007f2d20744b tempest-TestShelveInstance-858685255 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:14:50 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [req-fcd6f47a-7b64-4886-8c08-66fb75e278ee req-50d87465-0adb-461d-a14d-007f2d20744b tempest-TestShelveInstance-858685255 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:14:50 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [req-fcd6f47a-7b64-4886-8c08-66fb75e278ee req-50d87465-0adb-461d-a14d-007f2d20744b tempest-TestShelveInstance-858685255 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:14:50 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [req-fcd6f47a-7b64-4886-8c08-66fb75e278ee req-50d87465-0adb-461d-a14d-007f2d20744b tempest-TestShelveInstance-858685255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:14:50 devstack sudo[104992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a Sep 07 10:14:50 devstack sudo[104992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:14:50 devstack sudo[104992]: pam_unix(sudo:session): session closed for user root Sep 07 10:14:50 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [req-fcd6f47a-7b64-4886-8c08-66fb75e278ee req-50d87465-0adb-461d-a14d-007f2d20744b tempest-TestShelveInstance-858685255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a" returned: 0 in 0.242s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:14:50 devstack cinder-volume[87515]: DEBUG cinder.manager [req-fcd6f47a-7b64-4886-8c08-66fb75e278ee req-50d87465-0adb-461d-a14d-007f2d20744b tempest-TestShelveInstance-858685255 None] Notifying Schedulers of capabilities ... {{(pid=87515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:14:50 devstack cinder-volume[87515]: INFO cinder.volume.manager [req-fcd6f47a-7b64-4886-8c08-66fb75e278ee req-50d87465-0adb-461d-a14d-007f2d20744b tempest-TestShelveInstance-858685255 None] Deleted volume successfully. Sep 07 10:14:50 devstack cinder-volume[87515]: DEBUG cinder.coordination [req-fcd6f47a-7b64-4886-8c08-66fb75e278ee req-50d87465-0adb-461d-a14d-007f2d20744b tempest-TestShelveInstance-858685255 None] Lock "cinder-57317039-d395-4460-ba64-a04d0baf2864-delete_volume" released by "delete_volume" :: held 1.097s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:15:00 devstack cinder-volume[87515]: DEBUG dbcounter [-] [87515] Writing DB stats cinder:SELECT=4,cinder:INSERT=2,cinder:UPDATE=8,cinder:DELETE=1 {{(pid=87515) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 10:15:03 devstack cinder-volume[87515]: DEBUG dbcounter [-] [87515] Writing DB stats cinder:SELECT=9,cinder:UPDATE=9,cinder:INSERT=2 {{(pid=87515) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 10:15:11 devstack cinder-volume[87515]: DEBUG oslo_service.periodic_task [None req-cebd6a9d-3073-42a1-b65a-b38d444d85ed None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87515) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 10:15:11 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-cebd6a9d-3073-42a1-b65a-b38d444d85ed None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:15:11 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-cebd6a9d-3073-42a1-b65a-b38d444d85ed None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:15:11 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-cebd6a9d-3073-42a1-b65a-b38d444d85ed None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:15:11 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-cebd6a9d-3073-42a1-b65a-b38d444d85ed None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:15:11 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-cebd6a9d-3073-42a1-b65a-b38d444d85ed None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:15:11 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-cebd6a9d-3073-42a1-b65a-b38d444d85ed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:15:11 devstack sudo[105008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a Sep 07 10:15:11 devstack sudo[105008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:15:11 devstack sudo[105008]: pam_unix(sudo:session): session closed for user root Sep 07 10:15:11 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-cebd6a9d-3073-42a1-b65a-b38d444d85ed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a" returned: 0 in 0.293s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:15:11 devstack cinder-volume[87515]: DEBUG cinder.manager [None req-cebd6a9d-3073-42a1-b65a-b38d444d85ed None None] Notifying Schedulers of capabilities ... {{(pid=87515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:15:11 devstack cinder-volume[87515]: DEBUG oslo_service.periodic_task [None req-cebd6a9d-3073-42a1-b65a-b38d444d85ed None None] Running periodic task VolumeManager._thread_info {{(pid=87515) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 10:15:11 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-cebd6a9d-3073-42a1-b65a-b38d444d85ed None None] thread count: 29 {{(pid=87515) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 07 10:15:11 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-cebd6a9d-3073-42a1-b65a-b38d444d85ed None None] thread info: [<_MainThread(MainThread, started 131647121809536)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87515) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 07 10:15:20 devstack cinder-volume[87515]: DEBUG cinder.volume.flows.manager.create_volume [None req-8d6040c5-240c-4cb5-ad52-e4bf12023d11 tempest-TestStampPattern-892517498 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 10:15:20 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-8d6040c5-240c-4cb5-ad52-e4bf12023d11 tempest-TestStampPattern-892517498 None] Flow 'volume_create_manager' (1e41d6e3-dd02-4de2-85aa-baf85ba5a874) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:15:20 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-8d6040c5-240c-4cb5-ad52-e4bf12023d11 tempest-TestStampPattern-892517498 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e43fe93e-5325-424f-bdea-dc317dfc024f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:15:20 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-8d6040c5-240c-4cb5-ad52-e4bf12023d11 tempest-TestStampPattern-892517498 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e43fe93e-5325-424f-bdea-dc317dfc024f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:15:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1246116981',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb83f46b-b912-4428-98ba-8bd87b07a190,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b972cc6b2ced4749989afd8fe3dec9d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:15:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:15:21Z,use_quota=True,user_id='e8d07c7312e241008a8f73b04c28faa2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3a092cd-7947-4cbf-abff-4ba9567becf0),volume_type_id=f3a092cd-7947-4cbf-abff-4ba9567becf0)' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:15:20 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-8d6040c5-240c-4cb5-ad52-e4bf12023d11 tempest-TestStampPattern-892517498 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16632bd4-afcf-4282-b170-2f10e5a8e5b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:15:20 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-8d6040c5-240c-4cb5-ad52-e4bf12023d11 tempest-TestStampPattern-892517498 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16632bd4-afcf-4282-b170-2f10e5a8e5b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:15:20 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-8d6040c5-240c-4cb5-ad52-e4bf12023d11 tempest-TestStampPattern-892517498 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5eaefe78-346e-4d71-8f9e-18e320e44501) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:15:20 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-8d6040c5-240c-4cb5-ad52-e4bf12023d11 tempest-TestStampPattern-892517498 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5eaefe78-346e-4d71-8f9e-18e320e44501) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bb83f46b-b912-4428-98ba-8bd87b07a190', 'volume_name': 'volume-bb83f46b-b912-4428-98ba-8bd87b07a190', 'volume_size': 1}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:15:20 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-8d6040c5-240c-4cb5-ad52-e4bf12023d11 tempest-TestStampPattern-892517498 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b331c01e-1382-477d-9f60-c0bd24760b72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:15:20 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-8d6040c5-240c-4cb5-ad52-e4bf12023d11 tempest-TestStampPattern-892517498 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b331c01e-1382-477d-9f60-c0bd24760b72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:15:20 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-8d6040c5-240c-4cb5-ad52-e4bf12023d11 tempest-TestStampPattern-892517498 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ef73fb2-1e4b-4419-8ec1-2a681bdac56f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:15:20 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-8d6040c5-240c-4cb5-ad52-e4bf12023d11 tempest-TestStampPattern-892517498 None] Volume bb83f46b-b912-4428-98ba-8bd87b07a190: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bb83f46b-b912-4428-98ba-8bd87b07a190', 'volume_size': 1} Sep 07 10:15:20 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-8d6040c5-240c-4cb5-ad52-e4bf12023d11 tempest-TestStampPattern-892517498 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:15:20 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-8d6040c5-240c-4cb5-ad52-e4bf12023d11 tempest-TestStampPattern-892517498 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:15:20 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-8d6040c5-240c-4cb5-ad52-e4bf12023d11 tempest-TestStampPattern-892517498 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:15:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1246116981',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb83f46b-b912-4428-98ba-8bd87b07a190,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b972cc6b2ced4749989afd8fe3dec9d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:15:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:15:21Z,use_quota=True,user_id='e8d07c7312e241008a8f73b04c28faa2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3a092cd-7947-4cbf-abff-4ba9567becf0),volume_type_id=f3a092cd-7947-4cbf-abff-4ba9567becf0)}" {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 10:15:20 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-8d6040c5-240c-4cb5-ad52-e4bf12023d11 tempest-TestStampPattern-892517498 None] Creating volume bb83f46b-b912-4428-98ba-8bd87b07a190 {{(pid=87515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 10:15:20 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-8d6040c5-240c-4cb5-ad52-e4bf12023d11 tempest-TestStampPattern-892517498 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:15:20 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-8d6040c5-240c-4cb5-ad52-e4bf12023d11 tempest-TestStampPattern-892517498 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:15:20 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-8d6040c5-240c-4cb5-ad52-e4bf12023d11 tempest-TestStampPattern-892517498 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:15:20 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-8d6040c5-240c-4cb5-ad52-e4bf12023d11 tempest-TestStampPattern-892517498 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:15:20 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-8d6040c5-240c-4cb5-ad52-e4bf12023d11 tempest-TestStampPattern-892517498 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:15:20 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-8d6040c5-240c-4cb5-ad52-e4bf12023d11 tempest-TestStampPattern-892517498 None] Selected osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c as target Quobyte volume. {{(pid=87515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 10:15:20 devstack cinder-volume[87515]: INFO cinder.volume.drivers.remotefs [None req-8d6040c5-240c-4cb5-ad52-e4bf12023d11 tempest-TestStampPattern-892517498 None] casted to osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c Sep 07 10:15:20 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-8d6040c5-240c-4cb5-ad52-e4bf12023d11 tempest-TestStampPattern-892517498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-bb83f46b-b912-4428-98ba-8bd87b07a190 1073741824 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:15:20 devstack sudo[105013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-bb83f46b-b912-4428-98ba-8bd87b07a190 1073741824 Sep 07 10:15:20 devstack sudo[105013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:15:21 devstack sudo[105013]: pam_unix(sudo:session): session closed for user root Sep 07 10:15:21 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-8d6040c5-240c-4cb5-ad52-e4bf12023d11 tempest-TestStampPattern-892517498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-bb83f46b-b912-4428-98ba-8bd87b07a190 1073741824" returned: 0 in 0.452s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:15:21 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-8d6040c5-240c-4cb5-ad52-e4bf12023d11 tempest-TestStampPattern-892517498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-bb83f46b-b912-4428-98ba-8bd87b07a190 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:15:21 devstack sudo[105019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-bb83f46b-b912-4428-98ba-8bd87b07a190 Sep 07 10:15:21 devstack sudo[105019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:15:21 devstack sudo[105019]: pam_unix(sudo:session): session closed for user root Sep 07 10:15:21 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-8d6040c5-240c-4cb5-ad52-e4bf12023d11 tempest-TestStampPattern-892517498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-bb83f46b-b912-4428-98ba-8bd87b07a190" returned: 0 in 0.260s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:15:21 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-8d6040c5-240c-4cb5-ad52-e4bf12023d11 tempest-TestStampPattern-892517498 None] <== create_volume: return (758ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'} {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 10:15:21 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-8d6040c5-240c-4cb5-ad52-e4bf12023d11 tempest-TestStampPattern-892517498 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.761s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:15:21 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-8d6040c5-240c-4cb5-ad52-e4bf12023d11 tempest-TestStampPattern-892517498 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ef73fb2-1e4b-4419-8ec1-2a681bdac56f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bb83f46b-b912-4428-98ba-8bd87b07a190', 'volume_size': 1}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:15:21 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-8d6040c5-240c-4cb5-ad52-e4bf12023d11 tempest-TestStampPattern-892517498 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fcee1985-a4ac-4d83-b742-3c457c1c0f4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:15:21 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-8d6040c5-240c-4cb5-ad52-e4bf12023d11 tempest-TestStampPattern-892517498 None] Volume volume-bb83f46b-b912-4428-98ba-8bd87b07a190 (bb83f46b-b912-4428-98ba-8bd87b07a190): created successfully Sep 07 10:15:21 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-8d6040c5-240c-4cb5-ad52-e4bf12023d11 tempest-TestStampPattern-892517498 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fcee1985-a4ac-4d83-b742-3c457c1c0f4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:15:21 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-8d6040c5-240c-4cb5-ad52-e4bf12023d11 tempest-TestStampPattern-892517498 None] Flow 'volume_create_manager' (1e41d6e3-dd02-4de2-85aa-baf85ba5a874) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:15:21 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-8d6040c5-240c-4cb5-ad52-e4bf12023d11 tempest-TestStampPattern-892517498 None] Created volume successfully. Sep 07 10:15:31 devstack cinder-volume[87515]: DEBUG dbcounter [-] [87515] Writing DB stats cinder:SELECT=3,cinder:UPDATE=2 {{(pid=87515) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 10:15:31 devstack cinder-volume[87515]: DEBUG dbcounter [-] [87515] Writing DB stats cinder:UPDATE=4,cinder:SELECT=1,cinder:INSERT=1,cinder:DELETE=1 {{(pid=87515) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 10:15:50 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [req-821507a8-9cba-4bb4-99f6-df5fc3212423 req-00d7ab2a-9d4b-4460-ba7d-a80a0ca29c51 tempest-TestStampPattern-892517498 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:15:50 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [req-821507a8-9cba-4bb4-99f6-df5fc3212423 req-00d7ab2a-9d4b-4460-ba7d-a80a0ca29c51 tempest-TestStampPattern-892517498 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:15:50 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [req-821507a8-9cba-4bb4-99f6-df5fc3212423 req-00d7ab2a-9d4b-4460-ba7d-a80a0ca29c51 tempest-TestStampPattern-892517498 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.011s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:15:50 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [req-821507a8-9cba-4bb4-99f6-df5fc3212423 req-00d7ab2a-9d4b-4460-ba7d-a80a0ca29c51 tempest-TestStampPattern-892517498 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c', 'name': 'volume-bb83f46b-b912-4428-98ba-8bd87b07a190', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '79354629-081f-4661-b1f7-396e5ea1f96d', 'enforce_multipath': True} {{(pid=87515) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 07 10:15:50 devstack cinder-volume[87515]: INFO cinder.volume.manager [req-821507a8-9cba-4bb4-99f6-df5fc3212423 req-00d7ab2a-9d4b-4460-ba7d-a80a0ca29c51 tempest-TestStampPattern-892517498 None] attachment_update completed successfully. Sep 07 10:15:54 devstack cinder-volume[87515]: INFO cinder.volume.manager [req-1bba2650-27b7-4d10-993a-0207262a6260 req-2eaf14a4-093f-4fdd-822b-d3d5c7e92747 tempest-TestStampPattern-892517498 None] Terminate volume connection completed successfully. Sep 07 10:15:54 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [req-1bba2650-27b7-4d10-993a-0207262a6260 req-2eaf14a4-093f-4fdd-822b-d3d5c7e92747 tempest-TestStampPattern-892517498 None] Deleting attachment 79354629-081f-4661-b1f7-396e5ea1f96d. {{(pid=87515) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 07 10:15:55 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-bdc3aea3-9c42-475a-8650-5af85eb4575a tempest-TestStampPattern-892517498 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:15:55 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-bdc3aea3-9c42-475a-8650-5af85eb4575a tempest-TestStampPattern-892517498 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:15:55 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-bdc3aea3-9c42-475a-8650-5af85eb4575a tempest-TestStampPattern-892517498 None] Creating offline snapshot 7e7f4a13-3991-444a-9b31-3648f050665e of volume bb83f46b-b912-4428-98ba-8bd87b07a190 {{(pid=87515) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 10:15:55 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[4eb616b2-deff-410a-8af5-052cfc43461d]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:15:55 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-bdc3aea3-9c42-475a-8650-5af85eb4575a tempest-TestStampPattern-892517498 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-bb83f46b-b912-4428-98ba-8bd87b07a190 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:15:55 devstack sudo[105622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-bb83f46b-b912-4428-98ba-8bd87b07a190 Sep 07 10:15:55 devstack sudo[105622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:15:55 devstack sudo[105622]: pam_unix(sudo:session): session closed for user root Sep 07 10:15:55 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-bdc3aea3-9c42-475a-8650-5af85eb4575a tempest-TestStampPattern-892517498 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-bb83f46b-b912-4428-98ba-8bd87b07a190" returned: 0 in 0.363s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:15:55 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-bdc3aea3-9c42-475a-8650-5af85eb4575a tempest-TestStampPattern-892517498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-bb83f46b-b912-4428-98ba-8bd87b07a190,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-bb83f46b-b912-4428-98ba-8bd87b07a190.7e7f4a13-3991-444a-9b31-3648f050665e 1G {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:15:55 devstack sudo[105627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-bb83f46b-b912-4428-98ba-8bd87b07a190,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-bb83f46b-b912-4428-98ba-8bd87b07a190.7e7f4a13-3991-444a-9b31-3648f050665e 1G Sep 07 10:15:55 devstack sudo[105627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:15:56 devstack sudo[105627]: pam_unix(sudo:session): session closed for user root Sep 07 10:15:56 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-bdc3aea3-9c42-475a-8650-5af85eb4575a tempest-TestStampPattern-892517498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-bb83f46b-b912-4428-98ba-8bd87b07a190,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-bb83f46b-b912-4428-98ba-8bd87b07a190.7e7f4a13-3991-444a-9b31-3648f050665e 1G" returned: 0 in 0.368s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:15:56 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-bdc3aea3-9c42-475a-8650-5af85eb4575a tempest-TestStampPattern-892517498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bb83f46b-b912-4428-98ba-8bd87b07a190 -F qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-bb83f46b-b912-4428-98ba-8bd87b07a190.7e7f4a13-3991-444a-9b31-3648f050665e {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:15:56 devstack sudo[105632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bb83f46b-b912-4428-98ba-8bd87b07a190 -F qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-bb83f46b-b912-4428-98ba-8bd87b07a190.7e7f4a13-3991-444a-9b31-3648f050665e Sep 07 10:15:56 devstack sudo[105632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:15:56 devstack sudo[105632]: pam_unix(sudo:session): session closed for user root Sep 07 10:15:56 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-bdc3aea3-9c42-475a-8650-5af85eb4575a tempest-TestStampPattern-892517498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bb83f46b-b912-4428-98ba-8bd87b07a190 -F qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-bb83f46b-b912-4428-98ba-8bd87b07a190.7e7f4a13-3991-444a-9b31-3648f050665e" returned: 0 in 0.279s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:15:56 devstack cinder-volume[87515]: WARNING cinder.volume.drivers.remotefs [None req-bdc3aea3-9c42-475a-8650-5af85eb4575a tempest-TestStampPattern-892517498 None] /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-bb83f46b-b912-4428-98ba-8bd87b07a190.7e7f4a13-3991-444a-9b31-3648f050665e is being set with open permissions: ugo+rw Sep 07 10:15:56 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-bdc3aea3-9c42-475a-8650-5af85eb4575a tempest-TestStampPattern-892517498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-bb83f46b-b912-4428-98ba-8bd87b07a190.7e7f4a13-3991-444a-9b31-3648f050665e {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:15:56 devstack sudo[105638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-bb83f46b-b912-4428-98ba-8bd87b07a190.7e7f4a13-3991-444a-9b31-3648f050665e Sep 07 10:15:56 devstack sudo[105638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:15:56 devstack sudo[105638]: pam_unix(sudo:session): session closed for user root Sep 07 10:15:56 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-bdc3aea3-9c42-475a-8650-5af85eb4575a tempest-TestStampPattern-892517498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-bb83f46b-b912-4428-98ba-8bd87b07a190.7e7f4a13-3991-444a-9b31-3648f050665e" returned: 0 in 0.234s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:15:56 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-bdc3aea3-9c42-475a-8650-5af85eb4575a tempest-TestStampPattern-892517498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-bb83f46b-b912-4428-98ba-8bd87b07a190.info {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:15:56 devstack sudo[105641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-bb83f46b-b912-4428-98ba-8bd87b07a190.info Sep 07 10:15:56 devstack sudo[105641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:15:57 devstack sudo[105641]: pam_unix(sudo:session): session closed for user root Sep 07 10:15:57 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-bdc3aea3-9c42-475a-8650-5af85eb4575a tempest-TestStampPattern-892517498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-bb83f46b-b912-4428-98ba-8bd87b07a190.info" returned: 0 in 0.258s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:15:57 devstack cinder-volume[87515]: WARNING cinder.volume.drivers.remotefs [None req-bdc3aea3-9c42-475a-8650-5af85eb4575a tempest-TestStampPattern-892517498 None] /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-bb83f46b-b912-4428-98ba-8bd87b07a190.info is being set with open permissions: ugo+rw Sep 07 10:15:57 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-bdc3aea3-9c42-475a-8650-5af85eb4575a tempest-TestStampPattern-892517498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-bb83f46b-b912-4428-98ba-8bd87b07a190.info {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:15:57 devstack sudo[105644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-bb83f46b-b912-4428-98ba-8bd87b07a190.info Sep 07 10:15:57 devstack sudo[105644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:15:57 devstack sudo[105644]: pam_unix(sudo:session): session closed for user root Sep 07 10:15:57 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-bdc3aea3-9c42-475a-8650-5af85eb4575a tempest-TestStampPattern-892517498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-bb83f46b-b912-4428-98ba-8bd87b07a190.info" returned: 0 in 0.236s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:15:57 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-bdc3aea3-9c42-475a-8650-5af85eb4575a tempest-TestStampPattern-892517498 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.823s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:15:57 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-bdc3aea3-9c42-475a-8650-5af85eb4575a tempest-TestStampPattern-892517498 None] Create snapshot completed successfully Sep 07 10:16:04 devstack cinder-volume[87515]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa6e8cab-c473-4a4a-853f-1b5788d39a3b tempest-TestStampPattern-892517498 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 10:16:04 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-aa6e8cab-c473-4a4a-853f-1b5788d39a3b tempest-TestStampPattern-892517498 None] Flow 'volume_create_manager' (641ac87a-e969-4984-b0ad-cea97c8ab186) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:16:04 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-aa6e8cab-c473-4a4a-853f-1b5788d39a3b tempest-TestStampPattern-892517498 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3673a43c-0aa7-4a21-9c5f-53686d2590ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:16:04 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-aa6e8cab-c473-4a4a-853f-1b5788d39a3b tempest-TestStampPattern-892517498 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3673a43c-0aa7-4a21-9c5f-53686d2590ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:16:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-177877540',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c29f46f0-9ed4-4ea3-b0a4-c0d228196c37,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b972cc6b2ced4749989afd8fe3dec9d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:16:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=7e7f4a13-3991-444a-9b31-3648f050665e,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:16:04Z,use_quota=True,user_id='e8d07c7312e241008a8f73b04c28faa2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3a092cd-7947-4cbf-abff-4ba9567becf0),volume_type_id=f3a092cd-7947-4cbf-abff-4ba9567becf0)' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:16:04 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-aa6e8cab-c473-4a4a-853f-1b5788d39a3b tempest-TestStampPattern-892517498 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2cf45188-b34a-47aa-b09b-a2cffff01a23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:16:04 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-aa6e8cab-c473-4a4a-853f-1b5788d39a3b tempest-TestStampPattern-892517498 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2cf45188-b34a-47aa-b09b-a2cffff01a23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:16:04 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-aa6e8cab-c473-4a4a-853f-1b5788d39a3b tempest-TestStampPattern-892517498 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63308073-f110-4ce3-83c2-f0546cf3ea04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:16:04 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-aa6e8cab-c473-4a4a-853f-1b5788d39a3b tempest-TestStampPattern-892517498 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63308073-f110-4ce3-83c2-f0546cf3ea04) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'c29f46f0-9ed4-4ea3-b0a4-c0d228196c37', 'volume_name': 'volume-c29f46f0-9ed4-4ea3-b0a4-c0d228196c37', 'volume_size': 1, 'snapshot_id': '7e7f4a13-3991-444a-9b31-3648f050665e'}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:16:04 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-aa6e8cab-c473-4a4a-853f-1b5788d39a3b tempest-TestStampPattern-892517498 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05ce15e6-1026-44ac-aa66-b4e68412dfa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:16:04 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-aa6e8cab-c473-4a4a-853f-1b5788d39a3b tempest-TestStampPattern-892517498 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05ce15e6-1026-44ac-aa66-b4e68412dfa3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:16:04 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-aa6e8cab-c473-4a4a-853f-1b5788d39a3b tempest-TestStampPattern-892517498 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de985e30-acef-424f-86fc-b9fb274b55e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:16:04 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-aa6e8cab-c473-4a4a-853f-1b5788d39a3b tempest-TestStampPattern-892517498 None] Volume c29f46f0-9ed4-4ea3-b0a4-c0d228196c37: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-c29f46f0-9ed4-4ea3-b0a4-c0d228196c37', 'volume_size': 1, 'snapshot_id': '7e7f4a13-3991-444a-9b31-3648f050665e'} Sep 07 10:16:04 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-aa6e8cab-c473-4a4a-853f-1b5788d39a3b tempest-TestStampPattern-892517498 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:16:04 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-aa6e8cab-c473-4a4a-853f-1b5788d39a3b tempest-TestStampPattern-892517498 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:16:04 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-aa6e8cab-c473-4a4a-853f-1b5788d39a3b tempest-TestStampPattern-892517498 None] Acquiring lock "cinder-quobyte-7e7f4a13-3991-444a-9b31-3648f050665e-c29f46f0-9ed4-4ea3-b0a4-c0d228196c37" by "_create_volume_from_snapshot" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:16:04 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-aa6e8cab-c473-4a4a-853f-1b5788d39a3b tempest-TestStampPattern-892517498 None] Lock "cinder-quobyte-7e7f4a13-3991-444a-9b31-3648f050665e-c29f46f0-9ed4-4ea3-b0a4-c0d228196c37" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:16:04 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-aa6e8cab-c473-4a4a-853f-1b5788d39a3b tempest-TestStampPattern-892517498 None] Creating volume c29f46f0-9ed4-4ea3-b0a4-c0d228196c37 from snapshot 7e7f4a13-3991-444a-9b31-3648f050665e {{(pid=87515) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 07 10:16:04 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-aa6e8cab-c473-4a4a-853f-1b5788d39a3b tempest-TestStampPattern-892517498 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:16:04 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-aa6e8cab-c473-4a4a-853f-1b5788d39a3b tempest-TestStampPattern-892517498 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:16:04 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-aa6e8cab-c473-4a4a-853f-1b5788d39a3b tempest-TestStampPattern-892517498 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:16:04 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-aa6e8cab-c473-4a4a-853f-1b5788d39a3b tempest-TestStampPattern-892517498 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:16:04 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-aa6e8cab-c473-4a4a-853f-1b5788d39a3b tempest-TestStampPattern-892517498 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:16:04 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-aa6e8cab-c473-4a4a-853f-1b5788d39a3b tempest-TestStampPattern-892517498 None] Selected osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c as target Quobyte volume. {{(pid=87515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 10:16:04 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-aa6e8cab-c473-4a4a-853f-1b5788d39a3b tempest-TestStampPattern-892517498 None] Acquiring lock "cinder-quobyte-c29f46f0-9ed4-4ea3-b0a4-c0d228196c37" by "_copy_volume_from_snapshot" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:16:04 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-aa6e8cab-c473-4a4a-853f-1b5788d39a3b tempest-TestStampPattern-892517498 None] Lock "cinder-quobyte-c29f46f0-9ed4-4ea3-b0a4-c0d228196c37" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:16:04 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-aa6e8cab-c473-4a4a-853f-1b5788d39a3b tempest-TestStampPattern-892517498 None] snapshot: 7e7f4a13-3991-444a-9b31-3648f050665e, volume: c29f46f0-9ed4-4ea3-b0a4-c0d228196c37, {{(pid=87515) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 07 10:16:04 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-aa6e8cab-c473-4a4a-853f-1b5788d39a3b tempest-TestStampPattern-892517498 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:16:04 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-aa6e8cab-c473-4a4a-853f-1b5788d39a3b tempest-TestStampPattern-892517498 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:16:04 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-aa6e8cab-c473-4a4a-853f-1b5788d39a3b tempest-TestStampPattern-892517498 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:16:04 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-aa6e8cab-c473-4a4a-853f-1b5788d39a3b tempest-TestStampPattern-892517498 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:16:04 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-aa6e8cab-c473-4a4a-853f-1b5788d39a3b tempest-TestStampPattern-892517498 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:16:04 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[008c552a-078a-426e-b410-5c015c11203e]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:16:04 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-aa6e8cab-c473-4a4a-853f-1b5788d39a3b tempest-TestStampPattern-892517498 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-bb83f46b-b912-4428-98ba-8bd87b07a190.7e7f4a13-3991-444a-9b31-3648f050665e {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:16:04 devstack sudo[105673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-bb83f46b-b912-4428-98ba-8bd87b07a190.7e7f4a13-3991-444a-9b31-3648f050665e Sep 07 10:16:04 devstack sudo[105673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:16:04 devstack sudo[105673]: pam_unix(sudo:session): session closed for user root Sep 07 10:16:04 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-aa6e8cab-c473-4a4a-853f-1b5788d39a3b tempest-TestStampPattern-892517498 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-bb83f46b-b912-4428-98ba-8bd87b07a190.7e7f4a13-3991-444a-9b31-3648f050665e" returned: 0 in 0.388s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:16:04 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-aa6e8cab-c473-4a4a-853f-1b5788d39a3b tempest-TestStampPattern-892517498 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bb83f46b-b912-4428-98ba-8bd87b07a190(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87515) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 10:16:04 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[39dd6afd-af45-47fe-8d03-505dbe6b9ae7]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:16:04 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-aa6e8cab-c473-4a4a-853f-1b5788d39a3b tempest-TestStampPattern-892517498 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-bb83f46b-b912-4428-98ba-8bd87b07a190 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:16:05 devstack sudo[105678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-bb83f46b-b912-4428-98ba-8bd87b07a190 Sep 07 10:16:05 devstack sudo[105678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:16:05 devstack sudo[105678]: pam_unix(sudo:session): session closed for user root Sep 07 10:16:05 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-aa6e8cab-c473-4a4a-853f-1b5788d39a3b tempest-TestStampPattern-892517498 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-bb83f46b-b912-4428-98ba-8bd87b07a190" returned: 0 in 0.453s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:16:05 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-aa6e8cab-c473-4a4a-853f-1b5788d39a3b tempest-TestStampPattern-892517498 None] will copy from snapshot at /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-bb83f46b-b912-4428-98ba-8bd87b07a190 {{(pid=87515) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 07 10:16:05 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-aa6e8cab-c473-4a4a-853f-1b5788d39a3b tempest-TestStampPattern-892517498 None] Creating direct copy from snapshot {{(pid=87515) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 07 10:16:05 devstack cinder-volume[87515]: DEBUG cinder.utils [None req-aa6e8cab-c473-4a4a-853f-1b5788d39a3b tempest-TestStampPattern-892517498 None] Path /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-c29f46f0-9ed4-4ea3-b0a4-c0d228196c37 not found in is_blk_device check {{(pid=87515) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 07 10:16:05 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-aa6e8cab-c473-4a4a-853f-1b5788d39a3b tempest-TestStampPattern-892517498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-bb83f46b-b912-4428-98ba-8bd87b07a190 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-c29f46f0-9ed4-4ea3-b0a4-c0d228196c37 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:16:05 devstack sudo[105692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-bb83f46b-b912-4428-98ba-8bd87b07a190 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-c29f46f0-9ed4-4ea3-b0a4-c0d228196c37 Sep 07 10:16:05 devstack sudo[105692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:16:11 devstack sudo[105692]: pam_unix(sudo:session): session closed for user root Sep 07 10:16:11 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-aa6e8cab-c473-4a4a-853f-1b5788d39a3b tempest-TestStampPattern-892517498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-bb83f46b-b912-4428-98ba-8bd87b07a190 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-c29f46f0-9ed4-4ea3-b0a4-c0d228196c37" returned: 0 in 6.037s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:16:11 devstack cinder-volume[87515]: DEBUG cinder.image.image_utils [None req-aa6e8cab-c473-4a4a-853f-1b5788d39a3b tempest-TestStampPattern-892517498 None] Image conversion details: src /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-bb83f46b-b912-4428-98ba-8bd87b07a190, size 1024.00 MB, duration 6.04 sec, destination /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-c29f46f0-9ed4-4ea3-b0a4-c0d228196c37 {{(pid=87515) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 07 10:16:11 devstack cinder-volume[87515]: INFO cinder.image.image_utils [None req-aa6e8cab-c473-4a4a-853f-1b5788d39a3b tempest-TestStampPattern-892517498 None] Converted 1024.00 MB image at 169.55 MB/s Sep 07 10:16:11 devstack cinder-volume[87515]: WARNING cinder.volume.drivers.remotefs [None req-aa6e8cab-c473-4a4a-853f-1b5788d39a3b tempest-TestStampPattern-892517498 None] /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-c29f46f0-9ed4-4ea3-b0a4-c0d228196c37 is being set with open permissions: ugo+rw Sep 07 10:16:11 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-aa6e8cab-c473-4a4a-853f-1b5788d39a3b tempest-TestStampPattern-892517498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-c29f46f0-9ed4-4ea3-b0a4-c0d228196c37 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:16:11 devstack sudo[105712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-c29f46f0-9ed4-4ea3-b0a4-c0d228196c37 Sep 07 10:16:11 devstack sudo[105712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:16:11 devstack cinder-volume[87515]: DEBUG oslo_service.periodic_task [None req-cebd6a9d-3073-42a1-b65a-b38d444d85ed None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87515) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 10:16:11 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-cebd6a9d-3073-42a1-b65a-b38d444d85ed None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:16:11 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-cebd6a9d-3073-42a1-b65a-b38d444d85ed None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:16:11 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-cebd6a9d-3073-42a1-b65a-b38d444d85ed None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:16:11 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-cebd6a9d-3073-42a1-b65a-b38d444d85ed None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:16:11 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-cebd6a9d-3073-42a1-b65a-b38d444d85ed None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:16:11 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-cebd6a9d-3073-42a1-b65a-b38d444d85ed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:16:11 devstack sudo[105720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a Sep 07 10:16:11 devstack sudo[105720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:16:11 devstack sudo[105712]: pam_unix(sudo:session): session closed for user root Sep 07 10:16:11 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-aa6e8cab-c473-4a4a-853f-1b5788d39a3b tempest-TestStampPattern-892517498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-c29f46f0-9ed4-4ea3-b0a4-c0d228196c37" returned: 0 in 0.277s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:16:11 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-aa6e8cab-c473-4a4a-853f-1b5788d39a3b tempest-TestStampPattern-892517498 None] Lock "cinder-quobyte-c29f46f0-9ed4-4ea3-b0a4-c0d228196c37" released by "_copy_volume_from_snapshot" :: held 7.267s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:16:11 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-aa6e8cab-c473-4a4a-853f-1b5788d39a3b tempest-TestStampPattern-892517498 None] Lock "cinder-quobyte-7e7f4a13-3991-444a-9b31-3648f050665e-c29f46f0-9ed4-4ea3-b0a4-c0d228196c37" released by "_create_volume_from_snapshot" :: held 7.344s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:16:11 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-aa6e8cab-c473-4a4a-853f-1b5788d39a3b tempest-TestStampPattern-892517498 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.360s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:16:11 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-aa6e8cab-c473-4a4a-853f-1b5788d39a3b tempest-TestStampPattern-892517498 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de985e30-acef-424f-86fc-b9fb274b55e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c29f46f0-9ed4-4ea3-b0a4-c0d228196c37', 'volume_size': 1, 'snapshot_id': '7e7f4a13-3991-444a-9b31-3648f050665e'}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:16:11 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-aa6e8cab-c473-4a4a-853f-1b5788d39a3b tempest-TestStampPattern-892517498 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (834f0007-202b-4982-b47a-254da0cb8eae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:16:11 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-aa6e8cab-c473-4a4a-853f-1b5788d39a3b tempest-TestStampPattern-892517498 None] Volume volume-c29f46f0-9ed4-4ea3-b0a4-c0d228196c37 (c29f46f0-9ed4-4ea3-b0a4-c0d228196c37): created successfully Sep 07 10:16:11 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-aa6e8cab-c473-4a4a-853f-1b5788d39a3b tempest-TestStampPattern-892517498 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (834f0007-202b-4982-b47a-254da0cb8eae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:16:11 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-aa6e8cab-c473-4a4a-853f-1b5788d39a3b tempest-TestStampPattern-892517498 None] Flow 'volume_create_manager' (641ac87a-e969-4984-b0ad-cea97c8ab186) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:16:11 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-aa6e8cab-c473-4a4a-853f-1b5788d39a3b tempest-TestStampPattern-892517498 None] Created volume successfully. Sep 07 10:16:11 devstack sudo[105720]: pam_unix(sudo:session): session closed for user root Sep 07 10:16:11 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-cebd6a9d-3073-42a1-b65a-b38d444d85ed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a" returned: 0 in 0.302s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:16:11 devstack cinder-volume[87515]: DEBUG cinder.manager [None req-cebd6a9d-3073-42a1-b65a-b38d444d85ed None None] Notifying Schedulers of capabilities ... {{(pid=87515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:16:11 devstack cinder-volume[87515]: DEBUG oslo_service.periodic_task [None req-cebd6a9d-3073-42a1-b65a-b38d444d85ed None None] Running periodic task VolumeManager._thread_info {{(pid=87515) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 10:16:11 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-cebd6a9d-3073-42a1-b65a-b38d444d85ed None None] thread count: 29 {{(pid=87515) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 07 10:16:11 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-cebd6a9d-3073-42a1-b65a-b38d444d85ed None None] thread info: [<_MainThread(MainThread, started 131647121809536)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87515) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 07 10:16:21 devstack cinder-volume[87515]: DEBUG dbcounter [-] [87515] Writing DB stats cinder:SELECT=12,cinder:UPDATE=7,cinder:INSERT=2,cinder:DELETE=1 {{(pid=87515) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 10:16:21 devstack cinder-volume[87515]: DEBUG dbcounter [-] [87515] Writing DB stats cinder:SELECT=17,cinder:UPDATE=5,cinder:DELETE=1 {{(pid=87515) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 10:16:54 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [req-c05fef63-ec52-46bf-800c-3430f24b93f4 req-26ab7ad7-0a7f-47aa-9012-887eca090c88 tempest-TestStampPattern-892517498 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:16:54 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [req-c05fef63-ec52-46bf-800c-3430f24b93f4 req-26ab7ad7-0a7f-47aa-9012-887eca090c88 tempest-TestStampPattern-892517498 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:16:54 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [req-c05fef63-ec52-46bf-800c-3430f24b93f4 req-26ab7ad7-0a7f-47aa-9012-887eca090c88 tempest-TestStampPattern-892517498 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:16:54 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [req-c05fef63-ec52-46bf-800c-3430f24b93f4 req-26ab7ad7-0a7f-47aa-9012-887eca090c88 tempest-TestStampPattern-892517498 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c', 'name': 'volume-c29f46f0-9ed4-4ea3-b0a4-c0d228196c37', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '43bfd451-448d-4a5c-b326-8fd43c4397b6', 'enforce_multipath': True} {{(pid=87515) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 07 10:16:54 devstack cinder-volume[87515]: INFO cinder.volume.manager [req-c05fef63-ec52-46bf-800c-3430f24b93f4 req-26ab7ad7-0a7f-47aa-9012-887eca090c88 tempest-TestStampPattern-892517498 None] attachment_update completed successfully. Sep 07 10:16:56 devstack cinder-volume[87515]: INFO cinder.volume.manager [req-bcbff3f4-a438-46c2-bd52-eb3c67ef4f0a req-0f19eefc-d014-4847-a6a3-e1de07af911a tempest-TestStampPattern-892517498 None] Terminate volume connection completed successfully. Sep 07 10:16:56 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [req-bcbff3f4-a438-46c2-bd52-eb3c67ef4f0a req-0f19eefc-d014-4847-a6a3-e1de07af911a tempest-TestStampPattern-892517498 None] Deleting attachment 43bfd451-448d-4a5c-b326-8fd43c4397b6. {{(pid=87515) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 07 10:17:00 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-5ec5101a-de27-4b5f-a42f-118f7e765f46 tempest-TestStampPattern-892517498 None] Acquiring lock "cinder-c29f46f0-9ed4-4ea3-b0a4-c0d228196c37-delete_volume" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:17:00 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-5ec5101a-de27-4b5f-a42f-118f7e765f46 tempest-TestStampPattern-892517498 None] Lock "cinder-c29f46f0-9ed4-4ea3-b0a4-c0d228196c37-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:17:00 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-5ec5101a-de27-4b5f-a42f-118f7e765f46 tempest-TestStampPattern-892517498 None] Acquiring lock "cinder-quobyte-c29f46f0-9ed4-4ea3-b0a4-c0d228196c37" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:17:00 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-5ec5101a-de27-4b5f-a42f-118f7e765f46 tempest-TestStampPattern-892517498 None] Lock "cinder-quobyte-c29f46f0-9ed4-4ea3-b0a4-c0d228196c37" acquired by "delete_volume" :: waited 0.014s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:17:00 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b0e20e0-a574-4750-b57f-7a3ed959c2b9]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:17:00 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-5ec5101a-de27-4b5f-a42f-118f7e765f46 tempest-TestStampPattern-892517498 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-c29f46f0-9ed4-4ea3-b0a4-c0d228196c37 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:17:00 devstack sudo[106312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-c29f46f0-9ed4-4ea3-b0a4-c0d228196c37 Sep 07 10:17:00 devstack sudo[106312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:17:01 devstack sudo[106312]: pam_unix(sudo:session): session closed for user root Sep 07 10:17:01 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-5ec5101a-de27-4b5f-a42f-118f7e765f46 tempest-TestStampPattern-892517498 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-c29f46f0-9ed4-4ea3-b0a4-c0d228196c37" returned: 0 in 0.352s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:17:01 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-5ec5101a-de27-4b5f-a42f-118f7e765f46 tempest-TestStampPattern-892517498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-c29f46f0-9ed4-4ea3-b0a4-c0d228196c37 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:17:01 devstack sudo[106317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-c29f46f0-9ed4-4ea3-b0a4-c0d228196c37 Sep 07 10:17:01 devstack sudo[106317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:17:01 devstack sudo[106317]: pam_unix(sudo:session): session closed for user root Sep 07 10:17:01 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-5ec5101a-de27-4b5f-a42f-118f7e765f46 tempest-TestStampPattern-892517498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-c29f46f0-9ed4-4ea3-b0a4-c0d228196c37" returned: 0 in 0.263s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:17:01 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-5ec5101a-de27-4b5f-a42f-118f7e765f46 tempest-TestStampPattern-892517498 None] Lock "cinder-quobyte-c29f46f0-9ed4-4ea3-b0a4-c0d228196c37" released by "delete_volume" :: held 0.654s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:17:01 devstack cinder-volume[87515]: DEBUG cinder.quota [None req-5ec5101a-de27-4b5f-a42f-118f7e765f46 tempest-TestStampPattern-892517498 None] Created reservations ['21fe13d7-4ead-48b7-96b9-9971b4a3185e', '595ae31b-57d6-45d7-b7e1-2e561340ce72', 'cabcbd43-c0c2-45ff-85ec-9971adf96ded', '50f31d7e-14c5-4261-8bd3-6f22cb7310da'] {{(pid=87515) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:17:01 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-5ec5101a-de27-4b5f-a42f-118f7e765f46 tempest-TestStampPattern-892517498 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:17:01 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-5ec5101a-de27-4b5f-a42f-118f7e765f46 tempest-TestStampPattern-892517498 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:17:01 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-5ec5101a-de27-4b5f-a42f-118f7e765f46 tempest-TestStampPattern-892517498 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:17:01 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-5ec5101a-de27-4b5f-a42f-118f7e765f46 tempest-TestStampPattern-892517498 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:17:01 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-5ec5101a-de27-4b5f-a42f-118f7e765f46 tempest-TestStampPattern-892517498 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:17:01 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-5ec5101a-de27-4b5f-a42f-118f7e765f46 tempest-TestStampPattern-892517498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:17:01 devstack sudo[106320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a Sep 07 10:17:01 devstack sudo[106320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:17:01 devstack sudo[106320]: pam_unix(sudo:session): session closed for user root Sep 07 10:17:01 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-5ec5101a-de27-4b5f-a42f-118f7e765f46 tempest-TestStampPattern-892517498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a" returned: 0 in 0.252s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:17:01 devstack cinder-volume[87515]: DEBUG cinder.manager [None req-5ec5101a-de27-4b5f-a42f-118f7e765f46 tempest-TestStampPattern-892517498 None] Notifying Schedulers of capabilities ... {{(pid=87515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:17:01 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-5ec5101a-de27-4b5f-a42f-118f7e765f46 tempest-TestStampPattern-892517498 None] Deleted volume successfully. Sep 07 10:17:01 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-5ec5101a-de27-4b5f-a42f-118f7e765f46 tempest-TestStampPattern-892517498 None] Lock "cinder-c29f46f0-9ed4-4ea3-b0a4-c0d228196c37-delete_volume" released by "delete_volume" :: held 1.117s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:17:02 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-f12c3884-59c8-425f-9574-6df2902dc652 tempest-TestStampPattern-892517498 None] Acquiring lock "cinder-7e7f4a13-3991-444a-9b31-3648f050665e-delete_snapshot" by "delete_snapshot" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:17:02 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-f12c3884-59c8-425f-9574-6df2902dc652 tempest-TestStampPattern-892517498 None] Lock "cinder-7e7f4a13-3991-444a-9b31-3648f050665e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:17:02 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-f12c3884-59c8-425f-9574-6df2902dc652 tempest-TestStampPattern-892517498 None] Acquiring lock "cinder-quobyte-bb83f46b-b912-4428-98ba-8bd87b07a190" by "delete_snapshot" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:17:02 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-f12c3884-59c8-425f-9574-6df2902dc652 tempest-TestStampPattern-892517498 None] Lock "cinder-quobyte-bb83f46b-b912-4428-98ba-8bd87b07a190" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:17:02 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-f12c3884-59c8-425f-9574-6df2902dc652 tempest-TestStampPattern-892517498 None] Acquiring lock "cinder-quobyte-7e7f4a13-3991-444a-9b31-3648f050665e" by "_delete_snapshot" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:17:02 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-f12c3884-59c8-425f-9574-6df2902dc652 tempest-TestStampPattern-892517498 None] Lock "cinder-quobyte-7e7f4a13-3991-444a-9b31-3648f050665e" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:17:02 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-f12c3884-59c8-425f-9574-6df2902dc652 tempest-TestStampPattern-892517498 None] Deleting offline snapshot 7e7f4a13-3991-444a-9b31-3648f050665e of volume bb83f46b-b912-4428-98ba-8bd87b07a190 {{(pid=87515) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 10:17:02 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-f12c3884-59c8-425f-9574-6df2902dc652 tempest-TestStampPattern-892517498 None] snapshot_file for this snap is: volume-bb83f46b-b912-4428-98ba-8bd87b07a190.7e7f4a13-3991-444a-9b31-3648f050665e {{(pid=87515) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 10:17:02 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc403437-46bc-4ded-8bd4-30562e68d573]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:17:02 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-f12c3884-59c8-425f-9574-6df2902dc652 tempest-TestStampPattern-892517498 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-bb83f46b-b912-4428-98ba-8bd87b07a190.7e7f4a13-3991-444a-9b31-3648f050665e {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:17:02 devstack sudo[106326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-bb83f46b-b912-4428-98ba-8bd87b07a190.7e7f4a13-3991-444a-9b31-3648f050665e Sep 07 10:17:02 devstack sudo[106326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:17:02 devstack sudo[106326]: pam_unix(sudo:session): session closed for user root Sep 07 10:17:02 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-f12c3884-59c8-425f-9574-6df2902dc652 tempest-TestStampPattern-892517498 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-bb83f46b-b912-4428-98ba-8bd87b07a190.7e7f4a13-3991-444a-9b31-3648f050665e" returned: 0 in 0.379s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:17:02 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-f12c3884-59c8-425f-9574-6df2902dc652 tempest-TestStampPattern-892517498 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bb83f46b-b912-4428-98ba-8bd87b07a190(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87515) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 10:17:02 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[54a37cb4-2959-4539-b806-fe974127271a]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:17:02 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-f12c3884-59c8-425f-9574-6df2902dc652 tempest-TestStampPattern-892517498 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-bb83f46b-b912-4428-98ba-8bd87b07a190 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:17:02 devstack sudo[106331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-bb83f46b-b912-4428-98ba-8bd87b07a190 Sep 07 10:17:02 devstack sudo[106331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:17:03 devstack sudo[106331]: pam_unix(sudo:session): session closed for user root Sep 07 10:17:03 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-f12c3884-59c8-425f-9574-6df2902dc652 tempest-TestStampPattern-892517498 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-bb83f46b-b912-4428-98ba-8bd87b07a190" returned: 0 in 0.533s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:17:03 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-f12c3884-59c8-425f-9574-6df2902dc652 tempest-TestStampPattern-892517498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-bb83f46b-b912-4428-98ba-8bd87b07a190.7e7f4a13-3991-444a-9b31-3648f050665e {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:17:03 devstack sudo[106336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-bb83f46b-b912-4428-98ba-8bd87b07a190.7e7f4a13-3991-444a-9b31-3648f050665e Sep 07 10:17:03 devstack sudo[106336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:17:03 devstack sudo[106336]: pam_unix(sudo:session): session closed for user root Sep 07 10:17:03 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-f12c3884-59c8-425f-9574-6df2902dc652 tempest-TestStampPattern-892517498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-bb83f46b-b912-4428-98ba-8bd87b07a190.7e7f4a13-3991-444a-9b31-3648f050665e" returned: 0 in 0.341s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:17:03 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-f12c3884-59c8-425f-9574-6df2902dc652 tempest-TestStampPattern-892517498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-bb83f46b-b912-4428-98ba-8bd87b07a190.7e7f4a13-3991-444a-9b31-3648f050665e {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:17:03 devstack sudo[106341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-bb83f46b-b912-4428-98ba-8bd87b07a190.7e7f4a13-3991-444a-9b31-3648f050665e Sep 07 10:17:03 devstack sudo[106341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:17:03 devstack sudo[106341]: pam_unix(sudo:session): session closed for user root Sep 07 10:17:03 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-f12c3884-59c8-425f-9574-6df2902dc652 tempest-TestStampPattern-892517498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-bb83f46b-b912-4428-98ba-8bd87b07a190.7e7f4a13-3991-444a-9b31-3648f050665e" returned: 0 in 0.250s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:17:03 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-f12c3884-59c8-425f-9574-6df2902dc652 tempest-TestStampPattern-892517498 None] Lock "cinder-quobyte-7e7f4a13-3991-444a-9b31-3648f050665e" released by "_delete_snapshot" :: held 1.603s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:17:03 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-f12c3884-59c8-425f-9574-6df2902dc652 tempest-TestStampPattern-892517498 None] Lock "cinder-quobyte-bb83f46b-b912-4428-98ba-8bd87b07a190" released by "delete_snapshot" :: held 1.624s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:17:03 devstack cinder-volume[87515]: DEBUG cinder.quota [None req-f12c3884-59c8-425f-9574-6df2902dc652 tempest-TestStampPattern-892517498 None] Created reservations ['b43f613b-5fc3-4931-bf55-6423ecd0bd9a', '0e84af65-3aef-4f31-9993-389bf5ffe336', 'aaf8f7a7-d50e-4343-8408-bd1fb7795a98', '264ac5d2-7ba1-4394-b9dd-a067991c65d4'] {{(pid=87515) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:17:03 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-f12c3884-59c8-425f-9574-6df2902dc652 tempest-TestStampPattern-892517498 None] Delete snapshot completed successfully. Sep 07 10:17:03 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-f12c3884-59c8-425f-9574-6df2902dc652 tempest-TestStampPattern-892517498 None] Lock "cinder-7e7f4a13-3991-444a-9b31-3648f050665e-delete_snapshot" released by "delete_snapshot" :: held 1.759s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:17:07 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-c4fd4d30-9afb-4826-a579-191ce6d0e262 tempest-TestStampPattern-892517498 None] Acquiring lock "cinder-bb83f46b-b912-4428-98ba-8bd87b07a190-delete_volume" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:17:07 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-c4fd4d30-9afb-4826-a579-191ce6d0e262 tempest-TestStampPattern-892517498 None] Lock "cinder-bb83f46b-b912-4428-98ba-8bd87b07a190-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:17:07 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-c4fd4d30-9afb-4826-a579-191ce6d0e262 tempest-TestStampPattern-892517498 None] Acquiring lock "cinder-quobyte-bb83f46b-b912-4428-98ba-8bd87b07a190" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:17:07 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-c4fd4d30-9afb-4826-a579-191ce6d0e262 tempest-TestStampPattern-892517498 None] Lock "cinder-quobyte-bb83f46b-b912-4428-98ba-8bd87b07a190" acquired by "delete_volume" :: waited 0.016s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:17:07 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[07dc67e2-d48b-402e-a9cc-525e67d2917d]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:17:07 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-c4fd4d30-9afb-4826-a579-191ce6d0e262 tempest-TestStampPattern-892517498 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-bb83f46b-b912-4428-98ba-8bd87b07a190 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:17:07 devstack sudo[106373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-bb83f46b-b912-4428-98ba-8bd87b07a190 Sep 07 10:17:07 devstack sudo[106373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:17:08 devstack sudo[106373]: pam_unix(sudo:session): session closed for user root Sep 07 10:17:08 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-c4fd4d30-9afb-4826-a579-191ce6d0e262 tempest-TestStampPattern-892517498 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-bb83f46b-b912-4428-98ba-8bd87b07a190" returned: 0 in 0.350s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:17:08 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-c4fd4d30-9afb-4826-a579-191ce6d0e262 tempest-TestStampPattern-892517498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-bb83f46b-b912-4428-98ba-8bd87b07a190 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:17:08 devstack sudo[106378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-bb83f46b-b912-4428-98ba-8bd87b07a190 Sep 07 10:17:08 devstack sudo[106378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:17:08 devstack sudo[106378]: pam_unix(sudo:session): session closed for user root Sep 07 10:17:08 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-c4fd4d30-9afb-4826-a579-191ce6d0e262 tempest-TestStampPattern-892517498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-bb83f46b-b912-4428-98ba-8bd87b07a190" returned: 0 in 0.246s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:17:08 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-c4fd4d30-9afb-4826-a579-191ce6d0e262 tempest-TestStampPattern-892517498 None] Lock "cinder-quobyte-bb83f46b-b912-4428-98ba-8bd87b07a190" released by "delete_volume" :: held 0.653s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:17:08 devstack cinder-volume[87515]: DEBUG cinder.quota [None req-c4fd4d30-9afb-4826-a579-191ce6d0e262 tempest-TestStampPattern-892517498 None] Created reservations ['9e261336-5006-40e0-8c6a-0d841629d967', '808b8d94-404e-4264-9d77-3fb0f5b97d5a', 'df0a3d93-7d9a-488a-b2b9-6d098b31a948', 'eae06dc7-2b2a-4a4e-be10-ec3db6cbfcb9'] {{(pid=87515) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:17:08 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-c4fd4d30-9afb-4826-a579-191ce6d0e262 tempest-TestStampPattern-892517498 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:17:08 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-c4fd4d30-9afb-4826-a579-191ce6d0e262 tempest-TestStampPattern-892517498 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:17:08 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-c4fd4d30-9afb-4826-a579-191ce6d0e262 tempest-TestStampPattern-892517498 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:17:08 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-c4fd4d30-9afb-4826-a579-191ce6d0e262 tempest-TestStampPattern-892517498 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:17:08 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-c4fd4d30-9afb-4826-a579-191ce6d0e262 tempest-TestStampPattern-892517498 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:17:08 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-c4fd4d30-9afb-4826-a579-191ce6d0e262 tempest-TestStampPattern-892517498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:17:08 devstack sudo[106381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a Sep 07 10:17:08 devstack sudo[106381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:17:08 devstack sudo[106381]: pam_unix(sudo:session): session closed for user root Sep 07 10:17:08 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-c4fd4d30-9afb-4826-a579-191ce6d0e262 tempest-TestStampPattern-892517498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a" returned: 0 in 0.253s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:17:08 devstack cinder-volume[87515]: DEBUG cinder.manager [None req-c4fd4d30-9afb-4826-a579-191ce6d0e262 tempest-TestStampPattern-892517498 None] Notifying Schedulers of capabilities ... {{(pid=87515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:17:08 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-c4fd4d30-9afb-4826-a579-191ce6d0e262 tempest-TestStampPattern-892517498 None] Deleted volume successfully. Sep 07 10:17:08 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-c4fd4d30-9afb-4826-a579-191ce6d0e262 tempest-TestStampPattern-892517498 None] Lock "cinder-bb83f46b-b912-4428-98ba-8bd87b07a190-delete_volume" released by "delete_volume" :: held 1.090s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:17:11 devstack cinder-volume[87515]: DEBUG oslo_service.periodic_task [None req-cebd6a9d-3073-42a1-b65a-b38d444d85ed None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87515) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 10:17:11 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-cebd6a9d-3073-42a1-b65a-b38d444d85ed None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:17:11 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-cebd6a9d-3073-42a1-b65a-b38d444d85ed None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:17:11 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-cebd6a9d-3073-42a1-b65a-b38d444d85ed None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:17:11 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-cebd6a9d-3073-42a1-b65a-b38d444d85ed None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:17:11 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-cebd6a9d-3073-42a1-b65a-b38d444d85ed None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:17:11 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-cebd6a9d-3073-42a1-b65a-b38d444d85ed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:17:11 devstack sudo[106387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a Sep 07 10:17:11 devstack sudo[106387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:17:11 devstack sudo[106387]: pam_unix(sudo:session): session closed for user root Sep 07 10:17:11 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-cebd6a9d-3073-42a1-b65a-b38d444d85ed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a" returned: 0 in 0.241s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:17:11 devstack cinder-volume[87515]: DEBUG cinder.manager [None req-cebd6a9d-3073-42a1-b65a-b38d444d85ed None None] Notifying Schedulers of capabilities ... {{(pid=87515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:17:11 devstack cinder-volume[87515]: DEBUG oslo_service.periodic_task [None req-cebd6a9d-3073-42a1-b65a-b38d444d85ed None None] Running periodic task VolumeManager._thread_info {{(pid=87515) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 10:17:11 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-cebd6a9d-3073-42a1-b65a-b38d444d85ed None None] thread count: 29 {{(pid=87515) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 07 10:17:11 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-cebd6a9d-3073-42a1-b65a-b38d444d85ed None None] thread info: [<_MainThread(MainThread, started 131647121809536)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87515) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 07 10:17:18 devstack cinder-volume[87515]: DEBUG dbcounter [-] [87515] Writing DB stats cinder:SELECT=22,cinder:UPDATE=25,cinder:INSERT=8 {{(pid=87515) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 10:17:18 devstack cinder-volume[87515]: DEBUG dbcounter [-] [87515] Writing DB stats cinder:SELECT=25,cinder:UPDATE=22,cinder:DELETE=2,cinder:INSERT=4 {{(pid=87515) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 10:17:19 devstack cinder-volume[87515]: DEBUG cinder.volume.flows.manager.create_volume [None req-eb3212e9-be6b-4a7f-a976-e9c7b8cb8301 tempest-CreateVolumesFromImageTest-446209050 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 10:17:19 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-eb3212e9-be6b-4a7f-a976-e9c7b8cb8301 tempest-CreateVolumesFromImageTest-446209050 None] Flow 'volume_create_manager' (ad095c49-3060-4081-804c-291356f38db4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:17:19 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-eb3212e9-be6b-4a7f-a976-e9c7b8cb8301 tempest-CreateVolumesFromImageTest-446209050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90b39c6a-ccee-4a0f-b458-387b81a2b7dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:17:19 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-eb3212e9-be6b-4a7f-a976-e9c7b8cb8301 tempest-CreateVolumesFromImageTest-446209050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90b39c6a-ccee-4a0f-b458-387b81a2b7dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:17:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1445594162',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5818c75-cc55-433a-9094-344a6b2a65b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='086d5fda7e014e2fb31596c9322d6d70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:17:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:17:20Z,use_quota=True,user_id='711e3fb101a042e190cf06281a35166c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3a092cd-7947-4cbf-abff-4ba9567becf0),volume_type_id=f3a092cd-7947-4cbf-abff-4ba9567becf0)' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:17:19 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-eb3212e9-be6b-4a7f-a976-e9c7b8cb8301 tempest-CreateVolumesFromImageTest-446209050 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44392b25-dd06-486c-9fdd-737c5d8187ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:17:19 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-eb3212e9-be6b-4a7f-a976-e9c7b8cb8301 tempest-CreateVolumesFromImageTest-446209050 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44392b25-dd06-486c-9fdd-737c5d8187ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:17:19 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-eb3212e9-be6b-4a7f-a976-e9c7b8cb8301 tempest-CreateVolumesFromImageTest-446209050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80be0473-d19d-485d-9a1a-565cb4ac295c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:17:19 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-eb3212e9-be6b-4a7f-a976-e9c7b8cb8301 tempest-CreateVolumesFromImageTest-446209050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80be0473-d19d-485d-9a1a-565cb4ac295c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c5818c75-cc55-433a-9094-344a6b2a65b3', 'volume_name': 'volume-c5818c75-cc55-433a-9094-344a6b2a65b3', 'volume_size': 1}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:17:19 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-eb3212e9-be6b-4a7f-a976-e9c7b8cb8301 tempest-CreateVolumesFromImageTest-446209050 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08b12c52-1b87-4ab5-b9f7-ca84147da781) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:17:19 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-eb3212e9-be6b-4a7f-a976-e9c7b8cb8301 tempest-CreateVolumesFromImageTest-446209050 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08b12c52-1b87-4ab5-b9f7-ca84147da781) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:17:19 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-eb3212e9-be6b-4a7f-a976-e9c7b8cb8301 tempest-CreateVolumesFromImageTest-446209050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79f9d46d-5b83-41a4-991f-192cb846eb00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:17:19 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-eb3212e9-be6b-4a7f-a976-e9c7b8cb8301 tempest-CreateVolumesFromImageTest-446209050 None] Volume c5818c75-cc55-433a-9094-344a6b2a65b3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c5818c75-cc55-433a-9094-344a6b2a65b3', 'volume_size': 1} Sep 07 10:17:19 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-eb3212e9-be6b-4a7f-a976-e9c7b8cb8301 tempest-CreateVolumesFromImageTest-446209050 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:17:19 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-eb3212e9-be6b-4a7f-a976-e9c7b8cb8301 tempest-CreateVolumesFromImageTest-446209050 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:17:19 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-eb3212e9-be6b-4a7f-a976-e9c7b8cb8301 tempest-CreateVolumesFromImageTest-446209050 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:17:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1445594162',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5818c75-cc55-433a-9094-344a6b2a65b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='086d5fda7e014e2fb31596c9322d6d70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:17:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:17:20Z,use_quota=True,user_id='711e3fb101a042e190cf06281a35166c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3a092cd-7947-4cbf-abff-4ba9567becf0),volume_type_id=f3a092cd-7947-4cbf-abff-4ba9567becf0)}" {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 10:17:19 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-eb3212e9-be6b-4a7f-a976-e9c7b8cb8301 tempest-CreateVolumesFromImageTest-446209050 None] Creating volume c5818c75-cc55-433a-9094-344a6b2a65b3 {{(pid=87515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 10:17:19 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-eb3212e9-be6b-4a7f-a976-e9c7b8cb8301 tempest-CreateVolumesFromImageTest-446209050 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:17:19 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-eb3212e9-be6b-4a7f-a976-e9c7b8cb8301 tempest-CreateVolumesFromImageTest-446209050 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:17:19 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-eb3212e9-be6b-4a7f-a976-e9c7b8cb8301 tempest-CreateVolumesFromImageTest-446209050 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:17:19 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-eb3212e9-be6b-4a7f-a976-e9c7b8cb8301 tempest-CreateVolumesFromImageTest-446209050 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:17:19 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-eb3212e9-be6b-4a7f-a976-e9c7b8cb8301 tempest-CreateVolumesFromImageTest-446209050 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:17:19 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-eb3212e9-be6b-4a7f-a976-e9c7b8cb8301 tempest-CreateVolumesFromImageTest-446209050 None] Selected osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c as target Quobyte volume. {{(pid=87515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 10:17:19 devstack cinder-volume[87515]: INFO cinder.volume.drivers.remotefs [None req-eb3212e9-be6b-4a7f-a976-e9c7b8cb8301 tempest-CreateVolumesFromImageTest-446209050 None] casted to osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c Sep 07 10:17:19 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-eb3212e9-be6b-4a7f-a976-e9c7b8cb8301 tempest-CreateVolumesFromImageTest-446209050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-c5818c75-cc55-433a-9094-344a6b2a65b3 1073741824 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:17:19 devstack sudo[106395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-c5818c75-cc55-433a-9094-344a6b2a65b3 1073741824 Sep 07 10:17:19 devstack sudo[106395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:17:20 devstack cinder-volume[87515]: DEBUG cinder.volume.flows.manager.create_volume [None req-31b9b108-af8a-40aa-843c-e36232ef3fa6 tempest-CreateVolumesFromImageTest-446209050 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 10:17:20 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-31b9b108-af8a-40aa-843c-e36232ef3fa6 tempest-CreateVolumesFromImageTest-446209050 None] Flow 'volume_create_manager' (82f46632-9302-4d44-9fce-88a1df4a039d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:17:20 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-31b9b108-af8a-40aa-843c-e36232ef3fa6 tempest-CreateVolumesFromImageTest-446209050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a429985-f18b-457c-b486-d3b2f3b7e8cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:17:20 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-31b9b108-af8a-40aa-843c-e36232ef3fa6 tempest-CreateVolumesFromImageTest-446209050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a429985-f18b-457c-b486-d3b2f3b7e8cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:17:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2143739557',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23fb7743-afe3-49fd-a2f1-70421d2a845f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='086d5fda7e014e2fb31596c9322d6d70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:17:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:17:20Z,use_quota=True,user_id='711e3fb101a042e190cf06281a35166c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3a092cd-7947-4cbf-abff-4ba9567becf0),volume_type_id=f3a092cd-7947-4cbf-abff-4ba9567becf0)' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:17:20 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-31b9b108-af8a-40aa-843c-e36232ef3fa6 tempest-CreateVolumesFromImageTest-446209050 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (528ee3ef-3c9a-4dad-936e-7c9894fb0aa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:17:20 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-31b9b108-af8a-40aa-843c-e36232ef3fa6 tempest-CreateVolumesFromImageTest-446209050 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (528ee3ef-3c9a-4dad-936e-7c9894fb0aa6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:17:20 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-31b9b108-af8a-40aa-843c-e36232ef3fa6 tempest-CreateVolumesFromImageTest-446209050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f1f8878-41c9-49b6-9a55-671769e03a51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:17:20 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-31b9b108-af8a-40aa-843c-e36232ef3fa6 tempest-CreateVolumesFromImageTest-446209050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f1f8878-41c9-49b6-9a55-671769e03a51) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '23fb7743-afe3-49fd-a2f1-70421d2a845f', 'volume_name': 'volume-23fb7743-afe3-49fd-a2f1-70421d2a845f', 'volume_size': 1}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:17:20 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-31b9b108-af8a-40aa-843c-e36232ef3fa6 tempest-CreateVolumesFromImageTest-446209050 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa788a4f-abd7-48cc-86c8-3827f5778135) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:17:20 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-31b9b108-af8a-40aa-843c-e36232ef3fa6 tempest-CreateVolumesFromImageTest-446209050 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa788a4f-abd7-48cc-86c8-3827f5778135) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:17:20 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-31b9b108-af8a-40aa-843c-e36232ef3fa6 tempest-CreateVolumesFromImageTest-446209050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c25c3724-216b-4ff2-b966-cfa302c6edea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:17:20 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-31b9b108-af8a-40aa-843c-e36232ef3fa6 tempest-CreateVolumesFromImageTest-446209050 None] Volume 23fb7743-afe3-49fd-a2f1-70421d2a845f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-23fb7743-afe3-49fd-a2f1-70421d2a845f', 'volume_size': 1} Sep 07 10:17:20 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-31b9b108-af8a-40aa-843c-e36232ef3fa6 tempest-CreateVolumesFromImageTest-446209050 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:17:20 devstack sudo[106395]: pam_unix(sudo:session): session closed for user root Sep 07 10:17:20 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-eb3212e9-be6b-4a7f-a976-e9c7b8cb8301 tempest-CreateVolumesFromImageTest-446209050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-c5818c75-cc55-433a-9094-344a6b2a65b3 1073741824" returned: 0 in 0.541s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:17:20 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-eb3212e9-be6b-4a7f-a976-e9c7b8cb8301 tempest-CreateVolumesFromImageTest-446209050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-c5818c75-cc55-433a-9094-344a6b2a65b3 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:17:20 devstack sudo[106401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-c5818c75-cc55-433a-9094-344a6b2a65b3 Sep 07 10:17:20 devstack sudo[106401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:17:20 devstack cinder-volume[87515]: DEBUG cinder.volume.flows.manager.create_volume [None req-27ad4be9-f71e-4288-b5e6-ef7759b88b0d tempest-CreateVolumesFromImageTest-446209050 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 10:17:20 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-27ad4be9-f71e-4288-b5e6-ef7759b88b0d tempest-CreateVolumesFromImageTest-446209050 None] Flow 'volume_create_manager' (c91a9f35-91ee-40d2-a284-dc9d2c9ae21c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:17:20 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-27ad4be9-f71e-4288-b5e6-ef7759b88b0d tempest-CreateVolumesFromImageTest-446209050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c7a0b17-79c3-46fe-b311-74cca2d43b85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:17:20 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-27ad4be9-f71e-4288-b5e6-ef7759b88b0d tempest-CreateVolumesFromImageTest-446209050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c7a0b17-79c3-46fe-b311-74cca2d43b85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:17:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2141124789',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a55ba0bc-7683-406f-9b26-8307831512a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='086d5fda7e014e2fb31596c9322d6d70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:17:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:17:20Z,use_quota=True,user_id='711e3fb101a042e190cf06281a35166c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3a092cd-7947-4cbf-abff-4ba9567becf0),volume_type_id=f3a092cd-7947-4cbf-abff-4ba9567becf0)' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:17:20 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-27ad4be9-f71e-4288-b5e6-ef7759b88b0d tempest-CreateVolumesFromImageTest-446209050 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04d5e9ce-2e89-4e00-b44e-96de22c1de7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:17:20 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-27ad4be9-f71e-4288-b5e6-ef7759b88b0d tempest-CreateVolumesFromImageTest-446209050 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04d5e9ce-2e89-4e00-b44e-96de22c1de7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:17:20 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-27ad4be9-f71e-4288-b5e6-ef7759b88b0d tempest-CreateVolumesFromImageTest-446209050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97bc20a0-38ea-4dbb-8e98-73740bda0625) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:17:20 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-27ad4be9-f71e-4288-b5e6-ef7759b88b0d tempest-CreateVolumesFromImageTest-446209050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97bc20a0-38ea-4dbb-8e98-73740bda0625) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a55ba0bc-7683-406f-9b26-8307831512a7', 'volume_name': 'volume-a55ba0bc-7683-406f-9b26-8307831512a7', 'volume_size': 1}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:17:20 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-27ad4be9-f71e-4288-b5e6-ef7759b88b0d tempest-CreateVolumesFromImageTest-446209050 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32082221-3dff-450e-a17e-d97e33d0bc8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:17:20 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-27ad4be9-f71e-4288-b5e6-ef7759b88b0d tempest-CreateVolumesFromImageTest-446209050 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32082221-3dff-450e-a17e-d97e33d0bc8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:17:20 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-27ad4be9-f71e-4288-b5e6-ef7759b88b0d tempest-CreateVolumesFromImageTest-446209050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9901d33b-8803-48eb-88d9-3d3bae3dbad5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:17:20 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-27ad4be9-f71e-4288-b5e6-ef7759b88b0d tempest-CreateVolumesFromImageTest-446209050 None] Volume a55ba0bc-7683-406f-9b26-8307831512a7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a55ba0bc-7683-406f-9b26-8307831512a7', 'volume_size': 1} Sep 07 10:17:20 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-27ad4be9-f71e-4288-b5e6-ef7759b88b0d tempest-CreateVolumesFromImageTest-446209050 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:17:20 devstack sudo[106401]: pam_unix(sudo:session): session closed for user root Sep 07 10:17:20 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-eb3212e9-be6b-4a7f-a976-e9c7b8cb8301 tempest-CreateVolumesFromImageTest-446209050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-c5818c75-cc55-433a-9094-344a6b2a65b3" returned: 0 in 0.315s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:17:20 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-eb3212e9-be6b-4a7f-a976-e9c7b8cb8301 tempest-CreateVolumesFromImageTest-446209050 None] <== create_volume: return (896ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'} {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 10:17:20 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-eb3212e9-be6b-4a7f-a976-e9c7b8cb8301 tempest-CreateVolumesFromImageTest-446209050 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.899s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:17:20 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-31b9b108-af8a-40aa-843c-e36232ef3fa6 tempest-CreateVolumesFromImageTest-446209050 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.518s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:17:20 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-31b9b108-af8a-40aa-843c-e36232ef3fa6 tempest-CreateVolumesFromImageTest-446209050 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:17:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2143739557',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23fb7743-afe3-49fd-a2f1-70421d2a845f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='086d5fda7e014e2fb31596c9322d6d70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:17:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:17:20Z,use_quota=True,user_id='711e3fb101a042e190cf06281a35166c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3a092cd-7947-4cbf-abff-4ba9567becf0),volume_type_id=f3a092cd-7947-4cbf-abff-4ba9567becf0)}" {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 10:17:20 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-31b9b108-af8a-40aa-843c-e36232ef3fa6 tempest-CreateVolumesFromImageTest-446209050 None] Creating volume 23fb7743-afe3-49fd-a2f1-70421d2a845f {{(pid=87515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 10:17:20 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-31b9b108-af8a-40aa-843c-e36232ef3fa6 tempest-CreateVolumesFromImageTest-446209050 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:17:20 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-31b9b108-af8a-40aa-843c-e36232ef3fa6 tempest-CreateVolumesFromImageTest-446209050 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:17:20 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-31b9b108-af8a-40aa-843c-e36232ef3fa6 tempest-CreateVolumesFromImageTest-446209050 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:17:20 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-31b9b108-af8a-40aa-843c-e36232ef3fa6 tempest-CreateVolumesFromImageTest-446209050 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:17:20 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-31b9b108-af8a-40aa-843c-e36232ef3fa6 tempest-CreateVolumesFromImageTest-446209050 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:17:20 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-31b9b108-af8a-40aa-843c-e36232ef3fa6 tempest-CreateVolumesFromImageTest-446209050 None] Selected osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c as target Quobyte volume. {{(pid=87515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 10:17:20 devstack cinder-volume[87515]: INFO cinder.volume.drivers.remotefs [None req-31b9b108-af8a-40aa-843c-e36232ef3fa6 tempest-CreateVolumesFromImageTest-446209050 None] casted to osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c Sep 07 10:17:20 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-31b9b108-af8a-40aa-843c-e36232ef3fa6 tempest-CreateVolumesFromImageTest-446209050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-23fb7743-afe3-49fd-a2f1-70421d2a845f 1073741824 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:17:20 devstack sudo[106404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-23fb7743-afe3-49fd-a2f1-70421d2a845f 1073741824 Sep 07 10:17:20 devstack sudo[106404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:17:20 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-eb3212e9-be6b-4a7f-a976-e9c7b8cb8301 tempest-CreateVolumesFromImageTest-446209050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79f9d46d-5b83-41a4-991f-192cb846eb00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c5818c75-cc55-433a-9094-344a6b2a65b3', 'volume_size': 1}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:17:20 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-eb3212e9-be6b-4a7f-a976-e9c7b8cb8301 tempest-CreateVolumesFromImageTest-446209050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc662321-1b42-49a9-a78c-cb0d420b36c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:17:20 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-eb3212e9-be6b-4a7f-a976-e9c7b8cb8301 tempest-CreateVolumesFromImageTest-446209050 None] Volume volume-c5818c75-cc55-433a-9094-344a6b2a65b3 (c5818c75-cc55-433a-9094-344a6b2a65b3): created successfully Sep 07 10:17:20 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-eb3212e9-be6b-4a7f-a976-e9c7b8cb8301 tempest-CreateVolumesFromImageTest-446209050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc662321-1b42-49a9-a78c-cb0d420b36c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:17:20 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-eb3212e9-be6b-4a7f-a976-e9c7b8cb8301 tempest-CreateVolumesFromImageTest-446209050 None] Flow 'volume_create_manager' (ad095c49-3060-4081-804c-291356f38db4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:17:20 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-eb3212e9-be6b-4a7f-a976-e9c7b8cb8301 tempest-CreateVolumesFromImageTest-446209050 None] Created volume successfully. Sep 07 10:17:20 devstack cinder-volume[87515]: DEBUG cinder.volume.flows.manager.create_volume [None req-b045678f-c953-454f-82ac-b9358eb7cf78 tempest-CreateVolumesFromImageTest-446209050 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 10:17:20 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-b045678f-c953-454f-82ac-b9358eb7cf78 tempest-CreateVolumesFromImageTest-446209050 None] Flow 'volume_create_manager' (67d2ce0a-0a9f-4b33-b4d7-60f150301e0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:17:20 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-b045678f-c953-454f-82ac-b9358eb7cf78 tempest-CreateVolumesFromImageTest-446209050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4de6ab03-f4bc-41d8-98dc-67139ccdb5c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:17:20 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-b045678f-c953-454f-82ac-b9358eb7cf78 tempest-CreateVolumesFromImageTest-446209050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4de6ab03-f4bc-41d8-98dc-67139ccdb5c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:17:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-539752627',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3976f2a0-6868-46c4-ab50-213ae635b451,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='086d5fda7e014e2fb31596c9322d6d70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:17:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:17:21Z,use_quota=True,user_id='711e3fb101a042e190cf06281a35166c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3a092cd-7947-4cbf-abff-4ba9567becf0),volume_type_id=f3a092cd-7947-4cbf-abff-4ba9567becf0)' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:17:20 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-b045678f-c953-454f-82ac-b9358eb7cf78 tempest-CreateVolumesFromImageTest-446209050 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60407a95-3e4b-42b0-8885-e11d6629540b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:17:20 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-b045678f-c953-454f-82ac-b9358eb7cf78 tempest-CreateVolumesFromImageTest-446209050 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60407a95-3e4b-42b0-8885-e11d6629540b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:17:20 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-b045678f-c953-454f-82ac-b9358eb7cf78 tempest-CreateVolumesFromImageTest-446209050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4cd9d289-6640-4900-9fd9-b92d4b163b35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:17:21 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-b045678f-c953-454f-82ac-b9358eb7cf78 tempest-CreateVolumesFromImageTest-446209050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4cd9d289-6640-4900-9fd9-b92d4b163b35) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3976f2a0-6868-46c4-ab50-213ae635b451', 'volume_name': 'volume-3976f2a0-6868-46c4-ab50-213ae635b451', 'volume_size': 1}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:17:21 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-b045678f-c953-454f-82ac-b9358eb7cf78 tempest-CreateVolumesFromImageTest-446209050 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ae91b1c-2d41-4572-ab89-27602de43055) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:17:21 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-b045678f-c953-454f-82ac-b9358eb7cf78 tempest-CreateVolumesFromImageTest-446209050 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ae91b1c-2d41-4572-ab89-27602de43055) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:17:21 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-b045678f-c953-454f-82ac-b9358eb7cf78 tempest-CreateVolumesFromImageTest-446209050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (362d7a46-deb3-4fb5-a10b-2f3bfdc47c19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:17:21 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-b045678f-c953-454f-82ac-b9358eb7cf78 tempest-CreateVolumesFromImageTest-446209050 None] Volume 3976f2a0-6868-46c4-ab50-213ae635b451: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3976f2a0-6868-46c4-ab50-213ae635b451', 'volume_size': 1} Sep 07 10:17:21 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-b045678f-c953-454f-82ac-b9358eb7cf78 tempest-CreateVolumesFromImageTest-446209050 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:17:21 devstack cinder-volume[87515]: DEBUG cinder.volume.flows.manager.create_volume [None req-4cc3442d-1e7d-4331-9307-6b32389722c2 tempest-CreateVolumesFromImageTest-446209050 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 10:17:21 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-4cc3442d-1e7d-4331-9307-6b32389722c2 tempest-CreateVolumesFromImageTest-446209050 None] Flow 'volume_create_manager' (f73a401c-a633-4f5c-b638-04cbf69e9a53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:17:21 devstack sudo[106404]: pam_unix(sudo:session): session closed for user root Sep 07 10:17:21 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-4cc3442d-1e7d-4331-9307-6b32389722c2 tempest-CreateVolumesFromImageTest-446209050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ed075e9-f53d-476c-94bf-6480a719d727) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:17:21 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-31b9b108-af8a-40aa-843c-e36232ef3fa6 tempest-CreateVolumesFromImageTest-446209050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-23fb7743-afe3-49fd-a2f1-70421d2a845f 1073741824" returned: 0 in 0.542s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:17:21 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-4cc3442d-1e7d-4331-9307-6b32389722c2 tempest-CreateVolumesFromImageTest-446209050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ed075e9-f53d-476c-94bf-6480a719d727) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:17:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-48289606',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=048f8be2-f425-4a64-882e-a71fe7a675a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='086d5fda7e014e2fb31596c9322d6d70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:17:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:17:21Z,use_quota=True,user_id='711e3fb101a042e190cf06281a35166c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3a092cd-7947-4cbf-abff-4ba9567becf0),volume_type_id=f3a092cd-7947-4cbf-abff-4ba9567becf0)' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:17:21 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-4cc3442d-1e7d-4331-9307-6b32389722c2 tempest-CreateVolumesFromImageTest-446209050 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40938a39-1e9f-4163-a303-72da090c8ea1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:17:21 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-4cc3442d-1e7d-4331-9307-6b32389722c2 tempest-CreateVolumesFromImageTest-446209050 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40938a39-1e9f-4163-a303-72da090c8ea1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:17:21 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-4cc3442d-1e7d-4331-9307-6b32389722c2 tempest-CreateVolumesFromImageTest-446209050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f26f239-30f9-42a6-b986-533e3e52addb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:17:21 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-4cc3442d-1e7d-4331-9307-6b32389722c2 tempest-CreateVolumesFromImageTest-446209050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f26f239-30f9-42a6-b986-533e3e52addb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '048f8be2-f425-4a64-882e-a71fe7a675a0', 'volume_name': 'volume-048f8be2-f425-4a64-882e-a71fe7a675a0', 'volume_size': 1}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:17:21 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-4cc3442d-1e7d-4331-9307-6b32389722c2 tempest-CreateVolumesFromImageTest-446209050 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb6cbcf2-d279-420c-928e-12b17fc95b36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:17:21 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-4cc3442d-1e7d-4331-9307-6b32389722c2 tempest-CreateVolumesFromImageTest-446209050 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb6cbcf2-d279-420c-928e-12b17fc95b36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:17:21 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-4cc3442d-1e7d-4331-9307-6b32389722c2 tempest-CreateVolumesFromImageTest-446209050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a87d5a84-5ba7-4dc2-8dbc-0b1d7a743879) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:17:21 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-4cc3442d-1e7d-4331-9307-6b32389722c2 tempest-CreateVolumesFromImageTest-446209050 None] Volume 048f8be2-f425-4a64-882e-a71fe7a675a0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-048f8be2-f425-4a64-882e-a71fe7a675a0', 'volume_size': 1} Sep 07 10:17:21 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-4cc3442d-1e7d-4331-9307-6b32389722c2 tempest-CreateVolumesFromImageTest-446209050 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:17:21 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-31b9b108-af8a-40aa-843c-e36232ef3fa6 tempest-CreateVolumesFromImageTest-446209050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-23fb7743-afe3-49fd-a2f1-70421d2a845f {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:17:21 devstack sudo[106410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-23fb7743-afe3-49fd-a2f1-70421d2a845f Sep 07 10:17:21 devstack sudo[106410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:17:21 devstack sudo[106410]: pam_unix(sudo:session): session closed for user root Sep 07 10:17:21 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-31b9b108-af8a-40aa-843c-e36232ef3fa6 tempest-CreateVolumesFromImageTest-446209050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-23fb7743-afe3-49fd-a2f1-70421d2a845f" returned: 0 in 0.241s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:17:21 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-31b9b108-af8a-40aa-843c-e36232ef3fa6 tempest-CreateVolumesFromImageTest-446209050 None] <== create_volume: return (866ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'} {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 10:17:21 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-31b9b108-af8a-40aa-843c-e36232ef3fa6 tempest-CreateVolumesFromImageTest-446209050 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.869s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:17:21 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-27ad4be9-f71e-4288-b5e6-ef7759b88b0d tempest-CreateVolumesFromImageTest-446209050 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.002s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:17:21 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-27ad4be9-f71e-4288-b5e6-ef7759b88b0d tempest-CreateVolumesFromImageTest-446209050 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:17:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2141124789',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a55ba0bc-7683-406f-9b26-8307831512a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='086d5fda7e014e2fb31596c9322d6d70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:17:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:17:20Z,use_quota=True,user_id='711e3fb101a042e190cf06281a35166c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3a092cd-7947-4cbf-abff-4ba9567becf0),volume_type_id=f3a092cd-7947-4cbf-abff-4ba9567becf0)}" {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 10:17:21 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-27ad4be9-f71e-4288-b5e6-ef7759b88b0d tempest-CreateVolumesFromImageTest-446209050 None] Creating volume a55ba0bc-7683-406f-9b26-8307831512a7 {{(pid=87515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 10:17:21 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-27ad4be9-f71e-4288-b5e6-ef7759b88b0d tempest-CreateVolumesFromImageTest-446209050 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:17:21 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-27ad4be9-f71e-4288-b5e6-ef7759b88b0d tempest-CreateVolumesFromImageTest-446209050 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:17:21 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-27ad4be9-f71e-4288-b5e6-ef7759b88b0d tempest-CreateVolumesFromImageTest-446209050 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:17:21 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-27ad4be9-f71e-4288-b5e6-ef7759b88b0d tempest-CreateVolumesFromImageTest-446209050 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:17:21 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-27ad4be9-f71e-4288-b5e6-ef7759b88b0d tempest-CreateVolumesFromImageTest-446209050 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:17:21 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-27ad4be9-f71e-4288-b5e6-ef7759b88b0d tempest-CreateVolumesFromImageTest-446209050 None] Selected osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c as target Quobyte volume. {{(pid=87515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 10:17:21 devstack cinder-volume[87515]: INFO cinder.volume.drivers.remotefs [None req-27ad4be9-f71e-4288-b5e6-ef7759b88b0d tempest-CreateVolumesFromImageTest-446209050 None] casted to osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c Sep 07 10:17:21 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-27ad4be9-f71e-4288-b5e6-ef7759b88b0d tempest-CreateVolumesFromImageTest-446209050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-a55ba0bc-7683-406f-9b26-8307831512a7 1073741824 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:17:21 devstack sudo[106413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-a55ba0bc-7683-406f-9b26-8307831512a7 1073741824 Sep 07 10:17:21 devstack sudo[106413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:17:21 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-31b9b108-af8a-40aa-843c-e36232ef3fa6 tempest-CreateVolumesFromImageTest-446209050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c25c3724-216b-4ff2-b966-cfa302c6edea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-23fb7743-afe3-49fd-a2f1-70421d2a845f', 'volume_size': 1}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:17:21 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-31b9b108-af8a-40aa-843c-e36232ef3fa6 tempest-CreateVolumesFromImageTest-446209050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d399ee69-21f6-496f-8315-c89163f3b384) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:17:21 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-31b9b108-af8a-40aa-843c-e36232ef3fa6 tempest-CreateVolumesFromImageTest-446209050 None] Volume volume-23fb7743-afe3-49fd-a2f1-70421d2a845f (23fb7743-afe3-49fd-a2f1-70421d2a845f): created successfully Sep 07 10:17:21 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-31b9b108-af8a-40aa-843c-e36232ef3fa6 tempest-CreateVolumesFromImageTest-446209050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d399ee69-21f6-496f-8315-c89163f3b384) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:17:21 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-31b9b108-af8a-40aa-843c-e36232ef3fa6 tempest-CreateVolumesFromImageTest-446209050 None] Flow 'volume_create_manager' (82f46632-9302-4d44-9fce-88a1df4a039d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:17:21 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-31b9b108-af8a-40aa-843c-e36232ef3fa6 tempest-CreateVolumesFromImageTest-446209050 None] Created volume successfully. Sep 07 10:17:22 devstack sudo[106413]: pam_unix(sudo:session): session closed for user root Sep 07 10:17:22 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-27ad4be9-f71e-4288-b5e6-ef7759b88b0d tempest-CreateVolumesFromImageTest-446209050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-a55ba0bc-7683-406f-9b26-8307831512a7 1073741824" returned: 0 in 0.401s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:17:22 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-27ad4be9-f71e-4288-b5e6-ef7759b88b0d tempest-CreateVolumesFromImageTest-446209050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-a55ba0bc-7683-406f-9b26-8307831512a7 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:17:22 devstack sudo[106418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-a55ba0bc-7683-406f-9b26-8307831512a7 Sep 07 10:17:22 devstack sudo[106418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:17:22 devstack sudo[106418]: pam_unix(sudo:session): session closed for user root Sep 07 10:17:22 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-27ad4be9-f71e-4288-b5e6-ef7759b88b0d tempest-CreateVolumesFromImageTest-446209050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-a55ba0bc-7683-406f-9b26-8307831512a7" returned: 0 in 0.257s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:17:22 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-27ad4be9-f71e-4288-b5e6-ef7759b88b0d tempest-CreateVolumesFromImageTest-446209050 None] <== create_volume: return (695ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'} {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 10:17:22 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-27ad4be9-f71e-4288-b5e6-ef7759b88b0d tempest-CreateVolumesFromImageTest-446209050 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.698s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:17:22 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-b045678f-c953-454f-82ac-b9358eb7cf78 tempest-CreateVolumesFromImageTest-446209050 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.321s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:17:22 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-b045678f-c953-454f-82ac-b9358eb7cf78 tempest-CreateVolumesFromImageTest-446209050 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:17:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-539752627',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3976f2a0-6868-46c4-ab50-213ae635b451,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='086d5fda7e014e2fb31596c9322d6d70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:17:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:17:21Z,use_quota=True,user_id='711e3fb101a042e190cf06281a35166c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3a092cd-7947-4cbf-abff-4ba9567becf0),volume_type_id=f3a092cd-7947-4cbf-abff-4ba9567becf0)}" {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 10:17:22 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-b045678f-c953-454f-82ac-b9358eb7cf78 tempest-CreateVolumesFromImageTest-446209050 None] Creating volume 3976f2a0-6868-46c4-ab50-213ae635b451 {{(pid=87515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 10:17:22 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-b045678f-c953-454f-82ac-b9358eb7cf78 tempest-CreateVolumesFromImageTest-446209050 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:17:22 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-b045678f-c953-454f-82ac-b9358eb7cf78 tempest-CreateVolumesFromImageTest-446209050 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:17:22 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-b045678f-c953-454f-82ac-b9358eb7cf78 tempest-CreateVolumesFromImageTest-446209050 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:17:22 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-b045678f-c953-454f-82ac-b9358eb7cf78 tempest-CreateVolumesFromImageTest-446209050 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:17:22 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-b045678f-c953-454f-82ac-b9358eb7cf78 tempest-CreateVolumesFromImageTest-446209050 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:17:22 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-b045678f-c953-454f-82ac-b9358eb7cf78 tempest-CreateVolumesFromImageTest-446209050 None] Selected osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c as target Quobyte volume. {{(pid=87515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 10:17:22 devstack cinder-volume[87515]: INFO cinder.volume.drivers.remotefs [None req-b045678f-c953-454f-82ac-b9358eb7cf78 tempest-CreateVolumesFromImageTest-446209050 None] casted to osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c Sep 07 10:17:22 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-b045678f-c953-454f-82ac-b9358eb7cf78 tempest-CreateVolumesFromImageTest-446209050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-3976f2a0-6868-46c4-ab50-213ae635b451 1073741824 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:17:22 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-27ad4be9-f71e-4288-b5e6-ef7759b88b0d tempest-CreateVolumesFromImageTest-446209050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9901d33b-8803-48eb-88d9-3d3bae3dbad5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a55ba0bc-7683-406f-9b26-8307831512a7', 'volume_size': 1}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:17:22 devstack sudo[106421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-3976f2a0-6868-46c4-ab50-213ae635b451 1073741824 Sep 07 10:17:22 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-27ad4be9-f71e-4288-b5e6-ef7759b88b0d tempest-CreateVolumesFromImageTest-446209050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ede0e87-40ca-4842-a398-f5b3b7f4fc4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:17:22 devstack sudo[106421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:17:22 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-27ad4be9-f71e-4288-b5e6-ef7759b88b0d tempest-CreateVolumesFromImageTest-446209050 None] Volume volume-a55ba0bc-7683-406f-9b26-8307831512a7 (a55ba0bc-7683-406f-9b26-8307831512a7): created successfully Sep 07 10:17:22 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-27ad4be9-f71e-4288-b5e6-ef7759b88b0d tempest-CreateVolumesFromImageTest-446209050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ede0e87-40ca-4842-a398-f5b3b7f4fc4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:17:22 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-27ad4be9-f71e-4288-b5e6-ef7759b88b0d tempest-CreateVolumesFromImageTest-446209050 None] Flow 'volume_create_manager' (c91a9f35-91ee-40d2-a284-dc9d2c9ae21c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:17:22 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-27ad4be9-f71e-4288-b5e6-ef7759b88b0d tempest-CreateVolumesFromImageTest-446209050 None] Created volume successfully. Sep 07 10:17:22 devstack sudo[106421]: pam_unix(sudo:session): session closed for user root Sep 07 10:17:22 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-b045678f-c953-454f-82ac-b9358eb7cf78 tempest-CreateVolumesFromImageTest-446209050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-3976f2a0-6868-46c4-ab50-213ae635b451 1073741824" returned: 0 in 0.399s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:17:22 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-b045678f-c953-454f-82ac-b9358eb7cf78 tempest-CreateVolumesFromImageTest-446209050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-3976f2a0-6868-46c4-ab50-213ae635b451 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:17:22 devstack sudo[106426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-3976f2a0-6868-46c4-ab50-213ae635b451 Sep 07 10:17:22 devstack sudo[106426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:17:23 devstack sudo[106426]: pam_unix(sudo:session): session closed for user root Sep 07 10:17:23 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-b045678f-c953-454f-82ac-b9358eb7cf78 tempest-CreateVolumesFromImageTest-446209050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-3976f2a0-6868-46c4-ab50-213ae635b451" returned: 0 in 0.235s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:17:23 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-b045678f-c953-454f-82ac-b9358eb7cf78 tempest-CreateVolumesFromImageTest-446209050 None] <== create_volume: return (670ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'} {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 10:17:23 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-b045678f-c953-454f-82ac-b9358eb7cf78 tempest-CreateVolumesFromImageTest-446209050 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.673s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:17:23 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-4cc3442d-1e7d-4331-9307-6b32389722c2 tempest-CreateVolumesFromImageTest-446209050 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.647s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:17:23 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-4cc3442d-1e7d-4331-9307-6b32389722c2 tempest-CreateVolumesFromImageTest-446209050 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:17:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-48289606',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=048f8be2-f425-4a64-882e-a71fe7a675a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='086d5fda7e014e2fb31596c9322d6d70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:17:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:17:21Z,use_quota=True,user_id='711e3fb101a042e190cf06281a35166c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3a092cd-7947-4cbf-abff-4ba9567becf0),volume_type_id=f3a092cd-7947-4cbf-abff-4ba9567becf0)}" {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 10:17:23 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-4cc3442d-1e7d-4331-9307-6b32389722c2 tempest-CreateVolumesFromImageTest-446209050 None] Creating volume 048f8be2-f425-4a64-882e-a71fe7a675a0 {{(pid=87515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 10:17:23 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-4cc3442d-1e7d-4331-9307-6b32389722c2 tempest-CreateVolumesFromImageTest-446209050 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:17:23 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-4cc3442d-1e7d-4331-9307-6b32389722c2 tempest-CreateVolumesFromImageTest-446209050 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:17:23 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-4cc3442d-1e7d-4331-9307-6b32389722c2 tempest-CreateVolumesFromImageTest-446209050 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:17:23 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-4cc3442d-1e7d-4331-9307-6b32389722c2 tempest-CreateVolumesFromImageTest-446209050 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:17:23 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-4cc3442d-1e7d-4331-9307-6b32389722c2 tempest-CreateVolumesFromImageTest-446209050 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:17:23 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-4cc3442d-1e7d-4331-9307-6b32389722c2 tempest-CreateVolumesFromImageTest-446209050 None] Selected osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c as target Quobyte volume. {{(pid=87515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 10:17:23 devstack cinder-volume[87515]: INFO cinder.volume.drivers.remotefs [None req-4cc3442d-1e7d-4331-9307-6b32389722c2 tempest-CreateVolumesFromImageTest-446209050 None] casted to osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c Sep 07 10:17:23 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-4cc3442d-1e7d-4331-9307-6b32389722c2 tempest-CreateVolumesFromImageTest-446209050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-048f8be2-f425-4a64-882e-a71fe7a675a0 1073741824 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:17:23 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-b045678f-c953-454f-82ac-b9358eb7cf78 tempest-CreateVolumesFromImageTest-446209050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (362d7a46-deb3-4fb5-a10b-2f3bfdc47c19) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3976f2a0-6868-46c4-ab50-213ae635b451', 'volume_size': 1}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:17:23 devstack sudo[106429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-048f8be2-f425-4a64-882e-a71fe7a675a0 1073741824 Sep 07 10:17:23 devstack sudo[106429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:17:23 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-b045678f-c953-454f-82ac-b9358eb7cf78 tempest-CreateVolumesFromImageTest-446209050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a2def36-d62e-497c-aa2c-eda9c34a17c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:17:23 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-b045678f-c953-454f-82ac-b9358eb7cf78 tempest-CreateVolumesFromImageTest-446209050 None] Volume volume-3976f2a0-6868-46c4-ab50-213ae635b451 (3976f2a0-6868-46c4-ab50-213ae635b451): created successfully Sep 07 10:17:23 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-b045678f-c953-454f-82ac-b9358eb7cf78 tempest-CreateVolumesFromImageTest-446209050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a2def36-d62e-497c-aa2c-eda9c34a17c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:17:23 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-b045678f-c953-454f-82ac-b9358eb7cf78 tempest-CreateVolumesFromImageTest-446209050 None] Flow 'volume_create_manager' (67d2ce0a-0a9f-4b33-b4d7-60f150301e0e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:17:23 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-b045678f-c953-454f-82ac-b9358eb7cf78 tempest-CreateVolumesFromImageTest-446209050 None] Created volume successfully. Sep 07 10:17:23 devstack sudo[106429]: pam_unix(sudo:session): session closed for user root Sep 07 10:17:23 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-4cc3442d-1e7d-4331-9307-6b32389722c2 tempest-CreateVolumesFromImageTest-446209050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-048f8be2-f425-4a64-882e-a71fe7a675a0 1073741824" returned: 0 in 0.403s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:17:23 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-4cc3442d-1e7d-4331-9307-6b32389722c2 tempest-CreateVolumesFromImageTest-446209050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-048f8be2-f425-4a64-882e-a71fe7a675a0 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:17:23 devstack sudo[106435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-048f8be2-f425-4a64-882e-a71fe7a675a0 Sep 07 10:17:23 devstack sudo[106435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:17:23 devstack sudo[106435]: pam_unix(sudo:session): session closed for user root Sep 07 10:17:23 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-4cc3442d-1e7d-4331-9307-6b32389722c2 tempest-CreateVolumesFromImageTest-446209050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-048f8be2-f425-4a64-882e-a71fe7a675a0" returned: 0 in 0.243s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:17:23 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-4cc3442d-1e7d-4331-9307-6b32389722c2 tempest-CreateVolumesFromImageTest-446209050 None] <== create_volume: return (685ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'} {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 10:17:23 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-4cc3442d-1e7d-4331-9307-6b32389722c2 tempest-CreateVolumesFromImageTest-446209050 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.688s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:17:23 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-4cc3442d-1e7d-4331-9307-6b32389722c2 tempest-CreateVolumesFromImageTest-446209050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a87d5a84-5ba7-4dc2-8dbc-0b1d7a743879) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-048f8be2-f425-4a64-882e-a71fe7a675a0', 'volume_size': 1}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:17:23 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-4cc3442d-1e7d-4331-9307-6b32389722c2 tempest-CreateVolumesFromImageTest-446209050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85df94c0-62aa-4d76-ba16-e06e9ea05a81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:17:23 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-4cc3442d-1e7d-4331-9307-6b32389722c2 tempest-CreateVolumesFromImageTest-446209050 None] Volume volume-048f8be2-f425-4a64-882e-a71fe7a675a0 (048f8be2-f425-4a64-882e-a71fe7a675a0): created successfully Sep 07 10:17:23 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-4cc3442d-1e7d-4331-9307-6b32389722c2 tempest-CreateVolumesFromImageTest-446209050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85df94c0-62aa-4d76-ba16-e06e9ea05a81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:17:23 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-4cc3442d-1e7d-4331-9307-6b32389722c2 tempest-CreateVolumesFromImageTest-446209050 None] Flow 'volume_create_manager' (f73a401c-a633-4f5c-b638-04cbf69e9a53) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:17:23 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-4cc3442d-1e7d-4331-9307-6b32389722c2 tempest-CreateVolumesFromImageTest-446209050 None] Created volume successfully. Sep 07 10:17:24 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-214ef742-909a-480a-bf83-e619ac1cf4a3 tempest-CreateVolumesFromImageTest-446209050 None] Acquiring lock "cinder-048f8be2-f425-4a64-882e-a71fe7a675a0-delete_volume" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:17:24 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-214ef742-909a-480a-bf83-e619ac1cf4a3 tempest-CreateVolumesFromImageTest-446209050 None] Lock "cinder-048f8be2-f425-4a64-882e-a71fe7a675a0-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:17:24 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-214ef742-909a-480a-bf83-e619ac1cf4a3 tempest-CreateVolumesFromImageTest-446209050 None] Acquiring lock "cinder-quobyte-048f8be2-f425-4a64-882e-a71fe7a675a0" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:17:24 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-214ef742-909a-480a-bf83-e619ac1cf4a3 tempest-CreateVolumesFromImageTest-446209050 None] Lock "cinder-quobyte-048f8be2-f425-4a64-882e-a71fe7a675a0" acquired by "delete_volume" :: waited 0.016s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:17:24 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[55dd1dac-2557-476d-bf15-19d8392d14e6]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:17:24 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-214ef742-909a-480a-bf83-e619ac1cf4a3 tempest-CreateVolumesFromImageTest-446209050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-048f8be2-f425-4a64-882e-a71fe7a675a0 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:17:24 devstack sudo[106438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-048f8be2-f425-4a64-882e-a71fe7a675a0 Sep 07 10:17:24 devstack sudo[106438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:17:25 devstack sudo[106438]: pam_unix(sudo:session): session closed for user root Sep 07 10:17:25 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-214ef742-909a-480a-bf83-e619ac1cf4a3 tempest-CreateVolumesFromImageTest-446209050 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-048f8be2-f425-4a64-882e-a71fe7a675a0" returned: 0 in 0.350s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:17:25 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-214ef742-909a-480a-bf83-e619ac1cf4a3 tempest-CreateVolumesFromImageTest-446209050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-048f8be2-f425-4a64-882e-a71fe7a675a0 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:17:25 devstack sudo[106443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-048f8be2-f425-4a64-882e-a71fe7a675a0 Sep 07 10:17:25 devstack sudo[106443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:17:25 devstack sudo[106443]: pam_unix(sudo:session): session closed for user root Sep 07 10:17:25 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-214ef742-909a-480a-bf83-e619ac1cf4a3 tempest-CreateVolumesFromImageTest-446209050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-048f8be2-f425-4a64-882e-a71fe7a675a0" returned: 0 in 0.240s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:17:25 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-214ef742-909a-480a-bf83-e619ac1cf4a3 tempest-CreateVolumesFromImageTest-446209050 None] Lock "cinder-quobyte-048f8be2-f425-4a64-882e-a71fe7a675a0" released by "delete_volume" :: held 0.627s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:17:25 devstack cinder-volume[87515]: DEBUG cinder.quota [None req-214ef742-909a-480a-bf83-e619ac1cf4a3 tempest-CreateVolumesFromImageTest-446209050 None] Created reservations ['33147ea0-5115-4014-9a2b-75c46f0bb822', 'd40776fd-f7e2-4e65-9e95-4ac3e7a4c33b', 'b526aa9a-eeee-4996-9b52-7913dd7ecf99', 'a8227eba-33a2-44f5-9fde-47d791fd14f4'] {{(pid=87515) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:17:25 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-214ef742-909a-480a-bf83-e619ac1cf4a3 tempest-CreateVolumesFromImageTest-446209050 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:17:25 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-214ef742-909a-480a-bf83-e619ac1cf4a3 tempest-CreateVolumesFromImageTest-446209050 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:17:25 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-214ef742-909a-480a-bf83-e619ac1cf4a3 tempest-CreateVolumesFromImageTest-446209050 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:17:25 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-214ef742-909a-480a-bf83-e619ac1cf4a3 tempest-CreateVolumesFromImageTest-446209050 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:17:25 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-214ef742-909a-480a-bf83-e619ac1cf4a3 tempest-CreateVolumesFromImageTest-446209050 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:17:25 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-214ef742-909a-480a-bf83-e619ac1cf4a3 tempest-CreateVolumesFromImageTest-446209050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:17:25 devstack sudo[106446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a Sep 07 10:17:25 devstack sudo[106446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:17:25 devstack sudo[106446]: pam_unix(sudo:session): session closed for user root Sep 07 10:17:25 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-214ef742-909a-480a-bf83-e619ac1cf4a3 tempest-CreateVolumesFromImageTest-446209050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a" returned: 0 in 0.247s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:17:25 devstack cinder-volume[87515]: DEBUG cinder.manager [None req-214ef742-909a-480a-bf83-e619ac1cf4a3 tempest-CreateVolumesFromImageTest-446209050 None] Notifying Schedulers of capabilities ... {{(pid=87515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:17:25 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-214ef742-909a-480a-bf83-e619ac1cf4a3 tempest-CreateVolumesFromImageTest-446209050 None] Deleted volume successfully. Sep 07 10:17:25 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-214ef742-909a-480a-bf83-e619ac1cf4a3 tempest-CreateVolumesFromImageTest-446209050 None] Lock "cinder-048f8be2-f425-4a64-882e-a71fe7a675a0-delete_volume" released by "delete_volume" :: held 1.068s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:17:25 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-c5924fd9-1330-4b3b-9208-e566185e90ce tempest-CreateVolumesFromImageTest-446209050 None] Acquiring lock "cinder-3976f2a0-6868-46c4-ab50-213ae635b451-delete_volume" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:17:25 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-c5924fd9-1330-4b3b-9208-e566185e90ce tempest-CreateVolumesFromImageTest-446209050 None] Lock "cinder-3976f2a0-6868-46c4-ab50-213ae635b451-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:17:25 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-c5924fd9-1330-4b3b-9208-e566185e90ce tempest-CreateVolumesFromImageTest-446209050 None] Acquiring lock "cinder-quobyte-3976f2a0-6868-46c4-ab50-213ae635b451" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:17:25 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-c5924fd9-1330-4b3b-9208-e566185e90ce tempest-CreateVolumesFromImageTest-446209050 None] Lock "cinder-quobyte-3976f2a0-6868-46c4-ab50-213ae635b451" acquired by "delete_volume" :: waited 0.014s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:17:25 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ea4f56f-6b33-4cf8-aca2-2745bd27ed69]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:17:25 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-c5924fd9-1330-4b3b-9208-e566185e90ce tempest-CreateVolumesFromImageTest-446209050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-3976f2a0-6868-46c4-ab50-213ae635b451 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:17:26 devstack sudo[106449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-3976f2a0-6868-46c4-ab50-213ae635b451 Sep 07 10:17:26 devstack sudo[106449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:17:26 devstack sudo[106449]: pam_unix(sudo:session): session closed for user root Sep 07 10:17:26 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-c5924fd9-1330-4b3b-9208-e566185e90ce tempest-CreateVolumesFromImageTest-446209050 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-3976f2a0-6868-46c4-ab50-213ae635b451" returned: 0 in 0.342s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:17:26 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-c5924fd9-1330-4b3b-9208-e566185e90ce tempest-CreateVolumesFromImageTest-446209050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-3976f2a0-6868-46c4-ab50-213ae635b451 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:17:26 devstack sudo[106454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-3976f2a0-6868-46c4-ab50-213ae635b451 Sep 07 10:17:26 devstack sudo[106454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:17:26 devstack sudo[106454]: pam_unix(sudo:session): session closed for user root Sep 07 10:17:26 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-c5924fd9-1330-4b3b-9208-e566185e90ce tempest-CreateVolumesFromImageTest-446209050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-3976f2a0-6868-46c4-ab50-213ae635b451" returned: 0 in 0.239s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:17:26 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-c5924fd9-1330-4b3b-9208-e566185e90ce tempest-CreateVolumesFromImageTest-446209050 None] Lock "cinder-quobyte-3976f2a0-6868-46c4-ab50-213ae635b451" released by "delete_volume" :: held 0.617s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:17:26 devstack cinder-volume[87515]: DEBUG cinder.quota [None req-c5924fd9-1330-4b3b-9208-e566185e90ce tempest-CreateVolumesFromImageTest-446209050 None] Created reservations ['a7fef158-ea57-4bd7-802f-3a6f861f7246', 'c679fbd1-df82-4ea3-ac03-94c187b4a9e9', '44f2864e-77e3-4b3c-ab36-e1da235e4a5e', 'dd78586f-bb93-41d8-87dc-b8eb8cfede3c'] {{(pid=87515) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:17:26 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-c5924fd9-1330-4b3b-9208-e566185e90ce tempest-CreateVolumesFromImageTest-446209050 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:17:26 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-c5924fd9-1330-4b3b-9208-e566185e90ce tempest-CreateVolumesFromImageTest-446209050 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:17:26 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-c5924fd9-1330-4b3b-9208-e566185e90ce tempest-CreateVolumesFromImageTest-446209050 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:17:26 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-c5924fd9-1330-4b3b-9208-e566185e90ce tempest-CreateVolumesFromImageTest-446209050 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:17:26 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-c5924fd9-1330-4b3b-9208-e566185e90ce tempest-CreateVolumesFromImageTest-446209050 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:17:26 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-c5924fd9-1330-4b3b-9208-e566185e90ce tempest-CreateVolumesFromImageTest-446209050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:17:26 devstack sudo[106457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a Sep 07 10:17:26 devstack sudo[106457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:17:26 devstack sudo[106457]: pam_unix(sudo:session): session closed for user root Sep 07 10:17:26 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-c5924fd9-1330-4b3b-9208-e566185e90ce tempest-CreateVolumesFromImageTest-446209050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a" returned: 0 in 0.240s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:17:26 devstack cinder-volume[87515]: DEBUG cinder.manager [None req-c5924fd9-1330-4b3b-9208-e566185e90ce tempest-CreateVolumesFromImageTest-446209050 None] Notifying Schedulers of capabilities ... {{(pid=87515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:17:26 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-c5924fd9-1330-4b3b-9208-e566185e90ce tempest-CreateVolumesFromImageTest-446209050 None] Deleted volume successfully. Sep 07 10:17:26 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-c5924fd9-1330-4b3b-9208-e566185e90ce tempest-CreateVolumesFromImageTest-446209050 None] Lock "cinder-3976f2a0-6868-46c4-ab50-213ae635b451-delete_volume" released by "delete_volume" :: held 1.045s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:17:26 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-49cc6d8b-bcf3-42b2-89a3-1522fc3f6cf3 tempest-CreateVolumesFromImageTest-446209050 None] Acquiring lock "cinder-a55ba0bc-7683-406f-9b26-8307831512a7-delete_volume" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:17:27 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-49cc6d8b-bcf3-42b2-89a3-1522fc3f6cf3 tempest-CreateVolumesFromImageTest-446209050 None] Lock "cinder-a55ba0bc-7683-406f-9b26-8307831512a7-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:17:27 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-49cc6d8b-bcf3-42b2-89a3-1522fc3f6cf3 tempest-CreateVolumesFromImageTest-446209050 None] Acquiring lock "cinder-quobyte-a55ba0bc-7683-406f-9b26-8307831512a7" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:17:27 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-49cc6d8b-bcf3-42b2-89a3-1522fc3f6cf3 tempest-CreateVolumesFromImageTest-446209050 None] Lock "cinder-quobyte-a55ba0bc-7683-406f-9b26-8307831512a7" acquired by "delete_volume" :: waited 0.023s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:17:27 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[d52c172e-2bf0-4e19-9063-40ea627d3597]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:17:27 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-49cc6d8b-bcf3-42b2-89a3-1522fc3f6cf3 tempest-CreateVolumesFromImageTest-446209050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-a55ba0bc-7683-406f-9b26-8307831512a7 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:17:27 devstack sudo[106494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-a55ba0bc-7683-406f-9b26-8307831512a7 Sep 07 10:17:27 devstack sudo[106494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:17:27 devstack sudo[106494]: pam_unix(sudo:session): session closed for user root Sep 07 10:17:27 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-49cc6d8b-bcf3-42b2-89a3-1522fc3f6cf3 tempest-CreateVolumesFromImageTest-446209050 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-a55ba0bc-7683-406f-9b26-8307831512a7" returned: 0 in 0.352s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:17:27 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-49cc6d8b-bcf3-42b2-89a3-1522fc3f6cf3 tempest-CreateVolumesFromImageTest-446209050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-a55ba0bc-7683-406f-9b26-8307831512a7 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:17:27 devstack sudo[106501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-a55ba0bc-7683-406f-9b26-8307831512a7 Sep 07 10:17:27 devstack sudo[106501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:17:27 devstack sudo[106501]: pam_unix(sudo:session): session closed for user root Sep 07 10:17:27 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-49cc6d8b-bcf3-42b2-89a3-1522fc3f6cf3 tempest-CreateVolumesFromImageTest-446209050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-a55ba0bc-7683-406f-9b26-8307831512a7" returned: 0 in 0.240s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:17:27 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-49cc6d8b-bcf3-42b2-89a3-1522fc3f6cf3 tempest-CreateVolumesFromImageTest-446209050 None] Lock "cinder-quobyte-a55ba0bc-7683-406f-9b26-8307831512a7" released by "delete_volume" :: held 0.632s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:17:27 devstack cinder-volume[87515]: DEBUG cinder.quota [None req-49cc6d8b-bcf3-42b2-89a3-1522fc3f6cf3 tempest-CreateVolumesFromImageTest-446209050 None] Created reservations ['028fd5ff-8374-4a81-87c1-deeff2708710', 'ef558efb-295f-488f-98b7-bec86ec28afc', 'a4031f13-cb8b-4d2d-a457-74db27604f6b', '8923e436-eaec-4ba2-ba6d-6b555939b7cd'] {{(pid=87515) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:17:27 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-49cc6d8b-bcf3-42b2-89a3-1522fc3f6cf3 tempest-CreateVolumesFromImageTest-446209050 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:17:27 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-49cc6d8b-bcf3-42b2-89a3-1522fc3f6cf3 tempest-CreateVolumesFromImageTest-446209050 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:17:27 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-49cc6d8b-bcf3-42b2-89a3-1522fc3f6cf3 tempest-CreateVolumesFromImageTest-446209050 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:17:27 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-49cc6d8b-bcf3-42b2-89a3-1522fc3f6cf3 tempest-CreateVolumesFromImageTest-446209050 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:17:27 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-49cc6d8b-bcf3-42b2-89a3-1522fc3f6cf3 tempest-CreateVolumesFromImageTest-446209050 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:17:27 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-49cc6d8b-bcf3-42b2-89a3-1522fc3f6cf3 tempest-CreateVolumesFromImageTest-446209050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:17:27 devstack sudo[106504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a Sep 07 10:17:27 devstack sudo[106504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:17:28 devstack sudo[106504]: pam_unix(sudo:session): session closed for user root Sep 07 10:17:28 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-49cc6d8b-bcf3-42b2-89a3-1522fc3f6cf3 tempest-CreateVolumesFromImageTest-446209050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a" returned: 0 in 0.233s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:17:28 devstack cinder-volume[87515]: DEBUG cinder.manager [None req-49cc6d8b-bcf3-42b2-89a3-1522fc3f6cf3 tempest-CreateVolumesFromImageTest-446209050 None] Notifying Schedulers of capabilities ... {{(pid=87515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:17:28 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-49cc6d8b-bcf3-42b2-89a3-1522fc3f6cf3 tempest-CreateVolumesFromImageTest-446209050 None] Deleted volume successfully. Sep 07 10:17:28 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-49cc6d8b-bcf3-42b2-89a3-1522fc3f6cf3 tempest-CreateVolumesFromImageTest-446209050 None] Lock "cinder-a55ba0bc-7683-406f-9b26-8307831512a7-delete_volume" released by "delete_volume" :: held 1.060s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:17:28 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-416046f4-e5a1-49c3-8cb1-f7abbf450a81 tempest-CreateVolumesFromImageTest-446209050 None] Acquiring lock "cinder-23fb7743-afe3-49fd-a2f1-70421d2a845f-delete_volume" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:17:28 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-416046f4-e5a1-49c3-8cb1-f7abbf450a81 tempest-CreateVolumesFromImageTest-446209050 None] Lock "cinder-23fb7743-afe3-49fd-a2f1-70421d2a845f-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:17:28 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-416046f4-e5a1-49c3-8cb1-f7abbf450a81 tempest-CreateVolumesFromImageTest-446209050 None] Acquiring lock "cinder-quobyte-23fb7743-afe3-49fd-a2f1-70421d2a845f" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:17:28 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-416046f4-e5a1-49c3-8cb1-f7abbf450a81 tempest-CreateVolumesFromImageTest-446209050 None] Lock "cinder-quobyte-23fb7743-afe3-49fd-a2f1-70421d2a845f" acquired by "delete_volume" :: waited 0.014s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:17:28 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7fec2c4-928c-4783-8d9a-09617fce295e]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:17:28 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-416046f4-e5a1-49c3-8cb1-f7abbf450a81 tempest-CreateVolumesFromImageTest-446209050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-23fb7743-afe3-49fd-a2f1-70421d2a845f {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:17:28 devstack sudo[106507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-23fb7743-afe3-49fd-a2f1-70421d2a845f Sep 07 10:17:28 devstack sudo[106507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:17:28 devstack sudo[106507]: pam_unix(sudo:session): session closed for user root Sep 07 10:17:28 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-416046f4-e5a1-49c3-8cb1-f7abbf450a81 tempest-CreateVolumesFromImageTest-446209050 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-23fb7743-afe3-49fd-a2f1-70421d2a845f" returned: 0 in 0.355s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:17:28 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-416046f4-e5a1-49c3-8cb1-f7abbf450a81 tempest-CreateVolumesFromImageTest-446209050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-23fb7743-afe3-49fd-a2f1-70421d2a845f {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:17:28 devstack sudo[106512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-23fb7743-afe3-49fd-a2f1-70421d2a845f Sep 07 10:17:28 devstack sudo[106512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:17:28 devstack sudo[106512]: pam_unix(sudo:session): session closed for user root Sep 07 10:17:28 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-416046f4-e5a1-49c3-8cb1-f7abbf450a81 tempest-CreateVolumesFromImageTest-446209050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-23fb7743-afe3-49fd-a2f1-70421d2a845f" returned: 0 in 0.250s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:17:28 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-416046f4-e5a1-49c3-8cb1-f7abbf450a81 tempest-CreateVolumesFromImageTest-446209050 None] Lock "cinder-quobyte-23fb7743-afe3-49fd-a2f1-70421d2a845f" released by "delete_volume" :: held 0.642s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:17:28 devstack cinder-volume[87515]: DEBUG cinder.quota [None req-416046f4-e5a1-49c3-8cb1-f7abbf450a81 tempest-CreateVolumesFromImageTest-446209050 None] Created reservations ['ed2d2fbc-167a-47c9-9be6-5321e5229dbc', '36d05c1c-708f-42a0-b4fd-fc8303f385b5', 'e6032a65-e08e-4cb0-9782-006e11b75339', 'd9b19fca-dec2-4131-bcfa-0d302c14f89e'] {{(pid=87515) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:17:28 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-416046f4-e5a1-49c3-8cb1-f7abbf450a81 tempest-CreateVolumesFromImageTest-446209050 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:17:28 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-416046f4-e5a1-49c3-8cb1-f7abbf450a81 tempest-CreateVolumesFromImageTest-446209050 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:17:28 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-416046f4-e5a1-49c3-8cb1-f7abbf450a81 tempest-CreateVolumesFromImageTest-446209050 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:17:28 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-416046f4-e5a1-49c3-8cb1-f7abbf450a81 tempest-CreateVolumesFromImageTest-446209050 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:17:28 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-416046f4-e5a1-49c3-8cb1-f7abbf450a81 tempest-CreateVolumesFromImageTest-446209050 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:17:28 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-416046f4-e5a1-49c3-8cb1-f7abbf450a81 tempest-CreateVolumesFromImageTest-446209050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:17:28 devstack sudo[106515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a Sep 07 10:17:28 devstack sudo[106515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:17:29 devstack sudo[106515]: pam_unix(sudo:session): session closed for user root Sep 07 10:17:29 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-416046f4-e5a1-49c3-8cb1-f7abbf450a81 tempest-CreateVolumesFromImageTest-446209050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a" returned: 0 in 0.236s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:17:29 devstack cinder-volume[87515]: DEBUG cinder.manager [None req-416046f4-e5a1-49c3-8cb1-f7abbf450a81 tempest-CreateVolumesFromImageTest-446209050 None] Notifying Schedulers of capabilities ... {{(pid=87515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:17:29 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-416046f4-e5a1-49c3-8cb1-f7abbf450a81 tempest-CreateVolumesFromImageTest-446209050 None] Deleted volume successfully. Sep 07 10:17:29 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-416046f4-e5a1-49c3-8cb1-f7abbf450a81 tempest-CreateVolumesFromImageTest-446209050 None] Lock "cinder-23fb7743-afe3-49fd-a2f1-70421d2a845f-delete_volume" released by "delete_volume" :: held 1.064s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:17:29 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-a466b498-b8d3-4e64-bf79-521d9abf337f tempest-CreateVolumesFromImageTest-446209050 None] Acquiring lock "cinder-c5818c75-cc55-433a-9094-344a6b2a65b3-delete_volume" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:17:29 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-a466b498-b8d3-4e64-bf79-521d9abf337f tempest-CreateVolumesFromImageTest-446209050 None] Lock "cinder-c5818c75-cc55-433a-9094-344a6b2a65b3-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:17:29 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-a466b498-b8d3-4e64-bf79-521d9abf337f tempest-CreateVolumesFromImageTest-446209050 None] Acquiring lock "cinder-quobyte-c5818c75-cc55-433a-9094-344a6b2a65b3" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:17:29 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-a466b498-b8d3-4e64-bf79-521d9abf337f tempest-CreateVolumesFromImageTest-446209050 None] Lock "cinder-quobyte-c5818c75-cc55-433a-9094-344a6b2a65b3" acquired by "delete_volume" :: waited 0.019s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:17:29 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[532180b1-050b-4709-bcbb-0424f13ac8de]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:17:29 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-a466b498-b8d3-4e64-bf79-521d9abf337f tempest-CreateVolumesFromImageTest-446209050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-c5818c75-cc55-433a-9094-344a6b2a65b3 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:17:29 devstack sudo[106519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-c5818c75-cc55-433a-9094-344a6b2a65b3 Sep 07 10:17:29 devstack sudo[106519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:17:29 devstack sudo[106519]: pam_unix(sudo:session): session closed for user root Sep 07 10:17:29 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-a466b498-b8d3-4e64-bf79-521d9abf337f tempest-CreateVolumesFromImageTest-446209050 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-c5818c75-cc55-433a-9094-344a6b2a65b3" returned: 0 in 0.349s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:17:29 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-a466b498-b8d3-4e64-bf79-521d9abf337f tempest-CreateVolumesFromImageTest-446209050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-c5818c75-cc55-433a-9094-344a6b2a65b3 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:17:29 devstack sudo[106524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-c5818c75-cc55-433a-9094-344a6b2a65b3 Sep 07 10:17:29 devstack sudo[106524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:17:29 devstack sudo[106524]: pam_unix(sudo:session): session closed for user root Sep 07 10:17:30 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-a466b498-b8d3-4e64-bf79-521d9abf337f tempest-CreateVolumesFromImageTest-446209050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-c5818c75-cc55-433a-9094-344a6b2a65b3" returned: 0 in 0.240s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:17:30 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-a466b498-b8d3-4e64-bf79-521d9abf337f tempest-CreateVolumesFromImageTest-446209050 None] Lock "cinder-quobyte-c5818c75-cc55-433a-9094-344a6b2a65b3" released by "delete_volume" :: held 0.626s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:17:30 devstack cinder-volume[87515]: DEBUG cinder.quota [None req-a466b498-b8d3-4e64-bf79-521d9abf337f tempest-CreateVolumesFromImageTest-446209050 None] Created reservations ['63ee035c-b1a8-4f1f-b214-a0d9a3418dcf', '5a16cc71-8589-4a18-9483-87b24ea92414', 'e2942530-7075-4933-a702-3bb5758be473', '4e6d890e-f640-457c-ba53-ac443986025c'] {{(pid=87515) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:17:30 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-a466b498-b8d3-4e64-bf79-521d9abf337f tempest-CreateVolumesFromImageTest-446209050 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:17:30 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-a466b498-b8d3-4e64-bf79-521d9abf337f tempest-CreateVolumesFromImageTest-446209050 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:17:30 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-a466b498-b8d3-4e64-bf79-521d9abf337f tempest-CreateVolumesFromImageTest-446209050 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:17:30 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-a466b498-b8d3-4e64-bf79-521d9abf337f tempest-CreateVolumesFromImageTest-446209050 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:17:30 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-a466b498-b8d3-4e64-bf79-521d9abf337f tempest-CreateVolumesFromImageTest-446209050 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:17:30 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-a466b498-b8d3-4e64-bf79-521d9abf337f tempest-CreateVolumesFromImageTest-446209050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:17:30 devstack sudo[106527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a Sep 07 10:17:30 devstack sudo[106527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:17:30 devstack sudo[106527]: pam_unix(sudo:session): session closed for user root Sep 07 10:17:30 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-a466b498-b8d3-4e64-bf79-521d9abf337f tempest-CreateVolumesFromImageTest-446209050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a" returned: 0 in 0.253s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:17:30 devstack cinder-volume[87515]: DEBUG cinder.manager [None req-a466b498-b8d3-4e64-bf79-521d9abf337f tempest-CreateVolumesFromImageTest-446209050 None] Notifying Schedulers of capabilities ... {{(pid=87515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:17:30 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-a466b498-b8d3-4e64-bf79-521d9abf337f tempest-CreateVolumesFromImageTest-446209050 None] Deleted volume successfully. Sep 07 10:17:30 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-a466b498-b8d3-4e64-bf79-521d9abf337f tempest-CreateVolumesFromImageTest-446209050 None] Lock "cinder-c5818c75-cc55-433a-9094-344a6b2a65b3-delete_volume" released by "delete_volume" :: held 1.065s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:17:33 devstack cinder-volume[87515]: DEBUG cinder.volume.flows.manager.create_volume [None req-c3833a65-a41f-4275-a0b4-70ee0a85d9ec tempest-CreateVolumesFromSnapshotTest-2070828459 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 10:17:33 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-c3833a65-a41f-4275-a0b4-70ee0a85d9ec tempest-CreateVolumesFromSnapshotTest-2070828459 None] Flow 'volume_create_manager' (ec343218-4b89-4bc5-b5fe-e8b19440d156) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:17:33 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-c3833a65-a41f-4275-a0b4-70ee0a85d9ec tempest-CreateVolumesFromSnapshotTest-2070828459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13055599-1117-40cb-ab01-a43467a5d06e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:17:33 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-c3833a65-a41f-4275-a0b4-70ee0a85d9ec tempest-CreateVolumesFromSnapshotTest-2070828459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13055599-1117-40cb-ab01-a43467a5d06e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:17:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-791420354',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2fedc8ab-2322-46e4-9d2d-e3cb8b7d6afa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68d50cdd46974bd1bfed178e086b85e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:17:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:17:33Z,use_quota=True,user_id='9621d873b4d34707875a60d5d981b52b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3a092cd-7947-4cbf-abff-4ba9567becf0),volume_type_id=f3a092cd-7947-4cbf-abff-4ba9567becf0)' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:17:33 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-c3833a65-a41f-4275-a0b4-70ee0a85d9ec tempest-CreateVolumesFromSnapshotTest-2070828459 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b75464b-eded-4bb3-8f46-9c6f076b8040) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:17:33 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-c3833a65-a41f-4275-a0b4-70ee0a85d9ec tempest-CreateVolumesFromSnapshotTest-2070828459 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b75464b-eded-4bb3-8f46-9c6f076b8040) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:17:33 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-c3833a65-a41f-4275-a0b4-70ee0a85d9ec tempest-CreateVolumesFromSnapshotTest-2070828459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50549fd5-4ab7-4dc3-b2e8-4a8f2c84fe34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:17:33 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-c3833a65-a41f-4275-a0b4-70ee0a85d9ec tempest-CreateVolumesFromSnapshotTest-2070828459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50549fd5-4ab7-4dc3-b2e8-4a8f2c84fe34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2fedc8ab-2322-46e4-9d2d-e3cb8b7d6afa', 'volume_name': 'volume-2fedc8ab-2322-46e4-9d2d-e3cb8b7d6afa', 'volume_size': 1}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:17:33 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-c3833a65-a41f-4275-a0b4-70ee0a85d9ec tempest-CreateVolumesFromSnapshotTest-2070828459 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b5fa2b4-4f8b-4ee0-98f5-2e19fd34c6f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:17:33 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-c3833a65-a41f-4275-a0b4-70ee0a85d9ec tempest-CreateVolumesFromSnapshotTest-2070828459 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b5fa2b4-4f8b-4ee0-98f5-2e19fd34c6f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:17:33 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-c3833a65-a41f-4275-a0b4-70ee0a85d9ec tempest-CreateVolumesFromSnapshotTest-2070828459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a88848a-0a9e-4f8a-8192-631d046580be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:17:33 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-c3833a65-a41f-4275-a0b4-70ee0a85d9ec tempest-CreateVolumesFromSnapshotTest-2070828459 None] Volume 2fedc8ab-2322-46e4-9d2d-e3cb8b7d6afa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2fedc8ab-2322-46e4-9d2d-e3cb8b7d6afa', 'volume_size': 1} Sep 07 10:17:33 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-c3833a65-a41f-4275-a0b4-70ee0a85d9ec tempest-CreateVolumesFromSnapshotTest-2070828459 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:17:33 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-c3833a65-a41f-4275-a0b4-70ee0a85d9ec tempest-CreateVolumesFromSnapshotTest-2070828459 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:17:33 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-c3833a65-a41f-4275-a0b4-70ee0a85d9ec tempest-CreateVolumesFromSnapshotTest-2070828459 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:17:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-791420354',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2fedc8ab-2322-46e4-9d2d-e3cb8b7d6afa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68d50cdd46974bd1bfed178e086b85e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:17:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:17:33Z,use_quota=True,user_id='9621d873b4d34707875a60d5d981b52b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3a092cd-7947-4cbf-abff-4ba9567becf0),volume_type_id=f3a092cd-7947-4cbf-abff-4ba9567becf0)}" {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 10:17:33 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-c3833a65-a41f-4275-a0b4-70ee0a85d9ec tempest-CreateVolumesFromSnapshotTest-2070828459 None] Creating volume 2fedc8ab-2322-46e4-9d2d-e3cb8b7d6afa {{(pid=87515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 10:17:33 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-c3833a65-a41f-4275-a0b4-70ee0a85d9ec tempest-CreateVolumesFromSnapshotTest-2070828459 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:17:33 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-c3833a65-a41f-4275-a0b4-70ee0a85d9ec tempest-CreateVolumesFromSnapshotTest-2070828459 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:17:33 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-c3833a65-a41f-4275-a0b4-70ee0a85d9ec tempest-CreateVolumesFromSnapshotTest-2070828459 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:17:33 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-c3833a65-a41f-4275-a0b4-70ee0a85d9ec tempest-CreateVolumesFromSnapshotTest-2070828459 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:17:33 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-c3833a65-a41f-4275-a0b4-70ee0a85d9ec tempest-CreateVolumesFromSnapshotTest-2070828459 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:17:33 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-c3833a65-a41f-4275-a0b4-70ee0a85d9ec tempest-CreateVolumesFromSnapshotTest-2070828459 None] Selected osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c as target Quobyte volume. {{(pid=87515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 10:17:33 devstack cinder-volume[87515]: INFO cinder.volume.drivers.remotefs [None req-c3833a65-a41f-4275-a0b4-70ee0a85d9ec tempest-CreateVolumesFromSnapshotTest-2070828459 None] casted to osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c Sep 07 10:17:33 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-c3833a65-a41f-4275-a0b4-70ee0a85d9ec tempest-CreateVolumesFromSnapshotTest-2070828459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-2fedc8ab-2322-46e4-9d2d-e3cb8b7d6afa 1073741824 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:17:33 devstack sudo[106530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-2fedc8ab-2322-46e4-9d2d-e3cb8b7d6afa 1073741824 Sep 07 10:17:33 devstack sudo[106530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:17:33 devstack sudo[106530]: pam_unix(sudo:session): session closed for user root Sep 07 10:17:33 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-c3833a65-a41f-4275-a0b4-70ee0a85d9ec tempest-CreateVolumesFromSnapshotTest-2070828459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-2fedc8ab-2322-46e4-9d2d-e3cb8b7d6afa 1073741824" returned: 0 in 0.400s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:17:33 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-c3833a65-a41f-4275-a0b4-70ee0a85d9ec tempest-CreateVolumesFromSnapshotTest-2070828459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-2fedc8ab-2322-46e4-9d2d-e3cb8b7d6afa {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:17:33 devstack sudo[106535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-2fedc8ab-2322-46e4-9d2d-e3cb8b7d6afa Sep 07 10:17:33 devstack sudo[106535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:17:33 devstack sudo[106535]: pam_unix(sudo:session): session closed for user root Sep 07 10:17:33 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-c3833a65-a41f-4275-a0b4-70ee0a85d9ec tempest-CreateVolumesFromSnapshotTest-2070828459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-2fedc8ab-2322-46e4-9d2d-e3cb8b7d6afa" returned: 0 in 0.253s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:17:33 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-c3833a65-a41f-4275-a0b4-70ee0a85d9ec tempest-CreateVolumesFromSnapshotTest-2070828459 None] <== create_volume: return (693ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'} {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 10:17:33 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-c3833a65-a41f-4275-a0b4-70ee0a85d9ec tempest-CreateVolumesFromSnapshotTest-2070828459 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.696s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:17:33 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-c3833a65-a41f-4275-a0b4-70ee0a85d9ec tempest-CreateVolumesFromSnapshotTest-2070828459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a88848a-0a9e-4f8a-8192-631d046580be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2fedc8ab-2322-46e4-9d2d-e3cb8b7d6afa', 'volume_size': 1}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:17:33 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-c3833a65-a41f-4275-a0b4-70ee0a85d9ec tempest-CreateVolumesFromSnapshotTest-2070828459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85e52cb6-4fea-4b13-806c-13aeaf96be87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:17:33 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-c3833a65-a41f-4275-a0b4-70ee0a85d9ec tempest-CreateVolumesFromSnapshotTest-2070828459 None] Volume volume-2fedc8ab-2322-46e4-9d2d-e3cb8b7d6afa (2fedc8ab-2322-46e4-9d2d-e3cb8b7d6afa): created successfully Sep 07 10:17:33 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-c3833a65-a41f-4275-a0b4-70ee0a85d9ec tempest-CreateVolumesFromSnapshotTest-2070828459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85e52cb6-4fea-4b13-806c-13aeaf96be87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:17:33 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-c3833a65-a41f-4275-a0b4-70ee0a85d9ec tempest-CreateVolumesFromSnapshotTest-2070828459 None] Flow 'volume_create_manager' (ec343218-4b89-4bc5-b5fe-e8b19440d156) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:17:33 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-c3833a65-a41f-4275-a0b4-70ee0a85d9ec tempest-CreateVolumesFromSnapshotTest-2070828459 None] Created volume successfully. Sep 07 10:17:34 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-31713cf3-bbdc-42d2-890a-8f90d070a1ad tempest-CreateVolumesFromSnapshotTest-2070828459 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:17:34 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-31713cf3-bbdc-42d2-890a-8f90d070a1ad tempest-CreateVolumesFromSnapshotTest-2070828459 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:17:34 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-31713cf3-bbdc-42d2-890a-8f90d070a1ad tempest-CreateVolumesFromSnapshotTest-2070828459 None] Creating offline snapshot 6fbe9ca5-5510-49d2-83e5-4ace03652638 of volume 2fedc8ab-2322-46e4-9d2d-e3cb8b7d6afa {{(pid=87515) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 10:17:34 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[f68c0e7d-328a-4a0e-8f35-5abdb3da3e7a]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:17:34 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-31713cf3-bbdc-42d2-890a-8f90d070a1ad tempest-CreateVolumesFromSnapshotTest-2070828459 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-2fedc8ab-2322-46e4-9d2d-e3cb8b7d6afa {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:17:34 devstack sudo[106538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-2fedc8ab-2322-46e4-9d2d-e3cb8b7d6afa Sep 07 10:17:34 devstack sudo[106538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:17:34 devstack sudo[106538]: pam_unix(sudo:session): session closed for user root Sep 07 10:17:34 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-31713cf3-bbdc-42d2-890a-8f90d070a1ad tempest-CreateVolumesFromSnapshotTest-2070828459 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-2fedc8ab-2322-46e4-9d2d-e3cb8b7d6afa" returned: 0 in 0.354s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:17:34 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-31713cf3-bbdc-42d2-890a-8f90d070a1ad tempest-CreateVolumesFromSnapshotTest-2070828459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-2fedc8ab-2322-46e4-9d2d-e3cb8b7d6afa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-2fedc8ab-2322-46e4-9d2d-e3cb8b7d6afa.6fbe9ca5-5510-49d2-83e5-4ace03652638 1G {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:17:34 devstack sudo[106543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-2fedc8ab-2322-46e4-9d2d-e3cb8b7d6afa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-2fedc8ab-2322-46e4-9d2d-e3cb8b7d6afa.6fbe9ca5-5510-49d2-83e5-4ace03652638 1G Sep 07 10:17:34 devstack sudo[106543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:17:34 devstack sudo[106543]: pam_unix(sudo:session): session closed for user root Sep 07 10:17:34 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-31713cf3-bbdc-42d2-890a-8f90d070a1ad tempest-CreateVolumesFromSnapshotTest-2070828459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-2fedc8ab-2322-46e4-9d2d-e3cb8b7d6afa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-2fedc8ab-2322-46e4-9d2d-e3cb8b7d6afa.6fbe9ca5-5510-49d2-83e5-4ace03652638 1G" returned: 0 in 0.379s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:17:34 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-31713cf3-bbdc-42d2-890a-8f90d070a1ad tempest-CreateVolumesFromSnapshotTest-2070828459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2fedc8ab-2322-46e4-9d2d-e3cb8b7d6afa -F qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-2fedc8ab-2322-46e4-9d2d-e3cb8b7d6afa.6fbe9ca5-5510-49d2-83e5-4ace03652638 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:17:34 devstack sudo[106548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2fedc8ab-2322-46e4-9d2d-e3cb8b7d6afa -F qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-2fedc8ab-2322-46e4-9d2d-e3cb8b7d6afa.6fbe9ca5-5510-49d2-83e5-4ace03652638 Sep 07 10:17:34 devstack sudo[106548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:17:35 devstack sudo[106548]: pam_unix(sudo:session): session closed for user root Sep 07 10:17:35 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-31713cf3-bbdc-42d2-890a-8f90d070a1ad tempest-CreateVolumesFromSnapshotTest-2070828459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2fedc8ab-2322-46e4-9d2d-e3cb8b7d6afa -F qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-2fedc8ab-2322-46e4-9d2d-e3cb8b7d6afa.6fbe9ca5-5510-49d2-83e5-4ace03652638" returned: 0 in 0.279s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:17:35 devstack cinder-volume[87515]: WARNING cinder.volume.drivers.remotefs [None req-31713cf3-bbdc-42d2-890a-8f90d070a1ad tempest-CreateVolumesFromSnapshotTest-2070828459 None] /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-2fedc8ab-2322-46e4-9d2d-e3cb8b7d6afa.6fbe9ca5-5510-49d2-83e5-4ace03652638 is being set with open permissions: ugo+rw Sep 07 10:17:35 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-31713cf3-bbdc-42d2-890a-8f90d070a1ad tempest-CreateVolumesFromSnapshotTest-2070828459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-2fedc8ab-2322-46e4-9d2d-e3cb8b7d6afa.6fbe9ca5-5510-49d2-83e5-4ace03652638 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:17:35 devstack sudo[106553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-2fedc8ab-2322-46e4-9d2d-e3cb8b7d6afa.6fbe9ca5-5510-49d2-83e5-4ace03652638 Sep 07 10:17:35 devstack sudo[106553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:17:35 devstack sudo[106553]: pam_unix(sudo:session): session closed for user root Sep 07 10:17:35 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-31713cf3-bbdc-42d2-890a-8f90d070a1ad tempest-CreateVolumesFromSnapshotTest-2070828459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-2fedc8ab-2322-46e4-9d2d-e3cb8b7d6afa.6fbe9ca5-5510-49d2-83e5-4ace03652638" returned: 0 in 0.240s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:17:35 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-31713cf3-bbdc-42d2-890a-8f90d070a1ad tempest-CreateVolumesFromSnapshotTest-2070828459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-2fedc8ab-2322-46e4-9d2d-e3cb8b7d6afa.info {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:17:35 devstack sudo[106556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-2fedc8ab-2322-46e4-9d2d-e3cb8b7d6afa.info Sep 07 10:17:35 devstack sudo[106556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:17:35 devstack sudo[106556]: pam_unix(sudo:session): session closed for user root Sep 07 10:17:35 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-31713cf3-bbdc-42d2-890a-8f90d070a1ad tempest-CreateVolumesFromSnapshotTest-2070828459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-2fedc8ab-2322-46e4-9d2d-e3cb8b7d6afa.info" returned: 0 in 0.241s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:17:35 devstack cinder-volume[87515]: WARNING cinder.volume.drivers.remotefs [None req-31713cf3-bbdc-42d2-890a-8f90d070a1ad tempest-CreateVolumesFromSnapshotTest-2070828459 None] /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-2fedc8ab-2322-46e4-9d2d-e3cb8b7d6afa.info is being set with open permissions: ugo+rw Sep 07 10:17:35 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-31713cf3-bbdc-42d2-890a-8f90d070a1ad tempest-CreateVolumesFromSnapshotTest-2070828459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-2fedc8ab-2322-46e4-9d2d-e3cb8b7d6afa.info {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:17:35 devstack sudo[106559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-2fedc8ab-2322-46e4-9d2d-e3cb8b7d6afa.info Sep 07 10:17:35 devstack sudo[106559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:17:35 devstack sudo[106559]: pam_unix(sudo:session): session closed for user root Sep 07 10:17:35 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-31713cf3-bbdc-42d2-890a-8f90d070a1ad tempest-CreateVolumesFromSnapshotTest-2070828459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-2fedc8ab-2322-46e4-9d2d-e3cb8b7d6afa.info" returned: 0 in 0.234s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:17:36 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-31713cf3-bbdc-42d2-890a-8f90d070a1ad tempest-CreateVolumesFromSnapshotTest-2070828459 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.803s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:17:36 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-31713cf3-bbdc-42d2-890a-8f90d070a1ad tempest-CreateVolumesFromSnapshotTest-2070828459 None] Create snapshot completed successfully Sep 07 10:17:36 devstack cinder-volume[87515]: DEBUG cinder.volume.flows.manager.create_volume [None req-55a6e774-f063-4ef6-a98b-5b8b9c01adc9 tempest-CreateVolumesFromSnapshotTest-2070828459 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 10:17:36 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-55a6e774-f063-4ef6-a98b-5b8b9c01adc9 tempest-CreateVolumesFromSnapshotTest-2070828459 None] Flow 'volume_create_manager' (d5537864-57c2-439c-9ec6-feb6f4023505) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:17:36 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-55a6e774-f063-4ef6-a98b-5b8b9c01adc9 tempest-CreateVolumesFromSnapshotTest-2070828459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4db1711-ae62-4072-a9c0-9c95ed9d1335) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:17:36 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-55a6e774-f063-4ef6-a98b-5b8b9c01adc9 tempest-CreateVolumesFromSnapshotTest-2070828459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4db1711-ae62-4072-a9c0-9c95ed9d1335) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:17:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1807811031',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7fcffb4a-7ef7-49cc-89f5-def26f4e0502,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68d50cdd46974bd1bfed178e086b85e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:17:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:17:37Z,use_quota=True,user_id='9621d873b4d34707875a60d5d981b52b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3a092cd-7947-4cbf-abff-4ba9567becf0),volume_type_id=f3a092cd-7947-4cbf-abff-4ba9567becf0)' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:17:36 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-55a6e774-f063-4ef6-a98b-5b8b9c01adc9 tempest-CreateVolumesFromSnapshotTest-2070828459 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00624ebb-d462-460e-bca2-d9d43dc759f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:17:36 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-55a6e774-f063-4ef6-a98b-5b8b9c01adc9 tempest-CreateVolumesFromSnapshotTest-2070828459 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00624ebb-d462-460e-bca2-d9d43dc759f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:17:36 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-55a6e774-f063-4ef6-a98b-5b8b9c01adc9 tempest-CreateVolumesFromSnapshotTest-2070828459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (146d26e3-9098-4474-9a3e-a7971b102818) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:17:36 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-55a6e774-f063-4ef6-a98b-5b8b9c01adc9 tempest-CreateVolumesFromSnapshotTest-2070828459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (146d26e3-9098-4474-9a3e-a7971b102818) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7fcffb4a-7ef7-49cc-89f5-def26f4e0502', 'volume_name': 'volume-7fcffb4a-7ef7-49cc-89f5-def26f4e0502', 'volume_size': 1}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:17:36 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-55a6e774-f063-4ef6-a98b-5b8b9c01adc9 tempest-CreateVolumesFromSnapshotTest-2070828459 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9183b60-8dd6-4b86-bb3d-2a95a6468342) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:17:36 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-55a6e774-f063-4ef6-a98b-5b8b9c01adc9 tempest-CreateVolumesFromSnapshotTest-2070828459 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9183b60-8dd6-4b86-bb3d-2a95a6468342) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:17:36 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-55a6e774-f063-4ef6-a98b-5b8b9c01adc9 tempest-CreateVolumesFromSnapshotTest-2070828459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5a47e84-493b-4168-8caf-9c1c78b2a738) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:17:36 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-55a6e774-f063-4ef6-a98b-5b8b9c01adc9 tempest-CreateVolumesFromSnapshotTest-2070828459 None] Volume 7fcffb4a-7ef7-49cc-89f5-def26f4e0502: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7fcffb4a-7ef7-49cc-89f5-def26f4e0502', 'volume_size': 1} Sep 07 10:17:36 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-55a6e774-f063-4ef6-a98b-5b8b9c01adc9 tempest-CreateVolumesFromSnapshotTest-2070828459 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:17:36 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-55a6e774-f063-4ef6-a98b-5b8b9c01adc9 tempest-CreateVolumesFromSnapshotTest-2070828459 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:17:36 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-55a6e774-f063-4ef6-a98b-5b8b9c01adc9 tempest-CreateVolumesFromSnapshotTest-2070828459 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:17:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1807811031',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7fcffb4a-7ef7-49cc-89f5-def26f4e0502,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68d50cdd46974bd1bfed178e086b85e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:17:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:17:37Z,use_quota=True,user_id='9621d873b4d34707875a60d5d981b52b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3a092cd-7947-4cbf-abff-4ba9567becf0),volume_type_id=f3a092cd-7947-4cbf-abff-4ba9567becf0)}" {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 10:17:36 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-55a6e774-f063-4ef6-a98b-5b8b9c01adc9 tempest-CreateVolumesFromSnapshotTest-2070828459 None] Creating volume 7fcffb4a-7ef7-49cc-89f5-def26f4e0502 {{(pid=87515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 10:17:36 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-55a6e774-f063-4ef6-a98b-5b8b9c01adc9 tempest-CreateVolumesFromSnapshotTest-2070828459 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:17:36 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-55a6e774-f063-4ef6-a98b-5b8b9c01adc9 tempest-CreateVolumesFromSnapshotTest-2070828459 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:17:36 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-55a6e774-f063-4ef6-a98b-5b8b9c01adc9 tempest-CreateVolumesFromSnapshotTest-2070828459 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:17:36 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-55a6e774-f063-4ef6-a98b-5b8b9c01adc9 tempest-CreateVolumesFromSnapshotTest-2070828459 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:17:36 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-55a6e774-f063-4ef6-a98b-5b8b9c01adc9 tempest-CreateVolumesFromSnapshotTest-2070828459 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:17:36 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-55a6e774-f063-4ef6-a98b-5b8b9c01adc9 tempest-CreateVolumesFromSnapshotTest-2070828459 None] Selected osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c as target Quobyte volume. {{(pid=87515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 10:17:36 devstack cinder-volume[87515]: INFO cinder.volume.drivers.remotefs [None req-55a6e774-f063-4ef6-a98b-5b8b9c01adc9 tempest-CreateVolumesFromSnapshotTest-2070828459 None] casted to osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c Sep 07 10:17:36 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-55a6e774-f063-4ef6-a98b-5b8b9c01adc9 tempest-CreateVolumesFromSnapshotTest-2070828459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-7fcffb4a-7ef7-49cc-89f5-def26f4e0502 1073741824 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:17:36 devstack sudo[106562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-7fcffb4a-7ef7-49cc-89f5-def26f4e0502 1073741824 Sep 07 10:17:36 devstack sudo[106562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:17:37 devstack cinder-volume[87515]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa48247d-d1fd-4ea5-b330-ae94813bf8ec tempest-CreateVolumesFromSnapshotTest-2070828459 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 10:17:37 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-aa48247d-d1fd-4ea5-b330-ae94813bf8ec tempest-CreateVolumesFromSnapshotTest-2070828459 None] Flow 'volume_create_manager' (1f79f636-cd92-474d-819f-ea13388990de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:17:37 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-aa48247d-d1fd-4ea5-b330-ae94813bf8ec tempest-CreateVolumesFromSnapshotTest-2070828459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6d6d104-53ed-4535-bbbc-719d2b9f0742) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:17:37 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-aa48247d-d1fd-4ea5-b330-ae94813bf8ec tempest-CreateVolumesFromSnapshotTest-2070828459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6d6d104-53ed-4535-bbbc-719d2b9f0742) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:17:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-57812720',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4c28775-0951-49ff-b5cb-f7b10a1c9e46,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68d50cdd46974bd1bfed178e086b85e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:17:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:17:37Z,use_quota=True,user_id='9621d873b4d34707875a60d5d981b52b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3a092cd-7947-4cbf-abff-4ba9567becf0),volume_type_id=f3a092cd-7947-4cbf-abff-4ba9567becf0)' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:17:37 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-aa48247d-d1fd-4ea5-b330-ae94813bf8ec tempest-CreateVolumesFromSnapshotTest-2070828459 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a98943e-6174-47e0-b33a-d8c84bbb5df0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:17:37 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-aa48247d-d1fd-4ea5-b330-ae94813bf8ec tempest-CreateVolumesFromSnapshotTest-2070828459 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a98943e-6174-47e0-b33a-d8c84bbb5df0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:17:37 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-aa48247d-d1fd-4ea5-b330-ae94813bf8ec tempest-CreateVolumesFromSnapshotTest-2070828459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9582be3f-ecfa-4e78-afa7-a1ffcb2df1f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:17:37 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-aa48247d-d1fd-4ea5-b330-ae94813bf8ec tempest-CreateVolumesFromSnapshotTest-2070828459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9582be3f-ecfa-4e78-afa7-a1ffcb2df1f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e4c28775-0951-49ff-b5cb-f7b10a1c9e46', 'volume_name': 'volume-e4c28775-0951-49ff-b5cb-f7b10a1c9e46', 'volume_size': 1}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:17:37 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-aa48247d-d1fd-4ea5-b330-ae94813bf8ec tempest-CreateVolumesFromSnapshotTest-2070828459 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a264bbe5-c7c8-482d-abf5-6641a195a62e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:17:37 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-aa48247d-d1fd-4ea5-b330-ae94813bf8ec tempest-CreateVolumesFromSnapshotTest-2070828459 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a264bbe5-c7c8-482d-abf5-6641a195a62e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:17:37 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-aa48247d-d1fd-4ea5-b330-ae94813bf8ec tempest-CreateVolumesFromSnapshotTest-2070828459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72b7628c-c9f1-4bc3-9ef0-206e00649e7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:17:37 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-aa48247d-d1fd-4ea5-b330-ae94813bf8ec tempest-CreateVolumesFromSnapshotTest-2070828459 None] Volume e4c28775-0951-49ff-b5cb-f7b10a1c9e46: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e4c28775-0951-49ff-b5cb-f7b10a1c9e46', 'volume_size': 1} Sep 07 10:17:37 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-aa48247d-d1fd-4ea5-b330-ae94813bf8ec tempest-CreateVolumesFromSnapshotTest-2070828459 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:17:37 devstack sudo[106562]: pam_unix(sudo:session): session closed for user root Sep 07 10:17:37 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-55a6e774-f063-4ef6-a98b-5b8b9c01adc9 tempest-CreateVolumesFromSnapshotTest-2070828459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-7fcffb4a-7ef7-49cc-89f5-def26f4e0502 1073741824" returned: 0 in 0.464s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:17:37 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-55a6e774-f063-4ef6-a98b-5b8b9c01adc9 tempest-CreateVolumesFromSnapshotTest-2070828459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-7fcffb4a-7ef7-49cc-89f5-def26f4e0502 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:17:37 devstack sudo[106568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-7fcffb4a-7ef7-49cc-89f5-def26f4e0502 Sep 07 10:17:37 devstack sudo[106568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:17:37 devstack cinder-volume[87515]: DEBUG cinder.volume.flows.manager.create_volume [None req-29747a08-75a7-4ae6-af01-6e5433058a9d tempest-CreateVolumesFromSnapshotTest-2070828459 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 10:17:37 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-29747a08-75a7-4ae6-af01-6e5433058a9d tempest-CreateVolumesFromSnapshotTest-2070828459 None] Flow 'volume_create_manager' (6a6145fe-8c11-47bd-a67f-21d09a6e7623) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:17:37 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-29747a08-75a7-4ae6-af01-6e5433058a9d tempest-CreateVolumesFromSnapshotTest-2070828459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7cf19e4f-f4a8-4364-a401-60f31fee902e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:17:37 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-29747a08-75a7-4ae6-af01-6e5433058a9d tempest-CreateVolumesFromSnapshotTest-2070828459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7cf19e4f-f4a8-4364-a401-60f31fee902e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:17:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-292515758',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d26dc3ac-9801-43bd-833b-8efe9c9582e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68d50cdd46974bd1bfed178e086b85e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:17:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:17:37Z,use_quota=True,user_id='9621d873b4d34707875a60d5d981b52b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3a092cd-7947-4cbf-abff-4ba9567becf0),volume_type_id=f3a092cd-7947-4cbf-abff-4ba9567becf0)' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:17:37 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-29747a08-75a7-4ae6-af01-6e5433058a9d tempest-CreateVolumesFromSnapshotTest-2070828459 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af3c8682-4b36-40ba-97d5-f81fdaee2f24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:17:37 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-29747a08-75a7-4ae6-af01-6e5433058a9d tempest-CreateVolumesFromSnapshotTest-2070828459 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af3c8682-4b36-40ba-97d5-f81fdaee2f24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:17:37 devstack sudo[106568]: pam_unix(sudo:session): session closed for user root Sep 07 10:17:37 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-29747a08-75a7-4ae6-af01-6e5433058a9d tempest-CreateVolumesFromSnapshotTest-2070828459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55216dae-2752-4a65-8a69-4166d5117a6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:17:37 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-29747a08-75a7-4ae6-af01-6e5433058a9d tempest-CreateVolumesFromSnapshotTest-2070828459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55216dae-2752-4a65-8a69-4166d5117a6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd26dc3ac-9801-43bd-833b-8efe9c9582e0', 'volume_name': 'volume-d26dc3ac-9801-43bd-833b-8efe9c9582e0', 'volume_size': 1}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:17:37 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-29747a08-75a7-4ae6-af01-6e5433058a9d tempest-CreateVolumesFromSnapshotTest-2070828459 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07b3f131-2c5b-45bf-a9e4-da0df1cb13e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:17:37 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-29747a08-75a7-4ae6-af01-6e5433058a9d tempest-CreateVolumesFromSnapshotTest-2070828459 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07b3f131-2c5b-45bf-a9e4-da0df1cb13e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:17:37 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-29747a08-75a7-4ae6-af01-6e5433058a9d tempest-CreateVolumesFromSnapshotTest-2070828459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d29be129-a394-4964-ae46-3c579a81a208) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:17:37 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-29747a08-75a7-4ae6-af01-6e5433058a9d tempest-CreateVolumesFromSnapshotTest-2070828459 None] Volume d26dc3ac-9801-43bd-833b-8efe9c9582e0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d26dc3ac-9801-43bd-833b-8efe9c9582e0', 'volume_size': 1} Sep 07 10:17:37 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-29747a08-75a7-4ae6-af01-6e5433058a9d tempest-CreateVolumesFromSnapshotTest-2070828459 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:17:37 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-55a6e774-f063-4ef6-a98b-5b8b9c01adc9 tempest-CreateVolumesFromSnapshotTest-2070828459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-7fcffb4a-7ef7-49cc-89f5-def26f4e0502" returned: 0 in 0.301s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:17:37 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-55a6e774-f063-4ef6-a98b-5b8b9c01adc9 tempest-CreateVolumesFromSnapshotTest-2070828459 None] <== create_volume: return (810ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'} {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 10:17:37 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-55a6e774-f063-4ef6-a98b-5b8b9c01adc9 tempest-CreateVolumesFromSnapshotTest-2070828459 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.812s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:17:37 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-aa48247d-d1fd-4ea5-b330-ae94813bf8ec tempest-CreateVolumesFromSnapshotTest-2070828459 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.457s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:17:37 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-aa48247d-d1fd-4ea5-b330-ae94813bf8ec tempest-CreateVolumesFromSnapshotTest-2070828459 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:17:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-57812720',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4c28775-0951-49ff-b5cb-f7b10a1c9e46,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68d50cdd46974bd1bfed178e086b85e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:17:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:17:37Z,use_quota=True,user_id='9621d873b4d34707875a60d5d981b52b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3a092cd-7947-4cbf-abff-4ba9567becf0),volume_type_id=f3a092cd-7947-4cbf-abff-4ba9567becf0)}" {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 10:17:37 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-aa48247d-d1fd-4ea5-b330-ae94813bf8ec tempest-CreateVolumesFromSnapshotTest-2070828459 None] Creating volume e4c28775-0951-49ff-b5cb-f7b10a1c9e46 {{(pid=87515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 10:17:37 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-aa48247d-d1fd-4ea5-b330-ae94813bf8ec tempest-CreateVolumesFromSnapshotTest-2070828459 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:17:37 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-aa48247d-d1fd-4ea5-b330-ae94813bf8ec tempest-CreateVolumesFromSnapshotTest-2070828459 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:17:37 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-aa48247d-d1fd-4ea5-b330-ae94813bf8ec tempest-CreateVolumesFromSnapshotTest-2070828459 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:17:37 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-aa48247d-d1fd-4ea5-b330-ae94813bf8ec tempest-CreateVolumesFromSnapshotTest-2070828459 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:17:37 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-aa48247d-d1fd-4ea5-b330-ae94813bf8ec tempest-CreateVolumesFromSnapshotTest-2070828459 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:17:37 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-aa48247d-d1fd-4ea5-b330-ae94813bf8ec tempest-CreateVolumesFromSnapshotTest-2070828459 None] Selected osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c as target Quobyte volume. {{(pid=87515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 10:17:37 devstack cinder-volume[87515]: INFO cinder.volume.drivers.remotefs [None req-aa48247d-d1fd-4ea5-b330-ae94813bf8ec tempest-CreateVolumesFromSnapshotTest-2070828459 None] casted to osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c Sep 07 10:17:37 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-aa48247d-d1fd-4ea5-b330-ae94813bf8ec tempest-CreateVolumesFromSnapshotTest-2070828459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-e4c28775-0951-49ff-b5cb-f7b10a1c9e46 1073741824 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:17:37 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-55a6e774-f063-4ef6-a98b-5b8b9c01adc9 tempest-CreateVolumesFromSnapshotTest-2070828459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5a47e84-493b-4168-8caf-9c1c78b2a738) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7fcffb4a-7ef7-49cc-89f5-def26f4e0502', 'volume_size': 1}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:17:37 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-55a6e774-f063-4ef6-a98b-5b8b9c01adc9 tempest-CreateVolumesFromSnapshotTest-2070828459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9f72ecf-efe0-4a46-b13d-b4c5bae31e2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:17:37 devstack sudo[106577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-e4c28775-0951-49ff-b5cb-f7b10a1c9e46 1073741824 Sep 07 10:17:37 devstack sudo[106577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:17:37 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-55a6e774-f063-4ef6-a98b-5b8b9c01adc9 tempest-CreateVolumesFromSnapshotTest-2070828459 None] Volume volume-7fcffb4a-7ef7-49cc-89f5-def26f4e0502 (7fcffb4a-7ef7-49cc-89f5-def26f4e0502): created successfully Sep 07 10:17:37 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-55a6e774-f063-4ef6-a98b-5b8b9c01adc9 tempest-CreateVolumesFromSnapshotTest-2070828459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9f72ecf-efe0-4a46-b13d-b4c5bae31e2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:17:37 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-55a6e774-f063-4ef6-a98b-5b8b9c01adc9 tempest-CreateVolumesFromSnapshotTest-2070828459 None] Flow 'volume_create_manager' (d5537864-57c2-439c-9ec6-feb6f4023505) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:17:37 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-55a6e774-f063-4ef6-a98b-5b8b9c01adc9 tempest-CreateVolumesFromSnapshotTest-2070828459 None] Created volume successfully. Sep 07 10:17:37 devstack cinder-volume[87515]: DEBUG cinder.volume.flows.manager.create_volume [None req-decb7083-2b62-4b17-90bc-24796df741c3 tempest-CreateVolumesFromSnapshotTest-2070828459 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 10:17:37 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-decb7083-2b62-4b17-90bc-24796df741c3 tempest-CreateVolumesFromSnapshotTest-2070828459 None] Flow 'volume_create_manager' (6fca35ea-63b9-4ae8-9fc9-5ae5c7393fd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:17:37 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-decb7083-2b62-4b17-90bc-24796df741c3 tempest-CreateVolumesFromSnapshotTest-2070828459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (319a8f68-0f6f-4fe0-96a0-52e5f4a20c16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:17:37 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-decb7083-2b62-4b17-90bc-24796df741c3 tempest-CreateVolumesFromSnapshotTest-2070828459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (319a8f68-0f6f-4fe0-96a0-52e5f4a20c16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:17:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1459577185',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e08b891-f67e-4b5a-9390-e1fefe1e5097,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68d50cdd46974bd1bfed178e086b85e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:17:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:17:38Z,use_quota=True,user_id='9621d873b4d34707875a60d5d981b52b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3a092cd-7947-4cbf-abff-4ba9567becf0),volume_type_id=f3a092cd-7947-4cbf-abff-4ba9567becf0)' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:17:37 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-decb7083-2b62-4b17-90bc-24796df741c3 tempest-CreateVolumesFromSnapshotTest-2070828459 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b557b2e-3060-4b00-abfa-741f5d757410) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:17:37 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-decb7083-2b62-4b17-90bc-24796df741c3 tempest-CreateVolumesFromSnapshotTest-2070828459 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b557b2e-3060-4b00-abfa-741f5d757410) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:17:37 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-decb7083-2b62-4b17-90bc-24796df741c3 tempest-CreateVolumesFromSnapshotTest-2070828459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05cbc46e-fbc6-4d1f-a9ea-c92d0c55c83e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:17:37 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-decb7083-2b62-4b17-90bc-24796df741c3 tempest-CreateVolumesFromSnapshotTest-2070828459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05cbc46e-fbc6-4d1f-a9ea-c92d0c55c83e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7e08b891-f67e-4b5a-9390-e1fefe1e5097', 'volume_name': 'volume-7e08b891-f67e-4b5a-9390-e1fefe1e5097', 'volume_size': 1}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:17:37 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-decb7083-2b62-4b17-90bc-24796df741c3 tempest-CreateVolumesFromSnapshotTest-2070828459 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d30b8036-658a-42b5-a2e8-d924cabb13a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:17:37 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-decb7083-2b62-4b17-90bc-24796df741c3 tempest-CreateVolumesFromSnapshotTest-2070828459 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d30b8036-658a-42b5-a2e8-d924cabb13a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:17:37 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-decb7083-2b62-4b17-90bc-24796df741c3 tempest-CreateVolumesFromSnapshotTest-2070828459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7cfe5505-a7b9-466d-81f1-387942bdaa38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:17:37 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-decb7083-2b62-4b17-90bc-24796df741c3 tempest-CreateVolumesFromSnapshotTest-2070828459 None] Volume 7e08b891-f67e-4b5a-9390-e1fefe1e5097: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7e08b891-f67e-4b5a-9390-e1fefe1e5097', 'volume_size': 1} Sep 07 10:17:37 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-decb7083-2b62-4b17-90bc-24796df741c3 tempest-CreateVolumesFromSnapshotTest-2070828459 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:17:38 devstack sudo[106577]: pam_unix(sudo:session): session closed for user root Sep 07 10:17:38 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-aa48247d-d1fd-4ea5-b330-ae94813bf8ec tempest-CreateVolumesFromSnapshotTest-2070828459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-e4c28775-0951-49ff-b5cb-f7b10a1c9e46 1073741824" returned: 0 in 0.568s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:17:38 devstack cinder-volume[87515]: DEBUG cinder.volume.flows.manager.create_volume [None req-0cebd469-19f4-4598-a1b4-7e1901e45254 tempest-CreateVolumesFromSnapshotTest-2070828459 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 10:17:38 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-0cebd469-19f4-4598-a1b4-7e1901e45254 tempest-CreateVolumesFromSnapshotTest-2070828459 None] Flow 'volume_create_manager' (45a90b0d-dbb2-40f8-9786-7a5a65dbd983) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:17:38 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-0cebd469-19f4-4598-a1b4-7e1901e45254 tempest-CreateVolumesFromSnapshotTest-2070828459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5250e3c-e878-4a73-8957-e12b2ed50547) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:17:38 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-0cebd469-19f4-4598-a1b4-7e1901e45254 tempest-CreateVolumesFromSnapshotTest-2070828459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5250e3c-e878-4a73-8957-e12b2ed50547) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:17:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1496467229',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db005027-e529-44c6-86fc-395e2d65715c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68d50cdd46974bd1bfed178e086b85e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:17:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:17:38Z,use_quota=True,user_id='9621d873b4d34707875a60d5d981b52b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3a092cd-7947-4cbf-abff-4ba9567becf0),volume_type_id=f3a092cd-7947-4cbf-abff-4ba9567becf0)' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:17:38 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-0cebd469-19f4-4598-a1b4-7e1901e45254 tempest-CreateVolumesFromSnapshotTest-2070828459 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (121fab9a-cee7-4eeb-8cd6-f53d96f00fb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:17:38 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-0cebd469-19f4-4598-a1b4-7e1901e45254 tempest-CreateVolumesFromSnapshotTest-2070828459 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (121fab9a-cee7-4eeb-8cd6-f53d96f00fb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:17:38 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-0cebd469-19f4-4598-a1b4-7e1901e45254 tempest-CreateVolumesFromSnapshotTest-2070828459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6bdf77ce-e79a-4f77-979c-4c7092555cd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:17:38 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-0cebd469-19f4-4598-a1b4-7e1901e45254 tempest-CreateVolumesFromSnapshotTest-2070828459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6bdf77ce-e79a-4f77-979c-4c7092555cd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'db005027-e529-44c6-86fc-395e2d65715c', 'volume_name': 'volume-db005027-e529-44c6-86fc-395e2d65715c', 'volume_size': 1}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:17:38 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-0cebd469-19f4-4598-a1b4-7e1901e45254 tempest-CreateVolumesFromSnapshotTest-2070828459 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a96037e-2533-4b9e-bc68-47fc3695fdb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:17:38 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-0cebd469-19f4-4598-a1b4-7e1901e45254 tempest-CreateVolumesFromSnapshotTest-2070828459 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a96037e-2533-4b9e-bc68-47fc3695fdb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:17:38 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-0cebd469-19f4-4598-a1b4-7e1901e45254 tempest-CreateVolumesFromSnapshotTest-2070828459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (034d65b2-b3eb-42cf-87e4-821a80921ef0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:17:38 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-0cebd469-19f4-4598-a1b4-7e1901e45254 tempest-CreateVolumesFromSnapshotTest-2070828459 None] Volume db005027-e529-44c6-86fc-395e2d65715c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-db005027-e529-44c6-86fc-395e2d65715c', 'volume_size': 1} Sep 07 10:17:38 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-0cebd469-19f4-4598-a1b4-7e1901e45254 tempest-CreateVolumesFromSnapshotTest-2070828459 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:17:38 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-aa48247d-d1fd-4ea5-b330-ae94813bf8ec tempest-CreateVolumesFromSnapshotTest-2070828459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-e4c28775-0951-49ff-b5cb-f7b10a1c9e46 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:17:38 devstack sudo[106583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-e4c28775-0951-49ff-b5cb-f7b10a1c9e46 Sep 07 10:17:38 devstack sudo[106583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:17:38 devstack sudo[106583]: pam_unix(sudo:session): session closed for user root Sep 07 10:17:38 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-aa48247d-d1fd-4ea5-b330-ae94813bf8ec tempest-CreateVolumesFromSnapshotTest-2070828459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-e4c28775-0951-49ff-b5cb-f7b10a1c9e46" returned: 0 in 0.253s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:17:38 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-aa48247d-d1fd-4ea5-b330-ae94813bf8ec tempest-CreateVolumesFromSnapshotTest-2070828459 None] <== create_volume: return (951ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'} {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 10:17:38 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-aa48247d-d1fd-4ea5-b330-ae94813bf8ec tempest-CreateVolumesFromSnapshotTest-2070828459 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.953s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:17:38 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-29747a08-75a7-4ae6-af01-6e5433058a9d tempest-CreateVolumesFromSnapshotTest-2070828459 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.964s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:17:38 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-29747a08-75a7-4ae6-af01-6e5433058a9d tempest-CreateVolumesFromSnapshotTest-2070828459 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:17:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-292515758',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d26dc3ac-9801-43bd-833b-8efe9c9582e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68d50cdd46974bd1bfed178e086b85e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:17:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:17:37Z,use_quota=True,user_id='9621d873b4d34707875a60d5d981b52b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3a092cd-7947-4cbf-abff-4ba9567becf0),volume_type_id=f3a092cd-7947-4cbf-abff-4ba9567becf0)}" {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 10:17:38 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-29747a08-75a7-4ae6-af01-6e5433058a9d tempest-CreateVolumesFromSnapshotTest-2070828459 None] Creating volume d26dc3ac-9801-43bd-833b-8efe9c9582e0 {{(pid=87515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 10:17:38 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-29747a08-75a7-4ae6-af01-6e5433058a9d tempest-CreateVolumesFromSnapshotTest-2070828459 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:17:38 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-29747a08-75a7-4ae6-af01-6e5433058a9d tempest-CreateVolumesFromSnapshotTest-2070828459 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:17:38 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-29747a08-75a7-4ae6-af01-6e5433058a9d tempest-CreateVolumesFromSnapshotTest-2070828459 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:17:38 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-29747a08-75a7-4ae6-af01-6e5433058a9d tempest-CreateVolumesFromSnapshotTest-2070828459 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:17:38 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-29747a08-75a7-4ae6-af01-6e5433058a9d tempest-CreateVolumesFromSnapshotTest-2070828459 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:17:38 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-29747a08-75a7-4ae6-af01-6e5433058a9d tempest-CreateVolumesFromSnapshotTest-2070828459 None] Selected osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c as target Quobyte volume. {{(pid=87515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 10:17:38 devstack cinder-volume[87515]: INFO cinder.volume.drivers.remotefs [None req-29747a08-75a7-4ae6-af01-6e5433058a9d tempest-CreateVolumesFromSnapshotTest-2070828459 None] casted to osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c Sep 07 10:17:38 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-29747a08-75a7-4ae6-af01-6e5433058a9d tempest-CreateVolumesFromSnapshotTest-2070828459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-d26dc3ac-9801-43bd-833b-8efe9c9582e0 1073741824 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:17:38 devstack sudo[106586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-d26dc3ac-9801-43bd-833b-8efe9c9582e0 1073741824 Sep 07 10:17:38 devstack sudo[106586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:17:38 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-aa48247d-d1fd-4ea5-b330-ae94813bf8ec tempest-CreateVolumesFromSnapshotTest-2070828459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72b7628c-c9f1-4bc3-9ef0-206e00649e7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e4c28775-0951-49ff-b5cb-f7b10a1c9e46', 'volume_size': 1}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:17:38 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-aa48247d-d1fd-4ea5-b330-ae94813bf8ec tempest-CreateVolumesFromSnapshotTest-2070828459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9165b62-effb-4770-a8c9-23662b3965fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:17:38 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-aa48247d-d1fd-4ea5-b330-ae94813bf8ec tempest-CreateVolumesFromSnapshotTest-2070828459 None] Volume volume-e4c28775-0951-49ff-b5cb-f7b10a1c9e46 (e4c28775-0951-49ff-b5cb-f7b10a1c9e46): created successfully Sep 07 10:17:38 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-aa48247d-d1fd-4ea5-b330-ae94813bf8ec tempest-CreateVolumesFromSnapshotTest-2070828459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9165b62-effb-4770-a8c9-23662b3965fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:17:38 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-aa48247d-d1fd-4ea5-b330-ae94813bf8ec tempest-CreateVolumesFromSnapshotTest-2070828459 None] Flow 'volume_create_manager' (1f79f636-cd92-474d-819f-ea13388990de) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:17:38 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-aa48247d-d1fd-4ea5-b330-ae94813bf8ec tempest-CreateVolumesFromSnapshotTest-2070828459 None] Created volume successfully. Sep 07 10:17:39 devstack sudo[106586]: pam_unix(sudo:session): session closed for user root Sep 07 10:17:39 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-29747a08-75a7-4ae6-af01-6e5433058a9d tempest-CreateVolumesFromSnapshotTest-2070828459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-d26dc3ac-9801-43bd-833b-8efe9c9582e0 1073741824" returned: 0 in 0.404s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:17:39 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-29747a08-75a7-4ae6-af01-6e5433058a9d tempest-CreateVolumesFromSnapshotTest-2070828459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-d26dc3ac-9801-43bd-833b-8efe9c9582e0 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:17:39 devstack sudo[106592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-d26dc3ac-9801-43bd-833b-8efe9c9582e0 Sep 07 10:17:39 devstack sudo[106592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:17:39 devstack sudo[106592]: pam_unix(sudo:session): session closed for user root Sep 07 10:17:39 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-29747a08-75a7-4ae6-af01-6e5433058a9d tempest-CreateVolumesFromSnapshotTest-2070828459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-d26dc3ac-9801-43bd-833b-8efe9c9582e0" returned: 0 in 0.243s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:17:39 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-29747a08-75a7-4ae6-af01-6e5433058a9d tempest-CreateVolumesFromSnapshotTest-2070828459 None] <== create_volume: return (683ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'} {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 10:17:39 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-29747a08-75a7-4ae6-af01-6e5433058a9d tempest-CreateVolumesFromSnapshotTest-2070828459 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.686s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:17:39 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-decb7083-2b62-4b17-90bc-24796df741c3 tempest-CreateVolumesFromSnapshotTest-2070828459 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.298s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:17:39 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-decb7083-2b62-4b17-90bc-24796df741c3 tempest-CreateVolumesFromSnapshotTest-2070828459 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:17:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1459577185',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e08b891-f67e-4b5a-9390-e1fefe1e5097,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68d50cdd46974bd1bfed178e086b85e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:17:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:17:38Z,use_quota=True,user_id='9621d873b4d34707875a60d5d981b52b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3a092cd-7947-4cbf-abff-4ba9567becf0),volume_type_id=f3a092cd-7947-4cbf-abff-4ba9567becf0)}" {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 10:17:39 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-decb7083-2b62-4b17-90bc-24796df741c3 tempest-CreateVolumesFromSnapshotTest-2070828459 None] Creating volume 7e08b891-f67e-4b5a-9390-e1fefe1e5097 {{(pid=87515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 10:17:39 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-decb7083-2b62-4b17-90bc-24796df741c3 tempest-CreateVolumesFromSnapshotTest-2070828459 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:17:39 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-decb7083-2b62-4b17-90bc-24796df741c3 tempest-CreateVolumesFromSnapshotTest-2070828459 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:17:39 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-decb7083-2b62-4b17-90bc-24796df741c3 tempest-CreateVolumesFromSnapshotTest-2070828459 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:17:39 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-decb7083-2b62-4b17-90bc-24796df741c3 tempest-CreateVolumesFromSnapshotTest-2070828459 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:17:39 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-decb7083-2b62-4b17-90bc-24796df741c3 tempest-CreateVolumesFromSnapshotTest-2070828459 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:17:39 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-decb7083-2b62-4b17-90bc-24796df741c3 tempest-CreateVolumesFromSnapshotTest-2070828459 None] Selected osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c as target Quobyte volume. {{(pid=87515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 10:17:39 devstack cinder-volume[87515]: INFO cinder.volume.drivers.remotefs [None req-decb7083-2b62-4b17-90bc-24796df741c3 tempest-CreateVolumesFromSnapshotTest-2070828459 None] casted to osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c Sep 07 10:17:39 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-decb7083-2b62-4b17-90bc-24796df741c3 tempest-CreateVolumesFromSnapshotTest-2070828459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-7e08b891-f67e-4b5a-9390-e1fefe1e5097 1073741824 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:17:39 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-29747a08-75a7-4ae6-af01-6e5433058a9d tempest-CreateVolumesFromSnapshotTest-2070828459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d29be129-a394-4964-ae46-3c579a81a208) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d26dc3ac-9801-43bd-833b-8efe9c9582e0', 'volume_size': 1}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:17:39 devstack sudo[106596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-7e08b891-f67e-4b5a-9390-e1fefe1e5097 1073741824 Sep 07 10:17:39 devstack sudo[106596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:17:39 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-29747a08-75a7-4ae6-af01-6e5433058a9d tempest-CreateVolumesFromSnapshotTest-2070828459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c724d08b-6771-4d1b-a276-b03299dfc12e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:17:39 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-29747a08-75a7-4ae6-af01-6e5433058a9d tempest-CreateVolumesFromSnapshotTest-2070828459 None] Volume volume-d26dc3ac-9801-43bd-833b-8efe9c9582e0 (d26dc3ac-9801-43bd-833b-8efe9c9582e0): created successfully Sep 07 10:17:39 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-29747a08-75a7-4ae6-af01-6e5433058a9d tempest-CreateVolumesFromSnapshotTest-2070828459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c724d08b-6771-4d1b-a276-b03299dfc12e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:17:39 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-29747a08-75a7-4ae6-af01-6e5433058a9d tempest-CreateVolumesFromSnapshotTest-2070828459 None] Flow 'volume_create_manager' (6a6145fe-8c11-47bd-a67f-21d09a6e7623) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:17:39 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-29747a08-75a7-4ae6-af01-6e5433058a9d tempest-CreateVolumesFromSnapshotTest-2070828459 None] Created volume successfully. Sep 07 10:17:39 devstack sudo[106596]: pam_unix(sudo:session): session closed for user root Sep 07 10:17:39 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-decb7083-2b62-4b17-90bc-24796df741c3 tempest-CreateVolumesFromSnapshotTest-2070828459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-7e08b891-f67e-4b5a-9390-e1fefe1e5097 1073741824" returned: 0 in 0.417s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:17:39 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-decb7083-2b62-4b17-90bc-24796df741c3 tempest-CreateVolumesFromSnapshotTest-2070828459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-7e08b891-f67e-4b5a-9390-e1fefe1e5097 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:17:39 devstack sudo[106602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-7e08b891-f67e-4b5a-9390-e1fefe1e5097 Sep 07 10:17:39 devstack sudo[106602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:17:39 devstack sudo[106602]: pam_unix(sudo:session): session closed for user root Sep 07 10:17:39 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-decb7083-2b62-4b17-90bc-24796df741c3 tempest-CreateVolumesFromSnapshotTest-2070828459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-7e08b891-f67e-4b5a-9390-e1fefe1e5097" returned: 0 in 0.244s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:17:39 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-decb7083-2b62-4b17-90bc-24796df741c3 tempest-CreateVolumesFromSnapshotTest-2070828459 None] <== create_volume: return (699ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'} {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 10:17:39 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-decb7083-2b62-4b17-90bc-24796df741c3 tempest-CreateVolumesFromSnapshotTest-2070828459 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.702s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:17:40 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-0cebd469-19f4-4598-a1b4-7e1901e45254 tempest-CreateVolumesFromSnapshotTest-2070828459 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.668s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:17:40 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-0cebd469-19f4-4598-a1b4-7e1901e45254 tempest-CreateVolumesFromSnapshotTest-2070828459 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:17:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1496467229',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db005027-e529-44c6-86fc-395e2d65715c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68d50cdd46974bd1bfed178e086b85e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:17:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:17:38Z,use_quota=True,user_id='9621d873b4d34707875a60d5d981b52b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3a092cd-7947-4cbf-abff-4ba9567becf0),volume_type_id=f3a092cd-7947-4cbf-abff-4ba9567becf0)}" {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 10:17:40 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-0cebd469-19f4-4598-a1b4-7e1901e45254 tempest-CreateVolumesFromSnapshotTest-2070828459 None] Creating volume db005027-e529-44c6-86fc-395e2d65715c {{(pid=87515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 10:17:40 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-0cebd469-19f4-4598-a1b4-7e1901e45254 tempest-CreateVolumesFromSnapshotTest-2070828459 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:17:40 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-0cebd469-19f4-4598-a1b4-7e1901e45254 tempest-CreateVolumesFromSnapshotTest-2070828459 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:17:40 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-0cebd469-19f4-4598-a1b4-7e1901e45254 tempest-CreateVolumesFromSnapshotTest-2070828459 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:17:40 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-0cebd469-19f4-4598-a1b4-7e1901e45254 tempest-CreateVolumesFromSnapshotTest-2070828459 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:17:40 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-0cebd469-19f4-4598-a1b4-7e1901e45254 tempest-CreateVolumesFromSnapshotTest-2070828459 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:17:40 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-0cebd469-19f4-4598-a1b4-7e1901e45254 tempest-CreateVolumesFromSnapshotTest-2070828459 None] Selected osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c as target Quobyte volume. {{(pid=87515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 10:17:40 devstack cinder-volume[87515]: INFO cinder.volume.drivers.remotefs [None req-0cebd469-19f4-4598-a1b4-7e1901e45254 tempest-CreateVolumesFromSnapshotTest-2070828459 None] casted to osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c Sep 07 10:17:40 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-0cebd469-19f4-4598-a1b4-7e1901e45254 tempest-CreateVolumesFromSnapshotTest-2070828459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-db005027-e529-44c6-86fc-395e2d65715c 1073741824 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:17:40 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-decb7083-2b62-4b17-90bc-24796df741c3 tempest-CreateVolumesFromSnapshotTest-2070828459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7cfe5505-a7b9-466d-81f1-387942bdaa38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7e08b891-f67e-4b5a-9390-e1fefe1e5097', 'volume_size': 1}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:17:40 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-decb7083-2b62-4b17-90bc-24796df741c3 tempest-CreateVolumesFromSnapshotTest-2070828459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8224e7b-996c-4af9-9a03-16ea408ef65e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:17:40 devstack sudo[106605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-db005027-e529-44c6-86fc-395e2d65715c 1073741824 Sep 07 10:17:40 devstack sudo[106605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:17:40 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-decb7083-2b62-4b17-90bc-24796df741c3 tempest-CreateVolumesFromSnapshotTest-2070828459 None] Volume volume-7e08b891-f67e-4b5a-9390-e1fefe1e5097 (7e08b891-f67e-4b5a-9390-e1fefe1e5097): created successfully Sep 07 10:17:40 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-decb7083-2b62-4b17-90bc-24796df741c3 tempest-CreateVolumesFromSnapshotTest-2070828459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8224e7b-996c-4af9-9a03-16ea408ef65e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:17:40 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-decb7083-2b62-4b17-90bc-24796df741c3 tempest-CreateVolumesFromSnapshotTest-2070828459 None] Flow 'volume_create_manager' (6fca35ea-63b9-4ae8-9fc9-5ae5c7393fd7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:17:40 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-decb7083-2b62-4b17-90bc-24796df741c3 tempest-CreateVolumesFromSnapshotTest-2070828459 None] Created volume successfully. Sep 07 10:17:40 devstack sudo[106605]: pam_unix(sudo:session): session closed for user root Sep 07 10:17:40 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-0cebd469-19f4-4598-a1b4-7e1901e45254 tempest-CreateVolumesFromSnapshotTest-2070828459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-db005027-e529-44c6-86fc-395e2d65715c 1073741824" returned: 0 in 0.432s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:17:40 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-0cebd469-19f4-4598-a1b4-7e1901e45254 tempest-CreateVolumesFromSnapshotTest-2070828459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-db005027-e529-44c6-86fc-395e2d65715c {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:17:40 devstack sudo[106611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-db005027-e529-44c6-86fc-395e2d65715c Sep 07 10:17:40 devstack sudo[106611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:17:40 devstack sudo[106611]: pam_unix(sudo:session): session closed for user root Sep 07 10:17:40 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-0cebd469-19f4-4598-a1b4-7e1901e45254 tempest-CreateVolumesFromSnapshotTest-2070828459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-db005027-e529-44c6-86fc-395e2d65715c" returned: 0 in 0.246s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:17:40 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-0cebd469-19f4-4598-a1b4-7e1901e45254 tempest-CreateVolumesFromSnapshotTest-2070828459 None] <== create_volume: return (717ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'} {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 10:17:40 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-0cebd469-19f4-4598-a1b4-7e1901e45254 tempest-CreateVolumesFromSnapshotTest-2070828459 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.720s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:17:40 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-0cebd469-19f4-4598-a1b4-7e1901e45254 tempest-CreateVolumesFromSnapshotTest-2070828459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (034d65b2-b3eb-42cf-87e4-821a80921ef0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-db005027-e529-44c6-86fc-395e2d65715c', 'volume_size': 1}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:17:40 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-0cebd469-19f4-4598-a1b4-7e1901e45254 tempest-CreateVolumesFromSnapshotTest-2070828459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5a25b8b-144a-4365-b51e-f2b210c8ec44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:17:40 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-0cebd469-19f4-4598-a1b4-7e1901e45254 tempest-CreateVolumesFromSnapshotTest-2070828459 None] Volume volume-db005027-e529-44c6-86fc-395e2d65715c (db005027-e529-44c6-86fc-395e2d65715c): created successfully Sep 07 10:17:40 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-0cebd469-19f4-4598-a1b4-7e1901e45254 tempest-CreateVolumesFromSnapshotTest-2070828459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5a25b8b-144a-4365-b51e-f2b210c8ec44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:17:40 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-0cebd469-19f4-4598-a1b4-7e1901e45254 tempest-CreateVolumesFromSnapshotTest-2070828459 None] Flow 'volume_create_manager' (45a90b0d-dbb2-40f8-9786-7a5a65dbd983) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:17:40 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-0cebd469-19f4-4598-a1b4-7e1901e45254 tempest-CreateVolumesFromSnapshotTest-2070828459 None] Created volume successfully. Sep 07 10:17:41 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-3aee28a1-8708-46b7-893d-e747829b9066 tempest-CreateVolumesFromSnapshotTest-2070828459 None] Acquiring lock "cinder-db005027-e529-44c6-86fc-395e2d65715c-delete_volume" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:17:41 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-3aee28a1-8708-46b7-893d-e747829b9066 tempest-CreateVolumesFromSnapshotTest-2070828459 None] Lock "cinder-db005027-e529-44c6-86fc-395e2d65715c-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:17:41 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-3aee28a1-8708-46b7-893d-e747829b9066 tempest-CreateVolumesFromSnapshotTest-2070828459 None] Acquiring lock "cinder-quobyte-db005027-e529-44c6-86fc-395e2d65715c" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:17:41 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-3aee28a1-8708-46b7-893d-e747829b9066 tempest-CreateVolumesFromSnapshotTest-2070828459 None] Lock "cinder-quobyte-db005027-e529-44c6-86fc-395e2d65715c" acquired by "delete_volume" :: waited 0.014s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:17:41 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[dade0a59-b4b6-4c82-b765-ed3f2c953f8b]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:17:41 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-3aee28a1-8708-46b7-893d-e747829b9066 tempest-CreateVolumesFromSnapshotTest-2070828459 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-db005027-e529-44c6-86fc-395e2d65715c {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:17:41 devstack sudo[106614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-db005027-e529-44c6-86fc-395e2d65715c Sep 07 10:17:41 devstack sudo[106614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:17:42 devstack sudo[106614]: pam_unix(sudo:session): session closed for user root Sep 07 10:17:42 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-3aee28a1-8708-46b7-893d-e747829b9066 tempest-CreateVolumesFromSnapshotTest-2070828459 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-db005027-e529-44c6-86fc-395e2d65715c" returned: 0 in 0.359s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:17:42 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-3aee28a1-8708-46b7-893d-e747829b9066 tempest-CreateVolumesFromSnapshotTest-2070828459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-db005027-e529-44c6-86fc-395e2d65715c {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:17:42 devstack sudo[106619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-db005027-e529-44c6-86fc-395e2d65715c Sep 07 10:17:42 devstack sudo[106619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:17:42 devstack sudo[106619]: pam_unix(sudo:session): session closed for user root Sep 07 10:17:42 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-3aee28a1-8708-46b7-893d-e747829b9066 tempest-CreateVolumesFromSnapshotTest-2070828459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-db005027-e529-44c6-86fc-395e2d65715c" returned: 0 in 0.252s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:17:42 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-3aee28a1-8708-46b7-893d-e747829b9066 tempest-CreateVolumesFromSnapshotTest-2070828459 None] Lock "cinder-quobyte-db005027-e529-44c6-86fc-395e2d65715c" released by "delete_volume" :: held 0.646s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:17:42 devstack cinder-volume[87515]: DEBUG cinder.quota [None req-3aee28a1-8708-46b7-893d-e747829b9066 tempest-CreateVolumesFromSnapshotTest-2070828459 None] Created reservations ['a30c723f-b880-4612-8fae-c119011fe163', '4c7f1c43-5dc7-47c3-a546-5c0862601bb2', 'c5f8be8e-85ba-4735-918f-4244f8a82fb6', 'ddf254b2-cf9e-4003-9f02-142fc019ed49'] {{(pid=87515) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:17:42 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-3aee28a1-8708-46b7-893d-e747829b9066 tempest-CreateVolumesFromSnapshotTest-2070828459 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:17:42 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-3aee28a1-8708-46b7-893d-e747829b9066 tempest-CreateVolumesFromSnapshotTest-2070828459 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:17:42 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-3aee28a1-8708-46b7-893d-e747829b9066 tempest-CreateVolumesFromSnapshotTest-2070828459 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:17:42 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-3aee28a1-8708-46b7-893d-e747829b9066 tempest-CreateVolumesFromSnapshotTest-2070828459 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:17:42 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-3aee28a1-8708-46b7-893d-e747829b9066 tempest-CreateVolumesFromSnapshotTest-2070828459 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:17:42 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-3aee28a1-8708-46b7-893d-e747829b9066 tempest-CreateVolumesFromSnapshotTest-2070828459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:17:42 devstack sudo[106622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a Sep 07 10:17:42 devstack sudo[106622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:17:42 devstack sudo[106622]: pam_unix(sudo:session): session closed for user root Sep 07 10:17:42 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-3aee28a1-8708-46b7-893d-e747829b9066 tempest-CreateVolumesFromSnapshotTest-2070828459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a" returned: 0 in 0.261s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:17:42 devstack cinder-volume[87515]: DEBUG cinder.manager [None req-3aee28a1-8708-46b7-893d-e747829b9066 tempest-CreateVolumesFromSnapshotTest-2070828459 None] Notifying Schedulers of capabilities ... {{(pid=87515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:17:42 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-3aee28a1-8708-46b7-893d-e747829b9066 tempest-CreateVolumesFromSnapshotTest-2070828459 None] Deleted volume successfully. Sep 07 10:17:42 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-a1132670-571d-4135-9488-6f740aa349d5 tempest-CreateVolumesFromSnapshotTest-2070828459 None] Acquiring lock "cinder-7e08b891-f67e-4b5a-9390-e1fefe1e5097-delete_volume" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:17:42 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-3aee28a1-8708-46b7-893d-e747829b9066 tempest-CreateVolumesFromSnapshotTest-2070828459 None] Lock "cinder-db005027-e529-44c6-86fc-395e2d65715c-delete_volume" released by "delete_volume" :: held 1.150s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:17:42 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-a1132670-571d-4135-9488-6f740aa349d5 tempest-CreateVolumesFromSnapshotTest-2070828459 None] Lock "cinder-7e08b891-f67e-4b5a-9390-e1fefe1e5097-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:17:42 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-a1132670-571d-4135-9488-6f740aa349d5 tempest-CreateVolumesFromSnapshotTest-2070828459 None] Acquiring lock "cinder-quobyte-7e08b891-f67e-4b5a-9390-e1fefe1e5097" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:17:42 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-a1132670-571d-4135-9488-6f740aa349d5 tempest-CreateVolumesFromSnapshotTest-2070828459 None] Lock "cinder-quobyte-7e08b891-f67e-4b5a-9390-e1fefe1e5097" acquired by "delete_volume" :: waited 0.012s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:17:42 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[8aed0abf-cb3d-415a-b751-4e4e115e1760]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:17:42 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-a1132670-571d-4135-9488-6f740aa349d5 tempest-CreateVolumesFromSnapshotTest-2070828459 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-7e08b891-f67e-4b5a-9390-e1fefe1e5097 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:17:42 devstack sudo[106625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-7e08b891-f67e-4b5a-9390-e1fefe1e5097 Sep 07 10:17:42 devstack sudo[106625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:17:43 devstack sudo[106625]: pam_unix(sudo:session): session closed for user root Sep 07 10:17:43 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-a1132670-571d-4135-9488-6f740aa349d5 tempest-CreateVolumesFromSnapshotTest-2070828459 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-7e08b891-f67e-4b5a-9390-e1fefe1e5097" returned: 0 in 0.357s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:17:43 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-a1132670-571d-4135-9488-6f740aa349d5 tempest-CreateVolumesFromSnapshotTest-2070828459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-7e08b891-f67e-4b5a-9390-e1fefe1e5097 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:17:43 devstack sudo[106630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-7e08b891-f67e-4b5a-9390-e1fefe1e5097 Sep 07 10:17:43 devstack sudo[106630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:17:43 devstack sudo[106630]: pam_unix(sudo:session): session closed for user root Sep 07 10:17:43 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-a1132670-571d-4135-9488-6f740aa349d5 tempest-CreateVolumesFromSnapshotTest-2070828459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-7e08b891-f67e-4b5a-9390-e1fefe1e5097" returned: 0 in 0.257s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:17:43 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-a1132670-571d-4135-9488-6f740aa349d5 tempest-CreateVolumesFromSnapshotTest-2070828459 None] Lock "cinder-quobyte-7e08b891-f67e-4b5a-9390-e1fefe1e5097" released by "delete_volume" :: held 0.654s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:17:43 devstack cinder-volume[87515]: DEBUG cinder.quota [None req-a1132670-571d-4135-9488-6f740aa349d5 tempest-CreateVolumesFromSnapshotTest-2070828459 None] Created reservations ['cc430a32-a2f8-4b76-93f9-b417218a12ad', '264eb011-3eed-4aa0-bc98-1a5b4b66b59c', '98fec45c-a2d9-44cc-baba-2d68e3a42126', '6a5058bd-81c6-4a89-be70-b6454837794e'] {{(pid=87515) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:17:43 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-a1132670-571d-4135-9488-6f740aa349d5 tempest-CreateVolumesFromSnapshotTest-2070828459 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:17:43 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-a1132670-571d-4135-9488-6f740aa349d5 tempest-CreateVolumesFromSnapshotTest-2070828459 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:17:43 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-a1132670-571d-4135-9488-6f740aa349d5 tempest-CreateVolumesFromSnapshotTest-2070828459 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:17:43 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-a1132670-571d-4135-9488-6f740aa349d5 tempest-CreateVolumesFromSnapshotTest-2070828459 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:17:43 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-a1132670-571d-4135-9488-6f740aa349d5 tempest-CreateVolumesFromSnapshotTest-2070828459 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:17:43 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-a1132670-571d-4135-9488-6f740aa349d5 tempest-CreateVolumesFromSnapshotTest-2070828459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:17:43 devstack sudo[106633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a Sep 07 10:17:43 devstack sudo[106633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:17:43 devstack sudo[106633]: pam_unix(sudo:session): session closed for user root Sep 07 10:17:43 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-a1132670-571d-4135-9488-6f740aa349d5 tempest-CreateVolumesFromSnapshotTest-2070828459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a" returned: 0 in 0.247s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:17:43 devstack cinder-volume[87515]: DEBUG cinder.manager [None req-a1132670-571d-4135-9488-6f740aa349d5 tempest-CreateVolumesFromSnapshotTest-2070828459 None] Notifying Schedulers of capabilities ... {{(pid=87515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:17:43 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-a1132670-571d-4135-9488-6f740aa349d5 tempest-CreateVolumesFromSnapshotTest-2070828459 None] Deleted volume successfully. Sep 07 10:17:43 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-a1132670-571d-4135-9488-6f740aa349d5 tempest-CreateVolumesFromSnapshotTest-2070828459 None] Lock "cinder-7e08b891-f67e-4b5a-9390-e1fefe1e5097-delete_volume" released by "delete_volume" :: held 1.084s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:17:43 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-bf1e3a03-d39d-44e7-8324-f6aee3a7ba29 tempest-CreateVolumesFromSnapshotTest-2070828459 None] Acquiring lock "cinder-d26dc3ac-9801-43bd-833b-8efe9c9582e0-delete_volume" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:17:43 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-bf1e3a03-d39d-44e7-8324-f6aee3a7ba29 tempest-CreateVolumesFromSnapshotTest-2070828459 None] Lock "cinder-d26dc3ac-9801-43bd-833b-8efe9c9582e0-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:17:43 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-bf1e3a03-d39d-44e7-8324-f6aee3a7ba29 tempest-CreateVolumesFromSnapshotTest-2070828459 None] Acquiring lock "cinder-quobyte-d26dc3ac-9801-43bd-833b-8efe9c9582e0" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:17:44 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-bf1e3a03-d39d-44e7-8324-f6aee3a7ba29 tempest-CreateVolumesFromSnapshotTest-2070828459 None] Lock "cinder-quobyte-d26dc3ac-9801-43bd-833b-8efe9c9582e0" acquired by "delete_volume" :: waited 0.013s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:17:44 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e4e8103-b26f-46bf-984f-a863cfa1127f]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:17:44 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-bf1e3a03-d39d-44e7-8324-f6aee3a7ba29 tempest-CreateVolumesFromSnapshotTest-2070828459 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-d26dc3ac-9801-43bd-833b-8efe9c9582e0 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:17:44 devstack sudo[106636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-d26dc3ac-9801-43bd-833b-8efe9c9582e0 Sep 07 10:17:44 devstack sudo[106636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:17:44 devstack sudo[106636]: pam_unix(sudo:session): session closed for user root Sep 07 10:17:44 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-bf1e3a03-d39d-44e7-8324-f6aee3a7ba29 tempest-CreateVolumesFromSnapshotTest-2070828459 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-d26dc3ac-9801-43bd-833b-8efe9c9582e0" returned: 0 in 0.348s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:17:44 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-bf1e3a03-d39d-44e7-8324-f6aee3a7ba29 tempest-CreateVolumesFromSnapshotTest-2070828459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-d26dc3ac-9801-43bd-833b-8efe9c9582e0 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:17:44 devstack sudo[106641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-d26dc3ac-9801-43bd-833b-8efe9c9582e0 Sep 07 10:17:44 devstack sudo[106641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:17:44 devstack sudo[106641]: pam_unix(sudo:session): session closed for user root Sep 07 10:17:44 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-bf1e3a03-d39d-44e7-8324-f6aee3a7ba29 tempest-CreateVolumesFromSnapshotTest-2070828459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-d26dc3ac-9801-43bd-833b-8efe9c9582e0" returned: 0 in 0.240s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:17:44 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-bf1e3a03-d39d-44e7-8324-f6aee3a7ba29 tempest-CreateVolumesFromSnapshotTest-2070828459 None] Lock "cinder-quobyte-d26dc3ac-9801-43bd-833b-8efe9c9582e0" released by "delete_volume" :: held 0.626s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:17:44 devstack cinder-volume[87515]: DEBUG cinder.quota [None req-bf1e3a03-d39d-44e7-8324-f6aee3a7ba29 tempest-CreateVolumesFromSnapshotTest-2070828459 None] Created reservations ['a0d50de9-c19c-4096-8eea-aee656ecc85b', '91e81015-ac0a-4436-9c54-076838a5fcab', '49a24680-3e03-4449-93b1-1fa464344815', 'ee18b5d2-2b55-48a3-b5ff-972ce28a3726'] {{(pid=87515) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:17:44 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-bf1e3a03-d39d-44e7-8324-f6aee3a7ba29 tempest-CreateVolumesFromSnapshotTest-2070828459 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:17:44 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-bf1e3a03-d39d-44e7-8324-f6aee3a7ba29 tempest-CreateVolumesFromSnapshotTest-2070828459 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:17:44 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-bf1e3a03-d39d-44e7-8324-f6aee3a7ba29 tempest-CreateVolumesFromSnapshotTest-2070828459 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:17:44 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-bf1e3a03-d39d-44e7-8324-f6aee3a7ba29 tempest-CreateVolumesFromSnapshotTest-2070828459 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:17:44 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-bf1e3a03-d39d-44e7-8324-f6aee3a7ba29 tempest-CreateVolumesFromSnapshotTest-2070828459 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:17:44 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-bf1e3a03-d39d-44e7-8324-f6aee3a7ba29 tempest-CreateVolumesFromSnapshotTest-2070828459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:17:44 devstack sudo[106644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a Sep 07 10:17:44 devstack sudo[106644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:17:44 devstack sudo[106644]: pam_unix(sudo:session): session closed for user root Sep 07 10:17:44 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-bf1e3a03-d39d-44e7-8324-f6aee3a7ba29 tempest-CreateVolumesFromSnapshotTest-2070828459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a" returned: 0 in 0.260s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:17:44 devstack cinder-volume[87515]: DEBUG cinder.manager [None req-bf1e3a03-d39d-44e7-8324-f6aee3a7ba29 tempest-CreateVolumesFromSnapshotTest-2070828459 None] Notifying Schedulers of capabilities ... {{(pid=87515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:17:45 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-bf1e3a03-d39d-44e7-8324-f6aee3a7ba29 tempest-CreateVolumesFromSnapshotTest-2070828459 None] Deleted volume successfully. Sep 07 10:17:45 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-bf1e3a03-d39d-44e7-8324-f6aee3a7ba29 tempest-CreateVolumesFromSnapshotTest-2070828459 None] Lock "cinder-d26dc3ac-9801-43bd-833b-8efe9c9582e0-delete_volume" released by "delete_volume" :: held 1.103s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:17:45 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-3822f7f5-7c17-48a2-b08d-f74dd6df174a tempest-CreateVolumesFromSnapshotTest-2070828459 None] Acquiring lock "cinder-e4c28775-0951-49ff-b5cb-f7b10a1c9e46-delete_volume" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:17:45 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-3822f7f5-7c17-48a2-b08d-f74dd6df174a tempest-CreateVolumesFromSnapshotTest-2070828459 None] Lock "cinder-e4c28775-0951-49ff-b5cb-f7b10a1c9e46-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:17:45 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-3822f7f5-7c17-48a2-b08d-f74dd6df174a tempest-CreateVolumesFromSnapshotTest-2070828459 None] Acquiring lock "cinder-quobyte-e4c28775-0951-49ff-b5cb-f7b10a1c9e46" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:17:45 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-3822f7f5-7c17-48a2-b08d-f74dd6df174a tempest-CreateVolumesFromSnapshotTest-2070828459 None] Lock "cinder-quobyte-e4c28775-0951-49ff-b5cb-f7b10a1c9e46" acquired by "delete_volume" :: waited 0.015s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:17:45 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[f081c356-6f7f-4733-acfc-d6656bc911b9]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:17:45 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-3822f7f5-7c17-48a2-b08d-f74dd6df174a tempest-CreateVolumesFromSnapshotTest-2070828459 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-e4c28775-0951-49ff-b5cb-f7b10a1c9e46 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:17:45 devstack sudo[106647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-e4c28775-0951-49ff-b5cb-f7b10a1c9e46 Sep 07 10:17:45 devstack sudo[106647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:17:45 devstack sudo[106647]: pam_unix(sudo:session): session closed for user root Sep 07 10:17:45 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-3822f7f5-7c17-48a2-b08d-f74dd6df174a tempest-CreateVolumesFromSnapshotTest-2070828459 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-e4c28775-0951-49ff-b5cb-f7b10a1c9e46" returned: 0 in 0.357s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:17:45 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-3822f7f5-7c17-48a2-b08d-f74dd6df174a tempest-CreateVolumesFromSnapshotTest-2070828459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-e4c28775-0951-49ff-b5cb-f7b10a1c9e46 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:17:45 devstack sudo[106652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-e4c28775-0951-49ff-b5cb-f7b10a1c9e46 Sep 07 10:17:45 devstack sudo[106652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:17:45 devstack sudo[106652]: pam_unix(sudo:session): session closed for user root Sep 07 10:17:45 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-3822f7f5-7c17-48a2-b08d-f74dd6df174a tempest-CreateVolumesFromSnapshotTest-2070828459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-e4c28775-0951-49ff-b5cb-f7b10a1c9e46" returned: 0 in 0.241s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:17:45 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-3822f7f5-7c17-48a2-b08d-f74dd6df174a tempest-CreateVolumesFromSnapshotTest-2070828459 None] Lock "cinder-quobyte-e4c28775-0951-49ff-b5cb-f7b10a1c9e46" released by "delete_volume" :: held 0.636s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:17:45 devstack cinder-volume[87515]: DEBUG cinder.quota [None req-3822f7f5-7c17-48a2-b08d-f74dd6df174a tempest-CreateVolumesFromSnapshotTest-2070828459 None] Created reservations ['fb62f307-083e-4fc9-981f-3fa57eee1f93', '8f309bdf-c408-46ba-b5d4-41cc4f10c75a', '84f20075-1d32-40d4-ae76-05d8ce71476c', '5664b9c9-5a63-4ed7-b61b-c7874bd3bfc9'] {{(pid=87515) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:17:45 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-3822f7f5-7c17-48a2-b08d-f74dd6df174a tempest-CreateVolumesFromSnapshotTest-2070828459 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:17:45 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-3822f7f5-7c17-48a2-b08d-f74dd6df174a tempest-CreateVolumesFromSnapshotTest-2070828459 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:17:45 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-3822f7f5-7c17-48a2-b08d-f74dd6df174a tempest-CreateVolumesFromSnapshotTest-2070828459 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:17:45 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-3822f7f5-7c17-48a2-b08d-f74dd6df174a tempest-CreateVolumesFromSnapshotTest-2070828459 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:17:45 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-3822f7f5-7c17-48a2-b08d-f74dd6df174a tempest-CreateVolumesFromSnapshotTest-2070828459 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:17:45 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-3822f7f5-7c17-48a2-b08d-f74dd6df174a tempest-CreateVolumesFromSnapshotTest-2070828459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:17:45 devstack sudo[106655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a Sep 07 10:17:45 devstack sudo[106655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:17:46 devstack sudo[106655]: pam_unix(sudo:session): session closed for user root Sep 07 10:17:46 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-3822f7f5-7c17-48a2-b08d-f74dd6df174a tempest-CreateVolumesFromSnapshotTest-2070828459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a" returned: 0 in 0.234s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:17:46 devstack cinder-volume[87515]: DEBUG cinder.manager [None req-3822f7f5-7c17-48a2-b08d-f74dd6df174a tempest-CreateVolumesFromSnapshotTest-2070828459 None] Notifying Schedulers of capabilities ... {{(pid=87515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:17:46 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-3822f7f5-7c17-48a2-b08d-f74dd6df174a tempest-CreateVolumesFromSnapshotTest-2070828459 None] Deleted volume successfully. Sep 07 10:17:46 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-3822f7f5-7c17-48a2-b08d-f74dd6df174a tempest-CreateVolumesFromSnapshotTest-2070828459 None] Lock "cinder-e4c28775-0951-49ff-b5cb-f7b10a1c9e46-delete_volume" released by "delete_volume" :: held 1.057s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:17:46 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-69d750f0-bbdf-45ad-bb10-62a39b123194 tempest-CreateVolumesFromSnapshotTest-2070828459 None] Acquiring lock "cinder-7fcffb4a-7ef7-49cc-89f5-def26f4e0502-delete_volume" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:17:46 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-69d750f0-bbdf-45ad-bb10-62a39b123194 tempest-CreateVolumesFromSnapshotTest-2070828459 None] Lock "cinder-7fcffb4a-7ef7-49cc-89f5-def26f4e0502-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:17:46 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-69d750f0-bbdf-45ad-bb10-62a39b123194 tempest-CreateVolumesFromSnapshotTest-2070828459 None] Acquiring lock "cinder-quobyte-7fcffb4a-7ef7-49cc-89f5-def26f4e0502" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:17:46 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-69d750f0-bbdf-45ad-bb10-62a39b123194 tempest-CreateVolumesFromSnapshotTest-2070828459 None] Lock "cinder-quobyte-7fcffb4a-7ef7-49cc-89f5-def26f4e0502" acquired by "delete_volume" :: waited 0.019s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:17:46 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2e9a022-8271-4481-b523-c2f629d0efee]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:17:46 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-69d750f0-bbdf-45ad-bb10-62a39b123194 tempest-CreateVolumesFromSnapshotTest-2070828459 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-7fcffb4a-7ef7-49cc-89f5-def26f4e0502 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:17:46 devstack sudo[106658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-7fcffb4a-7ef7-49cc-89f5-def26f4e0502 Sep 07 10:17:46 devstack sudo[106658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:17:46 devstack sudo[106658]: pam_unix(sudo:session): session closed for user root Sep 07 10:17:46 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-69d750f0-bbdf-45ad-bb10-62a39b123194 tempest-CreateVolumesFromSnapshotTest-2070828459 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-7fcffb4a-7ef7-49cc-89f5-def26f4e0502" returned: 0 in 0.370s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:17:46 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-69d750f0-bbdf-45ad-bb10-62a39b123194 tempest-CreateVolumesFromSnapshotTest-2070828459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-7fcffb4a-7ef7-49cc-89f5-def26f4e0502 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:17:46 devstack sudo[106663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-7fcffb4a-7ef7-49cc-89f5-def26f4e0502 Sep 07 10:17:46 devstack sudo[106663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:17:46 devstack sudo[106663]: pam_unix(sudo:session): session closed for user root Sep 07 10:17:46 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-69d750f0-bbdf-45ad-bb10-62a39b123194 tempest-CreateVolumesFromSnapshotTest-2070828459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-7fcffb4a-7ef7-49cc-89f5-def26f4e0502" returned: 0 in 0.240s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:17:46 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-69d750f0-bbdf-45ad-bb10-62a39b123194 tempest-CreateVolumesFromSnapshotTest-2070828459 None] Lock "cinder-quobyte-7fcffb4a-7ef7-49cc-89f5-def26f4e0502" released by "delete_volume" :: held 0.650s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:17:47 devstack cinder-volume[87515]: DEBUG cinder.quota [None req-69d750f0-bbdf-45ad-bb10-62a39b123194 tempest-CreateVolumesFromSnapshotTest-2070828459 None] Created reservations ['4e1358da-c72d-423f-b516-52a80b4847c7', 'f98051bd-296c-4ce4-9110-c00776ac8a3c', '6e3e68b5-93d4-43aa-8873-21a5511cad1d', '2ac8a51e-11de-4722-93ba-a557cd2f51af'] {{(pid=87515) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:17:47 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-69d750f0-bbdf-45ad-bb10-62a39b123194 tempest-CreateVolumesFromSnapshotTest-2070828459 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:17:47 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-69d750f0-bbdf-45ad-bb10-62a39b123194 tempest-CreateVolumesFromSnapshotTest-2070828459 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:17:47 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-69d750f0-bbdf-45ad-bb10-62a39b123194 tempest-CreateVolumesFromSnapshotTest-2070828459 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:17:47 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-69d750f0-bbdf-45ad-bb10-62a39b123194 tempest-CreateVolumesFromSnapshotTest-2070828459 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:17:47 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-69d750f0-bbdf-45ad-bb10-62a39b123194 tempest-CreateVolumesFromSnapshotTest-2070828459 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:17:47 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-69d750f0-bbdf-45ad-bb10-62a39b123194 tempest-CreateVolumesFromSnapshotTest-2070828459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:17:47 devstack sudo[106666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a Sep 07 10:17:47 devstack sudo[106666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:17:47 devstack sudo[106666]: pam_unix(sudo:session): session closed for user root Sep 07 10:17:47 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-69d750f0-bbdf-45ad-bb10-62a39b123194 tempest-CreateVolumesFromSnapshotTest-2070828459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a" returned: 0 in 0.247s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:17:47 devstack cinder-volume[87515]: DEBUG cinder.manager [None req-69d750f0-bbdf-45ad-bb10-62a39b123194 tempest-CreateVolumesFromSnapshotTest-2070828459 None] Notifying Schedulers of capabilities ... {{(pid=87515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:17:47 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-69d750f0-bbdf-45ad-bb10-62a39b123194 tempest-CreateVolumesFromSnapshotTest-2070828459 None] Deleted volume successfully. Sep 07 10:17:47 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-69d750f0-bbdf-45ad-bb10-62a39b123194 tempest-CreateVolumesFromSnapshotTest-2070828459 None] Lock "cinder-7fcffb4a-7ef7-49cc-89f5-def26f4e0502-delete_volume" released by "delete_volume" :: held 1.100s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:17:47 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-d1eb1703-b2e4-4848-944a-e4eefe355db5 tempest-CreateVolumesFromSnapshotTest-2070828459 None] Acquiring lock "cinder-6fbe9ca5-5510-49d2-83e5-4ace03652638-delete_snapshot" by "delete_snapshot" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:17:47 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-d1eb1703-b2e4-4848-944a-e4eefe355db5 tempest-CreateVolumesFromSnapshotTest-2070828459 None] Lock "cinder-6fbe9ca5-5510-49d2-83e5-4ace03652638-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:17:47 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-d1eb1703-b2e4-4848-944a-e4eefe355db5 tempest-CreateVolumesFromSnapshotTest-2070828459 None] Acquiring lock "cinder-quobyte-2fedc8ab-2322-46e4-9d2d-e3cb8b7d6afa" by "delete_snapshot" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:17:47 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-d1eb1703-b2e4-4848-944a-e4eefe355db5 tempest-CreateVolumesFromSnapshotTest-2070828459 None] Lock "cinder-quobyte-2fedc8ab-2322-46e4-9d2d-e3cb8b7d6afa" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:17:47 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-d1eb1703-b2e4-4848-944a-e4eefe355db5 tempest-CreateVolumesFromSnapshotTest-2070828459 None] Acquiring lock "cinder-quobyte-6fbe9ca5-5510-49d2-83e5-4ace03652638" by "_delete_snapshot" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:17:47 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-d1eb1703-b2e4-4848-944a-e4eefe355db5 tempest-CreateVolumesFromSnapshotTest-2070828459 None] Lock "cinder-quobyte-6fbe9ca5-5510-49d2-83e5-4ace03652638" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:17:47 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-d1eb1703-b2e4-4848-944a-e4eefe355db5 tempest-CreateVolumesFromSnapshotTest-2070828459 None] Deleting offline snapshot 6fbe9ca5-5510-49d2-83e5-4ace03652638 of volume 2fedc8ab-2322-46e4-9d2d-e3cb8b7d6afa {{(pid=87515) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 10:17:47 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-d1eb1703-b2e4-4848-944a-e4eefe355db5 tempest-CreateVolumesFromSnapshotTest-2070828459 None] snapshot_file for this snap is: volume-2fedc8ab-2322-46e4-9d2d-e3cb8b7d6afa.6fbe9ca5-5510-49d2-83e5-4ace03652638 {{(pid=87515) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 10:17:47 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f905248-0ccf-45c6-9540-6f79e230d45f]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:17:47 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-d1eb1703-b2e4-4848-944a-e4eefe355db5 tempest-CreateVolumesFromSnapshotTest-2070828459 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-2fedc8ab-2322-46e4-9d2d-e3cb8b7d6afa.6fbe9ca5-5510-49d2-83e5-4ace03652638 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:17:47 devstack sudo[106669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-2fedc8ab-2322-46e4-9d2d-e3cb8b7d6afa.6fbe9ca5-5510-49d2-83e5-4ace03652638 Sep 07 10:17:47 devstack sudo[106669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:17:47 devstack sudo[106669]: pam_unix(sudo:session): session closed for user root Sep 07 10:17:47 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-d1eb1703-b2e4-4848-944a-e4eefe355db5 tempest-CreateVolumesFromSnapshotTest-2070828459 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-2fedc8ab-2322-46e4-9d2d-e3cb8b7d6afa.6fbe9ca5-5510-49d2-83e5-4ace03652638" returned: 0 in 0.349s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:17:47 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-d1eb1703-b2e4-4848-944a-e4eefe355db5 tempest-CreateVolumesFromSnapshotTest-2070828459 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2fedc8ab-2322-46e4-9d2d-e3cb8b7d6afa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87515) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 10:17:47 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[053f4d8b-b627-4992-8f0b-bc143e38fd6e]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:17:47 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-d1eb1703-b2e4-4848-944a-e4eefe355db5 tempest-CreateVolumesFromSnapshotTest-2070828459 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-2fedc8ab-2322-46e4-9d2d-e3cb8b7d6afa {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:17:47 devstack sudo[106674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-2fedc8ab-2322-46e4-9d2d-e3cb8b7d6afa Sep 07 10:17:47 devstack sudo[106674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:17:48 devstack sudo[106674]: pam_unix(sudo:session): session closed for user root Sep 07 10:17:48 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-d1eb1703-b2e4-4848-944a-e4eefe355db5 tempest-CreateVolumesFromSnapshotTest-2070828459 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-2fedc8ab-2322-46e4-9d2d-e3cb8b7d6afa" returned: 0 in 0.335s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:17:48 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-d1eb1703-b2e4-4848-944a-e4eefe355db5 tempest-CreateVolumesFromSnapshotTest-2070828459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-2fedc8ab-2322-46e4-9d2d-e3cb8b7d6afa.6fbe9ca5-5510-49d2-83e5-4ace03652638 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:17:48 devstack sudo[106679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-2fedc8ab-2322-46e4-9d2d-e3cb8b7d6afa.6fbe9ca5-5510-49d2-83e5-4ace03652638 Sep 07 10:17:48 devstack sudo[106679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:17:48 devstack sudo[106679]: pam_unix(sudo:session): session closed for user root Sep 07 10:17:48 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-d1eb1703-b2e4-4848-944a-e4eefe355db5 tempest-CreateVolumesFromSnapshotTest-2070828459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-2fedc8ab-2322-46e4-9d2d-e3cb8b7d6afa.6fbe9ca5-5510-49d2-83e5-4ace03652638" returned: 0 in 0.323s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:17:48 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-d1eb1703-b2e4-4848-944a-e4eefe355db5 tempest-CreateVolumesFromSnapshotTest-2070828459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-2fedc8ab-2322-46e4-9d2d-e3cb8b7d6afa.6fbe9ca5-5510-49d2-83e5-4ace03652638 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:17:48 devstack sudo[106687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-2fedc8ab-2322-46e4-9d2d-e3cb8b7d6afa.6fbe9ca5-5510-49d2-83e5-4ace03652638 Sep 07 10:17:48 devstack sudo[106687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:17:48 devstack sudo[106687]: pam_unix(sudo:session): session closed for user root Sep 07 10:17:48 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-d1eb1703-b2e4-4848-944a-e4eefe355db5 tempest-CreateVolumesFromSnapshotTest-2070828459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-2fedc8ab-2322-46e4-9d2d-e3cb8b7d6afa.6fbe9ca5-5510-49d2-83e5-4ace03652638" returned: 0 in 0.249s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:17:48 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-d1eb1703-b2e4-4848-944a-e4eefe355db5 tempest-CreateVolumesFromSnapshotTest-2070828459 None] Lock "cinder-quobyte-6fbe9ca5-5510-49d2-83e5-4ace03652638" released by "_delete_snapshot" :: held 1.349s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:17:48 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-d1eb1703-b2e4-4848-944a-e4eefe355db5 tempest-CreateVolumesFromSnapshotTest-2070828459 None] Lock "cinder-quobyte-2fedc8ab-2322-46e4-9d2d-e3cb8b7d6afa" released by "delete_snapshot" :: held 1.371s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:17:48 devstack cinder-volume[87515]: DEBUG cinder.quota [None req-d1eb1703-b2e4-4848-944a-e4eefe355db5 tempest-CreateVolumesFromSnapshotTest-2070828459 None] Created reservations ['8c53d4f1-b7f5-4b8a-b57d-7b9322e623fb', 'f80c4aa2-9c22-423d-80cd-6c11bbf135d3', 'a80fecad-1f65-4f3a-a10d-e6d46eee33f9', 'a3d54c9b-acd8-4426-89b4-af3e64c3db1c'] {{(pid=87515) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:17:48 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-d1eb1703-b2e4-4848-944a-e4eefe355db5 tempest-CreateVolumesFromSnapshotTest-2070828459 None] Delete snapshot completed successfully. Sep 07 10:17:48 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-d1eb1703-b2e4-4848-944a-e4eefe355db5 tempest-CreateVolumesFromSnapshotTest-2070828459 None] Lock "cinder-6fbe9ca5-5510-49d2-83e5-4ace03652638-delete_snapshot" released by "delete_snapshot" :: held 1.497s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:17:49 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-d7ed6eee-e780-4a14-9262-37390bce01a2 tempest-CreateVolumesFromSnapshotTest-2070828459 None] Acquiring lock "cinder-2fedc8ab-2322-46e4-9d2d-e3cb8b7d6afa-delete_volume" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:17:49 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-d7ed6eee-e780-4a14-9262-37390bce01a2 tempest-CreateVolumesFromSnapshotTest-2070828459 None] Lock "cinder-2fedc8ab-2322-46e4-9d2d-e3cb8b7d6afa-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:17:49 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-d7ed6eee-e780-4a14-9262-37390bce01a2 tempest-CreateVolumesFromSnapshotTest-2070828459 None] Acquiring lock "cinder-quobyte-2fedc8ab-2322-46e4-9d2d-e3cb8b7d6afa" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:17:49 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-d7ed6eee-e780-4a14-9262-37390bce01a2 tempest-CreateVolumesFromSnapshotTest-2070828459 None] Lock "cinder-quobyte-2fedc8ab-2322-46e4-9d2d-e3cb8b7d6afa" acquired by "delete_volume" :: waited 0.017s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:17:49 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[904ddaf5-2e91-4c59-9c04-77b3f4bc6d64]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:17:49 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-d7ed6eee-e780-4a14-9262-37390bce01a2 tempest-CreateVolumesFromSnapshotTest-2070828459 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-2fedc8ab-2322-46e4-9d2d-e3cb8b7d6afa {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:17:49 devstack sudo[106691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-2fedc8ab-2322-46e4-9d2d-e3cb8b7d6afa Sep 07 10:17:49 devstack sudo[106691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:17:50 devstack sudo[106691]: pam_unix(sudo:session): session closed for user root Sep 07 10:17:50 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-d7ed6eee-e780-4a14-9262-37390bce01a2 tempest-CreateVolumesFromSnapshotTest-2070828459 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-2fedc8ab-2322-46e4-9d2d-e3cb8b7d6afa" returned: 0 in 0.379s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:17:50 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-d7ed6eee-e780-4a14-9262-37390bce01a2 tempest-CreateVolumesFromSnapshotTest-2070828459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-2fedc8ab-2322-46e4-9d2d-e3cb8b7d6afa {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:17:50 devstack sudo[106696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-2fedc8ab-2322-46e4-9d2d-e3cb8b7d6afa Sep 07 10:17:50 devstack sudo[106696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:17:50 devstack sudo[106696]: pam_unix(sudo:session): session closed for user root Sep 07 10:17:50 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-d7ed6eee-e780-4a14-9262-37390bce01a2 tempest-CreateVolumesFromSnapshotTest-2070828459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-2fedc8ab-2322-46e4-9d2d-e3cb8b7d6afa" returned: 0 in 0.253s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:17:50 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-d7ed6eee-e780-4a14-9262-37390bce01a2 tempest-CreateVolumesFromSnapshotTest-2070828459 None] Lock "cinder-quobyte-2fedc8ab-2322-46e4-9d2d-e3cb8b7d6afa" released by "delete_volume" :: held 0.688s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:17:50 devstack cinder-volume[87515]: DEBUG cinder.quota [None req-d7ed6eee-e780-4a14-9262-37390bce01a2 tempest-CreateVolumesFromSnapshotTest-2070828459 None] Created reservations ['423c710c-a06f-4718-a346-070205f8e985', '5b154a77-30a2-4bf8-9b61-ed3ace8126e8', '62ac7647-d717-4628-88f0-1a3007926349', '7bc96722-f4ef-45f9-8231-8406b8b9914d'] {{(pid=87515) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:17:50 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-d7ed6eee-e780-4a14-9262-37390bce01a2 tempest-CreateVolumesFromSnapshotTest-2070828459 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:17:50 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-d7ed6eee-e780-4a14-9262-37390bce01a2 tempest-CreateVolumesFromSnapshotTest-2070828459 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:17:50 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-d7ed6eee-e780-4a14-9262-37390bce01a2 tempest-CreateVolumesFromSnapshotTest-2070828459 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:17:50 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-d7ed6eee-e780-4a14-9262-37390bce01a2 tempest-CreateVolumesFromSnapshotTest-2070828459 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:17:50 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-d7ed6eee-e780-4a14-9262-37390bce01a2 tempest-CreateVolumesFromSnapshotTest-2070828459 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:17:50 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-d7ed6eee-e780-4a14-9262-37390bce01a2 tempest-CreateVolumesFromSnapshotTest-2070828459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:17:50 devstack sudo[106699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a Sep 07 10:17:50 devstack sudo[106699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:17:50 devstack sudo[106699]: pam_unix(sudo:session): session closed for user root Sep 07 10:17:50 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-d7ed6eee-e780-4a14-9262-37390bce01a2 tempest-CreateVolumesFromSnapshotTest-2070828459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a" returned: 0 in 0.259s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:17:50 devstack cinder-volume[87515]: DEBUG cinder.manager [None req-d7ed6eee-e780-4a14-9262-37390bce01a2 tempest-CreateVolumesFromSnapshotTest-2070828459 None] Notifying Schedulers of capabilities ... {{(pid=87515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:17:50 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-d7ed6eee-e780-4a14-9262-37390bce01a2 tempest-CreateVolumesFromSnapshotTest-2070828459 None] Deleted volume successfully. Sep 07 10:17:50 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-d7ed6eee-e780-4a14-9262-37390bce01a2 tempest-CreateVolumesFromSnapshotTest-2070828459 None] Lock "cinder-2fedc8ab-2322-46e4-9d2d-e3cb8b7d6afa-delete_volume" released by "delete_volume" :: held 1.166s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:18:00 devstack cinder-volume[87515]: DEBUG dbcounter [-] [87515] Writing DB stats cinder:SELECT=94,cinder:INSERT=31,cinder:UPDATE=115,cinder:DELETE=11 {{(pid=87515) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 10:18:00 devstack cinder-volume[87515]: DEBUG dbcounter [-] [87515] Writing DB stats cinder:UPDATE=141,cinder:SELECT=78,cinder:DELETE=12,cinder:INSERT=29 {{(pid=87515) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 10:18:08 devstack cinder-volume[87515]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b0879e3-4617-4b32-8ad4-6246e0d22af1 tempest-CreateVolumesFromSourceVolumeTest-111434518 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 10:18:08 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-1b0879e3-4617-4b32-8ad4-6246e0d22af1 tempest-CreateVolumesFromSourceVolumeTest-111434518 None] Flow 'volume_create_manager' (98bb3c5e-5c53-40d7-828d-9afedd03f36a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:18:08 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-1b0879e3-4617-4b32-8ad4-6246e0d22af1 tempest-CreateVolumesFromSourceVolumeTest-111434518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21930e0a-fe68-4345-96d1-f56bf6c8ce3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:18:08 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-1b0879e3-4617-4b32-8ad4-6246e0d22af1 tempest-CreateVolumesFromSourceVolumeTest-111434518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21930e0a-fe68-4345-96d1-f56bf6c8ce3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:18:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2027543483',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8535c3aa-6d2b-4453-8612-6cd4c058dfeb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1596dfb46b6048a39258b40787d56cb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:18:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:18:09Z,use_quota=True,user_id='ac941fc6439241cfa0cdd521ad8db64c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3a092cd-7947-4cbf-abff-4ba9567becf0),volume_type_id=f3a092cd-7947-4cbf-abff-4ba9567becf0)' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:18:08 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-1b0879e3-4617-4b32-8ad4-6246e0d22af1 tempest-CreateVolumesFromSourceVolumeTest-111434518 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a6592e1-bfa9-48ae-b90e-cd30d3842666) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:18:08 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-1b0879e3-4617-4b32-8ad4-6246e0d22af1 tempest-CreateVolumesFromSourceVolumeTest-111434518 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a6592e1-bfa9-48ae-b90e-cd30d3842666) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:18:08 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-1b0879e3-4617-4b32-8ad4-6246e0d22af1 tempest-CreateVolumesFromSourceVolumeTest-111434518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74075ebb-7d82-4c6b-998f-20b93e98aa5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:18:08 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-1b0879e3-4617-4b32-8ad4-6246e0d22af1 tempest-CreateVolumesFromSourceVolumeTest-111434518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74075ebb-7d82-4c6b-998f-20b93e98aa5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8535c3aa-6d2b-4453-8612-6cd4c058dfeb', 'volume_name': 'volume-8535c3aa-6d2b-4453-8612-6cd4c058dfeb', 'volume_size': 1}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:18:08 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-1b0879e3-4617-4b32-8ad4-6246e0d22af1 tempest-CreateVolumesFromSourceVolumeTest-111434518 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5523242e-09d1-4340-b58d-56fb5f8db4ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:18:08 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-1b0879e3-4617-4b32-8ad4-6246e0d22af1 tempest-CreateVolumesFromSourceVolumeTest-111434518 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5523242e-09d1-4340-b58d-56fb5f8db4ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:18:08 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-1b0879e3-4617-4b32-8ad4-6246e0d22af1 tempest-CreateVolumesFromSourceVolumeTest-111434518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f76a47fe-d86e-4e82-b700-d145ba9e81db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:18:08 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-1b0879e3-4617-4b32-8ad4-6246e0d22af1 tempest-CreateVolumesFromSourceVolumeTest-111434518 None] Volume 8535c3aa-6d2b-4453-8612-6cd4c058dfeb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8535c3aa-6d2b-4453-8612-6cd4c058dfeb', 'volume_size': 1} Sep 07 10:18:08 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-1b0879e3-4617-4b32-8ad4-6246e0d22af1 tempest-CreateVolumesFromSourceVolumeTest-111434518 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:18:08 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-1b0879e3-4617-4b32-8ad4-6246e0d22af1 tempest-CreateVolumesFromSourceVolumeTest-111434518 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:18:08 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-1b0879e3-4617-4b32-8ad4-6246e0d22af1 tempest-CreateVolumesFromSourceVolumeTest-111434518 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:18:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2027543483',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8535c3aa-6d2b-4453-8612-6cd4c058dfeb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1596dfb46b6048a39258b40787d56cb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:18:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:18:09Z,use_quota=True,user_id='ac941fc6439241cfa0cdd521ad8db64c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3a092cd-7947-4cbf-abff-4ba9567becf0),volume_type_id=f3a092cd-7947-4cbf-abff-4ba9567becf0)}" {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 10:18:08 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-1b0879e3-4617-4b32-8ad4-6246e0d22af1 tempest-CreateVolumesFromSourceVolumeTest-111434518 None] Creating volume 8535c3aa-6d2b-4453-8612-6cd4c058dfeb {{(pid=87515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 10:18:08 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-1b0879e3-4617-4b32-8ad4-6246e0d22af1 tempest-CreateVolumesFromSourceVolumeTest-111434518 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:18:08 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-1b0879e3-4617-4b32-8ad4-6246e0d22af1 tempest-CreateVolumesFromSourceVolumeTest-111434518 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:18:08 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-1b0879e3-4617-4b32-8ad4-6246e0d22af1 tempest-CreateVolumesFromSourceVolumeTest-111434518 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:18:08 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-1b0879e3-4617-4b32-8ad4-6246e0d22af1 tempest-CreateVolumesFromSourceVolumeTest-111434518 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:18:08 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-1b0879e3-4617-4b32-8ad4-6246e0d22af1 tempest-CreateVolumesFromSourceVolumeTest-111434518 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:18:08 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-1b0879e3-4617-4b32-8ad4-6246e0d22af1 tempest-CreateVolumesFromSourceVolumeTest-111434518 None] Selected osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c as target Quobyte volume. {{(pid=87515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 10:18:08 devstack cinder-volume[87515]: INFO cinder.volume.drivers.remotefs [None req-1b0879e3-4617-4b32-8ad4-6246e0d22af1 tempest-CreateVolumesFromSourceVolumeTest-111434518 None] casted to osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c Sep 07 10:18:08 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-1b0879e3-4617-4b32-8ad4-6246e0d22af1 tempest-CreateVolumesFromSourceVolumeTest-111434518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-8535c3aa-6d2b-4453-8612-6cd4c058dfeb 1073741824 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:18:08 devstack sudo[106742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-8535c3aa-6d2b-4453-8612-6cd4c058dfeb 1073741824 Sep 07 10:18:08 devstack sudo[106742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:18:08 devstack cinder-volume[87515]: DEBUG cinder.volume.flows.manager.create_volume [None req-e108341e-d72b-426f-9025-5709062d67b6 tempest-CreateVolumesFromImageTest-296560334 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 10:18:08 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-e108341e-d72b-426f-9025-5709062d67b6 tempest-CreateVolumesFromImageTest-296560334 None] Flow 'volume_create_manager' (e947c781-a631-4525-bf45-e132610e9078) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:18:08 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-e108341e-d72b-426f-9025-5709062d67b6 tempest-CreateVolumesFromImageTest-296560334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d84414ca-1234-445e-827d-46612a0426da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:18:09 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-e108341e-d72b-426f-9025-5709062d67b6 tempest-CreateVolumesFromImageTest-296560334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d84414ca-1234-445e-827d-46612a0426da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:18:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1501584160',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e66220a2-f982-4d64-9fe3-21571c7feb4a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5df77aa8fa14034987f73b50b968740',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:18:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:18:09Z,use_quota=True,user_id='611d268ba48f464fa73485c6d7a282ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3a092cd-7947-4cbf-abff-4ba9567becf0),volume_type_id=f3a092cd-7947-4cbf-abff-4ba9567becf0)' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:18:09 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-e108341e-d72b-426f-9025-5709062d67b6 tempest-CreateVolumesFromImageTest-296560334 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c35ad964-b561-4573-904c-9e41f370f49b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:18:09 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-e108341e-d72b-426f-9025-5709062d67b6 tempest-CreateVolumesFromImageTest-296560334 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c35ad964-b561-4573-904c-9e41f370f49b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:18:09 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-e108341e-d72b-426f-9025-5709062d67b6 tempest-CreateVolumesFromImageTest-296560334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (629400e7-cb92-44f9-be78-88567a9486c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:18:09 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-e108341e-d72b-426f-9025-5709062d67b6 tempest-CreateVolumesFromImageTest-296560334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (629400e7-cb92-44f9-be78-88567a9486c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e66220a2-f982-4d64-9fe3-21571c7feb4a', 'volume_name': 'volume-e66220a2-f982-4d64-9fe3-21571c7feb4a', 'volume_size': 1}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:18:09 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-e108341e-d72b-426f-9025-5709062d67b6 tempest-CreateVolumesFromImageTest-296560334 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (313a91b9-60de-4001-a20e-1335d6bc9638) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:18:09 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-e108341e-d72b-426f-9025-5709062d67b6 tempest-CreateVolumesFromImageTest-296560334 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (313a91b9-60de-4001-a20e-1335d6bc9638) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:18:09 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-e108341e-d72b-426f-9025-5709062d67b6 tempest-CreateVolumesFromImageTest-296560334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2367d16-c8d9-44d2-92bf-9a7ae1effdbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:18:09 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-e108341e-d72b-426f-9025-5709062d67b6 tempest-CreateVolumesFromImageTest-296560334 None] Volume e66220a2-f982-4d64-9fe3-21571c7feb4a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e66220a2-f982-4d64-9fe3-21571c7feb4a', 'volume_size': 1} Sep 07 10:18:09 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-e108341e-d72b-426f-9025-5709062d67b6 tempest-CreateVolumesFromImageTest-296560334 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:18:09 devstack cinder-volume[87515]: DEBUG cinder.volume.flows.manager.create_volume [None req-2ac052cc-f521-4afe-9adb-15fa2101aefc tempest-CreateVolumesFromImageTest-296560334 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 10:18:09 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-2ac052cc-f521-4afe-9adb-15fa2101aefc tempest-CreateVolumesFromImageTest-296560334 None] Flow 'volume_create_manager' (337ef62f-4808-4f86-8020-6c0d903642cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:18:09 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-2ac052cc-f521-4afe-9adb-15fa2101aefc tempest-CreateVolumesFromImageTest-296560334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3572b177-28f9-4cde-a9e8-777f77217923) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:18:09 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-2ac052cc-f521-4afe-9adb-15fa2101aefc tempest-CreateVolumesFromImageTest-296560334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3572b177-28f9-4cde-a9e8-777f77217923) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:18:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-574005479',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db9a0c07-2521-46b6-a235-173fd902d92e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5df77aa8fa14034987f73b50b968740',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:18:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:18:09Z,use_quota=True,user_id='611d268ba48f464fa73485c6d7a282ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3a092cd-7947-4cbf-abff-4ba9567becf0),volume_type_id=f3a092cd-7947-4cbf-abff-4ba9567becf0)' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:18:09 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-2ac052cc-f521-4afe-9adb-15fa2101aefc tempest-CreateVolumesFromImageTest-296560334 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57995279-8c51-4be1-a70e-c3dc66225b69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:18:09 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-2ac052cc-f521-4afe-9adb-15fa2101aefc tempest-CreateVolumesFromImageTest-296560334 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57995279-8c51-4be1-a70e-c3dc66225b69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:18:09 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-2ac052cc-f521-4afe-9adb-15fa2101aefc tempest-CreateVolumesFromImageTest-296560334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27aa8dcc-1936-4229-ad5e-810c438e0fa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:18:09 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-2ac052cc-f521-4afe-9adb-15fa2101aefc tempest-CreateVolumesFromImageTest-296560334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27aa8dcc-1936-4229-ad5e-810c438e0fa7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'db9a0c07-2521-46b6-a235-173fd902d92e', 'volume_name': 'volume-db9a0c07-2521-46b6-a235-173fd902d92e', 'volume_size': 1}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:18:09 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-2ac052cc-f521-4afe-9adb-15fa2101aefc tempest-CreateVolumesFromImageTest-296560334 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6dd49aa6-d584-4cf3-8d92-40594118b1df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:18:09 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-2ac052cc-f521-4afe-9adb-15fa2101aefc tempest-CreateVolumesFromImageTest-296560334 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6dd49aa6-d584-4cf3-8d92-40594118b1df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:18:09 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-2ac052cc-f521-4afe-9adb-15fa2101aefc tempest-CreateVolumesFromImageTest-296560334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a5d6e97-8009-4392-b856-0129d3ecb022) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:18:09 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-2ac052cc-f521-4afe-9adb-15fa2101aefc tempest-CreateVolumesFromImageTest-296560334 None] Volume db9a0c07-2521-46b6-a235-173fd902d92e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-db9a0c07-2521-46b6-a235-173fd902d92e', 'volume_size': 1} Sep 07 10:18:09 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-2ac052cc-f521-4afe-9adb-15fa2101aefc tempest-CreateVolumesFromImageTest-296560334 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:18:09 devstack sudo[106742]: pam_unix(sudo:session): session closed for user root Sep 07 10:18:09 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-1b0879e3-4617-4b32-8ad4-6246e0d22af1 tempest-CreateVolumesFromSourceVolumeTest-111434518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-8535c3aa-6d2b-4453-8612-6cd4c058dfeb 1073741824" returned: 0 in 0.699s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:18:09 devstack cinder-volume[87515]: DEBUG cinder.volume.flows.manager.create_volume [None req-53e38b6c-96cb-45fa-a012-5ed52323fcae tempest-VolumeDependencyTests-1280371773 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 10:18:09 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-53e38b6c-96cb-45fa-a012-5ed52323fcae tempest-VolumeDependencyTests-1280371773 None] Flow 'volume_create_manager' (de6d24e2-bf6e-4a42-a755-e636c6df2c46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:18:09 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-53e38b6c-96cb-45fa-a012-5ed52323fcae tempest-VolumeDependencyTests-1280371773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d26f060e-a12c-4b29-bf3e-8168819b7a54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:18:09 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-1b0879e3-4617-4b32-8ad4-6246e0d22af1 tempest-CreateVolumesFromSourceVolumeTest-111434518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-8535c3aa-6d2b-4453-8612-6cd4c058dfeb {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:18:09 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-53e38b6c-96cb-45fa-a012-5ed52323fcae tempest-VolumeDependencyTests-1280371773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d26f060e-a12c-4b29-bf3e-8168819b7a54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:18:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1883725727',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=321e9476-3454-435c-936f-cee61f12d97f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4bcbb3ce234437bb6bf9d32d30a5a64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:18:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:18:10Z,use_quota=True,user_id='3fdd123e3b8c4082a15d5d604aabfc06',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3a092cd-7947-4cbf-abff-4ba9567becf0),volume_type_id=f3a092cd-7947-4cbf-abff-4ba9567becf0)' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:18:09 devstack sudo[106748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-8535c3aa-6d2b-4453-8612-6cd4c058dfeb Sep 07 10:18:09 devstack sudo[106748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:18:09 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-53e38b6c-96cb-45fa-a012-5ed52323fcae tempest-VolumeDependencyTests-1280371773 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5281146c-d93f-49ba-8b5f-1989caab2338) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:18:09 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-53e38b6c-96cb-45fa-a012-5ed52323fcae tempest-VolumeDependencyTests-1280371773 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5281146c-d93f-49ba-8b5f-1989caab2338) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:18:09 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-53e38b6c-96cb-45fa-a012-5ed52323fcae tempest-VolumeDependencyTests-1280371773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9608a870-48aa-4a98-adde-9b692bdb800f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:18:09 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-53e38b6c-96cb-45fa-a012-5ed52323fcae tempest-VolumeDependencyTests-1280371773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9608a870-48aa-4a98-adde-9b692bdb800f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '321e9476-3454-435c-936f-cee61f12d97f', 'volume_name': 'volume-321e9476-3454-435c-936f-cee61f12d97f', 'volume_size': 1}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:18:09 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-53e38b6c-96cb-45fa-a012-5ed52323fcae tempest-VolumeDependencyTests-1280371773 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fdc9a1f2-7ee9-44be-ab44-cb44801adaf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:18:09 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-53e38b6c-96cb-45fa-a012-5ed52323fcae tempest-VolumeDependencyTests-1280371773 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fdc9a1f2-7ee9-44be-ab44-cb44801adaf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:18:09 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-53e38b6c-96cb-45fa-a012-5ed52323fcae tempest-VolumeDependencyTests-1280371773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (495a9494-cbc6-4278-b97d-32ab96f37b9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:18:09 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-53e38b6c-96cb-45fa-a012-5ed52323fcae tempest-VolumeDependencyTests-1280371773 None] Volume 321e9476-3454-435c-936f-cee61f12d97f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-321e9476-3454-435c-936f-cee61f12d97f', 'volume_size': 1} Sep 07 10:18:09 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-53e38b6c-96cb-45fa-a012-5ed52323fcae tempest-VolumeDependencyTests-1280371773 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:18:10 devstack sudo[106748]: pam_unix(sudo:session): session closed for user root Sep 07 10:18:10 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-1b0879e3-4617-4b32-8ad4-6246e0d22af1 tempest-CreateVolumesFromSourceVolumeTest-111434518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-8535c3aa-6d2b-4453-8612-6cd4c058dfeb" returned: 0 in 0.323s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:18:10 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-1b0879e3-4617-4b32-8ad4-6246e0d22af1 tempest-CreateVolumesFromSourceVolumeTest-111434518 None] <== create_volume: return (1135ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'} {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 10:18:10 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-1b0879e3-4617-4b32-8ad4-6246e0d22af1 tempest-CreateVolumesFromSourceVolumeTest-111434518 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.139s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:18:10 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-e108341e-d72b-426f-9025-5709062d67b6 tempest-CreateVolumesFromImageTest-296560334 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.923s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:18:10 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-e108341e-d72b-426f-9025-5709062d67b6 tempest-CreateVolumesFromImageTest-296560334 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:18:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1501584160',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e66220a2-f982-4d64-9fe3-21571c7feb4a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5df77aa8fa14034987f73b50b968740',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:18:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:18:09Z,use_quota=True,user_id='611d268ba48f464fa73485c6d7a282ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3a092cd-7947-4cbf-abff-4ba9567becf0),volume_type_id=f3a092cd-7947-4cbf-abff-4ba9567becf0)}" {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 10:18:10 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-e108341e-d72b-426f-9025-5709062d67b6 tempest-CreateVolumesFromImageTest-296560334 None] Creating volume e66220a2-f982-4d64-9fe3-21571c7feb4a {{(pid=87515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 10:18:10 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-e108341e-d72b-426f-9025-5709062d67b6 tempest-CreateVolumesFromImageTest-296560334 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:18:10 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-e108341e-d72b-426f-9025-5709062d67b6 tempest-CreateVolumesFromImageTest-296560334 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:18:10 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-e108341e-d72b-426f-9025-5709062d67b6 tempest-CreateVolumesFromImageTest-296560334 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:18:10 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-e108341e-d72b-426f-9025-5709062d67b6 tempest-CreateVolumesFromImageTest-296560334 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:18:10 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-e108341e-d72b-426f-9025-5709062d67b6 tempest-CreateVolumesFromImageTest-296560334 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:18:10 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-e108341e-d72b-426f-9025-5709062d67b6 tempest-CreateVolumesFromImageTest-296560334 None] Selected osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c as target Quobyte volume. {{(pid=87515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 10:18:10 devstack cinder-volume[87515]: INFO cinder.volume.drivers.remotefs [None req-e108341e-d72b-426f-9025-5709062d67b6 tempest-CreateVolumesFromImageTest-296560334 None] casted to osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c Sep 07 10:18:10 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-e108341e-d72b-426f-9025-5709062d67b6 tempest-CreateVolumesFromImageTest-296560334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-e66220a2-f982-4d64-9fe3-21571c7feb4a 1073741824 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:18:10 devstack sudo[106751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-e66220a2-f982-4d64-9fe3-21571c7feb4a 1073741824 Sep 07 10:18:10 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-1b0879e3-4617-4b32-8ad4-6246e0d22af1 tempest-CreateVolumesFromSourceVolumeTest-111434518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f76a47fe-d86e-4e82-b700-d145ba9e81db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8535c3aa-6d2b-4453-8612-6cd4c058dfeb', 'volume_size': 1}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:18:10 devstack sudo[106751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:18:10 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-1b0879e3-4617-4b32-8ad4-6246e0d22af1 tempest-CreateVolumesFromSourceVolumeTest-111434518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51bf3de7-8014-40cb-bace-0de719563793) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:18:10 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-1b0879e3-4617-4b32-8ad4-6246e0d22af1 tempest-CreateVolumesFromSourceVolumeTest-111434518 None] Volume volume-8535c3aa-6d2b-4453-8612-6cd4c058dfeb (8535c3aa-6d2b-4453-8612-6cd4c058dfeb): created successfully Sep 07 10:18:10 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-1b0879e3-4617-4b32-8ad4-6246e0d22af1 tempest-CreateVolumesFromSourceVolumeTest-111434518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51bf3de7-8014-40cb-bace-0de719563793) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:18:10 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-1b0879e3-4617-4b32-8ad4-6246e0d22af1 tempest-CreateVolumesFromSourceVolumeTest-111434518 None] Flow 'volume_create_manager' (98bb3c5e-5c53-40d7-828d-9afedd03f36a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:18:10 devstack cinder-volume[87515]: DEBUG cinder.volume.flows.manager.create_volume [None req-b91b0fb9-61f8-4c58-bbb0-f6207888195e tempest-CreateVolumesFromImageTest-296560334 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 10:18:10 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-b91b0fb9-61f8-4c58-bbb0-f6207888195e tempest-CreateVolumesFromImageTest-296560334 None] Flow 'volume_create_manager' (c42ce6b1-2d4d-49b9-8fdd-c5cc52d38408) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:18:10 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-b91b0fb9-61f8-4c58-bbb0-f6207888195e tempest-CreateVolumesFromImageTest-296560334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52a7eaf9-ebd7-4b38-8f94-63ed64015267) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:18:10 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-b91b0fb9-61f8-4c58-bbb0-f6207888195e tempest-CreateVolumesFromImageTest-296560334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52a7eaf9-ebd7-4b38-8f94-63ed64015267) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:18:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1010291655',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97e279ce-e959-47a0-8fe0-68a04ffa0c7a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5df77aa8fa14034987f73b50b968740',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:18:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:18:10Z,use_quota=True,user_id='611d268ba48f464fa73485c6d7a282ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3a092cd-7947-4cbf-abff-4ba9567becf0),volume_type_id=f3a092cd-7947-4cbf-abff-4ba9567becf0)' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:18:10 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-b91b0fb9-61f8-4c58-bbb0-f6207888195e tempest-CreateVolumesFromImageTest-296560334 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e64f015-cab6-4556-afde-ed658c911e7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:18:10 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-b91b0fb9-61f8-4c58-bbb0-f6207888195e tempest-CreateVolumesFromImageTest-296560334 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e64f015-cab6-4556-afde-ed658c911e7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:18:10 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-b91b0fb9-61f8-4c58-bbb0-f6207888195e tempest-CreateVolumesFromImageTest-296560334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e3a3549-f14b-405b-b744-cbe8c7a37e32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:18:10 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-b91b0fb9-61f8-4c58-bbb0-f6207888195e tempest-CreateVolumesFromImageTest-296560334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e3a3549-f14b-405b-b744-cbe8c7a37e32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '97e279ce-e959-47a0-8fe0-68a04ffa0c7a', 'volume_name': 'volume-97e279ce-e959-47a0-8fe0-68a04ffa0c7a', 'volume_size': 1}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:18:10 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-b91b0fb9-61f8-4c58-bbb0-f6207888195e tempest-CreateVolumesFromImageTest-296560334 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3dc07ca-adff-4047-9b12-e1fecb50f5f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:18:10 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-b91b0fb9-61f8-4c58-bbb0-f6207888195e tempest-CreateVolumesFromImageTest-296560334 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3dc07ca-adff-4047-9b12-e1fecb50f5f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:18:10 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-b91b0fb9-61f8-4c58-bbb0-f6207888195e tempest-CreateVolumesFromImageTest-296560334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2569da29-d9bf-45ca-9c4d-dd9dbae7d94a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:18:10 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-b91b0fb9-61f8-4c58-bbb0-f6207888195e tempest-CreateVolumesFromImageTest-296560334 None] Volume 97e279ce-e959-47a0-8fe0-68a04ffa0c7a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-97e279ce-e959-47a0-8fe0-68a04ffa0c7a', 'volume_size': 1} Sep 07 10:18:10 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-b91b0fb9-61f8-4c58-bbb0-f6207888195e tempest-CreateVolumesFromImageTest-296560334 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:18:10 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-1b0879e3-4617-4b32-8ad4-6246e0d22af1 tempest-CreateVolumesFromSourceVolumeTest-111434518 None] Created volume successfully. Sep 07 10:18:10 devstack cinder-volume[87515]: DEBUG cinder.volume.flows.manager.create_volume [None req-4afc300e-0a69-42b8-b7c1-b0f268d4e017 tempest-CreateVolumesFromImageTest-296560334 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 10:18:10 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-4afc300e-0a69-42b8-b7c1-b0f268d4e017 tempest-CreateVolumesFromImageTest-296560334 None] Flow 'volume_create_manager' (3e644550-d4a2-44e7-931a-025918472e0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:18:10 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-4afc300e-0a69-42b8-b7c1-b0f268d4e017 tempest-CreateVolumesFromImageTest-296560334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37705464-6366-4e5b-b704-184615ef0957) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:18:10 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-4afc300e-0a69-42b8-b7c1-b0f268d4e017 tempest-CreateVolumesFromImageTest-296560334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37705464-6366-4e5b-b704-184615ef0957) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:18:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1293772909',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e95ffa7a-6c32-41ea-a834-364d2b65530b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5df77aa8fa14034987f73b50b968740',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:18:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:18:10Z,use_quota=True,user_id='611d268ba48f464fa73485c6d7a282ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3a092cd-7947-4cbf-abff-4ba9567becf0),volume_type_id=f3a092cd-7947-4cbf-abff-4ba9567becf0)' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:18:10 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-4afc300e-0a69-42b8-b7c1-b0f268d4e017 tempest-CreateVolumesFromImageTest-296560334 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (272382ec-95fb-4dd0-97db-8bb6a2682c18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:18:10 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-4afc300e-0a69-42b8-b7c1-b0f268d4e017 tempest-CreateVolumesFromImageTest-296560334 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (272382ec-95fb-4dd0-97db-8bb6a2682c18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:18:10 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-4afc300e-0a69-42b8-b7c1-b0f268d4e017 tempest-CreateVolumesFromImageTest-296560334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0357555d-7186-432e-9cf2-caaaed3c0771) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:18:10 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-4afc300e-0a69-42b8-b7c1-b0f268d4e017 tempest-CreateVolumesFromImageTest-296560334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0357555d-7186-432e-9cf2-caaaed3c0771) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e95ffa7a-6c32-41ea-a834-364d2b65530b', 'volume_name': 'volume-e95ffa7a-6c32-41ea-a834-364d2b65530b', 'volume_size': 1}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:18:10 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-4afc300e-0a69-42b8-b7c1-b0f268d4e017 tempest-CreateVolumesFromImageTest-296560334 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4a33652-6e30-4e9c-a1b1-9b6a114db528) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:18:10 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-4afc300e-0a69-42b8-b7c1-b0f268d4e017 tempest-CreateVolumesFromImageTest-296560334 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4a33652-6e30-4e9c-a1b1-9b6a114db528) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:18:10 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-4afc300e-0a69-42b8-b7c1-b0f268d4e017 tempest-CreateVolumesFromImageTest-296560334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a980fe3-b12d-4ec3-ac95-d181309801bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:18:10 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-4afc300e-0a69-42b8-b7c1-b0f268d4e017 tempest-CreateVolumesFromImageTest-296560334 None] Volume e95ffa7a-6c32-41ea-a834-364d2b65530b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e95ffa7a-6c32-41ea-a834-364d2b65530b', 'volume_size': 1} Sep 07 10:18:10 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-4afc300e-0a69-42b8-b7c1-b0f268d4e017 tempest-CreateVolumesFromImageTest-296560334 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:18:10 devstack sudo[106751]: pam_unix(sudo:session): session closed for user root Sep 07 10:18:10 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-e108341e-d72b-426f-9025-5709062d67b6 tempest-CreateVolumesFromImageTest-296560334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-e66220a2-f982-4d64-9fe3-21571c7feb4a 1073741824" returned: 0 in 0.731s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:18:10 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-e108341e-d72b-426f-9025-5709062d67b6 tempest-CreateVolumesFromImageTest-296560334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-e66220a2-f982-4d64-9fe3-21571c7feb4a {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:18:10 devstack sudo[106757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-e66220a2-f982-4d64-9fe3-21571c7feb4a Sep 07 10:18:10 devstack sudo[106757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:18:11 devstack cinder-volume[87515]: DEBUG cinder.volume.flows.manager.create_volume [None req-2d4c042d-e4e0-430f-80fb-24d8e5169173 tempest-CreateVolumesFromImageTest-296560334 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 10:18:11 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-2d4c042d-e4e0-430f-80fb-24d8e5169173 tempest-CreateVolumesFromImageTest-296560334 None] Flow 'volume_create_manager' (5302d89e-7132-4b42-93e1-d952705f83ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:18:11 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-2d4c042d-e4e0-430f-80fb-24d8e5169173 tempest-CreateVolumesFromImageTest-296560334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6f35fd1-ed21-4bb7-82f9-38432c2df8b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:18:11 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-2d4c042d-e4e0-430f-80fb-24d8e5169173 tempest-CreateVolumesFromImageTest-296560334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6f35fd1-ed21-4bb7-82f9-38432c2df8b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:18:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-557281934',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d379b4d-778c-418e-818e-ac0038e7d769,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5df77aa8fa14034987f73b50b968740',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:18:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:18:11Z,use_quota=True,user_id='611d268ba48f464fa73485c6d7a282ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3a092cd-7947-4cbf-abff-4ba9567becf0),volume_type_id=f3a092cd-7947-4cbf-abff-4ba9567becf0)' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:18:11 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-2d4c042d-e4e0-430f-80fb-24d8e5169173 tempest-CreateVolumesFromImageTest-296560334 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b19737e5-a576-4c4c-bc5f-6a4ff29b2af0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:18:11 devstack sudo[106757]: pam_unix(sudo:session): session closed for user root Sep 07 10:18:11 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-2d4c042d-e4e0-430f-80fb-24d8e5169173 tempest-CreateVolumesFromImageTest-296560334 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b19737e5-a576-4c4c-bc5f-6a4ff29b2af0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:18:11 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-2d4c042d-e4e0-430f-80fb-24d8e5169173 tempest-CreateVolumesFromImageTest-296560334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57e4bd14-5029-4a54-bea3-a15dc6c45674) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:18:11 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-2d4c042d-e4e0-430f-80fb-24d8e5169173 tempest-CreateVolumesFromImageTest-296560334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57e4bd14-5029-4a54-bea3-a15dc6c45674) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0d379b4d-778c-418e-818e-ac0038e7d769', 'volume_name': 'volume-0d379b4d-778c-418e-818e-ac0038e7d769', 'volume_size': 1}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:18:11 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-2d4c042d-e4e0-430f-80fb-24d8e5169173 tempest-CreateVolumesFromImageTest-296560334 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75301312-1029-4596-8a1c-6cb613f806fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:18:11 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-2d4c042d-e4e0-430f-80fb-24d8e5169173 tempest-CreateVolumesFromImageTest-296560334 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75301312-1029-4596-8a1c-6cb613f806fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:18:11 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-2d4c042d-e4e0-430f-80fb-24d8e5169173 tempest-CreateVolumesFromImageTest-296560334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (539d2e12-85de-4bee-835c-fd22bf2c0192) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:18:11 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-2d4c042d-e4e0-430f-80fb-24d8e5169173 tempest-CreateVolumesFromImageTest-296560334 None] Volume 0d379b4d-778c-418e-818e-ac0038e7d769: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0d379b4d-778c-418e-818e-ac0038e7d769', 'volume_size': 1} Sep 07 10:18:11 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-2d4c042d-e4e0-430f-80fb-24d8e5169173 tempest-CreateVolumesFromImageTest-296560334 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:18:11 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-e108341e-d72b-426f-9025-5709062d67b6 tempest-CreateVolumesFromImageTest-296560334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-e66220a2-f982-4d64-9fe3-21571c7feb4a" returned: 0 in 0.334s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:18:11 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-e108341e-d72b-426f-9025-5709062d67b6 tempest-CreateVolumesFromImageTest-296560334 None] <== create_volume: return (1112ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'} {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 10:18:11 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-e108341e-d72b-426f-9025-5709062d67b6 tempest-CreateVolumesFromImageTest-296560334 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.114s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:18:11 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-2ac052cc-f521-4afe-9adb-15fa2101aefc tempest-CreateVolumesFromImageTest-296560334 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.582s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:18:11 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-2ac052cc-f521-4afe-9adb-15fa2101aefc tempest-CreateVolumesFromImageTest-296560334 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:18:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-574005479',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db9a0c07-2521-46b6-a235-173fd902d92e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5df77aa8fa14034987f73b50b968740',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:18:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:18:09Z,use_quota=True,user_id='611d268ba48f464fa73485c6d7a282ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3a092cd-7947-4cbf-abff-4ba9567becf0),volume_type_id=f3a092cd-7947-4cbf-abff-4ba9567becf0)}" {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 10:18:11 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-2ac052cc-f521-4afe-9adb-15fa2101aefc tempest-CreateVolumesFromImageTest-296560334 None] Creating volume db9a0c07-2521-46b6-a235-173fd902d92e {{(pid=87515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 10:18:11 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-2ac052cc-f521-4afe-9adb-15fa2101aefc tempest-CreateVolumesFromImageTest-296560334 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:18:11 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-2ac052cc-f521-4afe-9adb-15fa2101aefc tempest-CreateVolumesFromImageTest-296560334 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:18:11 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-2ac052cc-f521-4afe-9adb-15fa2101aefc tempest-CreateVolumesFromImageTest-296560334 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:18:11 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-2ac052cc-f521-4afe-9adb-15fa2101aefc tempest-CreateVolumesFromImageTest-296560334 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:18:11 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-2ac052cc-f521-4afe-9adb-15fa2101aefc tempest-CreateVolumesFromImageTest-296560334 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:18:11 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-2ac052cc-f521-4afe-9adb-15fa2101aefc tempest-CreateVolumesFromImageTest-296560334 None] Selected osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c as target Quobyte volume. {{(pid=87515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 10:18:11 devstack cinder-volume[87515]: INFO cinder.volume.drivers.remotefs [None req-2ac052cc-f521-4afe-9adb-15fa2101aefc tempest-CreateVolumesFromImageTest-296560334 None] casted to osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c Sep 07 10:18:11 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-2ac052cc-f521-4afe-9adb-15fa2101aefc tempest-CreateVolumesFromImageTest-296560334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-db9a0c07-2521-46b6-a235-173fd902d92e 1073741824 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:18:11 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-e108341e-d72b-426f-9025-5709062d67b6 tempest-CreateVolumesFromImageTest-296560334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2367d16-c8d9-44d2-92bf-9a7ae1effdbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e66220a2-f982-4d64-9fe3-21571c7feb4a', 'volume_size': 1}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:18:11 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-e108341e-d72b-426f-9025-5709062d67b6 tempest-CreateVolumesFromImageTest-296560334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e65f39d-4b7c-4ad9-8aa6-d98ad946db71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:18:11 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-e108341e-d72b-426f-9025-5709062d67b6 tempest-CreateVolumesFromImageTest-296560334 None] Volume volume-e66220a2-f982-4d64-9fe3-21571c7feb4a (e66220a2-f982-4d64-9fe3-21571c7feb4a): created successfully Sep 07 10:18:11 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-e108341e-d72b-426f-9025-5709062d67b6 tempest-CreateVolumesFromImageTest-296560334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e65f39d-4b7c-4ad9-8aa6-d98ad946db71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:18:11 devstack sudo[106760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-db9a0c07-2521-46b6-a235-173fd902d92e 1073741824 Sep 07 10:18:11 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-e108341e-d72b-426f-9025-5709062d67b6 tempest-CreateVolumesFromImageTest-296560334 None] Flow 'volume_create_manager' (e947c781-a631-4525-bf45-e132610e9078) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:18:11 devstack sudo[106760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:18:11 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-e108341e-d72b-426f-9025-5709062d67b6 tempest-CreateVolumesFromImageTest-296560334 None] Created volume successfully. Sep 07 10:18:11 devstack cinder-volume[87515]: DEBUG cinder.volume.flows.manager.create_volume [None req-430011be-2e43-414b-afe2-39e636f04469 tempest-CreateVolumesFromSourceVolumeTest-111434518 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 10:18:11 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-430011be-2e43-414b-afe2-39e636f04469 tempest-CreateVolumesFromSourceVolumeTest-111434518 None] Flow 'volume_create_manager' (24407c71-d5ca-4156-a2f9-bc2d28c12ad6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:18:11 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-430011be-2e43-414b-afe2-39e636f04469 tempest-CreateVolumesFromSourceVolumeTest-111434518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2cce5ccd-d951-4d52-93ae-0b6ce737d70e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:18:11 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-430011be-2e43-414b-afe2-39e636f04469 tempest-CreateVolumesFromSourceVolumeTest-111434518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2cce5ccd-d951-4d52-93ae-0b6ce737d70e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:18:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-998553200',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f219527b-edf2-4045-a6f9-965e0945b744,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1596dfb46b6048a39258b40787d56cb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:18:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:18:11Z,use_quota=True,user_id='ac941fc6439241cfa0cdd521ad8db64c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3a092cd-7947-4cbf-abff-4ba9567becf0),volume_type_id=f3a092cd-7947-4cbf-abff-4ba9567becf0)' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:18:11 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-430011be-2e43-414b-afe2-39e636f04469 tempest-CreateVolumesFromSourceVolumeTest-111434518 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb93cd14-545c-4532-8bae-dee03afcf986) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:18:11 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-430011be-2e43-414b-afe2-39e636f04469 tempest-CreateVolumesFromSourceVolumeTest-111434518 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb93cd14-545c-4532-8bae-dee03afcf986) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:18:11 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-430011be-2e43-414b-afe2-39e636f04469 tempest-CreateVolumesFromSourceVolumeTest-111434518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfb915d0-ab59-4551-b3ee-c33362edaeaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:18:11 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-430011be-2e43-414b-afe2-39e636f04469 tempest-CreateVolumesFromSourceVolumeTest-111434518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfb915d0-ab59-4551-b3ee-c33362edaeaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f219527b-edf2-4045-a6f9-965e0945b744', 'volume_name': 'volume-f219527b-edf2-4045-a6f9-965e0945b744', 'volume_size': 1}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:18:11 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-430011be-2e43-414b-afe2-39e636f04469 tempest-CreateVolumesFromSourceVolumeTest-111434518 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77106d1c-eb0d-4b5f-9a0b-9a794632b059) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:18:11 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-430011be-2e43-414b-afe2-39e636f04469 tempest-CreateVolumesFromSourceVolumeTest-111434518 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77106d1c-eb0d-4b5f-9a0b-9a794632b059) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:18:11 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-430011be-2e43-414b-afe2-39e636f04469 tempest-CreateVolumesFromSourceVolumeTest-111434518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b029275b-fd88-48e4-b4b5-2a75eab75206) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:18:11 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-430011be-2e43-414b-afe2-39e636f04469 tempest-CreateVolumesFromSourceVolumeTest-111434518 None] Volume f219527b-edf2-4045-a6f9-965e0945b744: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f219527b-edf2-4045-a6f9-965e0945b744', 'volume_size': 1} Sep 07 10:18:11 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-430011be-2e43-414b-afe2-39e636f04469 tempest-CreateVolumesFromSourceVolumeTest-111434518 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:18:11 devstack cinder-volume[87515]: DEBUG oslo_service.periodic_task [None req-cebd6a9d-3073-42a1-b65a-b38d444d85ed None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87515) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 10:18:11 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-cebd6a9d-3073-42a1-b65a-b38d444d85ed None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:18:11 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-cebd6a9d-3073-42a1-b65a-b38d444d85ed None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:18:11 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-cebd6a9d-3073-42a1-b65a-b38d444d85ed None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:18:11 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-cebd6a9d-3073-42a1-b65a-b38d444d85ed None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:18:11 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-cebd6a9d-3073-42a1-b65a-b38d444d85ed None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:18:11 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-cebd6a9d-3073-42a1-b65a-b38d444d85ed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:18:11 devstack sudo[106765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a Sep 07 10:18:11 devstack sudo[106765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:18:11 devstack cinder-volume[87515]: DEBUG cinder.volume.flows.manager.create_volume [None req-fd755aea-7678-44be-b809-d3eed84df4c4 tempest-CreateVolumesFromSourceVolumeTest-111434518 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 10:18:11 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-fd755aea-7678-44be-b809-d3eed84df4c4 tempest-CreateVolumesFromSourceVolumeTest-111434518 None] Flow 'volume_create_manager' (4dd21797-e432-49d4-8c7b-50cb3daf0c32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:18:11 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-fd755aea-7678-44be-b809-d3eed84df4c4 tempest-CreateVolumesFromSourceVolumeTest-111434518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7771072-e06f-40f1-8c89-4d94fb00574a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:18:11 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-fd755aea-7678-44be-b809-d3eed84df4c4 tempest-CreateVolumesFromSourceVolumeTest-111434518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7771072-e06f-40f1-8c89-4d94fb00574a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:18:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2144492674',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97f301d2-1c54-4d95-89e1-49e7e7991bc3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1596dfb46b6048a39258b40787d56cb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:18:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:18:12Z,use_quota=True,user_id='ac941fc6439241cfa0cdd521ad8db64c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3a092cd-7947-4cbf-abff-4ba9567becf0),volume_type_id=f3a092cd-7947-4cbf-abff-4ba9567becf0)' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:18:11 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-fd755aea-7678-44be-b809-d3eed84df4c4 tempest-CreateVolumesFromSourceVolumeTest-111434518 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00d79d5c-a4b7-41be-8380-c7693b4326ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:18:11 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-fd755aea-7678-44be-b809-d3eed84df4c4 tempest-CreateVolumesFromSourceVolumeTest-111434518 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00d79d5c-a4b7-41be-8380-c7693b4326ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:18:11 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-fd755aea-7678-44be-b809-d3eed84df4c4 tempest-CreateVolumesFromSourceVolumeTest-111434518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73aefb99-44a1-41f8-8eeb-cd9a852a8807) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:18:11 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-fd755aea-7678-44be-b809-d3eed84df4c4 tempest-CreateVolumesFromSourceVolumeTest-111434518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73aefb99-44a1-41f8-8eeb-cd9a852a8807) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '97f301d2-1c54-4d95-89e1-49e7e7991bc3', 'volume_name': 'volume-97f301d2-1c54-4d95-89e1-49e7e7991bc3', 'volume_size': 1}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:18:11 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-fd755aea-7678-44be-b809-d3eed84df4c4 tempest-CreateVolumesFromSourceVolumeTest-111434518 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03127a00-6d25-4f08-a59b-3385f638613f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:18:11 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-fd755aea-7678-44be-b809-d3eed84df4c4 tempest-CreateVolumesFromSourceVolumeTest-111434518 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03127a00-6d25-4f08-a59b-3385f638613f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:18:11 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-fd755aea-7678-44be-b809-d3eed84df4c4 tempest-CreateVolumesFromSourceVolumeTest-111434518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0bf49f2e-2ad7-435f-8bff-a1355f08f21c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:18:11 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-fd755aea-7678-44be-b809-d3eed84df4c4 tempest-CreateVolumesFromSourceVolumeTest-111434518 None] Volume 97f301d2-1c54-4d95-89e1-49e7e7991bc3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-97f301d2-1c54-4d95-89e1-49e7e7991bc3', 'volume_size': 1} Sep 07 10:18:11 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-fd755aea-7678-44be-b809-d3eed84df4c4 tempest-CreateVolumesFromSourceVolumeTest-111434518 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:18:11 devstack sudo[106760]: pam_unix(sudo:session): session closed for user root Sep 07 10:18:11 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-2ac052cc-f521-4afe-9adb-15fa2101aefc tempest-CreateVolumesFromImageTest-296560334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-db9a0c07-2521-46b6-a235-173fd902d92e 1073741824" returned: 0 in 0.791s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:18:11 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-2ac052cc-f521-4afe-9adb-15fa2101aefc tempest-CreateVolumesFromImageTest-296560334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-db9a0c07-2521-46b6-a235-173fd902d92e {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:18:12 devstack sudo[106765]: pam_unix(sudo:session): session closed for user root Sep 07 10:18:12 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-cebd6a9d-3073-42a1-b65a-b38d444d85ed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a" returned: 0 in 0.448s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:18:12 devstack cinder-volume[87515]: DEBUG cinder.manager [None req-cebd6a9d-3073-42a1-b65a-b38d444d85ed None None] Notifying Schedulers of capabilities ... {{(pid=87515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:18:12 devstack sudo[106768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-db9a0c07-2521-46b6-a235-173fd902d92e Sep 07 10:18:12 devstack cinder-volume[87515]: DEBUG oslo_service.periodic_task [None req-cebd6a9d-3073-42a1-b65a-b38d444d85ed None None] Running periodic task VolumeManager._thread_info {{(pid=87515) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 10:18:12 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-cebd6a9d-3073-42a1-b65a-b38d444d85ed None None] thread count: 29 {{(pid=87515) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 07 10:18:12 devstack sudo[106768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:18:12 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-cebd6a9d-3073-42a1-b65a-b38d444d85ed None None] thread info: [<_MainThread(MainThread, started 131647121809536)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87515) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 07 10:18:12 devstack sudo[106768]: pam_unix(sudo:session): session closed for user root Sep 07 10:18:12 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-2ac052cc-f521-4afe-9adb-15fa2101aefc tempest-CreateVolumesFromImageTest-296560334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-db9a0c07-2521-46b6-a235-173fd902d92e" returned: 0 in 0.356s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:18:12 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-2ac052cc-f521-4afe-9adb-15fa2101aefc tempest-CreateVolumesFromImageTest-296560334 None] <== create_volume: return (1195ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'} {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 10:18:12 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-2ac052cc-f521-4afe-9adb-15fa2101aefc tempest-CreateVolumesFromImageTest-296560334 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.198s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:18:12 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-53e38b6c-96cb-45fa-a012-5ed52323fcae tempest-VolumeDependencyTests-1280371773 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.575s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:18:12 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-53e38b6c-96cb-45fa-a012-5ed52323fcae tempest-VolumeDependencyTests-1280371773 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:18:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1883725727',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=321e9476-3454-435c-936f-cee61f12d97f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4bcbb3ce234437bb6bf9d32d30a5a64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:18:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:18:10Z,use_quota=True,user_id='3fdd123e3b8c4082a15d5d604aabfc06',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3a092cd-7947-4cbf-abff-4ba9567becf0),volume_type_id=f3a092cd-7947-4cbf-abff-4ba9567becf0)}" {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 10:18:12 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-53e38b6c-96cb-45fa-a012-5ed52323fcae tempest-VolumeDependencyTests-1280371773 None] Creating volume 321e9476-3454-435c-936f-cee61f12d97f {{(pid=87515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 10:18:12 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-53e38b6c-96cb-45fa-a012-5ed52323fcae tempest-VolumeDependencyTests-1280371773 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:18:12 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-53e38b6c-96cb-45fa-a012-5ed52323fcae tempest-VolumeDependencyTests-1280371773 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:18:12 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-53e38b6c-96cb-45fa-a012-5ed52323fcae tempest-VolumeDependencyTests-1280371773 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:18:12 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-53e38b6c-96cb-45fa-a012-5ed52323fcae tempest-VolumeDependencyTests-1280371773 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:18:12 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-53e38b6c-96cb-45fa-a012-5ed52323fcae tempest-VolumeDependencyTests-1280371773 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:18:12 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-53e38b6c-96cb-45fa-a012-5ed52323fcae tempest-VolumeDependencyTests-1280371773 None] Selected osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c as target Quobyte volume. {{(pid=87515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 10:18:12 devstack cinder-volume[87515]: INFO cinder.volume.drivers.remotefs [None req-53e38b6c-96cb-45fa-a012-5ed52323fcae tempest-VolumeDependencyTests-1280371773 None] casted to osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c Sep 07 10:18:12 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-53e38b6c-96cb-45fa-a012-5ed52323fcae tempest-VolumeDependencyTests-1280371773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-321e9476-3454-435c-936f-cee61f12d97f 1073741824 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:18:12 devstack cinder-volume[87515]: DEBUG cinder.volume.flows.manager.create_volume [None req-210704b7-0df2-4e88-8c50-c81c72426451 tempest-CreateVolumesFromSourceVolumeTest-111434518 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 10:18:12 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-210704b7-0df2-4e88-8c50-c81c72426451 tempest-CreateVolumesFromSourceVolumeTest-111434518 None] Flow 'volume_create_manager' (1ed68b3c-da47-4110-8aca-f597310eeae3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:18:12 devstack sudo[106771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-321e9476-3454-435c-936f-cee61f12d97f 1073741824 Sep 07 10:18:12 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-210704b7-0df2-4e88-8c50-c81c72426451 tempest-CreateVolumesFromSourceVolumeTest-111434518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48c5fb2e-7e70-4fb3-b5d7-8b16ec3606a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:18:12 devstack sudo[106771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:18:12 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-2ac052cc-f521-4afe-9adb-15fa2101aefc tempest-CreateVolumesFromImageTest-296560334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a5d6e97-8009-4392-b856-0129d3ecb022) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-db9a0c07-2521-46b6-a235-173fd902d92e', 'volume_size': 1}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:18:12 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-2ac052cc-f521-4afe-9adb-15fa2101aefc tempest-CreateVolumesFromImageTest-296560334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb4fce06-4cdf-40b7-8b6e-5a39884cf3d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:18:12 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-210704b7-0df2-4e88-8c50-c81c72426451 tempest-CreateVolumesFromSourceVolumeTest-111434518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48c5fb2e-7e70-4fb3-b5d7-8b16ec3606a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:18:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-129303713',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38b2b2b1-7d42-4c03-8bfb-af8794eee52f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1596dfb46b6048a39258b40787d56cb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:18:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:18:12Z,use_quota=True,user_id='ac941fc6439241cfa0cdd521ad8db64c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3a092cd-7947-4cbf-abff-4ba9567becf0),volume_type_id=f3a092cd-7947-4cbf-abff-4ba9567becf0)' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:18:12 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-210704b7-0df2-4e88-8c50-c81c72426451 tempest-CreateVolumesFromSourceVolumeTest-111434518 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a4a4101-5535-43f3-a255-4b0aa35d19f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:18:12 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-210704b7-0df2-4e88-8c50-c81c72426451 tempest-CreateVolumesFromSourceVolumeTest-111434518 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a4a4101-5535-43f3-a255-4b0aa35d19f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:18:12 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-210704b7-0df2-4e88-8c50-c81c72426451 tempest-CreateVolumesFromSourceVolumeTest-111434518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d72c5067-1d40-4b60-a0ed-96d9152b9046) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:18:12 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-210704b7-0df2-4e88-8c50-c81c72426451 tempest-CreateVolumesFromSourceVolumeTest-111434518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d72c5067-1d40-4b60-a0ed-96d9152b9046) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '38b2b2b1-7d42-4c03-8bfb-af8794eee52f', 'volume_name': 'volume-38b2b2b1-7d42-4c03-8bfb-af8794eee52f', 'volume_size': 1}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:18:12 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-210704b7-0df2-4e88-8c50-c81c72426451 tempest-CreateVolumesFromSourceVolumeTest-111434518 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79f25d97-4e06-4d67-a04f-6236933b7eea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:18:12 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-210704b7-0df2-4e88-8c50-c81c72426451 tempest-CreateVolumesFromSourceVolumeTest-111434518 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79f25d97-4e06-4d67-a04f-6236933b7eea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:18:12 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-210704b7-0df2-4e88-8c50-c81c72426451 tempest-CreateVolumesFromSourceVolumeTest-111434518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0796d74c-4e50-4efa-a44b-47969ccc9b8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:18:12 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-210704b7-0df2-4e88-8c50-c81c72426451 tempest-CreateVolumesFromSourceVolumeTest-111434518 None] Volume 38b2b2b1-7d42-4c03-8bfb-af8794eee52f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-38b2b2b1-7d42-4c03-8bfb-af8794eee52f', 'volume_size': 1} Sep 07 10:18:12 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-210704b7-0df2-4e88-8c50-c81c72426451 tempest-CreateVolumesFromSourceVolumeTest-111434518 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:18:12 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-2ac052cc-f521-4afe-9adb-15fa2101aefc tempest-CreateVolumesFromImageTest-296560334 None] Volume volume-db9a0c07-2521-46b6-a235-173fd902d92e (db9a0c07-2521-46b6-a235-173fd902d92e): created successfully Sep 07 10:18:12 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-2ac052cc-f521-4afe-9adb-15fa2101aefc tempest-CreateVolumesFromImageTest-296560334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb4fce06-4cdf-40b7-8b6e-5a39884cf3d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:18:12 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-2ac052cc-f521-4afe-9adb-15fa2101aefc tempest-CreateVolumesFromImageTest-296560334 None] Flow 'volume_create_manager' (337ef62f-4808-4f86-8020-6c0d903642cd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:18:12 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-2ac052cc-f521-4afe-9adb-15fa2101aefc tempest-CreateVolumesFromImageTest-296560334 None] Created volume successfully. Sep 07 10:18:12 devstack cinder-volume[87515]: DEBUG cinder.volume.flows.manager.create_volume [None req-727c7906-4ed6-4c97-bc9f-af41bf61754a tempest-CreateVolumesFromSourceVolumeTest-111434518 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 10:18:12 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-727c7906-4ed6-4c97-bc9f-af41bf61754a tempest-CreateVolumesFromSourceVolumeTest-111434518 None] Flow 'volume_create_manager' (e70742de-7bf1-40df-9a37-09b1155ec818) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:18:12 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-727c7906-4ed6-4c97-bc9f-af41bf61754a tempest-CreateVolumesFromSourceVolumeTest-111434518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7bbfc24b-0d67-40ac-9cb8-edb8d65bdf72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:18:12 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-727c7906-4ed6-4c97-bc9f-af41bf61754a tempest-CreateVolumesFromSourceVolumeTest-111434518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7bbfc24b-0d67-40ac-9cb8-edb8d65bdf72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:18:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1366309062',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13e24d06-ede2-4c2d-a359-c9a772b2efab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1596dfb46b6048a39258b40787d56cb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:18:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:18:13Z,use_quota=True,user_id='ac941fc6439241cfa0cdd521ad8db64c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3a092cd-7947-4cbf-abff-4ba9567becf0),volume_type_id=f3a092cd-7947-4cbf-abff-4ba9567becf0)' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:18:12 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-727c7906-4ed6-4c97-bc9f-af41bf61754a tempest-CreateVolumesFromSourceVolumeTest-111434518 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (397d3517-03fc-49d1-8322-0cbbef8e962f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:18:12 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-727c7906-4ed6-4c97-bc9f-af41bf61754a tempest-CreateVolumesFromSourceVolumeTest-111434518 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (397d3517-03fc-49d1-8322-0cbbef8e962f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:18:12 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-727c7906-4ed6-4c97-bc9f-af41bf61754a tempest-CreateVolumesFromSourceVolumeTest-111434518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5cb1bfe-9ab8-40b0-b0e8-e402cb198be7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:18:12 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-727c7906-4ed6-4c97-bc9f-af41bf61754a tempest-CreateVolumesFromSourceVolumeTest-111434518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5cb1bfe-9ab8-40b0-b0e8-e402cb198be7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '13e24d06-ede2-4c2d-a359-c9a772b2efab', 'volume_name': 'volume-13e24d06-ede2-4c2d-a359-c9a772b2efab', 'volume_size': 1}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:18:12 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-727c7906-4ed6-4c97-bc9f-af41bf61754a tempest-CreateVolumesFromSourceVolumeTest-111434518 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe2d6f55-8ec8-46d4-911a-c6ec40149e2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:18:12 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-727c7906-4ed6-4c97-bc9f-af41bf61754a tempest-CreateVolumesFromSourceVolumeTest-111434518 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe2d6f55-8ec8-46d4-911a-c6ec40149e2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:18:12 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-727c7906-4ed6-4c97-bc9f-af41bf61754a tempest-CreateVolumesFromSourceVolumeTest-111434518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3697ead0-70b7-4f90-b74f-6b77dc3578c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:18:12 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-727c7906-4ed6-4c97-bc9f-af41bf61754a tempest-CreateVolumesFromSourceVolumeTest-111434518 None] Volume 13e24d06-ede2-4c2d-a359-c9a772b2efab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-13e24d06-ede2-4c2d-a359-c9a772b2efab', 'volume_size': 1} Sep 07 10:18:12 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-727c7906-4ed6-4c97-bc9f-af41bf61754a tempest-CreateVolumesFromSourceVolumeTest-111434518 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:18:13 devstack sudo[106771]: pam_unix(sudo:session): session closed for user root Sep 07 10:18:13 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-53e38b6c-96cb-45fa-a012-5ed52323fcae tempest-VolumeDependencyTests-1280371773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-321e9476-3454-435c-936f-cee61f12d97f 1073741824" returned: 0 in 0.668s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:18:13 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-53e38b6c-96cb-45fa-a012-5ed52323fcae tempest-VolumeDependencyTests-1280371773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-321e9476-3454-435c-936f-cee61f12d97f {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:18:13 devstack sudo[106777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-321e9476-3454-435c-936f-cee61f12d97f Sep 07 10:18:13 devstack sudo[106777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:18:13 devstack cinder-volume[87515]: DEBUG cinder.volume.flows.manager.create_volume [None req-a353d390-7b90-40b6-b004-ff95b59f3a61 tempest-CreateVolumesFromSourceVolumeTest-111434518 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 10:18:13 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-a353d390-7b90-40b6-b004-ff95b59f3a61 tempest-CreateVolumesFromSourceVolumeTest-111434518 None] Flow 'volume_create_manager' (f0813c16-cd71-4e0b-a420-e5d4623545d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:18:13 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-a353d390-7b90-40b6-b004-ff95b59f3a61 tempest-CreateVolumesFromSourceVolumeTest-111434518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77e5a599-9497-4307-aeaf-ff97ab6a3bce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:18:13 devstack sudo[106777]: pam_unix(sudo:session): session closed for user root Sep 07 10:18:13 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-53e38b6c-96cb-45fa-a012-5ed52323fcae tempest-VolumeDependencyTests-1280371773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-321e9476-3454-435c-936f-cee61f12d97f" returned: 0 in 0.310s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:18:13 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-53e38b6c-96cb-45fa-a012-5ed52323fcae tempest-VolumeDependencyTests-1280371773 None] <== create_volume: return (1039ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'} {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 10:18:13 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-53e38b6c-96cb-45fa-a012-5ed52323fcae tempest-VolumeDependencyTests-1280371773 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.044s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:18:13 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-b91b0fb9-61f8-4c58-bbb0-f6207888195e tempest-CreateVolumesFromImageTest-296560334 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.120s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:18:13 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-b91b0fb9-61f8-4c58-bbb0-f6207888195e tempest-CreateVolumesFromImageTest-296560334 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:18:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1010291655',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97e279ce-e959-47a0-8fe0-68a04ffa0c7a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5df77aa8fa14034987f73b50b968740',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:18:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:18:10Z,use_quota=True,user_id='611d268ba48f464fa73485c6d7a282ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3a092cd-7947-4cbf-abff-4ba9567becf0),volume_type_id=f3a092cd-7947-4cbf-abff-4ba9567becf0)}" {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 10:18:13 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-b91b0fb9-61f8-4c58-bbb0-f6207888195e tempest-CreateVolumesFromImageTest-296560334 None] Creating volume 97e279ce-e959-47a0-8fe0-68a04ffa0c7a {{(pid=87515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 10:18:13 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-b91b0fb9-61f8-4c58-bbb0-f6207888195e tempest-CreateVolumesFromImageTest-296560334 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:18:13 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-b91b0fb9-61f8-4c58-bbb0-f6207888195e tempest-CreateVolumesFromImageTest-296560334 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:18:13 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-b91b0fb9-61f8-4c58-bbb0-f6207888195e tempest-CreateVolumesFromImageTest-296560334 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:18:13 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-b91b0fb9-61f8-4c58-bbb0-f6207888195e tempest-CreateVolumesFromImageTest-296560334 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:18:13 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-b91b0fb9-61f8-4c58-bbb0-f6207888195e tempest-CreateVolumesFromImageTest-296560334 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:18:13 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-b91b0fb9-61f8-4c58-bbb0-f6207888195e tempest-CreateVolumesFromImageTest-296560334 None] Selected osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c as target Quobyte volume. {{(pid=87515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 10:18:13 devstack cinder-volume[87515]: INFO cinder.volume.drivers.remotefs [None req-b91b0fb9-61f8-4c58-bbb0-f6207888195e tempest-CreateVolumesFromImageTest-296560334 None] casted to osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c Sep 07 10:18:13 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-b91b0fb9-61f8-4c58-bbb0-f6207888195e tempest-CreateVolumesFromImageTest-296560334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-97e279ce-e959-47a0-8fe0-68a04ffa0c7a 1073741824 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:18:13 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-a353d390-7b90-40b6-b004-ff95b59f3a61 tempest-CreateVolumesFromSourceVolumeTest-111434518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77e5a599-9497-4307-aeaf-ff97ab6a3bce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:18:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-175846756',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f8c8091-092d-44fd-bd18-6ac043122ac2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1596dfb46b6048a39258b40787d56cb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:18:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:18:13Z,use_quota=True,user_id='ac941fc6439241cfa0cdd521ad8db64c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3a092cd-7947-4cbf-abff-4ba9567becf0),volume_type_id=f3a092cd-7947-4cbf-abff-4ba9567becf0)' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:18:13 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-a353d390-7b90-40b6-b004-ff95b59f3a61 tempest-CreateVolumesFromSourceVolumeTest-111434518 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (abd5bcdb-ff19-4f47-b341-1a4f71ff5b66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:18:13 devstack sudo[106780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-97e279ce-e959-47a0-8fe0-68a04ffa0c7a 1073741824 Sep 07 10:18:13 devstack sudo[106780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:18:13 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-a353d390-7b90-40b6-b004-ff95b59f3a61 tempest-CreateVolumesFromSourceVolumeTest-111434518 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (abd5bcdb-ff19-4f47-b341-1a4f71ff5b66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:18:13 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-a353d390-7b90-40b6-b004-ff95b59f3a61 tempest-CreateVolumesFromSourceVolumeTest-111434518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55f7570e-d63d-4645-977d-dae5d38732e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:18:13 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-a353d390-7b90-40b6-b004-ff95b59f3a61 tempest-CreateVolumesFromSourceVolumeTest-111434518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55f7570e-d63d-4645-977d-dae5d38732e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4f8c8091-092d-44fd-bd18-6ac043122ac2', 'volume_name': 'volume-4f8c8091-092d-44fd-bd18-6ac043122ac2', 'volume_size': 1}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:18:13 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-a353d390-7b90-40b6-b004-ff95b59f3a61 tempest-CreateVolumesFromSourceVolumeTest-111434518 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c492b4b1-005a-4ddc-977f-dff422d7b149) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:18:13 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-a353d390-7b90-40b6-b004-ff95b59f3a61 tempest-CreateVolumesFromSourceVolumeTest-111434518 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c492b4b1-005a-4ddc-977f-dff422d7b149) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:18:13 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-a353d390-7b90-40b6-b004-ff95b59f3a61 tempest-CreateVolumesFromSourceVolumeTest-111434518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d7e8d5b-294f-4922-92f1-9969cec30045) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:18:13 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-a353d390-7b90-40b6-b004-ff95b59f3a61 tempest-CreateVolumesFromSourceVolumeTest-111434518 None] Volume 4f8c8091-092d-44fd-bd18-6ac043122ac2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4f8c8091-092d-44fd-bd18-6ac043122ac2', 'volume_size': 1} Sep 07 10:18:13 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-a353d390-7b90-40b6-b004-ff95b59f3a61 tempest-CreateVolumesFromSourceVolumeTest-111434518 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:18:13 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-53e38b6c-96cb-45fa-a012-5ed52323fcae tempest-VolumeDependencyTests-1280371773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (495a9494-cbc6-4278-b97d-32ab96f37b9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-321e9476-3454-435c-936f-cee61f12d97f', 'volume_size': 1}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:18:13 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-53e38b6c-96cb-45fa-a012-5ed52323fcae tempest-VolumeDependencyTests-1280371773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2f5c852-eac6-4b1b-841c-1c2cd4292823) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:18:13 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-53e38b6c-96cb-45fa-a012-5ed52323fcae tempest-VolumeDependencyTests-1280371773 None] Volume volume-321e9476-3454-435c-936f-cee61f12d97f (321e9476-3454-435c-936f-cee61f12d97f): created successfully Sep 07 10:18:13 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-53e38b6c-96cb-45fa-a012-5ed52323fcae tempest-VolumeDependencyTests-1280371773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2f5c852-eac6-4b1b-841c-1c2cd4292823) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:18:13 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-53e38b6c-96cb-45fa-a012-5ed52323fcae tempest-VolumeDependencyTests-1280371773 None] Flow 'volume_create_manager' (de6d24e2-bf6e-4a42-a755-e636c6df2c46) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:18:13 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-53e38b6c-96cb-45fa-a012-5ed52323fcae tempest-VolumeDependencyTests-1280371773 None] Created volume successfully. Sep 07 10:18:13 devstack sudo[106780]: pam_unix(sudo:session): session closed for user root Sep 07 10:18:13 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-b91b0fb9-61f8-4c58-bbb0-f6207888195e tempest-CreateVolumesFromImageTest-296560334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-97e279ce-e959-47a0-8fe0-68a04ffa0c7a 1073741824" returned: 0 in 0.513s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:18:13 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-b91b0fb9-61f8-4c58-bbb0-f6207888195e tempest-CreateVolumesFromImageTest-296560334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-97e279ce-e959-47a0-8fe0-68a04ffa0c7a {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:18:14 devstack sudo[106786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-97e279ce-e959-47a0-8fe0-68a04ffa0c7a Sep 07 10:18:14 devstack sudo[106786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:18:14 devstack cinder-volume[87515]: DEBUG cinder.volume.flows.manager.create_volume [None req-2b20ce9e-8095-4ffa-b896-49a97447fbbe tempest-VolumeAndVolumeTypeFromImageTest-975568629 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 10:18:14 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-2b20ce9e-8095-4ffa-b896-49a97447fbbe tempest-VolumeAndVolumeTypeFromImageTest-975568629 None] Flow 'volume_create_manager' (896b5d0e-3331-4738-9584-41148472c1a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:18:14 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-2b20ce9e-8095-4ffa-b896-49a97447fbbe tempest-VolumeAndVolumeTypeFromImageTest-975568629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b245d6c1-b26e-482b-bab4-596abc3c68a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:18:14 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-2b20ce9e-8095-4ffa-b896-49a97447fbbe tempest-VolumeAndVolumeTypeFromImageTest-975568629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b245d6c1-b26e-482b-bab4-596abc3c68a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:18:14Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=879c7071-a915-4633-b091-5ce48faf8d79,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0de5d145c4da4191b542cb37983cd7fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:18:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:18:14Z,use_quota=True,user_id='693731cc9bea4a9b9a60ab68abf75fd6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8905195b-9c51-4d6d-90ab-923d94400089),volume_type_id=8905195b-9c51-4d6d-90ab-923d94400089)' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:18:14 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-2b20ce9e-8095-4ffa-b896-49a97447fbbe tempest-VolumeAndVolumeTypeFromImageTest-975568629 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c040b8e-02ad-4869-a97f-d39b2b7cec99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:18:14 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-2b20ce9e-8095-4ffa-b896-49a97447fbbe tempest-VolumeAndVolumeTypeFromImageTest-975568629 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c040b8e-02ad-4869-a97f-d39b2b7cec99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:18:14 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-2b20ce9e-8095-4ffa-b896-49a97447fbbe tempest-VolumeAndVolumeTypeFromImageTest-975568629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f7bafaf-c118-47b7-bbcf-c766561e738e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:18:14 devstack cinder-volume[87515]: DEBUG cinder.image.glance [None req-2b20ce9e-8095-4ffa-b896-49a97447fbbe tempest-VolumeAndVolumeTypeFromImageTest-975568629 None] Creating Keystone auth plugin from conf {{(pid=87515) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 07 10:18:14 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-20314ffc-c3f8-466d-8769-148e7164d3c7 tempest-VolumeDependencyTests-1280371773 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:18:14 devstack sudo[106786]: pam_unix(sudo:session): session closed for user root Sep 07 10:18:14 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-b91b0fb9-61f8-4c58-bbb0-f6207888195e tempest-CreateVolumesFromImageTest-296560334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-97e279ce-e959-47a0-8fe0-68a04ffa0c7a" returned: 0 in 0.329s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:18:14 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-b91b0fb9-61f8-4c58-bbb0-f6207888195e tempest-CreateVolumesFromImageTest-296560334 None] <== create_volume: return (897ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'} {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 10:18:14 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-b91b0fb9-61f8-4c58-bbb0-f6207888195e tempest-CreateVolumesFromImageTest-296560334 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.899s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:18:14 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-4afc300e-0a69-42b8-b7c1-b0f268d4e017 tempest-CreateVolumesFromImageTest-296560334 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.688s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:18:14 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-4afc300e-0a69-42b8-b7c1-b0f268d4e017 tempest-CreateVolumesFromImageTest-296560334 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:18:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1293772909',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e95ffa7a-6c32-41ea-a834-364d2b65530b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5df77aa8fa14034987f73b50b968740',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:18:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:18:10Z,use_quota=True,user_id='611d268ba48f464fa73485c6d7a282ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3a092cd-7947-4cbf-abff-4ba9567becf0),volume_type_id=f3a092cd-7947-4cbf-abff-4ba9567becf0)}" {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 10:18:14 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-4afc300e-0a69-42b8-b7c1-b0f268d4e017 tempest-CreateVolumesFromImageTest-296560334 None] Creating volume e95ffa7a-6c32-41ea-a834-364d2b65530b {{(pid=87515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 10:18:14 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-4afc300e-0a69-42b8-b7c1-b0f268d4e017 tempest-CreateVolumesFromImageTest-296560334 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:18:14 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-4afc300e-0a69-42b8-b7c1-b0f268d4e017 tempest-CreateVolumesFromImageTest-296560334 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:18:14 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-4afc300e-0a69-42b8-b7c1-b0f268d4e017 tempest-CreateVolumesFromImageTest-296560334 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:18:14 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-4afc300e-0a69-42b8-b7c1-b0f268d4e017 tempest-CreateVolumesFromImageTest-296560334 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:18:14 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-4afc300e-0a69-42b8-b7c1-b0f268d4e017 tempest-CreateVolumesFromImageTest-296560334 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:18:14 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-4afc300e-0a69-42b8-b7c1-b0f268d4e017 tempest-CreateVolumesFromImageTest-296560334 None] Selected osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c as target Quobyte volume. {{(pid=87515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 10:18:14 devstack cinder-volume[87515]: INFO cinder.volume.drivers.remotefs [None req-4afc300e-0a69-42b8-b7c1-b0f268d4e017 tempest-CreateVolumesFromImageTest-296560334 None] casted to osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c Sep 07 10:18:14 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-4afc300e-0a69-42b8-b7c1-b0f268d4e017 tempest-CreateVolumesFromImageTest-296560334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-e95ffa7a-6c32-41ea-a834-364d2b65530b 1073741824 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:18:14 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-b91b0fb9-61f8-4c58-bbb0-f6207888195e tempest-CreateVolumesFromImageTest-296560334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2569da29-d9bf-45ca-9c4d-dd9dbae7d94a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-97e279ce-e959-47a0-8fe0-68a04ffa0c7a', 'volume_size': 1}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:18:14 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-b91b0fb9-61f8-4c58-bbb0-f6207888195e tempest-CreateVolumesFromImageTest-296560334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc7fb391-70eb-425e-aa08-46b571a75251) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:18:14 devstack sudo[106789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-e95ffa7a-6c32-41ea-a834-364d2b65530b 1073741824 Sep 07 10:18:14 devstack sudo[106789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:18:14 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-b91b0fb9-61f8-4c58-bbb0-f6207888195e tempest-CreateVolumesFromImageTest-296560334 None] Volume volume-97e279ce-e959-47a0-8fe0-68a04ffa0c7a (97e279ce-e959-47a0-8fe0-68a04ffa0c7a): created successfully Sep 07 10:18:14 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-b91b0fb9-61f8-4c58-bbb0-f6207888195e tempest-CreateVolumesFromImageTest-296560334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc7fb391-70eb-425e-aa08-46b571a75251) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:18:14 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-b91b0fb9-61f8-4c58-bbb0-f6207888195e tempest-CreateVolumesFromImageTest-296560334 None] Flow 'volume_create_manager' (c42ce6b1-2d4d-49b9-8fdd-c5cc52d38408) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:18:14 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-b91b0fb9-61f8-4c58-bbb0-f6207888195e tempest-CreateVolumesFromImageTest-296560334 None] Created volume successfully. Sep 07 10:18:14 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-2b20ce9e-8095-4ffa-b896-49a97447fbbe tempest-VolumeAndVolumeTypeFromImageTest-975568629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f7bafaf-c118-47b7-bbcf-c766561e738e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '879c7071-a915-4633-b091-5ce48faf8d79', 'volume_name': 'volume-879c7071-a915-4633-b091-5ce48faf8d79', 'volume_size': 1, 'image_id': '18b53134-13b3-434f-af5c-094d7476cdb4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/18b53134-13b3-434f-af5c-094d7476cdb4', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '436a8f1ef88448bdcd4c0246675a5770', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '0de5d145c4da4191b542cb37983cd7fc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '2d86f2ab1b1ae443e56a815e8febf4b727c927aa936e2a27198815b3be12503d129aab2b5cf4438140dd4d47efe9305ef2d6822e1916fa0fb5b6e3471416366e', 'id': '18b53134-13b3-434f-af5c-094d7476cdb4', 'created_at': datetime.datetime(2026, 9, 7, 8, 18, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 7, 8, 18, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/18b53134-13b3-434f-af5c-094d7476cdb4/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:18:14 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-2b20ce9e-8095-4ffa-b896-49a97447fbbe tempest-VolumeAndVolumeTypeFromImageTest-975568629 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7728e82e-39a7-4a40-9d50-3498526d4eb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:18:14 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-2b20ce9e-8095-4ffa-b896-49a97447fbbe tempest-VolumeAndVolumeTypeFromImageTest-975568629 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7728e82e-39a7-4a40-9d50-3498526d4eb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:18:14 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-2b20ce9e-8095-4ffa-b896-49a97447fbbe tempest-VolumeAndVolumeTypeFromImageTest-975568629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fdbfd084-8a09-4219-9c4a-61f404d06598) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:18:14 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-2b20ce9e-8095-4ffa-b896-49a97447fbbe tempest-VolumeAndVolumeTypeFromImageTest-975568629 None] Volume 879c7071-a915-4633-b091-5ce48faf8d79: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-879c7071-a915-4633-b091-5ce48faf8d79', 'volume_size': 1, 'image_id': '18b53134-13b3-434f-af5c-094d7476cdb4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/18b53134-13b3-434f-af5c-094d7476cdb4', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '436a8f1ef88448bdcd4c0246675a5770', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '0de5d145c4da4191b542cb37983cd7fc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '2d86f2ab1b1ae443e56a815e8febf4b727c927aa936e2a27198815b3be12503d129aab2b5cf4438140dd4d47efe9305ef2d6822e1916fa0fb5b6e3471416366e', 'id': '18b53134-13b3-434f-af5c-094d7476cdb4', 'created_at': datetime.datetime(2026, 9, 7, 8, 18, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 7, 8, 18, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/18b53134-13b3-434f-af5c-094d7476cdb4/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Sep 07 10:18:14 devstack cinder-volume[87515]: DEBUG cinder.volume.flows.manager.create_volume [None req-2b20ce9e-8095-4ffa-b896-49a97447fbbe tempest-VolumeAndVolumeTypeFromImageTest-975568629 None] Trying to clone 879c7071-a915-4633-b091-5ce48faf8d79 from image 18b53134-13b3-434f-af5c-094d7476cdb4 at location (None, [{'url': 'file:///opt/stack/data/glance/images/18b53134-13b3-434f-af5c-094d7476cdb4', 'metadata': {}}]). {{(pid=87515) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 07 10:18:14 devstack cinder-volume[87515]: DEBUG cinder.image.image_utils [None req-2b20ce9e-8095-4ffa-b896-49a97447fbbe tempest-VolumeAndVolumeTypeFromImageTest-975568629 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_18b53134-13b3-434f-af5c-094d7476cdb4_6q1ry1j5devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87515) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 07 10:18:14 devstack cinder-volume[87515]: INFO cinder.image.image_utils [None req-2b20ce9e-8095-4ffa-b896-49a97447fbbe tempest-VolumeAndVolumeTypeFromImageTest-975568629 None] Image download 0.00 MB at 0.00 MB/s Sep 07 10:18:14 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6875107-77fe-468f-bbb5-77c50cec425a]: (4, 'raw') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:18:14 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-2b20ce9e-8095-4ffa-b896-49a97447fbbe tempest-VolumeAndVolumeTypeFromImageTest-975568629 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_18b53134-13b3-434f-af5c-094d7476cdb4_6q1ry1j5devstack@QuobyteHD {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:18:14 devstack sudo[106789]: pam_unix(sudo:session): session closed for user root Sep 07 10:18:14 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-4afc300e-0a69-42b8-b7c1-b0f268d4e017 tempest-CreateVolumesFromImageTest-296560334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-e95ffa7a-6c32-41ea-a834-364d2b65530b 1073741824" returned: 0 in 0.458s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:18:14 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-4afc300e-0a69-42b8-b7c1-b0f268d4e017 tempest-CreateVolumesFromImageTest-296560334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-e95ffa7a-6c32-41ea-a834-364d2b65530b {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:18:14 devstack sudo[106795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_18b53134-13b3-434f-af5c-094d7476cdb4_6q1ry1j5devstack@QuobyteHD Sep 07 10:18:14 devstack sudo[106795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:18:14 devstack sudo[106796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-e95ffa7a-6c32-41ea-a834-364d2b65530b Sep 07 10:18:14 devstack sudo[106796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:18:15 devstack sudo[106795]: pam_unix(sudo:session): session closed for user root Sep 07 10:18:15 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-2b20ce9e-8095-4ffa-b896-49a97447fbbe tempest-VolumeAndVolumeTypeFromImageTest-975568629 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_18b53134-13b3-434f-af5c-094d7476cdb4_6q1ry1j5devstack@QuobyteHD" returned: 0 in 0.343s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:18:15 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-2b20ce9e-8095-4ffa-b896-49a97447fbbe tempest-VolumeAndVolumeTypeFromImageTest-975568629 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_18b53134-13b3-434f-af5c-094d7476cdb4_6q1ry1j5devstack@QuobyteHD {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:18:15 devstack sudo[106796]: pam_unix(sudo:session): session closed for user root Sep 07 10:18:15 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-4afc300e-0a69-42b8-b7c1-b0f268d4e017 tempest-CreateVolumesFromImageTest-296560334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-e95ffa7a-6c32-41ea-a834-364d2b65530b" returned: 0 in 0.254s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:18:15 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-4afc300e-0a69-42b8-b7c1-b0f268d4e017 tempest-CreateVolumesFromImageTest-296560334 None] <== create_volume: return (755ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'} {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 10:18:15 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-4afc300e-0a69-42b8-b7c1-b0f268d4e017 tempest-CreateVolumesFromImageTest-296560334 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.759s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:18:15 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-2d4c042d-e4e0-430f-80fb-24d8e5169173 tempest-CreateVolumesFromImageTest-296560334 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.927s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:18:15 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-2d4c042d-e4e0-430f-80fb-24d8e5169173 tempest-CreateVolumesFromImageTest-296560334 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:18:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-557281934',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d379b4d-778c-418e-818e-ac0038e7d769,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5df77aa8fa14034987f73b50b968740',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:18:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:18:11Z,use_quota=True,user_id='611d268ba48f464fa73485c6d7a282ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3a092cd-7947-4cbf-abff-4ba9567becf0),volume_type_id=f3a092cd-7947-4cbf-abff-4ba9567becf0)}" {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 10:18:15 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-2d4c042d-e4e0-430f-80fb-24d8e5169173 tempest-CreateVolumesFromImageTest-296560334 None] Creating volume 0d379b4d-778c-418e-818e-ac0038e7d769 {{(pid=87515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 10:18:15 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-2d4c042d-e4e0-430f-80fb-24d8e5169173 tempest-CreateVolumesFromImageTest-296560334 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:18:15 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-2d4c042d-e4e0-430f-80fb-24d8e5169173 tempest-CreateVolumesFromImageTest-296560334 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:18:15 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-2d4c042d-e4e0-430f-80fb-24d8e5169173 tempest-CreateVolumesFromImageTest-296560334 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:18:15 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-2d4c042d-e4e0-430f-80fb-24d8e5169173 tempest-CreateVolumesFromImageTest-296560334 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:18:15 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-2d4c042d-e4e0-430f-80fb-24d8e5169173 tempest-CreateVolumesFromImageTest-296560334 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:18:15 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-2d4c042d-e4e0-430f-80fb-24d8e5169173 tempest-CreateVolumesFromImageTest-296560334 None] Selected osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c as target Quobyte volume. {{(pid=87515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 10:18:15 devstack cinder-volume[87515]: INFO cinder.volume.drivers.remotefs [None req-2d4c042d-e4e0-430f-80fb-24d8e5169173 tempest-CreateVolumesFromImageTest-296560334 None] casted to osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c Sep 07 10:18:15 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-2d4c042d-e4e0-430f-80fb-24d8e5169173 tempest-CreateVolumesFromImageTest-296560334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-0d379b4d-778c-418e-818e-ac0038e7d769 1073741824 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:18:15 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-4afc300e-0a69-42b8-b7c1-b0f268d4e017 tempest-CreateVolumesFromImageTest-296560334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a980fe3-b12d-4ec3-ac95-d181309801bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e95ffa7a-6c32-41ea-a834-364d2b65530b', 'volume_size': 1}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:18:15 devstack sudo[106803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-0d379b4d-778c-418e-818e-ac0038e7d769 1073741824 Sep 07 10:18:15 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-4afc300e-0a69-42b8-b7c1-b0f268d4e017 tempest-CreateVolumesFromImageTest-296560334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b00d282-789f-4584-be5b-eff8606e7ab1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:18:15 devstack sudo[106803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:18:15 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-4afc300e-0a69-42b8-b7c1-b0f268d4e017 tempest-CreateVolumesFromImageTest-296560334 None] Volume volume-e95ffa7a-6c32-41ea-a834-364d2b65530b (e95ffa7a-6c32-41ea-a834-364d2b65530b): created successfully Sep 07 10:18:15 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-4afc300e-0a69-42b8-b7c1-b0f268d4e017 tempest-CreateVolumesFromImageTest-296560334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b00d282-789f-4584-be5b-eff8606e7ab1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:18:15 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-4afc300e-0a69-42b8-b7c1-b0f268d4e017 tempest-CreateVolumesFromImageTest-296560334 None] Flow 'volume_create_manager' (3e644550-d4a2-44e7-931a-025918472e0a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:18:15 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-4afc300e-0a69-42b8-b7c1-b0f268d4e017 tempest-CreateVolumesFromImageTest-296560334 None] Created volume successfully. Sep 07 10:18:15 devstack sudo[106802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_18b53134-13b3-434f-af5c-094d7476cdb4_6q1ry1j5devstack@QuobyteHD Sep 07 10:18:15 devstack sudo[106802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:18:15 devstack sudo[106802]: pam_unix(sudo:session): session closed for user root Sep 07 10:18:15 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-2b20ce9e-8095-4ffa-b896-49a97447fbbe tempest-VolumeAndVolumeTypeFromImageTest-975568629 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_18b53134-13b3-434f-af5c-094d7476cdb4_6q1ry1j5devstack@QuobyteHD" returned: 1 in 0.351s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:18:15 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-2b20ce9e-8095-4ffa-b896-49a97447fbbe tempest-VolumeAndVolumeTypeFromImageTest-975568629 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_18b53134-13b3-434f-af5c-094d7476cdb4_6q1ry1j5devstack@QuobyteHD' failed. Not Retrying. {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 07 10:18:15 devstack cinder-volume[87515]: DEBUG cinder.image.image_utils [None req-2b20ce9e-8095-4ffa-b896-49a97447fbbe tempest-VolumeAndVolumeTypeFromImageTest-975568629 None] Temporary image 18b53134-13b3-434f-af5c-094d7476cdb4 is fetched for user 693731cc9bea4a9b9a60ab68abf75fd6. {{(pid=87515) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 07 10:18:15 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[84ec9f18-06bb-47e9-897c-923dfef02aac]: (4, 'raw') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:18:15 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-2b20ce9e-8095-4ffa-b896-49a97447fbbe tempest-VolumeAndVolumeTypeFromImageTest-975568629 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_18b53134-13b3-434f-af5c-094d7476cdb4_6q1ry1j5devstack@QuobyteHD {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:18:15 devstack sudo[106803]: pam_unix(sudo:session): session closed for user root Sep 07 10:18:15 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-2d4c042d-e4e0-430f-80fb-24d8e5169173 tempest-CreateVolumesFromImageTest-296560334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-0d379b4d-778c-418e-818e-ac0038e7d769 1073741824" returned: 0 in 0.525s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:18:15 devstack sudo[106813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_18b53134-13b3-434f-af5c-094d7476cdb4_6q1ry1j5devstack@QuobyteHD Sep 07 10:18:15 devstack sudo[106813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:18:15 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-2d4c042d-e4e0-430f-80fb-24d8e5169173 tempest-CreateVolumesFromImageTest-296560334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-0d379b4d-778c-418e-818e-ac0038e7d769 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:18:15 devstack sudo[106816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-0d379b4d-778c-418e-818e-ac0038e7d769 Sep 07 10:18:15 devstack sudo[106816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:18:15 devstack sudo[106813]: pam_unix(sudo:session): session closed for user root Sep 07 10:18:15 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-2b20ce9e-8095-4ffa-b896-49a97447fbbe tempest-VolumeAndVolumeTypeFromImageTest-975568629 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_18b53134-13b3-434f-af5c-094d7476cdb4_6q1ry1j5devstack@QuobyteHD" returned: 0 in 0.384s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:18:15 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-2b20ce9e-8095-4ffa-b896-49a97447fbbe tempest-VolumeAndVolumeTypeFromImageTest-975568629 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_18b53134-13b3-434f-af5c-094d7476cdb4_6q1ry1j5devstack@QuobyteHD {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:18:15 devstack sudo[106816]: pam_unix(sudo:session): session closed for user root Sep 07 10:18:15 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-2d4c042d-e4e0-430f-80fb-24d8e5169173 tempest-CreateVolumesFromImageTest-296560334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-0d379b4d-778c-418e-818e-ac0038e7d769" returned: 0 in 0.257s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:18:15 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-2d4c042d-e4e0-430f-80fb-24d8e5169173 tempest-CreateVolumesFromImageTest-296560334 None] <== create_volume: return (890ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'} {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 10:18:15 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-2d4c042d-e4e0-430f-80fb-24d8e5169173 tempest-CreateVolumesFromImageTest-296560334 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.892s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:18:15 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-430011be-2e43-414b-afe2-39e636f04469 tempest-CreateVolumesFromSourceVolumeTest-111434518 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.419s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:18:15 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-430011be-2e43-414b-afe2-39e636f04469 tempest-CreateVolumesFromSourceVolumeTest-111434518 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:18:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-998553200',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f219527b-edf2-4045-a6f9-965e0945b744,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1596dfb46b6048a39258b40787d56cb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:18:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:18:11Z,use_quota=True,user_id='ac941fc6439241cfa0cdd521ad8db64c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3a092cd-7947-4cbf-abff-4ba9567becf0),volume_type_id=f3a092cd-7947-4cbf-abff-4ba9567becf0)}" {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 10:18:15 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-430011be-2e43-414b-afe2-39e636f04469 tempest-CreateVolumesFromSourceVolumeTest-111434518 None] Creating volume f219527b-edf2-4045-a6f9-965e0945b744 {{(pid=87515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 10:18:15 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-430011be-2e43-414b-afe2-39e636f04469 tempest-CreateVolumesFromSourceVolumeTest-111434518 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:18:15 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-430011be-2e43-414b-afe2-39e636f04469 tempest-CreateVolumesFromSourceVolumeTest-111434518 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:18:15 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-430011be-2e43-414b-afe2-39e636f04469 tempest-CreateVolumesFromSourceVolumeTest-111434518 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:18:15 devstack sudo[106820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_18b53134-13b3-434f-af5c-094d7476cdb4_6q1ry1j5devstack@QuobyteHD Sep 07 10:18:15 devstack sudo[106820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:18:15 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-430011be-2e43-414b-afe2-39e636f04469 tempest-CreateVolumesFromSourceVolumeTest-111434518 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:18:15 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-430011be-2e43-414b-afe2-39e636f04469 tempest-CreateVolumesFromSourceVolumeTest-111434518 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:18:15 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-430011be-2e43-414b-afe2-39e636f04469 tempest-CreateVolumesFromSourceVolumeTest-111434518 None] Selected osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c as target Quobyte volume. {{(pid=87515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 10:18:15 devstack cinder-volume[87515]: INFO cinder.volume.drivers.remotefs [None req-430011be-2e43-414b-afe2-39e636f04469 tempest-CreateVolumesFromSourceVolumeTest-111434518 None] casted to osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c Sep 07 10:18:15 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-430011be-2e43-414b-afe2-39e636f04469 tempest-CreateVolumesFromSourceVolumeTest-111434518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-f219527b-edf2-4045-a6f9-965e0945b744 1073741824 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:18:16 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-2d4c042d-e4e0-430f-80fb-24d8e5169173 tempest-CreateVolumesFromImageTest-296560334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (539d2e12-85de-4bee-835c-fd22bf2c0192) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0d379b4d-778c-418e-818e-ac0038e7d769', 'volume_size': 1}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:18:16 devstack sudo[106823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-f219527b-edf2-4045-a6f9-965e0945b744 1073741824 Sep 07 10:18:16 devstack sudo[106823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:18:16 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-2d4c042d-e4e0-430f-80fb-24d8e5169173 tempest-CreateVolumesFromImageTest-296560334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8da25a1-ce73-4761-bf93-fd32fc476147) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:18:16 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-2d4c042d-e4e0-430f-80fb-24d8e5169173 tempest-CreateVolumesFromImageTest-296560334 None] Volume volume-0d379b4d-778c-418e-818e-ac0038e7d769 (0d379b4d-778c-418e-818e-ac0038e7d769): created successfully Sep 07 10:18:16 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-2d4c042d-e4e0-430f-80fb-24d8e5169173 tempest-CreateVolumesFromImageTest-296560334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8da25a1-ce73-4761-bf93-fd32fc476147) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:18:16 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-2d4c042d-e4e0-430f-80fb-24d8e5169173 tempest-CreateVolumesFromImageTest-296560334 None] Flow 'volume_create_manager' (5302d89e-7132-4b42-93e1-d952705f83ea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:18:16 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-2d4c042d-e4e0-430f-80fb-24d8e5169173 tempest-CreateVolumesFromImageTest-296560334 None] Created volume successfully. Sep 07 10:18:16 devstack sudo[106820]: pam_unix(sudo:session): session closed for user root Sep 07 10:18:16 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-2b20ce9e-8095-4ffa-b896-49a97447fbbe tempest-VolumeAndVolumeTypeFromImageTest-975568629 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_18b53134-13b3-434f-af5c-094d7476cdb4_6q1ry1j5devstack@QuobyteHD" returned: 1 in 0.343s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:18:16 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-2b20ce9e-8095-4ffa-b896-49a97447fbbe tempest-VolumeAndVolumeTypeFromImageTest-975568629 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_18b53134-13b3-434f-af5c-094d7476cdb4_6q1ry1j5devstack@QuobyteHD' failed. Not Retrying. {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 07 10:18:16 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-2b20ce9e-8095-4ffa-b896-49a97447fbbe tempest-VolumeAndVolumeTypeFromImageTest-975568629 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:18:16 devstack sudo[106823]: pam_unix(sudo:session): session closed for user root Sep 07 10:18:16 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-430011be-2e43-414b-afe2-39e636f04469 tempest-CreateVolumesFromSourceVolumeTest-111434518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-f219527b-edf2-4045-a6f9-965e0945b744 1073741824" returned: 0 in 0.435s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:18:16 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-430011be-2e43-414b-afe2-39e636f04469 tempest-CreateVolumesFromSourceVolumeTest-111434518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-f219527b-edf2-4045-a6f9-965e0945b744 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:18:16 devstack sudo[106831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-f219527b-edf2-4045-a6f9-965e0945b744 Sep 07 10:18:16 devstack sudo[106831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:18:16 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-d987048f-8294-41c0-a3dc-602c671b8dd1 tempest-CreateVolumesFromImageTest-296560334 None] Acquiring lock "cinder-0d379b4d-778c-418e-818e-ac0038e7d769-delete_volume" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:18:16 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-d987048f-8294-41c0-a3dc-602c671b8dd1 tempest-CreateVolumesFromImageTest-296560334 None] Lock "cinder-0d379b4d-778c-418e-818e-ac0038e7d769-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:18:16 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-d987048f-8294-41c0-a3dc-602c671b8dd1 tempest-CreateVolumesFromImageTest-296560334 None] Acquiring lock "cinder-quobyte-0d379b4d-778c-418e-818e-ac0038e7d769" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:18:16 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-d987048f-8294-41c0-a3dc-602c671b8dd1 tempest-CreateVolumesFromImageTest-296560334 None] Lock "cinder-quobyte-0d379b4d-778c-418e-818e-ac0038e7d769" acquired by "delete_volume" :: waited 0.017s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:18:16 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[f112ed78-71eb-4f32-8184-9761f0db12f3]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:18:16 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-d987048f-8294-41c0-a3dc-602c671b8dd1 tempest-CreateVolumesFromImageTest-296560334 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-0d379b4d-778c-418e-818e-ac0038e7d769 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:18:16 devstack sudo[106831]: pam_unix(sudo:session): session closed for user root Sep 07 10:18:16 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-430011be-2e43-414b-afe2-39e636f04469 tempest-CreateVolumesFromSourceVolumeTest-111434518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-f219527b-edf2-4045-a6f9-965e0945b744" returned: 0 in 0.278s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:18:16 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-430011be-2e43-414b-afe2-39e636f04469 tempest-CreateVolumesFromSourceVolumeTest-111434518 None] <== create_volume: return (753ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'} {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 10:18:16 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-430011be-2e43-414b-afe2-39e636f04469 tempest-CreateVolumesFromSourceVolumeTest-111434518 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.757s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:18:16 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-fd755aea-7678-44be-b809-d3eed84df4c4 tempest-CreateVolumesFromSourceVolumeTest-111434518 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.798s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:18:16 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-fd755aea-7678-44be-b809-d3eed84df4c4 tempest-CreateVolumesFromSourceVolumeTest-111434518 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:18:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2144492674',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97f301d2-1c54-4d95-89e1-49e7e7991bc3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1596dfb46b6048a39258b40787d56cb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:18:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:18:12Z,use_quota=True,user_id='ac941fc6439241cfa0cdd521ad8db64c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3a092cd-7947-4cbf-abff-4ba9567becf0),volume_type_id=f3a092cd-7947-4cbf-abff-4ba9567becf0)}" {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 10:18:16 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-fd755aea-7678-44be-b809-d3eed84df4c4 tempest-CreateVolumesFromSourceVolumeTest-111434518 None] Creating volume 97f301d2-1c54-4d95-89e1-49e7e7991bc3 {{(pid=87515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 10:18:16 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-fd755aea-7678-44be-b809-d3eed84df4c4 tempest-CreateVolumesFromSourceVolumeTest-111434518 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:18:16 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-fd755aea-7678-44be-b809-d3eed84df4c4 tempest-CreateVolumesFromSourceVolumeTest-111434518 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:18:16 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-fd755aea-7678-44be-b809-d3eed84df4c4 tempest-CreateVolumesFromSourceVolumeTest-111434518 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:18:16 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-fd755aea-7678-44be-b809-d3eed84df4c4 tempest-CreateVolumesFromSourceVolumeTest-111434518 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:18:16 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-fd755aea-7678-44be-b809-d3eed84df4c4 tempest-CreateVolumesFromSourceVolumeTest-111434518 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:18:16 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-fd755aea-7678-44be-b809-d3eed84df4c4 tempest-CreateVolumesFromSourceVolumeTest-111434518 None] Selected osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c as target Quobyte volume. {{(pid=87515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 10:18:16 devstack cinder-volume[87515]: INFO cinder.volume.drivers.remotefs [None req-fd755aea-7678-44be-b809-d3eed84df4c4 tempest-CreateVolumesFromSourceVolumeTest-111434518 None] casted to osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c Sep 07 10:18:16 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-fd755aea-7678-44be-b809-d3eed84df4c4 tempest-CreateVolumesFromSourceVolumeTest-111434518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-97f301d2-1c54-4d95-89e1-49e7e7991bc3 1073741824 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:18:16 devstack sudo[106835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-97f301d2-1c54-4d95-89e1-49e7e7991bc3 1073741824 Sep 07 10:18:16 devstack sudo[106835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:18:16 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-430011be-2e43-414b-afe2-39e636f04469 tempest-CreateVolumesFromSourceVolumeTest-111434518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b029275b-fd88-48e4-b4b5-2a75eab75206) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f219527b-edf2-4045-a6f9-965e0945b744', 'volume_size': 1}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:18:16 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-430011be-2e43-414b-afe2-39e636f04469 tempest-CreateVolumesFromSourceVolumeTest-111434518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d07484b-d48e-408d-9f26-f1c4b2d8b9d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:18:16 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-430011be-2e43-414b-afe2-39e636f04469 tempest-CreateVolumesFromSourceVolumeTest-111434518 None] Volume volume-f219527b-edf2-4045-a6f9-965e0945b744 (f219527b-edf2-4045-a6f9-965e0945b744): created successfully Sep 07 10:18:16 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-430011be-2e43-414b-afe2-39e636f04469 tempest-CreateVolumesFromSourceVolumeTest-111434518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d07484b-d48e-408d-9f26-f1c4b2d8b9d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:18:16 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-430011be-2e43-414b-afe2-39e636f04469 tempest-CreateVolumesFromSourceVolumeTest-111434518 None] Flow 'volume_create_manager' (24407c71-d5ca-4156-a2f9-bc2d28c12ad6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:18:16 devstack sudo[106834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-0d379b4d-778c-418e-818e-ac0038e7d769 Sep 07 10:18:16 devstack sudo[106834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:18:16 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-430011be-2e43-414b-afe2-39e636f04469 tempest-CreateVolumesFromSourceVolumeTest-111434518 None] Created volume successfully. Sep 07 10:18:17 devstack sudo[106834]: pam_unix(sudo:session): session closed for user root Sep 07 10:18:17 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-d987048f-8294-41c0-a3dc-602c671b8dd1 tempest-CreateVolumesFromImageTest-296560334 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-0d379b4d-778c-418e-818e-ac0038e7d769" returned: 0 in 0.399s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:18:17 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-d987048f-8294-41c0-a3dc-602c671b8dd1 tempest-CreateVolumesFromImageTest-296560334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-0d379b4d-778c-418e-818e-ac0038e7d769 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:18:17 devstack sudo[106845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-0d379b4d-778c-418e-818e-ac0038e7d769 Sep 07 10:18:17 devstack sudo[106845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:18:17 devstack sudo[106835]: pam_unix(sudo:session): session closed for user root Sep 07 10:18:17 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-fd755aea-7678-44be-b809-d3eed84df4c4 tempest-CreateVolumesFromSourceVolumeTest-111434518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-97f301d2-1c54-4d95-89e1-49e7e7991bc3 1073741824" returned: 0 in 0.432s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:18:17 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-fd755aea-7678-44be-b809-d3eed84df4c4 tempest-CreateVolumesFromSourceVolumeTest-111434518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-97f301d2-1c54-4d95-89e1-49e7e7991bc3 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:18:17 devstack sudo[106847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-97f301d2-1c54-4d95-89e1-49e7e7991bc3 Sep 07 10:18:17 devstack sudo[106847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:18:17 devstack sudo[106845]: pam_unix(sudo:session): session closed for user root Sep 07 10:18:17 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-d987048f-8294-41c0-a3dc-602c671b8dd1 tempest-CreateVolumesFromImageTest-296560334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-0d379b4d-778c-418e-818e-ac0038e7d769" returned: 0 in 0.275s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:18:17 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-d987048f-8294-41c0-a3dc-602c671b8dd1 tempest-CreateVolumesFromImageTest-296560334 None] Lock "cinder-quobyte-0d379b4d-778c-418e-818e-ac0038e7d769" released by "delete_volume" :: held 0.725s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:18:17 devstack cinder-volume[87515]: DEBUG cinder.quota [None req-d987048f-8294-41c0-a3dc-602c671b8dd1 tempest-CreateVolumesFromImageTest-296560334 None] Created reservations ['09ba9e0d-97af-469e-9311-f912a7410faa', 'a24ecd83-fac1-4827-b07a-5fb74bd4146d', '62d3b7bc-5e07-4a73-9a82-746fd0e719a0', '0ef4309c-c76a-4df6-81de-fc76bf0e5f7d'] {{(pid=87515) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:18:17 devstack sudo[106847]: pam_unix(sudo:session): session closed for user root Sep 07 10:18:17 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-fd755aea-7678-44be-b809-d3eed84df4c4 tempest-CreateVolumesFromSourceVolumeTest-111434518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-97f301d2-1c54-4d95-89e1-49e7e7991bc3" returned: 0 in 0.288s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:18:17 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-fd755aea-7678-44be-b809-d3eed84df4c4 tempest-CreateVolumesFromSourceVolumeTest-111434518 None] <== create_volume: return (770ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'} {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 10:18:17 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-fd755aea-7678-44be-b809-d3eed84df4c4 tempest-CreateVolumesFromSourceVolumeTest-111434518 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.773s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:18:17 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-210704b7-0df2-4e88-8c50-c81c72426451 tempest-CreateVolumesFromSourceVolumeTest-111434518 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.997s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:18:17 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-210704b7-0df2-4e88-8c50-c81c72426451 tempest-CreateVolumesFromSourceVolumeTest-111434518 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:18:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-129303713',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38b2b2b1-7d42-4c03-8bfb-af8794eee52f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1596dfb46b6048a39258b40787d56cb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:18:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:18:12Z,use_quota=True,user_id='ac941fc6439241cfa0cdd521ad8db64c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3a092cd-7947-4cbf-abff-4ba9567becf0),volume_type_id=f3a092cd-7947-4cbf-abff-4ba9567becf0)}" {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 10:18:17 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-210704b7-0df2-4e88-8c50-c81c72426451 tempest-CreateVolumesFromSourceVolumeTest-111434518 None] Creating volume 38b2b2b1-7d42-4c03-8bfb-af8794eee52f {{(pid=87515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 10:18:17 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-210704b7-0df2-4e88-8c50-c81c72426451 tempest-CreateVolumesFromSourceVolumeTest-111434518 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:18:17 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-210704b7-0df2-4e88-8c50-c81c72426451 tempest-CreateVolumesFromSourceVolumeTest-111434518 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:18:17 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-210704b7-0df2-4e88-8c50-c81c72426451 tempest-CreateVolumesFromSourceVolumeTest-111434518 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:18:17 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-210704b7-0df2-4e88-8c50-c81c72426451 tempest-CreateVolumesFromSourceVolumeTest-111434518 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:18:17 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-210704b7-0df2-4e88-8c50-c81c72426451 tempest-CreateVolumesFromSourceVolumeTest-111434518 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:18:17 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-210704b7-0df2-4e88-8c50-c81c72426451 tempest-CreateVolumesFromSourceVolumeTest-111434518 None] Selected osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c as target Quobyte volume. {{(pid=87515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 10:18:17 devstack cinder-volume[87515]: INFO cinder.volume.drivers.remotefs [None req-210704b7-0df2-4e88-8c50-c81c72426451 tempest-CreateVolumesFromSourceVolumeTest-111434518 None] casted to osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c Sep 07 10:18:17 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-210704b7-0df2-4e88-8c50-c81c72426451 tempest-CreateVolumesFromSourceVolumeTest-111434518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-38b2b2b1-7d42-4c03-8bfb-af8794eee52f 1073741824 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:18:17 devstack sudo[106851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-38b2b2b1-7d42-4c03-8bfb-af8794eee52f 1073741824 Sep 07 10:18:17 devstack sudo[106851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:18:17 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-fd755aea-7678-44be-b809-d3eed84df4c4 tempest-CreateVolumesFromSourceVolumeTest-111434518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0bf49f2e-2ad7-435f-8bff-a1355f08f21c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-97f301d2-1c54-4d95-89e1-49e7e7991bc3', 'volume_size': 1}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:18:17 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-fd755aea-7678-44be-b809-d3eed84df4c4 tempest-CreateVolumesFromSourceVolumeTest-111434518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49e6cbe5-1ccf-4690-a9ca-89293c61260a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:18:17 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-d987048f-8294-41c0-a3dc-602c671b8dd1 tempest-CreateVolumesFromImageTest-296560334 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:18:17 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-d987048f-8294-41c0-a3dc-602c671b8dd1 tempest-CreateVolumesFromImageTest-296560334 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:18:17 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-d987048f-8294-41c0-a3dc-602c671b8dd1 tempest-CreateVolumesFromImageTest-296560334 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:18:17 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-d987048f-8294-41c0-a3dc-602c671b8dd1 tempest-CreateVolumesFromImageTest-296560334 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:18:17 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-d987048f-8294-41c0-a3dc-602c671b8dd1 tempest-CreateVolumesFromImageTest-296560334 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:18:17 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-d987048f-8294-41c0-a3dc-602c671b8dd1 tempest-CreateVolumesFromImageTest-296560334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:18:17 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-fd755aea-7678-44be-b809-d3eed84df4c4 tempest-CreateVolumesFromSourceVolumeTest-111434518 None] Volume volume-97f301d2-1c54-4d95-89e1-49e7e7991bc3 (97f301d2-1c54-4d95-89e1-49e7e7991bc3): created successfully Sep 07 10:18:17 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-fd755aea-7678-44be-b809-d3eed84df4c4 tempest-CreateVolumesFromSourceVolumeTest-111434518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49e6cbe5-1ccf-4690-a9ca-89293c61260a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:18:17 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-fd755aea-7678-44be-b809-d3eed84df4c4 tempest-CreateVolumesFromSourceVolumeTest-111434518 None] Flow 'volume_create_manager' (4dd21797-e432-49d4-8c7b-50cb3daf0c32) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:18:17 devstack sudo[106853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a Sep 07 10:18:17 devstack sudo[106853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:18:17 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-fd755aea-7678-44be-b809-d3eed84df4c4 tempest-CreateVolumesFromSourceVolumeTest-111434518 None] Created volume successfully. Sep 07 10:18:17 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-320264de-4b21-45bb-b024-8420142b5bf6 tempest-CreateVolumesFromImageTest-296560334 None] Acquiring lock "cinder-e95ffa7a-6c32-41ea-a834-364d2b65530b-delete_volume" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:18:17 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-320264de-4b21-45bb-b024-8420142b5bf6 tempest-CreateVolumesFromImageTest-296560334 None] Lock "cinder-e95ffa7a-6c32-41ea-a834-364d2b65530b-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:18:17 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-320264de-4b21-45bb-b024-8420142b5bf6 tempest-CreateVolumesFromImageTest-296560334 None] Acquiring lock "cinder-quobyte-e95ffa7a-6c32-41ea-a834-364d2b65530b" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:18:17 devstack sudo[106853]: pam_unix(sudo:session): session closed for user root Sep 07 10:18:17 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-d987048f-8294-41c0-a3dc-602c671b8dd1 tempest-CreateVolumesFromImageTest-296560334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a" returned: 0 in 0.268s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:18:17 devstack cinder-volume[87515]: DEBUG cinder.manager [None req-d987048f-8294-41c0-a3dc-602c671b8dd1 tempest-CreateVolumesFromImageTest-296560334 None] Notifying Schedulers of capabilities ... {{(pid=87515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:18:17 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-d987048f-8294-41c0-a3dc-602c671b8dd1 tempest-CreateVolumesFromImageTest-296560334 None] Deleted volume successfully. Sep 07 10:18:17 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-320264de-4b21-45bb-b024-8420142b5bf6 tempest-CreateVolumesFromImageTest-296560334 None] Lock "cinder-quobyte-e95ffa7a-6c32-41ea-a834-364d2b65530b" acquired by "delete_volume" :: waited 0.026s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:18:17 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[068aa6e9-ceeb-40a9-a133-f52e32ad1625]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:18:17 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-320264de-4b21-45bb-b024-8420142b5bf6 tempest-CreateVolumesFromImageTest-296560334 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-e95ffa7a-6c32-41ea-a834-364d2b65530b {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:18:17 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-d987048f-8294-41c0-a3dc-602c671b8dd1 tempest-CreateVolumesFromImageTest-296560334 None] Lock "cinder-0d379b4d-778c-418e-818e-ac0038e7d769-delete_volume" released by "delete_volume" :: held 1.293s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:18:18 devstack sudo[106851]: pam_unix(sudo:session): session closed for user root Sep 07 10:18:18 devstack sudo[106859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-e95ffa7a-6c32-41ea-a834-364d2b65530b Sep 07 10:18:18 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-210704b7-0df2-4e88-8c50-c81c72426451 tempest-CreateVolumesFromSourceVolumeTest-111434518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-38b2b2b1-7d42-4c03-8bfb-af8794eee52f 1073741824" returned: 0 in 0.490s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:18:18 devstack sudo[106859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:18:18 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-210704b7-0df2-4e88-8c50-c81c72426451 tempest-CreateVolumesFromSourceVolumeTest-111434518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-38b2b2b1-7d42-4c03-8bfb-af8794eee52f {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:18:18 devstack sudo[106861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-38b2b2b1-7d42-4c03-8bfb-af8794eee52f Sep 07 10:18:18 devstack sudo[106861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:18:18 devstack sudo[106859]: pam_unix(sudo:session): session closed for user root Sep 07 10:18:18 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-320264de-4b21-45bb-b024-8420142b5bf6 tempest-CreateVolumesFromImageTest-296560334 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-e95ffa7a-6c32-41ea-a834-364d2b65530b" returned: 0 in 0.376s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:18:18 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-320264de-4b21-45bb-b024-8420142b5bf6 tempest-CreateVolumesFromImageTest-296560334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-e95ffa7a-6c32-41ea-a834-364d2b65530b {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:18:18 devstack sudo[106867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-e95ffa7a-6c32-41ea-a834-364d2b65530b Sep 07 10:18:18 devstack sudo[106867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:18:18 devstack sudo[106861]: pam_unix(sudo:session): session closed for user root Sep 07 10:18:18 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-210704b7-0df2-4e88-8c50-c81c72426451 tempest-CreateVolumesFromSourceVolumeTest-111434518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-38b2b2b1-7d42-4c03-8bfb-af8794eee52f" returned: 0 in 0.261s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:18:18 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-210704b7-0df2-4e88-8c50-c81c72426451 tempest-CreateVolumesFromSourceVolumeTest-111434518 None] <== create_volume: return (797ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'} {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 10:18:18 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-210704b7-0df2-4e88-8c50-c81c72426451 tempest-CreateVolumesFromSourceVolumeTest-111434518 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.800s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:18:18 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-727c7906-4ed6-4c97-bc9f-af41bf61754a tempest-CreateVolumesFromSourceVolumeTest-111434518 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.436s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:18:18 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-727c7906-4ed6-4c97-bc9f-af41bf61754a tempest-CreateVolumesFromSourceVolumeTest-111434518 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:18:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1366309062',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13e24d06-ede2-4c2d-a359-c9a772b2efab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1596dfb46b6048a39258b40787d56cb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:18:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:18:13Z,use_quota=True,user_id='ac941fc6439241cfa0cdd521ad8db64c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3a092cd-7947-4cbf-abff-4ba9567becf0),volume_type_id=f3a092cd-7947-4cbf-abff-4ba9567becf0)}" {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 10:18:18 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-727c7906-4ed6-4c97-bc9f-af41bf61754a tempest-CreateVolumesFromSourceVolumeTest-111434518 None] Creating volume 13e24d06-ede2-4c2d-a359-c9a772b2efab {{(pid=87515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 10:18:18 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-727c7906-4ed6-4c97-bc9f-af41bf61754a tempest-CreateVolumesFromSourceVolumeTest-111434518 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:18:18 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-727c7906-4ed6-4c97-bc9f-af41bf61754a tempest-CreateVolumesFromSourceVolumeTest-111434518 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:18:18 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-727c7906-4ed6-4c97-bc9f-af41bf61754a tempest-CreateVolumesFromSourceVolumeTest-111434518 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:18:18 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-727c7906-4ed6-4c97-bc9f-af41bf61754a tempest-CreateVolumesFromSourceVolumeTest-111434518 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:18:18 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-727c7906-4ed6-4c97-bc9f-af41bf61754a tempest-CreateVolumesFromSourceVolumeTest-111434518 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:18:18 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-727c7906-4ed6-4c97-bc9f-af41bf61754a tempest-CreateVolumesFromSourceVolumeTest-111434518 None] Selected osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c as target Quobyte volume. {{(pid=87515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 10:18:18 devstack cinder-volume[87515]: INFO cinder.volume.drivers.remotefs [None req-727c7906-4ed6-4c97-bc9f-af41bf61754a tempest-CreateVolumesFromSourceVolumeTest-111434518 None] casted to osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c Sep 07 10:18:18 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-727c7906-4ed6-4c97-bc9f-af41bf61754a tempest-CreateVolumesFromSourceVolumeTest-111434518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-13e24d06-ede2-4c2d-a359-c9a772b2efab 1073741824 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:18:18 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-210704b7-0df2-4e88-8c50-c81c72426451 tempest-CreateVolumesFromSourceVolumeTest-111434518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0796d74c-4e50-4efa-a44b-47969ccc9b8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-38b2b2b1-7d42-4c03-8bfb-af8794eee52f', 'volume_size': 1}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:18:18 devstack sudo[106869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-13e24d06-ede2-4c2d-a359-c9a772b2efab 1073741824 Sep 07 10:18:18 devstack sudo[106869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:18:18 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-210704b7-0df2-4e88-8c50-c81c72426451 tempest-CreateVolumesFromSourceVolumeTest-111434518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38a8e228-8bdf-4a1e-82bb-18d46cf39f9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:18:18 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-210704b7-0df2-4e88-8c50-c81c72426451 tempest-CreateVolumesFromSourceVolumeTest-111434518 None] Volume volume-38b2b2b1-7d42-4c03-8bfb-af8794eee52f (38b2b2b1-7d42-4c03-8bfb-af8794eee52f): created successfully Sep 07 10:18:18 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-210704b7-0df2-4e88-8c50-c81c72426451 tempest-CreateVolumesFromSourceVolumeTest-111434518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38a8e228-8bdf-4a1e-82bb-18d46cf39f9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:18:18 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-210704b7-0df2-4e88-8c50-c81c72426451 tempest-CreateVolumesFromSourceVolumeTest-111434518 None] Flow 'volume_create_manager' (1ed68b3c-da47-4110-8aca-f597310eeae3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:18:18 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-210704b7-0df2-4e88-8c50-c81c72426451 tempest-CreateVolumesFromSourceVolumeTest-111434518 None] Created volume successfully. Sep 07 10:18:18 devstack sudo[106867]: pam_unix(sudo:session): session closed for user root Sep 07 10:18:18 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-320264de-4b21-45bb-b024-8420142b5bf6 tempest-CreateVolumesFromImageTest-296560334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-e95ffa7a-6c32-41ea-a834-364d2b65530b" returned: 0 in 0.276s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:18:18 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-320264de-4b21-45bb-b024-8420142b5bf6 tempest-CreateVolumesFromImageTest-296560334 None] Lock "cinder-quobyte-e95ffa7a-6c32-41ea-a834-364d2b65530b" released by "delete_volume" :: held 0.698s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:18:18 devstack cinder-volume[87515]: DEBUG cinder.quota [None req-320264de-4b21-45bb-b024-8420142b5bf6 tempest-CreateVolumesFromImageTest-296560334 None] Created reservations ['5cc0229e-dfdf-4e3a-9311-2db8bfa747a8', 'ae8f488c-09ed-4064-a1f1-75e4c8cc0986', 'd30dade9-be9e-47fe-a51f-c7b8f1645f3b', 'd9ae5574-2e58-445f-b25a-a945eabbde7f'] {{(pid=87515) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:18:18 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-320264de-4b21-45bb-b024-8420142b5bf6 tempest-CreateVolumesFromImageTest-296560334 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:18:18 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-320264de-4b21-45bb-b024-8420142b5bf6 tempest-CreateVolumesFromImageTest-296560334 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:18:18 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-320264de-4b21-45bb-b024-8420142b5bf6 tempest-CreateVolumesFromImageTest-296560334 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:18:18 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-320264de-4b21-45bb-b024-8420142b5bf6 tempest-CreateVolumesFromImageTest-296560334 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:18:18 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-320264de-4b21-45bb-b024-8420142b5bf6 tempest-CreateVolumesFromImageTest-296560334 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:18:18 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-320264de-4b21-45bb-b024-8420142b5bf6 tempest-CreateVolumesFromImageTest-296560334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:18:18 devstack sudo[106876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a Sep 07 10:18:18 devstack sudo[106876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:18:18 devstack sudo[106869]: pam_unix(sudo:session): session closed for user root Sep 07 10:18:18 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-727c7906-4ed6-4c97-bc9f-af41bf61754a tempest-CreateVolumesFromSourceVolumeTest-111434518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-13e24d06-ede2-4c2d-a359-c9a772b2efab 1073741824" returned: 0 in 0.506s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:18:18 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-727c7906-4ed6-4c97-bc9f-af41bf61754a tempest-CreateVolumesFromSourceVolumeTest-111434518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-13e24d06-ede2-4c2d-a359-c9a772b2efab {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:18:18 devstack sudo[106878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-13e24d06-ede2-4c2d-a359-c9a772b2efab Sep 07 10:18:18 devstack sudo[106878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:18:18 devstack sudo[106876]: pam_unix(sudo:session): session closed for user root Sep 07 10:18:18 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-9fd64134-2553-48b0-a2ae-88626d555b10 tempest-CreateVolumesFromImageTest-296560334 None] Acquiring lock "cinder-97e279ce-e959-47a0-8fe0-68a04ffa0c7a-delete_volume" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:18:18 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-320264de-4b21-45bb-b024-8420142b5bf6 tempest-CreateVolumesFromImageTest-296560334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a" returned: 0 in 0.280s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:18:18 devstack cinder-volume[87515]: DEBUG cinder.manager [None req-320264de-4b21-45bb-b024-8420142b5bf6 tempest-CreateVolumesFromImageTest-296560334 None] Notifying Schedulers of capabilities ... {{(pid=87515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:18:18 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-320264de-4b21-45bb-b024-8420142b5bf6 tempest-CreateVolumesFromImageTest-296560334 None] Deleted volume successfully. Sep 07 10:18:19 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-9fd64134-2553-48b0-a2ae-88626d555b10 tempest-CreateVolumesFromImageTest-296560334 None] Lock "cinder-97e279ce-e959-47a0-8fe0-68a04ffa0c7a-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:18:19 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-320264de-4b21-45bb-b024-8420142b5bf6 tempest-CreateVolumesFromImageTest-296560334 None] Lock "cinder-e95ffa7a-6c32-41ea-a834-364d2b65530b-delete_volume" released by "delete_volume" :: held 1.223s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:18:19 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-9fd64134-2553-48b0-a2ae-88626d555b10 tempest-CreateVolumesFromImageTest-296560334 None] Acquiring lock "cinder-quobyte-97e279ce-e959-47a0-8fe0-68a04ffa0c7a" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:18:19 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-9fd64134-2553-48b0-a2ae-88626d555b10 tempest-CreateVolumesFromImageTest-296560334 None] Lock "cinder-quobyte-97e279ce-e959-47a0-8fe0-68a04ffa0c7a" acquired by "delete_volume" :: waited 0.015s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:18:19 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[fce7d00f-e7de-4f7f-b8b2-987ac439eeb4]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:18:19 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-9fd64134-2553-48b0-a2ae-88626d555b10 tempest-CreateVolumesFromImageTest-296560334 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-97e279ce-e959-47a0-8fe0-68a04ffa0c7a {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:18:19 devstack sudo[106878]: pam_unix(sudo:session): session closed for user root Sep 07 10:18:19 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-727c7906-4ed6-4c97-bc9f-af41bf61754a tempest-CreateVolumesFromSourceVolumeTest-111434518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-13e24d06-ede2-4c2d-a359-c9a772b2efab" returned: 0 in 0.283s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:18:19 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-727c7906-4ed6-4c97-bc9f-af41bf61754a tempest-CreateVolumesFromSourceVolumeTest-111434518 None] <== create_volume: return (832ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'} {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 10:18:19 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-727c7906-4ed6-4c97-bc9f-af41bf61754a tempest-CreateVolumesFromSourceVolumeTest-111434518 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.835s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:18:19 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-a353d390-7b90-40b6-b004-ff95b59f3a61 tempest-CreateVolumesFromSourceVolumeTest-111434518 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.685s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:18:19 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-a353d390-7b90-40b6-b004-ff95b59f3a61 tempest-CreateVolumesFromSourceVolumeTest-111434518 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:18:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-175846756',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f8c8091-092d-44fd-bd18-6ac043122ac2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1596dfb46b6048a39258b40787d56cb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:18:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:18:13Z,use_quota=True,user_id='ac941fc6439241cfa0cdd521ad8db64c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3a092cd-7947-4cbf-abff-4ba9567becf0),volume_type_id=f3a092cd-7947-4cbf-abff-4ba9567becf0)}" {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 10:18:19 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-a353d390-7b90-40b6-b004-ff95b59f3a61 tempest-CreateVolumesFromSourceVolumeTest-111434518 None] Creating volume 4f8c8091-092d-44fd-bd18-6ac043122ac2 {{(pid=87515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 10:18:19 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-a353d390-7b90-40b6-b004-ff95b59f3a61 tempest-CreateVolumesFromSourceVolumeTest-111434518 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:18:19 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-a353d390-7b90-40b6-b004-ff95b59f3a61 tempest-CreateVolumesFromSourceVolumeTest-111434518 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:18:19 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-a353d390-7b90-40b6-b004-ff95b59f3a61 tempest-CreateVolumesFromSourceVolumeTest-111434518 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:18:19 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-a353d390-7b90-40b6-b004-ff95b59f3a61 tempest-CreateVolumesFromSourceVolumeTest-111434518 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:18:19 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-a353d390-7b90-40b6-b004-ff95b59f3a61 tempest-CreateVolumesFromSourceVolumeTest-111434518 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:18:19 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-a353d390-7b90-40b6-b004-ff95b59f3a61 tempest-CreateVolumesFromSourceVolumeTest-111434518 None] Selected osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c as target Quobyte volume. {{(pid=87515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 10:18:19 devstack cinder-volume[87515]: INFO cinder.volume.drivers.remotefs [None req-a353d390-7b90-40b6-b004-ff95b59f3a61 tempest-CreateVolumesFromSourceVolumeTest-111434518 None] casted to osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c Sep 07 10:18:19 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-a353d390-7b90-40b6-b004-ff95b59f3a61 tempest-CreateVolumesFromSourceVolumeTest-111434518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-4f8c8091-092d-44fd-bd18-6ac043122ac2 1073741824 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:18:19 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-727c7906-4ed6-4c97-bc9f-af41bf61754a tempest-CreateVolumesFromSourceVolumeTest-111434518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3697ead0-70b7-4f90-b74f-6b77dc3578c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-13e24d06-ede2-4c2d-a359-c9a772b2efab', 'volume_size': 1}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:18:19 devstack sudo[106883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-4f8c8091-092d-44fd-bd18-6ac043122ac2 1073741824 Sep 07 10:18:19 devstack sudo[106883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:18:19 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-727c7906-4ed6-4c97-bc9f-af41bf61754a tempest-CreateVolumesFromSourceVolumeTest-111434518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (202bff3e-ded1-43e2-9710-49d855603d1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:18:19 devstack sudo[106881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-97e279ce-e959-47a0-8fe0-68a04ffa0c7a Sep 07 10:18:19 devstack sudo[106881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:18:19 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-727c7906-4ed6-4c97-bc9f-af41bf61754a tempest-CreateVolumesFromSourceVolumeTest-111434518 None] Volume volume-13e24d06-ede2-4c2d-a359-c9a772b2efab (13e24d06-ede2-4c2d-a359-c9a772b2efab): created successfully Sep 07 10:18:19 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-727c7906-4ed6-4c97-bc9f-af41bf61754a tempest-CreateVolumesFromSourceVolumeTest-111434518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (202bff3e-ded1-43e2-9710-49d855603d1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:18:19 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-727c7906-4ed6-4c97-bc9f-af41bf61754a tempest-CreateVolumesFromSourceVolumeTest-111434518 None] Flow 'volume_create_manager' (e70742de-7bf1-40df-9a37-09b1155ec818) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:18:19 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-727c7906-4ed6-4c97-bc9f-af41bf61754a tempest-CreateVolumesFromSourceVolumeTest-111434518 None] Created volume successfully. Sep 07 10:18:19 devstack sudo[106881]: pam_unix(sudo:session): session closed for user root Sep 07 10:18:19 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-9fd64134-2553-48b0-a2ae-88626d555b10 tempest-CreateVolumesFromImageTest-296560334 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-97e279ce-e959-47a0-8fe0-68a04ffa0c7a" returned: 0 in 0.376s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:18:19 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-9fd64134-2553-48b0-a2ae-88626d555b10 tempest-CreateVolumesFromImageTest-296560334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-97e279ce-e959-47a0-8fe0-68a04ffa0c7a {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:18:19 devstack sudo[106893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-97e279ce-e959-47a0-8fe0-68a04ffa0c7a Sep 07 10:18:19 devstack sudo[106893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:18:19 devstack sudo[106883]: pam_unix(sudo:session): session closed for user root Sep 07 10:18:19 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-a353d390-7b90-40b6-b004-ff95b59f3a61 tempest-CreateVolumesFromSourceVolumeTest-111434518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-4f8c8091-092d-44fd-bd18-6ac043122ac2 1073741824" returned: 0 in 0.460s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:18:19 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-a353d390-7b90-40b6-b004-ff95b59f3a61 tempest-CreateVolumesFromSourceVolumeTest-111434518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-4f8c8091-092d-44fd-bd18-6ac043122ac2 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:18:19 devstack sudo[106896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-4f8c8091-092d-44fd-bd18-6ac043122ac2 Sep 07 10:18:19 devstack sudo[106896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:18:19 devstack sudo[106893]: pam_unix(sudo:session): session closed for user root Sep 07 10:18:19 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-9fd64134-2553-48b0-a2ae-88626d555b10 tempest-CreateVolumesFromImageTest-296560334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-97e279ce-e959-47a0-8fe0-68a04ffa0c7a" returned: 0 in 0.269s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:18:19 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-9fd64134-2553-48b0-a2ae-88626d555b10 tempest-CreateVolumesFromImageTest-296560334 None] Lock "cinder-quobyte-97e279ce-e959-47a0-8fe0-68a04ffa0c7a" released by "delete_volume" :: held 0.688s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:18:19 devstack cinder-volume[87515]: DEBUG cinder.quota [None req-9fd64134-2553-48b0-a2ae-88626d555b10 tempest-CreateVolumesFromImageTest-296560334 None] Created reservations ['ec61ad40-d87b-4fdc-ab53-d0de503fa03f', '766fac03-644c-4d1d-ba7a-8b26dcd3fed8', '0ea7a404-241a-4293-a9d1-3e028defdff0', 'ec0567e8-7651-4bbb-8d8a-06b07598ecf5'] {{(pid=87515) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:18:19 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-9fd64134-2553-48b0-a2ae-88626d555b10 tempest-CreateVolumesFromImageTest-296560334 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:18:19 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-9fd64134-2553-48b0-a2ae-88626d555b10 tempest-CreateVolumesFromImageTest-296560334 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:18:19 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-9fd64134-2553-48b0-a2ae-88626d555b10 tempest-CreateVolumesFromImageTest-296560334 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:18:19 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-9fd64134-2553-48b0-a2ae-88626d555b10 tempest-CreateVolumesFromImageTest-296560334 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:18:19 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-9fd64134-2553-48b0-a2ae-88626d555b10 tempest-CreateVolumesFromImageTest-296560334 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:18:19 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-9fd64134-2553-48b0-a2ae-88626d555b10 tempest-CreateVolumesFromImageTest-296560334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:18:19 devstack sudo[106900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a Sep 07 10:18:19 devstack sudo[106900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:18:19 devstack sudo[106896]: pam_unix(sudo:session): session closed for user root Sep 07 10:18:19 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-a353d390-7b90-40b6-b004-ff95b59f3a61 tempest-CreateVolumesFromSourceVolumeTest-111434518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-4f8c8091-092d-44fd-bd18-6ac043122ac2" returned: 0 in 0.288s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:18:19 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-a353d390-7b90-40b6-b004-ff95b59f3a61 tempest-CreateVolumesFromSourceVolumeTest-111434518 None] <== create_volume: return (793ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'} {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 10:18:19 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-a353d390-7b90-40b6-b004-ff95b59f3a61 tempest-CreateVolumesFromSourceVolumeTest-111434518 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.796s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:18:19 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-20314ffc-c3f8-466d-8769-148e7164d3c7 tempest-VolumeDependencyTests-1280371773 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.752s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:18:19 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-a353d390-7b90-40b6-b004-ff95b59f3a61 tempest-CreateVolumesFromSourceVolumeTest-111434518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d7e8d5b-294f-4922-92f1-9969cec30045) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4f8c8091-092d-44fd-bd18-6ac043122ac2', 'volume_size': 1}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:18:19 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-a353d390-7b90-40b6-b004-ff95b59f3a61 tempest-CreateVolumesFromSourceVolumeTest-111434518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9b42b73-b64d-48fb-9a26-17e2a2fd3740) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:18:19 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-20314ffc-c3f8-466d-8769-148e7164d3c7 tempest-VolumeDependencyTests-1280371773 None] Creating offline snapshot 3b9c86c3-3056-4110-ad20-6abc82c60cb5 of volume 321e9476-3454-435c-936f-cee61f12d97f {{(pid=87515) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 10:18:19 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-a353d390-7b90-40b6-b004-ff95b59f3a61 tempest-CreateVolumesFromSourceVolumeTest-111434518 None] Volume volume-4f8c8091-092d-44fd-bd18-6ac043122ac2 (4f8c8091-092d-44fd-bd18-6ac043122ac2): created successfully Sep 07 10:18:20 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-a353d390-7b90-40b6-b004-ff95b59f3a61 tempest-CreateVolumesFromSourceVolumeTest-111434518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9b42b73-b64d-48fb-9a26-17e2a2fd3740) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:18:20 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-a353d390-7b90-40b6-b004-ff95b59f3a61 tempest-CreateVolumesFromSourceVolumeTest-111434518 None] Flow 'volume_create_manager' (f0813c16-cd71-4e0b-a420-e5d4623545d7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:18:20 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3e5d01b-1284-44bb-86e9-6399e5788354]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:18:20 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-20314ffc-c3f8-466d-8769-148e7164d3c7 tempest-VolumeDependencyTests-1280371773 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-321e9476-3454-435c-936f-cee61f12d97f {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:18:20 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-a353d390-7b90-40b6-b004-ff95b59f3a61 tempest-CreateVolumesFromSourceVolumeTest-111434518 None] Created volume successfully. Sep 07 10:18:20 devstack sudo[106902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-321e9476-3454-435c-936f-cee61f12d97f Sep 07 10:18:20 devstack sudo[106902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:18:20 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-2fd02159-0f20-45bd-94cc-b477dff54815 tempest-CreateVolumesFromImageTest-296560334 None] Acquiring lock "cinder-db9a0c07-2521-46b6-a235-173fd902d92e-delete_volume" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:18:20 devstack sudo[106900]: pam_unix(sudo:session): session closed for user root Sep 07 10:18:20 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-9fd64134-2553-48b0-a2ae-88626d555b10 tempest-CreateVolumesFromImageTest-296560334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a" returned: 0 in 0.257s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:18:20 devstack cinder-volume[87515]: DEBUG cinder.manager [None req-9fd64134-2553-48b0-a2ae-88626d555b10 tempest-CreateVolumesFromImageTest-296560334 None] Notifying Schedulers of capabilities ... {{(pid=87515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:18:20 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-2fd02159-0f20-45bd-94cc-b477dff54815 tempest-CreateVolumesFromImageTest-296560334 None] Lock "cinder-db9a0c07-2521-46b6-a235-173fd902d92e-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:18:20 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-9fd64134-2553-48b0-a2ae-88626d555b10 tempest-CreateVolumesFromImageTest-296560334 None] Deleted volume successfully. Sep 07 10:18:20 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-9fd64134-2553-48b0-a2ae-88626d555b10 tempest-CreateVolumesFromImageTest-296560334 None] Lock "cinder-97e279ce-e959-47a0-8fe0-68a04ffa0c7a-delete_volume" released by "delete_volume" :: held 1.205s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:18:20 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-2fd02159-0f20-45bd-94cc-b477dff54815 tempest-CreateVolumesFromImageTest-296560334 None] Acquiring lock "cinder-quobyte-db9a0c07-2521-46b6-a235-173fd902d92e" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:18:20 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-2fd02159-0f20-45bd-94cc-b477dff54815 tempest-CreateVolumesFromImageTest-296560334 None] Lock "cinder-quobyte-db9a0c07-2521-46b6-a235-173fd902d92e" acquired by "delete_volume" :: waited 0.014s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:18:20 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[5df911de-cde2-468e-9ea9-73874ebff469]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:18:20 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-2fd02159-0f20-45bd-94cc-b477dff54815 tempest-CreateVolumesFromImageTest-296560334 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-db9a0c07-2521-46b6-a235-173fd902d92e {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:18:20 devstack sudo[106905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-db9a0c07-2521-46b6-a235-173fd902d92e Sep 07 10:18:20 devstack sudo[106905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:18:20 devstack sudo[106902]: pam_unix(sudo:session): session closed for user root Sep 07 10:18:20 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-20314ffc-c3f8-466d-8769-148e7164d3c7 tempest-VolumeDependencyTests-1280371773 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-321e9476-3454-435c-936f-cee61f12d97f" returned: 0 in 0.438s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:18:20 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-20314ffc-c3f8-466d-8769-148e7164d3c7 tempest-VolumeDependencyTests-1280371773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-321e9476-3454-435c-936f-cee61f12d97f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-321e9476-3454-435c-936f-cee61f12d97f.3b9c86c3-3056-4110-ad20-6abc82c60cb5 1G {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:18:20 devstack sudo[106910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-321e9476-3454-435c-936f-cee61f12d97f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-321e9476-3454-435c-936f-cee61f12d97f.3b9c86c3-3056-4110-ad20-6abc82c60cb5 1G Sep 07 10:18:20 devstack sudo[106910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:18:20 devstack sudo[106905]: pam_unix(sudo:session): session closed for user root Sep 07 10:18:20 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-2fd02159-0f20-45bd-94cc-b477dff54815 tempest-CreateVolumesFromImageTest-296560334 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-db9a0c07-2521-46b6-a235-173fd902d92e" returned: 0 in 0.372s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:18:20 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-2fd02159-0f20-45bd-94cc-b477dff54815 tempest-CreateVolumesFromImageTest-296560334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-db9a0c07-2521-46b6-a235-173fd902d92e {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:18:20 devstack sudo[106915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-db9a0c07-2521-46b6-a235-173fd902d92e Sep 07 10:18:20 devstack sudo[106915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:18:20 devstack sudo[106910]: pam_unix(sudo:session): session closed for user root Sep 07 10:18:20 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-20314ffc-c3f8-466d-8769-148e7164d3c7 tempest-VolumeDependencyTests-1280371773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-321e9476-3454-435c-936f-cee61f12d97f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-321e9476-3454-435c-936f-cee61f12d97f.3b9c86c3-3056-4110-ad20-6abc82c60cb5 1G" returned: 0 in 0.388s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:18:20 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-20314ffc-c3f8-466d-8769-148e7164d3c7 tempest-VolumeDependencyTests-1280371773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-321e9476-3454-435c-936f-cee61f12d97f -F qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-321e9476-3454-435c-936f-cee61f12d97f.3b9c86c3-3056-4110-ad20-6abc82c60cb5 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:18:20 devstack sudo[106920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-321e9476-3454-435c-936f-cee61f12d97f -F qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-321e9476-3454-435c-936f-cee61f12d97f.3b9c86c3-3056-4110-ad20-6abc82c60cb5 Sep 07 10:18:20 devstack sudo[106920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:18:20 devstack sudo[106915]: pam_unix(sudo:session): session closed for user root Sep 07 10:18:20 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-2fd02159-0f20-45bd-94cc-b477dff54815 tempest-CreateVolumesFromImageTest-296560334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-db9a0c07-2521-46b6-a235-173fd902d92e" returned: 0 in 0.256s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:18:20 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-2fd02159-0f20-45bd-94cc-b477dff54815 tempest-CreateVolumesFromImageTest-296560334 None] Lock "cinder-quobyte-db9a0c07-2521-46b6-a235-173fd902d92e" released by "delete_volume" :: held 0.671s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:18:20 devstack cinder-volume[87515]: DEBUG cinder.quota [None req-2fd02159-0f20-45bd-94cc-b477dff54815 tempest-CreateVolumesFromImageTest-296560334 None] Created reservations ['abf191c4-badb-4253-9731-f2ca707809a9', '127bac9a-3bec-44f1-85ba-b1cc6680c8c6', '161a8ff8-1375-4fb3-9475-bf9b3ac0158c', '2df8001c-0b14-48e8-b289-e38c2420a9f8'] {{(pid=87515) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:18:21 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-2fd02159-0f20-45bd-94cc-b477dff54815 tempest-CreateVolumesFromImageTest-296560334 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:18:21 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-2fd02159-0f20-45bd-94cc-b477dff54815 tempest-CreateVolumesFromImageTest-296560334 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:18:21 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-2fd02159-0f20-45bd-94cc-b477dff54815 tempest-CreateVolumesFromImageTest-296560334 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:18:21 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-2fd02159-0f20-45bd-94cc-b477dff54815 tempest-CreateVolumesFromImageTest-296560334 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:18:21 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-2fd02159-0f20-45bd-94cc-b477dff54815 tempest-CreateVolumesFromImageTest-296560334 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:18:21 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-2fd02159-0f20-45bd-94cc-b477dff54815 tempest-CreateVolumesFromImageTest-296560334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:18:21 devstack sudo[106923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a Sep 07 10:18:21 devstack sudo[106923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:18:21 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-7ac00966-7ae7-40e7-8f94-05242e3ddd89 tempest-CreateVolumesFromSourceVolumeTest-111434518 None] Acquiring lock "cinder-4f8c8091-092d-44fd-bd18-6ac043122ac2-delete_volume" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:18:21 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-7ac00966-7ae7-40e7-8f94-05242e3ddd89 tempest-CreateVolumesFromSourceVolumeTest-111434518 None] Lock "cinder-4f8c8091-092d-44fd-bd18-6ac043122ac2-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:18:21 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-7ac00966-7ae7-40e7-8f94-05242e3ddd89 tempest-CreateVolumesFromSourceVolumeTest-111434518 None] Acquiring lock "cinder-quobyte-4f8c8091-092d-44fd-bd18-6ac043122ac2" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:18:21 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-7ac00966-7ae7-40e7-8f94-05242e3ddd89 tempest-CreateVolumesFromSourceVolumeTest-111434518 None] Lock "cinder-quobyte-4f8c8091-092d-44fd-bd18-6ac043122ac2" acquired by "delete_volume" :: waited 0.016s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:18:21 devstack sudo[106920]: pam_unix(sudo:session): session closed for user root Sep 07 10:18:21 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-20314ffc-c3f8-466d-8769-148e7164d3c7 tempest-VolumeDependencyTests-1280371773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-321e9476-3454-435c-936f-cee61f12d97f -F qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-321e9476-3454-435c-936f-cee61f12d97f.3b9c86c3-3056-4110-ad20-6abc82c60cb5" returned: 0 in 0.349s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:18:21 devstack cinder-volume[87515]: WARNING cinder.volume.drivers.remotefs [None req-20314ffc-c3f8-466d-8769-148e7164d3c7 tempest-VolumeDependencyTests-1280371773 None] /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-321e9476-3454-435c-936f-cee61f12d97f.3b9c86c3-3056-4110-ad20-6abc82c60cb5 is being set with open permissions: ugo+rw Sep 07 10:18:21 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-20314ffc-c3f8-466d-8769-148e7164d3c7 tempest-VolumeDependencyTests-1280371773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-321e9476-3454-435c-936f-cee61f12d97f.3b9c86c3-3056-4110-ad20-6abc82c60cb5 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:18:21 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[76e968a6-0d29-4351-a7de-a278eb55542d]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:18:21 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-7ac00966-7ae7-40e7-8f94-05242e3ddd89 tempest-CreateVolumesFromSourceVolumeTest-111434518 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-4f8c8091-092d-44fd-bd18-6ac043122ac2 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:18:21 devstack sudo[106928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-321e9476-3454-435c-936f-cee61f12d97f.3b9c86c3-3056-4110-ad20-6abc82c60cb5 Sep 07 10:18:21 devstack sudo[106928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:18:21 devstack sudo[106923]: pam_unix(sudo:session): session closed for user root Sep 07 10:18:21 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-17c15202-4dbf-4e5e-a3f0-766eada93fc5 tempest-CreateVolumesFromImageTest-296560334 None] Acquiring lock "cinder-e66220a2-f982-4d64-9fe3-21571c7feb4a-delete_volume" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:18:21 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-2fd02159-0f20-45bd-94cc-b477dff54815 tempest-CreateVolumesFromImageTest-296560334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a" returned: 0 in 0.309s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:18:21 devstack cinder-volume[87515]: DEBUG cinder.manager [None req-2fd02159-0f20-45bd-94cc-b477dff54815 tempest-CreateVolumesFromImageTest-296560334 None] Notifying Schedulers of capabilities ... {{(pid=87515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:18:21 devstack sudo[106929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-4f8c8091-092d-44fd-bd18-6ac043122ac2 Sep 07 10:18:21 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-2fd02159-0f20-45bd-94cc-b477dff54815 tempest-CreateVolumesFromImageTest-296560334 None] Deleted volume successfully. Sep 07 10:18:21 devstack sudo[106929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:18:21 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-17c15202-4dbf-4e5e-a3f0-766eada93fc5 tempest-CreateVolumesFromImageTest-296560334 None] Lock "cinder-e66220a2-f982-4d64-9fe3-21571c7feb4a-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:18:21 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-2fd02159-0f20-45bd-94cc-b477dff54815 tempest-CreateVolumesFromImageTest-296560334 None] Lock "cinder-db9a0c07-2521-46b6-a235-173fd902d92e-delete_volume" released by "delete_volume" :: held 1.217s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:18:21 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-17c15202-4dbf-4e5e-a3f0-766eada93fc5 tempest-CreateVolumesFromImageTest-296560334 None] Acquiring lock "cinder-quobyte-e66220a2-f982-4d64-9fe3-21571c7feb4a" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:18:21 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-17c15202-4dbf-4e5e-a3f0-766eada93fc5 tempest-CreateVolumesFromImageTest-296560334 None] Lock "cinder-quobyte-e66220a2-f982-4d64-9fe3-21571c7feb4a" acquired by "delete_volume" :: waited 0.025s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:18:21 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[5385319a-8079-4728-b0ab-1a8ac9085dfb]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:18:21 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-17c15202-4dbf-4e5e-a3f0-766eada93fc5 tempest-CreateVolumesFromImageTest-296560334 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-e66220a2-f982-4d64-9fe3-21571c7feb4a {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:18:21 devstack sudo[106928]: pam_unix(sudo:session): session closed for user root Sep 07 10:18:21 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-20314ffc-c3f8-466d-8769-148e7164d3c7 tempest-VolumeDependencyTests-1280371773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-321e9476-3454-435c-936f-cee61f12d97f.3b9c86c3-3056-4110-ad20-6abc82c60cb5" returned: 0 in 0.358s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:18:21 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-20314ffc-c3f8-466d-8769-148e7164d3c7 tempest-VolumeDependencyTests-1280371773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-321e9476-3454-435c-936f-cee61f12d97f.info {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:18:21 devstack sudo[106933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-e66220a2-f982-4d64-9fe3-21571c7feb4a Sep 07 10:18:21 devstack sudo[106935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-321e9476-3454-435c-936f-cee61f12d97f.info Sep 07 10:18:21 devstack sudo[106933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:18:21 devstack sudo[106935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:18:21 devstack sudo[106929]: pam_unix(sudo:session): session closed for user root Sep 07 10:18:21 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-7ac00966-7ae7-40e7-8f94-05242e3ddd89 tempest-CreateVolumesFromSourceVolumeTest-111434518 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-4f8c8091-092d-44fd-bd18-6ac043122ac2" returned: 0 in 0.480s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:18:21 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-7ac00966-7ae7-40e7-8f94-05242e3ddd89 tempest-CreateVolumesFromSourceVolumeTest-111434518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-4f8c8091-092d-44fd-bd18-6ac043122ac2 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:18:21 devstack sudo[106941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-4f8c8091-092d-44fd-bd18-6ac043122ac2 Sep 07 10:18:21 devstack sudo[106941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:18:21 devstack sudo[106935]: pam_unix(sudo:session): session closed for user root Sep 07 10:18:21 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-20314ffc-c3f8-466d-8769-148e7164d3c7 tempest-VolumeDependencyTests-1280371773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-321e9476-3454-435c-936f-cee61f12d97f.info" returned: 0 in 0.272s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:18:21 devstack cinder-volume[87515]: WARNING cinder.volume.drivers.remotefs [None req-20314ffc-c3f8-466d-8769-148e7164d3c7 tempest-VolumeDependencyTests-1280371773 None] /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-321e9476-3454-435c-936f-cee61f12d97f.info is being set with open permissions: ugo+rw Sep 07 10:18:21 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-20314ffc-c3f8-466d-8769-148e7164d3c7 tempest-VolumeDependencyTests-1280371773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-321e9476-3454-435c-936f-cee61f12d97f.info {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:18:21 devstack sudo[106933]: pam_unix(sudo:session): session closed for user root Sep 07 10:18:21 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-17c15202-4dbf-4e5e-a3f0-766eada93fc5 tempest-CreateVolumesFromImageTest-296560334 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-e66220a2-f982-4d64-9fe3-21571c7feb4a" returned: 0 in 0.376s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:18:21 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-17c15202-4dbf-4e5e-a3f0-766eada93fc5 tempest-CreateVolumesFromImageTest-296560334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-e66220a2-f982-4d64-9fe3-21571c7feb4a {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:18:21 devstack sudo[106947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-321e9476-3454-435c-936f-cee61f12d97f.info Sep 07 10:18:21 devstack sudo[106947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:18:21 devstack sudo[106948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-e66220a2-f982-4d64-9fe3-21571c7feb4a Sep 07 10:18:21 devstack sudo[106948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:18:21 devstack sudo[106941]: pam_unix(sudo:session): session closed for user root Sep 07 10:18:21 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-7ac00966-7ae7-40e7-8f94-05242e3ddd89 tempest-CreateVolumesFromSourceVolumeTest-111434518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-4f8c8091-092d-44fd-bd18-6ac043122ac2" returned: 0 in 0.268s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:18:21 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-7ac00966-7ae7-40e7-8f94-05242e3ddd89 tempest-CreateVolumesFromSourceVolumeTest-111434518 None] Lock "cinder-quobyte-4f8c8091-092d-44fd-bd18-6ac043122ac2" released by "delete_volume" :: held 0.805s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:18:22 devstack cinder-volume[87515]: DEBUG cinder.quota [None req-7ac00966-7ae7-40e7-8f94-05242e3ddd89 tempest-CreateVolumesFromSourceVolumeTest-111434518 None] Created reservations ['d4d25356-e9e1-42cd-a280-4d90aa15494d', 'f8a9f2bb-404a-4b2f-a8c8-f719bfb280dc', '4cd1c0e3-5f46-4127-bd8c-1caf0326e467', 'd22b9e92-c498-4bca-8d75-0b14f9033b22'] {{(pid=87515) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:18:22 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-7ac00966-7ae7-40e7-8f94-05242e3ddd89 tempest-CreateVolumesFromSourceVolumeTest-111434518 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:18:22 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-7ac00966-7ae7-40e7-8f94-05242e3ddd89 tempest-CreateVolumesFromSourceVolumeTest-111434518 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:18:22 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-7ac00966-7ae7-40e7-8f94-05242e3ddd89 tempest-CreateVolumesFromSourceVolumeTest-111434518 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:18:22 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-7ac00966-7ae7-40e7-8f94-05242e3ddd89 tempest-CreateVolumesFromSourceVolumeTest-111434518 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:18:22 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-7ac00966-7ae7-40e7-8f94-05242e3ddd89 tempest-CreateVolumesFromSourceVolumeTest-111434518 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:18:22 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-7ac00966-7ae7-40e7-8f94-05242e3ddd89 tempest-CreateVolumesFromSourceVolumeTest-111434518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:18:22 devstack sudo[106954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a Sep 07 10:18:22 devstack sudo[106954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:18:22 devstack sudo[106947]: pam_unix(sudo:session): session closed for user root Sep 07 10:18:22 devstack sudo[106948]: pam_unix(sudo:session): session closed for user root Sep 07 10:18:22 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-20314ffc-c3f8-466d-8769-148e7164d3c7 tempest-VolumeDependencyTests-1280371773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-321e9476-3454-435c-936f-cee61f12d97f.info" returned: 0 in 0.267s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:18:22 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-20314ffc-c3f8-466d-8769-148e7164d3c7 tempest-VolumeDependencyTests-1280371773 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.189s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:18:22 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-2b20ce9e-8095-4ffa-b896-49a97447fbbe tempest-VolumeAndVolumeTypeFromImageTest-975568629 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.935s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:18:22 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-2b20ce9e-8095-4ffa-b896-49a97447fbbe tempest-VolumeAndVolumeTypeFromImageTest-975568629 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:18:14Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=879c7071-a915-4633-b091-5ce48faf8d79,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0de5d145c4da4191b542cb37983cd7fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:18:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:18:14Z,use_quota=True,user_id='693731cc9bea4a9b9a60ab68abf75fd6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8905195b-9c51-4d6d-90ab-923d94400089),volume_type_id=8905195b-9c51-4d6d-90ab-923d94400089)}" {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 10:18:22 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-2b20ce9e-8095-4ffa-b896-49a97447fbbe tempest-VolumeAndVolumeTypeFromImageTest-975568629 None] Creating volume 879c7071-a915-4633-b091-5ce48faf8d79 {{(pid=87515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 10:18:22 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-2b20ce9e-8095-4ffa-b896-49a97447fbbe tempest-VolumeAndVolumeTypeFromImageTest-975568629 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:18:22 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-2b20ce9e-8095-4ffa-b896-49a97447fbbe tempest-VolumeAndVolumeTypeFromImageTest-975568629 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:18:22 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-2b20ce9e-8095-4ffa-b896-49a97447fbbe tempest-VolumeAndVolumeTypeFromImageTest-975568629 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:18:22 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-2b20ce9e-8095-4ffa-b896-49a97447fbbe tempest-VolumeAndVolumeTypeFromImageTest-975568629 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:18:22 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-2b20ce9e-8095-4ffa-b896-49a97447fbbe tempest-VolumeAndVolumeTypeFromImageTest-975568629 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:18:22 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-2b20ce9e-8095-4ffa-b896-49a97447fbbe tempest-VolumeAndVolumeTypeFromImageTest-975568629 None] Selected osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c as target Quobyte volume. {{(pid=87515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 10:18:22 devstack cinder-volume[87515]: INFO cinder.volume.drivers.remotefs [None req-2b20ce9e-8095-4ffa-b896-49a97447fbbe tempest-VolumeAndVolumeTypeFromImageTest-975568629 None] casted to osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c Sep 07 10:18:22 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-2b20ce9e-8095-4ffa-b896-49a97447fbbe tempest-VolumeAndVolumeTypeFromImageTest-975568629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-879c7071-a915-4633-b091-5ce48faf8d79 1073741824 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:18:22 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-17c15202-4dbf-4e5e-a3f0-766eada93fc5 tempest-CreateVolumesFromImageTest-296560334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-e66220a2-f982-4d64-9fe3-21571c7feb4a" returned: 0 in 0.300s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:18:22 devstack sudo[106956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-879c7071-a915-4633-b091-5ce48faf8d79 1073741824 Sep 07 10:18:22 devstack sudo[106956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:18:22 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-17c15202-4dbf-4e5e-a3f0-766eada93fc5 tempest-CreateVolumesFromImageTest-296560334 None] Lock "cinder-quobyte-e66220a2-f982-4d64-9fe3-21571c7feb4a" released by "delete_volume" :: held 0.735s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:18:22 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-20314ffc-c3f8-466d-8769-148e7164d3c7 tempest-VolumeDependencyTests-1280371773 None] Create snapshot completed successfully Sep 07 10:18:22 devstack cinder-volume[87515]: DEBUG cinder.quota [None req-17c15202-4dbf-4e5e-a3f0-766eada93fc5 tempest-CreateVolumesFromImageTest-296560334 None] Created reservations ['6f7e654c-df49-4970-b414-c5fd6b1d3b74', 'aa95f14f-2184-4487-8dd0-028db03c5d83', '0a0a5974-7129-49d4-bfb3-0e1bf9b8de95', 'e91938ae-5d96-4e2d-a3b2-88f7c4b3613d'] {{(pid=87515) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:18:22 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-20da5da7-ddea-413b-804d-b28a3532bc42 tempest-CreateVolumesFromSourceVolumeTest-111434518 None] Acquiring lock "cinder-13e24d06-ede2-4c2d-a359-c9a772b2efab-delete_volume" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:18:22 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-20da5da7-ddea-413b-804d-b28a3532bc42 tempest-CreateVolumesFromSourceVolumeTest-111434518 None] Lock "cinder-13e24d06-ede2-4c2d-a359-c9a772b2efab-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:18:22 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-20da5da7-ddea-413b-804d-b28a3532bc42 tempest-CreateVolumesFromSourceVolumeTest-111434518 None] Acquiring lock "cinder-quobyte-13e24d06-ede2-4c2d-a359-c9a772b2efab" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:18:22 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-17c15202-4dbf-4e5e-a3f0-766eada93fc5 tempest-CreateVolumesFromImageTest-296560334 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:18:22 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-17c15202-4dbf-4e5e-a3f0-766eada93fc5 tempest-CreateVolumesFromImageTest-296560334 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:18:22 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-17c15202-4dbf-4e5e-a3f0-766eada93fc5 tempest-CreateVolumesFromImageTest-296560334 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:18:22 devstack sudo[106954]: pam_unix(sudo:session): session closed for user root Sep 07 10:18:22 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-17c15202-4dbf-4e5e-a3f0-766eada93fc5 tempest-CreateVolumesFromImageTest-296560334 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:18:22 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-17c15202-4dbf-4e5e-a3f0-766eada93fc5 tempest-CreateVolumesFromImageTest-296560334 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:18:22 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-17c15202-4dbf-4e5e-a3f0-766eada93fc5 tempest-CreateVolumesFromImageTest-296560334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:18:22 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-20da5da7-ddea-413b-804d-b28a3532bc42 tempest-CreateVolumesFromSourceVolumeTest-111434518 None] Lock "cinder-quobyte-13e24d06-ede2-4c2d-a359-c9a772b2efab" acquired by "delete_volume" :: waited 0.045s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:18:22 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-7ac00966-7ae7-40e7-8f94-05242e3ddd89 tempest-CreateVolumesFromSourceVolumeTest-111434518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a" returned: 0 in 0.362s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:18:22 devstack sudo[106961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a Sep 07 10:18:22 devstack cinder-volume[87515]: DEBUG cinder.manager [None req-7ac00966-7ae7-40e7-8f94-05242e3ddd89 tempest-CreateVolumesFromSourceVolumeTest-111434518 None] Notifying Schedulers of capabilities ... {{(pid=87515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:18:22 devstack sudo[106961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:18:22 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-7ac00966-7ae7-40e7-8f94-05242e3ddd89 tempest-CreateVolumesFromSourceVolumeTest-111434518 None] Deleted volume successfully. Sep 07 10:18:22 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[e74c180f-1269-4638-bc02-ea79f7d552a7]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:18:22 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-20da5da7-ddea-413b-804d-b28a3532bc42 tempest-CreateVolumesFromSourceVolumeTest-111434518 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-13e24d06-ede2-4c2d-a359-c9a772b2efab {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:18:22 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-7ac00966-7ae7-40e7-8f94-05242e3ddd89 tempest-CreateVolumesFromSourceVolumeTest-111434518 None] Lock "cinder-4f8c8091-092d-44fd-bd18-6ac043122ac2-delete_volume" released by "delete_volume" :: held 1.399s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:18:22 devstack sudo[106964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-13e24d06-ede2-4c2d-a359-c9a772b2efab Sep 07 10:18:22 devstack sudo[106964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:18:22 devstack sudo[106961]: pam_unix(sudo:session): session closed for user root Sep 07 10:18:22 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-17c15202-4dbf-4e5e-a3f0-766eada93fc5 tempest-CreateVolumesFromImageTest-296560334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a" returned: 0 in 0.331s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:18:22 devstack cinder-volume[87515]: DEBUG cinder.manager [None req-17c15202-4dbf-4e5e-a3f0-766eada93fc5 tempest-CreateVolumesFromImageTest-296560334 None] Notifying Schedulers of capabilities ... {{(pid=87515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:18:22 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-17c15202-4dbf-4e5e-a3f0-766eada93fc5 tempest-CreateVolumesFromImageTest-296560334 None] Deleted volume successfully. Sep 07 10:18:22 devstack sudo[106956]: pam_unix(sudo:session): session closed for user root Sep 07 10:18:22 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-17c15202-4dbf-4e5e-a3f0-766eada93fc5 tempest-CreateVolumesFromImageTest-296560334 None] Lock "cinder-e66220a2-f982-4d64-9fe3-21571c7feb4a-delete_volume" released by "delete_volume" :: held 1.421s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:18:22 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-2b20ce9e-8095-4ffa-b896-49a97447fbbe tempest-VolumeAndVolumeTypeFromImageTest-975568629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-879c7071-a915-4633-b091-5ce48faf8d79 1073741824" returned: 0 in 0.652s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:18:22 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-2b20ce9e-8095-4ffa-b896-49a97447fbbe tempest-VolumeAndVolumeTypeFromImageTest-975568629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-879c7071-a915-4633-b091-5ce48faf8d79 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:18:22 devstack sudo[106967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-879c7071-a915-4633-b091-5ce48faf8d79 Sep 07 10:18:22 devstack sudo[106967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:18:22 devstack sudo[106964]: pam_unix(sudo:session): session closed for user root Sep 07 10:18:22 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-20da5da7-ddea-413b-804d-b28a3532bc42 tempest-CreateVolumesFromSourceVolumeTest-111434518 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-13e24d06-ede2-4c2d-a359-c9a772b2efab" returned: 0 in 0.508s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:18:22 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-20da5da7-ddea-413b-804d-b28a3532bc42 tempest-CreateVolumesFromSourceVolumeTest-111434518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-13e24d06-ede2-4c2d-a359-c9a772b2efab {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:18:23 devstack sudo[106972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-13e24d06-ede2-4c2d-a359-c9a772b2efab Sep 07 10:18:23 devstack sudo[106972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:18:23 devstack sudo[106967]: pam_unix(sudo:session): session closed for user root Sep 07 10:18:23 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-2b20ce9e-8095-4ffa-b896-49a97447fbbe tempest-VolumeAndVolumeTypeFromImageTest-975568629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-879c7071-a915-4633-b091-5ce48faf8d79" returned: 0 in 0.326s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:18:23 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-2b20ce9e-8095-4ffa-b896-49a97447fbbe tempest-VolumeAndVolumeTypeFromImageTest-975568629 None] <== create_volume: return (1028ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'} {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 10:18:23 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-2b20ce9e-8095-4ffa-b896-49a97447fbbe tempest-VolumeAndVolumeTypeFromImageTest-975568629 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.034s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:18:23 devstack cinder-volume[87515]: DEBUG cinder.volume.volume_utils [None req-2b20ce9e-8095-4ffa-b896-49a97447fbbe tempest-VolumeAndVolumeTypeFromImageTest-975568629 None] Attempting download of 18b53134-13b3-434f-af5c-094d7476cdb4 ((None, [{'url': 'file:///opt/stack/data/glance/images/18b53134-13b3-434f-af5c-094d7476cdb4', 'metadata': {}}])) to volume 879c7071-a915-4633-b091-5ce48faf8d79. {{(pid=87515) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 07 10:18:23 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[652e86c7-d78c-471f-9a57-971f921f0e5e]: (4, 'raw') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:18:23 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-2b20ce9e-8095-4ffa-b896-49a97447fbbe tempest-VolumeAndVolumeTypeFromImageTest-975568629 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_18b53134-13b3-434f-af5c-094d7476cdb4_x39gmmle {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:18:23 devstack sudo[106972]: pam_unix(sudo:session): session closed for user root Sep 07 10:18:23 devstack cinder-volume[87515]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c6ae0d1-e81d-4c5e-aa6f-b9542111baa6 tempest-VolumeDependencyTests-1280371773 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 10:18:23 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-20da5da7-ddea-413b-804d-b28a3532bc42 tempest-CreateVolumesFromSourceVolumeTest-111434518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-13e24d06-ede2-4c2d-a359-c9a772b2efab" returned: 0 in 0.356s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:18:23 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-2c6ae0d1-e81d-4c5e-aa6f-b9542111baa6 tempest-VolumeDependencyTests-1280371773 None] Flow 'volume_create_manager' (f61ab3a4-f7a2-478b-ad27-fd0376cd0063) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:18:23 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-2c6ae0d1-e81d-4c5e-aa6f-b9542111baa6 tempest-VolumeDependencyTests-1280371773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9266e228-bd17-4a00-9fe3-cf89719e9eea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:18:23 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-20da5da7-ddea-413b-804d-b28a3532bc42 tempest-CreateVolumesFromSourceVolumeTest-111434518 None] Lock "cinder-quobyte-13e24d06-ede2-4c2d-a359-c9a772b2efab" released by "delete_volume" :: held 0.947s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:18:23 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-2c6ae0d1-e81d-4c5e-aa6f-b9542111baa6 tempest-VolumeDependencyTests-1280371773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9266e228-bd17-4a00-9fe3-cf89719e9eea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:18:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1080649797',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e93a0b2c-d426-4a44-af44-da3a7e5d09ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4bcbb3ce234437bb6bf9d32d30a5a64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:18:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=3b9c86c3-3056-4110-ad20-6abc82c60cb5,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:18:23Z,use_quota=True,user_id='3fdd123e3b8c4082a15d5d604aabfc06',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3a092cd-7947-4cbf-abff-4ba9567becf0),volume_type_id=f3a092cd-7947-4cbf-abff-4ba9567becf0)' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:18:23 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-2c6ae0d1-e81d-4c5e-aa6f-b9542111baa6 tempest-VolumeDependencyTests-1280371773 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (361265f2-67b6-40c3-b011-bf6377369d47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:18:23 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-2c6ae0d1-e81d-4c5e-aa6f-b9542111baa6 tempest-VolumeDependencyTests-1280371773 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (361265f2-67b6-40c3-b011-bf6377369d47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:18:23 devstack sudo[106976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_18b53134-13b3-434f-af5c-094d7476cdb4_x39gmmle Sep 07 10:18:23 devstack sudo[106976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:18:23 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-2c6ae0d1-e81d-4c5e-aa6f-b9542111baa6 tempest-VolumeDependencyTests-1280371773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b69aee8-efb3-4f0b-b70e-1f0c5a6645cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:18:23 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-2c6ae0d1-e81d-4c5e-aa6f-b9542111baa6 tempest-VolumeDependencyTests-1280371773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b69aee8-efb3-4f0b-b70e-1f0c5a6645cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'e93a0b2c-d426-4a44-af44-da3a7e5d09ee', 'volume_name': 'volume-e93a0b2c-d426-4a44-af44-da3a7e5d09ee', 'volume_size': 1, 'snapshot_id': '3b9c86c3-3056-4110-ad20-6abc82c60cb5'}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:18:23 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-2c6ae0d1-e81d-4c5e-aa6f-b9542111baa6 tempest-VolumeDependencyTests-1280371773 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce9fef35-8c1b-4dcc-b7e6-877d74919217) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:18:23 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-2c6ae0d1-e81d-4c5e-aa6f-b9542111baa6 tempest-VolumeDependencyTests-1280371773 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce9fef35-8c1b-4dcc-b7e6-877d74919217) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:18:23 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-2c6ae0d1-e81d-4c5e-aa6f-b9542111baa6 tempest-VolumeDependencyTests-1280371773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (392d497e-c4b5-4a4c-949d-a3ea96256750) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:18:23 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-2c6ae0d1-e81d-4c5e-aa6f-b9542111baa6 tempest-VolumeDependencyTests-1280371773 None] Volume e93a0b2c-d426-4a44-af44-da3a7e5d09ee: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-e93a0b2c-d426-4a44-af44-da3a7e5d09ee', 'volume_size': 1, 'snapshot_id': '3b9c86c3-3056-4110-ad20-6abc82c60cb5'} Sep 07 10:18:23 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-2c6ae0d1-e81d-4c5e-aa6f-b9542111baa6 tempest-VolumeDependencyTests-1280371773 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:18:23 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-2c6ae0d1-e81d-4c5e-aa6f-b9542111baa6 tempest-VolumeDependencyTests-1280371773 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:18:23 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-2c6ae0d1-e81d-4c5e-aa6f-b9542111baa6 tempest-VolumeDependencyTests-1280371773 None] Acquiring lock "cinder-quobyte-3b9c86c3-3056-4110-ad20-6abc82c60cb5-e93a0b2c-d426-4a44-af44-da3a7e5d09ee" by "_create_volume_from_snapshot" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:18:23 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-2c6ae0d1-e81d-4c5e-aa6f-b9542111baa6 tempest-VolumeDependencyTests-1280371773 None] Lock "cinder-quobyte-3b9c86c3-3056-4110-ad20-6abc82c60cb5-e93a0b2c-d426-4a44-af44-da3a7e5d09ee" acquired by "_create_volume_from_snapshot" :: waited 0.031s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:18:23 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-2c6ae0d1-e81d-4c5e-aa6f-b9542111baa6 tempest-VolumeDependencyTests-1280371773 None] Creating volume e93a0b2c-d426-4a44-af44-da3a7e5d09ee from snapshot 3b9c86c3-3056-4110-ad20-6abc82c60cb5 {{(pid=87515) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 07 10:18:23 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-2c6ae0d1-e81d-4c5e-aa6f-b9542111baa6 tempest-VolumeDependencyTests-1280371773 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:18:23 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-2c6ae0d1-e81d-4c5e-aa6f-b9542111baa6 tempest-VolumeDependencyTests-1280371773 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:18:23 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-2c6ae0d1-e81d-4c5e-aa6f-b9542111baa6 tempest-VolumeDependencyTests-1280371773 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:18:23 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-2c6ae0d1-e81d-4c5e-aa6f-b9542111baa6 tempest-VolumeDependencyTests-1280371773 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:18:23 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-2c6ae0d1-e81d-4c5e-aa6f-b9542111baa6 tempest-VolumeDependencyTests-1280371773 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:18:23 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-2c6ae0d1-e81d-4c5e-aa6f-b9542111baa6 tempest-VolumeDependencyTests-1280371773 None] Selected osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c as target Quobyte volume. {{(pid=87515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 10:18:23 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-2c6ae0d1-e81d-4c5e-aa6f-b9542111baa6 tempest-VolumeDependencyTests-1280371773 None] Acquiring lock "cinder-quobyte-e93a0b2c-d426-4a44-af44-da3a7e5d09ee" by "_copy_volume_from_snapshot" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:18:23 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-2c6ae0d1-e81d-4c5e-aa6f-b9542111baa6 tempest-VolumeDependencyTests-1280371773 None] Lock "cinder-quobyte-e93a0b2c-d426-4a44-af44-da3a7e5d09ee" acquired by "_copy_volume_from_snapshot" :: waited 0.036s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:18:23 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-2c6ae0d1-e81d-4c5e-aa6f-b9542111baa6 tempest-VolumeDependencyTests-1280371773 None] snapshot: 3b9c86c3-3056-4110-ad20-6abc82c60cb5, volume: e93a0b2c-d426-4a44-af44-da3a7e5d09ee, {{(pid=87515) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 07 10:18:23 devstack cinder-volume[87515]: DEBUG cinder.quota [None req-20da5da7-ddea-413b-804d-b28a3532bc42 tempest-CreateVolumesFromSourceVolumeTest-111434518 None] Created reservations ['1811e115-065b-4d83-b983-12ce31ba3a97', '57f1f6e3-626e-4a8d-8524-4f1be789acd3', '43d7ea70-66b0-4e4c-846d-4ac85bf101a3', '382a8cdd-03df-42ab-bb9a-fab77846c72e'] {{(pid=87515) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:18:23 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-2c6ae0d1-e81d-4c5e-aa6f-b9542111baa6 tempest-VolumeDependencyTests-1280371773 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:18:23 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-2c6ae0d1-e81d-4c5e-aa6f-b9542111baa6 tempest-VolumeDependencyTests-1280371773 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:18:23 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-2c6ae0d1-e81d-4c5e-aa6f-b9542111baa6 tempest-VolumeDependencyTests-1280371773 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:18:23 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-2c6ae0d1-e81d-4c5e-aa6f-b9542111baa6 tempest-VolumeDependencyTests-1280371773 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:18:23 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-2c6ae0d1-e81d-4c5e-aa6f-b9542111baa6 tempest-VolumeDependencyTests-1280371773 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:18:23 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a1f21d4-71dd-4ca1-a881-7204081f4420]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:18:23 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-2c6ae0d1-e81d-4c5e-aa6f-b9542111baa6 tempest-VolumeDependencyTests-1280371773 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-321e9476-3454-435c-936f-cee61f12d97f.3b9c86c3-3056-4110-ad20-6abc82c60cb5 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:18:23 devstack sudo[106976]: pam_unix(sudo:session): session closed for user root Sep 07 10:18:23 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-2b20ce9e-8095-4ffa-b896-49a97447fbbe tempest-VolumeAndVolumeTypeFromImageTest-975568629 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_18b53134-13b3-434f-af5c-094d7476cdb4_x39gmmle" returned: 0 in 0.450s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:18:23 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-2b20ce9e-8095-4ffa-b896-49a97447fbbe tempest-VolumeAndVolumeTypeFromImageTest-975568629 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_18b53134-13b3-434f-af5c-094d7476cdb4_x39gmmle {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:18:23 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-20da5da7-ddea-413b-804d-b28a3532bc42 tempest-CreateVolumesFromSourceVolumeTest-111434518 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:18:23 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-20da5da7-ddea-413b-804d-b28a3532bc42 tempest-CreateVolumesFromSourceVolumeTest-111434518 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:18:23 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-20da5da7-ddea-413b-804d-b28a3532bc42 tempest-CreateVolumesFromSourceVolumeTest-111434518 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:18:23 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-20da5da7-ddea-413b-804d-b28a3532bc42 tempest-CreateVolumesFromSourceVolumeTest-111434518 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:18:23 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-20da5da7-ddea-413b-804d-b28a3532bc42 tempest-CreateVolumesFromSourceVolumeTest-111434518 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:18:23 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-20da5da7-ddea-413b-804d-b28a3532bc42 tempest-CreateVolumesFromSourceVolumeTest-111434518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:18:23 devstack sudo[106978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-321e9476-3454-435c-936f-cee61f12d97f.3b9c86c3-3056-4110-ad20-6abc82c60cb5 Sep 07 10:18:23 devstack sudo[106978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:18:23 devstack sudo[106983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a Sep 07 10:18:23 devstack sudo[106983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:18:23 devstack sudo[106981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_18b53134-13b3-434f-af5c-094d7476cdb4_x39gmmle Sep 07 10:18:23 devstack sudo[106981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:18:24 devstack sudo[106983]: pam_unix(sudo:session): session closed for user root Sep 07 10:18:24 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-20da5da7-ddea-413b-804d-b28a3532bc42 tempest-CreateVolumesFromSourceVolumeTest-111434518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a" returned: 0 in 0.263s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:18:24 devstack cinder-volume[87515]: DEBUG cinder.manager [None req-20da5da7-ddea-413b-804d-b28a3532bc42 tempest-CreateVolumesFromSourceVolumeTest-111434518 None] Notifying Schedulers of capabilities ... {{(pid=87515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:18:24 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-20da5da7-ddea-413b-804d-b28a3532bc42 tempest-CreateVolumesFromSourceVolumeTest-111434518 None] Deleted volume successfully. Sep 07 10:18:24 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-20da5da7-ddea-413b-804d-b28a3532bc42 tempest-CreateVolumesFromSourceVolumeTest-111434518 None] Lock "cinder-13e24d06-ede2-4c2d-a359-c9a772b2efab-delete_volume" released by "delete_volume" :: held 1.751s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:18:24 devstack sudo[106981]: pam_unix(sudo:session): session closed for user root Sep 07 10:18:24 devstack sudo[106978]: pam_unix(sudo:session): session closed for user root Sep 07 10:18:24 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-2b20ce9e-8095-4ffa-b896-49a97447fbbe tempest-VolumeAndVolumeTypeFromImageTest-975568629 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_18b53134-13b3-434f-af5c-094d7476cdb4_x39gmmle" returned: 1 in 0.418s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:18:24 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-2b20ce9e-8095-4ffa-b896-49a97447fbbe tempest-VolumeAndVolumeTypeFromImageTest-975568629 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_18b53134-13b3-434f-af5c-094d7476cdb4_x39gmmle' failed. Not Retrying. {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 07 10:18:24 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-2c6ae0d1-e81d-4c5e-aa6f-b9542111baa6 tempest-VolumeDependencyTests-1280371773 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-321e9476-3454-435c-936f-cee61f12d97f.3b9c86c3-3056-4110-ad20-6abc82c60cb5" returned: 0 in 0.513s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:18:24 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-2c6ae0d1-e81d-4c5e-aa6f-b9542111baa6 tempest-VolumeDependencyTests-1280371773 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-321e9476-3454-435c-936f-cee61f12d97f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87515) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 10:18:24 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8fe7995-181f-4544-8bf8-2af6316ecd8f]: (4, 'raw') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:18:24 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-2b20ce9e-8095-4ffa-b896-49a97447fbbe tempest-VolumeAndVolumeTypeFromImageTest-975568629 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_18b53134-13b3-434f-af5c-094d7476cdb4_6q1ry1j5devstack@QuobyteHD {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:18:24 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fd02636-0b6f-4c30-b784-f6a6cbbb6b3e]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:18:24 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-2c6ae0d1-e81d-4c5e-aa6f-b9542111baa6 tempest-VolumeDependencyTests-1280371773 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-321e9476-3454-435c-936f-cee61f12d97f {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:18:24 devstack sudo[106993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_18b53134-13b3-434f-af5c-094d7476cdb4_6q1ry1j5devstack@QuobyteHD Sep 07 10:18:24 devstack sudo[106993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:18:24 devstack sudo[106994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-321e9476-3454-435c-936f-cee61f12d97f Sep 07 10:18:24 devstack sudo[106994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:18:24 devstack sudo[106993]: pam_unix(sudo:session): session closed for user root Sep 07 10:18:24 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-2b20ce9e-8095-4ffa-b896-49a97447fbbe tempest-VolumeAndVolumeTypeFromImageTest-975568629 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_18b53134-13b3-434f-af5c-094d7476cdb4_6q1ry1j5devstack@QuobyteHD" returned: 0 in 0.357s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:18:24 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-2b20ce9e-8095-4ffa-b896-49a97447fbbe tempest-VolumeAndVolumeTypeFromImageTest-975568629 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_18b53134-13b3-434f-af5c-094d7476cdb4_6q1ry1j5devstack@QuobyteHD {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:18:24 devstack sudo[106994]: pam_unix(sudo:session): session closed for user root Sep 07 10:18:24 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-2c6ae0d1-e81d-4c5e-aa6f-b9542111baa6 tempest-VolumeDependencyTests-1280371773 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-321e9476-3454-435c-936f-cee61f12d97f" returned: 0 in 0.415s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:18:24 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-2c6ae0d1-e81d-4c5e-aa6f-b9542111baa6 tempest-VolumeDependencyTests-1280371773 None] will copy from snapshot at /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-321e9476-3454-435c-936f-cee61f12d97f {{(pid=87515) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 07 10:18:24 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-2c6ae0d1-e81d-4c5e-aa6f-b9542111baa6 tempest-VolumeDependencyTests-1280371773 None] Creating direct copy from snapshot {{(pid=87515) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 07 10:18:24 devstack cinder-volume[87515]: DEBUG cinder.utils [None req-2c6ae0d1-e81d-4c5e-aa6f-b9542111baa6 tempest-VolumeDependencyTests-1280371773 None] Path /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-e93a0b2c-d426-4a44-af44-da3a7e5d09ee not found in is_blk_device check {{(pid=87515) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 07 10:18:24 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-2c6ae0d1-e81d-4c5e-aa6f-b9542111baa6 tempest-VolumeDependencyTests-1280371773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-321e9476-3454-435c-936f-cee61f12d97f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-e93a0b2c-d426-4a44-af44-da3a7e5d09ee {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:18:24 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-e4aa2d8a-99f4-4194-a8d3-0f927b2142cd tempest-CreateVolumesFromSourceVolumeTest-111434518 None] Acquiring lock "cinder-38b2b2b1-7d42-4c03-8bfb-af8794eee52f-delete_volume" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:18:24 devstack sudo[107004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-321e9476-3454-435c-936f-cee61f12d97f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-e93a0b2c-d426-4a44-af44-da3a7e5d09ee Sep 07 10:18:24 devstack sudo[107004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:18:24 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-e4aa2d8a-99f4-4194-a8d3-0f927b2142cd tempest-CreateVolumesFromSourceVolumeTest-111434518 None] Lock "cinder-38b2b2b1-7d42-4c03-8bfb-af8794eee52f-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:18:24 devstack sudo[107001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_18b53134-13b3-434f-af5c-094d7476cdb4_6q1ry1j5devstack@QuobyteHD Sep 07 10:18:24 devstack sudo[107001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:18:24 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-e4aa2d8a-99f4-4194-a8d3-0f927b2142cd tempest-CreateVolumesFromSourceVolumeTest-111434518 None] Acquiring lock "cinder-quobyte-38b2b2b1-7d42-4c03-8bfb-af8794eee52f" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:18:24 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-e4aa2d8a-99f4-4194-a8d3-0f927b2142cd tempest-CreateVolumesFromSourceVolumeTest-111434518 None] Lock "cinder-quobyte-38b2b2b1-7d42-4c03-8bfb-af8794eee52f" acquired by "delete_volume" :: waited 0.034s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:18:24 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[03ca1789-c2b4-465c-aa4a-703765d70081]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:18:24 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-e4aa2d8a-99f4-4194-a8d3-0f927b2142cd tempest-CreateVolumesFromSourceVolumeTest-111434518 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-38b2b2b1-7d42-4c03-8bfb-af8794eee52f {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:18:24 devstack sudo[107007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-38b2b2b1-7d42-4c03-8bfb-af8794eee52f Sep 07 10:18:24 devstack sudo[107007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:18:25 devstack sudo[107001]: pam_unix(sudo:session): session closed for user root Sep 07 10:18:25 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-2b20ce9e-8095-4ffa-b896-49a97447fbbe tempest-VolumeAndVolumeTypeFromImageTest-975568629 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_18b53134-13b3-434f-af5c-094d7476cdb4_6q1ry1j5devstack@QuobyteHD" returned: 1 in 0.496s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:18:25 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-2b20ce9e-8095-4ffa-b896-49a97447fbbe tempest-VolumeAndVolumeTypeFromImageTest-975568629 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_18b53134-13b3-434f-af5c-094d7476cdb4_6q1ry1j5devstack@QuobyteHD' failed. Not Retrying. {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 07 10:18:25 devstack cinder-volume[87515]: DEBUG cinder.image.image_utils [None req-2b20ce9e-8095-4ffa-b896-49a97447fbbe tempest-VolumeAndVolumeTypeFromImageTest-975568629 None] 18b53134-13b3-434f-af5c-094d7476cdb4 was raw, converting to qcow2 {{(pid=87515) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 07 10:18:25 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-2b20ce9e-8095-4ffa-b896-49a97447fbbe tempest-VolumeAndVolumeTypeFromImageTest-975568629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_18b53134-13b3-434f-af5c-094d7476cdb4_6q1ry1j5devstack@QuobyteHD /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-879c7071-a915-4633-b091-5ce48faf8d79 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:18:25 devstack sudo[107015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_18b53134-13b3-434f-af5c-094d7476cdb4_6q1ry1j5devstack@QuobyteHD /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-879c7071-a915-4633-b091-5ce48faf8d79 Sep 07 10:18:25 devstack sudo[107015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:18:25 devstack sudo[107007]: pam_unix(sudo:session): session closed for user root Sep 07 10:18:25 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-e4aa2d8a-99f4-4194-a8d3-0f927b2142cd tempest-CreateVolumesFromSourceVolumeTest-111434518 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-38b2b2b1-7d42-4c03-8bfb-af8794eee52f" returned: 0 in 0.452s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:18:25 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-e4aa2d8a-99f4-4194-a8d3-0f927b2142cd tempest-CreateVolumesFromSourceVolumeTest-111434518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-38b2b2b1-7d42-4c03-8bfb-af8794eee52f {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:18:25 devstack sudo[107024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-38b2b2b1-7d42-4c03-8bfb-af8794eee52f Sep 07 10:18:25 devstack sudo[107024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:18:25 devstack sudo[107024]: pam_unix(sudo:session): session closed for user root Sep 07 10:18:25 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-e4aa2d8a-99f4-4194-a8d3-0f927b2142cd tempest-CreateVolumesFromSourceVolumeTest-111434518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-38b2b2b1-7d42-4c03-8bfb-af8794eee52f" returned: 0 in 0.514s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:18:25 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-e4aa2d8a-99f4-4194-a8d3-0f927b2142cd tempest-CreateVolumesFromSourceVolumeTest-111434518 None] Lock "cinder-quobyte-38b2b2b1-7d42-4c03-8bfb-af8794eee52f" released by "delete_volume" :: held 1.057s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:18:25 devstack cinder-volume[87515]: DEBUG cinder.quota [None req-e4aa2d8a-99f4-4194-a8d3-0f927b2142cd tempest-CreateVolumesFromSourceVolumeTest-111434518 None] Created reservations ['9bbcc8b4-d837-499d-8723-0b970b3a1d9c', 'c0a7ff81-91ae-4365-84f7-77978ed916c3', 'e104601e-4933-4ca9-ac33-a00ca07a5896', '6e812fd4-193d-4680-92cd-686f1b5cd319'] {{(pid=87515) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:18:26 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-e4aa2d8a-99f4-4194-a8d3-0f927b2142cd tempest-CreateVolumesFromSourceVolumeTest-111434518 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:18:26 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-e4aa2d8a-99f4-4194-a8d3-0f927b2142cd tempest-CreateVolumesFromSourceVolumeTest-111434518 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:18:26 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-e4aa2d8a-99f4-4194-a8d3-0f927b2142cd tempest-CreateVolumesFromSourceVolumeTest-111434518 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:18:26 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-e4aa2d8a-99f4-4194-a8d3-0f927b2142cd tempest-CreateVolumesFromSourceVolumeTest-111434518 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:18:26 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-e4aa2d8a-99f4-4194-a8d3-0f927b2142cd tempest-CreateVolumesFromSourceVolumeTest-111434518 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:18:26 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-e4aa2d8a-99f4-4194-a8d3-0f927b2142cd tempest-CreateVolumesFromSourceVolumeTest-111434518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:18:26 devstack sudo[107033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a Sep 07 10:18:26 devstack sudo[107033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:18:26 devstack sudo[107015]: pam_unix(sudo:session): session closed for user root Sep 07 10:18:26 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-2b20ce9e-8095-4ffa-b896-49a97447fbbe tempest-VolumeAndVolumeTypeFromImageTest-975568629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_18b53134-13b3-434f-af5c-094d7476cdb4_6q1ry1j5devstack@QuobyteHD /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-879c7071-a915-4633-b091-5ce48faf8d79" returned: 0 in 1.116s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:18:26 devstack cinder-volume[87515]: DEBUG cinder.image.image_utils [None req-2b20ce9e-8095-4ffa-b896-49a97447fbbe tempest-VolumeAndVolumeTypeFromImageTest-975568629 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_18b53134-13b3-434f-af5c-094d7476cdb4_6q1ry1j5devstack@QuobyteHD, size 0.00 MB, duration 1.12 sec, destination /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-879c7071-a915-4633-b091-5ce48faf8d79 {{(pid=87515) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 07 10:18:26 devstack cinder-volume[87515]: INFO cinder.image.image_utils [None req-2b20ce9e-8095-4ffa-b896-49a97447fbbe tempest-VolumeAndVolumeTypeFromImageTest-975568629 None] Converted 0.00 MB image at 0.00 MB/s Sep 07 10:18:26 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-2b20ce9e-8095-4ffa-b896-49a97447fbbe tempest-VolumeAndVolumeTypeFromImageTest-975568629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-879c7071-a915-4633-b091-5ce48faf8d79 1G {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:18:26 devstack sudo[107035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-879c7071-a915-4633-b091-5ce48faf8d79 1G Sep 07 10:18:26 devstack sudo[107035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:18:26 devstack sudo[107033]: pam_unix(sudo:session): session closed for user root Sep 07 10:18:26 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-e4aa2d8a-99f4-4194-a8d3-0f927b2142cd tempest-CreateVolumesFromSourceVolumeTest-111434518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a" returned: 0 in 0.573s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:18:26 devstack cinder-volume[87515]: DEBUG cinder.manager [None req-e4aa2d8a-99f4-4194-a8d3-0f927b2142cd tempest-CreateVolumesFromSourceVolumeTest-111434518 None] Notifying Schedulers of capabilities ... {{(pid=87515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:18:26 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-e4aa2d8a-99f4-4194-a8d3-0f927b2142cd tempest-CreateVolumesFromSourceVolumeTest-111434518 None] Deleted volume successfully. Sep 07 10:18:26 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-e4aa2d8a-99f4-4194-a8d3-0f927b2142cd tempest-CreateVolumesFromSourceVolumeTest-111434518 None] Lock "cinder-38b2b2b1-7d42-4c03-8bfb-af8794eee52f-delete_volume" released by "delete_volume" :: held 2.104s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:18:27 devstack sudo[107035]: pam_unix(sudo:session): session closed for user root Sep 07 10:18:27 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-2b20ce9e-8095-4ffa-b896-49a97447fbbe tempest-VolumeAndVolumeTypeFromImageTest-975568629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-879c7071-a915-4633-b091-5ce48faf8d79 1G" returned: 0 in 0.907s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:18:27 devstack cinder-volume[87515]: DEBUG cinder.volume.volume_utils [None req-2b20ce9e-8095-4ffa-b896-49a97447fbbe tempest-VolumeAndVolumeTypeFromImageTest-975568629 None] Downloaded image 18b53134-13b3-434f-af5c-094d7476cdb4 ((None, [{'url': 'file:///opt/stack/data/glance/images/18b53134-13b3-434f-af5c-094d7476cdb4', 'metadata': {}}])) to volume 879c7071-a915-4633-b091-5ce48faf8d79 successfully. {{(pid=87515) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 07 10:18:27 devstack cinder-volume[87515]: DEBUG cinder.image.image_utils [None req-2b20ce9e-8095-4ffa-b896-49a97447fbbe tempest-VolumeAndVolumeTypeFromImageTest-975568629 None] Temporary image 18b53134-13b3-434f-af5c-094d7476cdb4 for user 693731cc9bea4a9b9a60ab68abf75fd6 is deleted. {{(pid=87515) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 07 10:18:27 devstack cinder-volume[87515]: DEBUG cinder.volume.volume_utils [None req-2b20ce9e-8095-4ffa-b896-49a97447fbbe tempest-VolumeAndVolumeTypeFromImageTest-975568629 None] Marking volume 879c7071-a915-4633-b091-5ce48faf8d79 as bootable. {{(pid=87515) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 07 10:18:27 devstack cinder-volume[87515]: DEBUG cinder.volume.flows.manager.create_volume [None req-2b20ce9e-8095-4ffa-b896-49a97447fbbe tempest-VolumeAndVolumeTypeFromImageTest-975568629 None] Copying metadata from image 18b53134-13b3-434f-af5c-094d7476cdb4 to 879c7071-a915-4633-b091-5ce48faf8d79. {{(pid=87515) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 07 10:18:27 devstack cinder-volume[87515]: DEBUG cinder.volume.flows.manager.create_volume [None req-2b20ce9e-8095-4ffa-b896-49a97447fbbe tempest-VolumeAndVolumeTypeFromImageTest-975568629 None] Creating volume glance metadata for volume 879c7071-a915-4633-b091-5ce48faf8d79 backed by image 18b53134-13b3-434f-af5c-094d7476cdb4 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '18b53134-13b3-434f-af5c-094d7476cdb4', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '436a8f1ef88448bdcd4c0246675a5770', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87515) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 07 10:18:27 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-b92aa241-4663-4c71-a135-44472f96b3a6 tempest-CreateVolumesFromSourceVolumeTest-111434518 None] Acquiring lock "cinder-97f301d2-1c54-4d95-89e1-49e7e7991bc3-delete_volume" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:18:27 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-b92aa241-4663-4c71-a135-44472f96b3a6 tempest-CreateVolumesFromSourceVolumeTest-111434518 None] Lock "cinder-97f301d2-1c54-4d95-89e1-49e7e7991bc3-delete_volume" acquired by "delete_volume" :: waited 0.070s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:18:27 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-2b20ce9e-8095-4ffa-b896-49a97447fbbe tempest-VolumeAndVolumeTypeFromImageTest-975568629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fdbfd084-8a09-4219-9c4a-61f404d06598) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-879c7071-a915-4633-b091-5ce48faf8d79', 'volume_size': 1, 'image_id': '18b53134-13b3-434f-af5c-094d7476cdb4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/18b53134-13b3-434f-af5c-094d7476cdb4', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '436a8f1ef88448bdcd4c0246675a5770', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '0de5d145c4da4191b542cb37983cd7fc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '2d86f2ab1b1ae443e56a815e8febf4b727c927aa936e2a27198815b3be12503d129aab2b5cf4438140dd4d47efe9305ef2d6822e1916fa0fb5b6e3471416366e', 'id': '18b53134-13b3-434f-af5c-094d7476cdb4', 'created_at': datetime.datetime(2026, 9, 7, 8, 18, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 7, 8, 18, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/18b53134-13b3-434f-af5c-094d7476cdb4/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:18:27 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-2b20ce9e-8095-4ffa-b896-49a97447fbbe tempest-VolumeAndVolumeTypeFromImageTest-975568629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (553bd6fc-99b9-42ae-b719-5d74d82418d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:18:27 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-2b20ce9e-8095-4ffa-b896-49a97447fbbe tempest-VolumeAndVolumeTypeFromImageTest-975568629 None] Volume volume-879c7071-a915-4633-b091-5ce48faf8d79 (879c7071-a915-4633-b091-5ce48faf8d79): created successfully Sep 07 10:18:27 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-2b20ce9e-8095-4ffa-b896-49a97447fbbe tempest-VolumeAndVolumeTypeFromImageTest-975568629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (553bd6fc-99b9-42ae-b719-5d74d82418d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:18:27 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-2b20ce9e-8095-4ffa-b896-49a97447fbbe tempest-VolumeAndVolumeTypeFromImageTest-975568629 None] Flow 'volume_create_manager' (896b5d0e-3331-4738-9584-41148472c1a4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:18:27 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-2b20ce9e-8095-4ffa-b896-49a97447fbbe tempest-VolumeAndVolumeTypeFromImageTest-975568629 None] Created volume successfully. Sep 07 10:18:27 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-b92aa241-4663-4c71-a135-44472f96b3a6 tempest-CreateVolumesFromSourceVolumeTest-111434518 None] Acquiring lock "cinder-quobyte-97f301d2-1c54-4d95-89e1-49e7e7991bc3" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:18:27 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-b92aa241-4663-4c71-a135-44472f96b3a6 tempest-CreateVolumesFromSourceVolumeTest-111434518 None] Lock "cinder-quobyte-97f301d2-1c54-4d95-89e1-49e7e7991bc3" acquired by "delete_volume" :: waited 0.063s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:18:27 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[a00b227f-059d-45b4-9072-01eb5270c3a8]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:18:27 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-b92aa241-4663-4c71-a135-44472f96b3a6 tempest-CreateVolumesFromSourceVolumeTest-111434518 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-97f301d2-1c54-4d95-89e1-49e7e7991bc3 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:18:27 devstack cinder-volume[87515]: DEBUG cinder.volume.flows.manager.create_volume [None req-38f0ccda-3d09-454b-bdc6-946ecbd3e121 tempest-CreateVolumesFromSnapshotTest-917122263 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 10:18:27 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-38f0ccda-3d09-454b-bdc6-946ecbd3e121 tempest-CreateVolumesFromSnapshotTest-917122263 None] Flow 'volume_create_manager' (feb90bcc-4b5a-4755-9cb3-2e5888522794) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:18:27 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-38f0ccda-3d09-454b-bdc6-946ecbd3e121 tempest-CreateVolumesFromSnapshotTest-917122263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ddcfae34-ecf9-44e6-a30c-9d1aa746317b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:18:27 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-38f0ccda-3d09-454b-bdc6-946ecbd3e121 tempest-CreateVolumesFromSnapshotTest-917122263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ddcfae34-ecf9-44e6-a30c-9d1aa746317b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:18:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2141733907',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe683bd4-f454-4081-8221-c692d329cdb9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a3407d067744ab1a54f28d3320f9639',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:18:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:18:28Z,use_quota=True,user_id='ecc1196b6626463b885713d7b2091688',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3a092cd-7947-4cbf-abff-4ba9567becf0),volume_type_id=f3a092cd-7947-4cbf-abff-4ba9567becf0)' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:18:27 devstack sudo[107078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-97f301d2-1c54-4d95-89e1-49e7e7991bc3 Sep 07 10:18:27 devstack sudo[107078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:18:28 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-38f0ccda-3d09-454b-bdc6-946ecbd3e121 tempest-CreateVolumesFromSnapshotTest-917122263 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5a516ea-d2e6-478f-bc4f-d34f647914d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:18:28 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-38f0ccda-3d09-454b-bdc6-946ecbd3e121 tempest-CreateVolumesFromSnapshotTest-917122263 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5a516ea-d2e6-478f-bc4f-d34f647914d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:18:28 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-38f0ccda-3d09-454b-bdc6-946ecbd3e121 tempest-CreateVolumesFromSnapshotTest-917122263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b82d5d0-fcb5-4484-abbb-c4a3ec13f681) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:18:28 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-38f0ccda-3d09-454b-bdc6-946ecbd3e121 tempest-CreateVolumesFromSnapshotTest-917122263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b82d5d0-fcb5-4484-abbb-c4a3ec13f681) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fe683bd4-f454-4081-8221-c692d329cdb9', 'volume_name': 'volume-fe683bd4-f454-4081-8221-c692d329cdb9', 'volume_size': 1}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:18:28 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-38f0ccda-3d09-454b-bdc6-946ecbd3e121 tempest-CreateVolumesFromSnapshotTest-917122263 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba4ad57c-d223-43ad-9bf0-ff18792780f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:18:28 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-38f0ccda-3d09-454b-bdc6-946ecbd3e121 tempest-CreateVolumesFromSnapshotTest-917122263 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba4ad57c-d223-43ad-9bf0-ff18792780f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:18:28 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-38f0ccda-3d09-454b-bdc6-946ecbd3e121 tempest-CreateVolumesFromSnapshotTest-917122263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5c7d2df-6dbb-4938-a573-f24e21a301a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:18:28 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-38f0ccda-3d09-454b-bdc6-946ecbd3e121 tempest-CreateVolumesFromSnapshotTest-917122263 None] Volume fe683bd4-f454-4081-8221-c692d329cdb9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fe683bd4-f454-4081-8221-c692d329cdb9', 'volume_size': 1} Sep 07 10:18:28 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-38f0ccda-3d09-454b-bdc6-946ecbd3e121 tempest-CreateVolumesFromSnapshotTest-917122263 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:18:28 devstack sudo[107078]: pam_unix(sudo:session): session closed for user root Sep 07 10:18:28 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-b92aa241-4663-4c71-a135-44472f96b3a6 tempest-CreateVolumesFromSourceVolumeTest-111434518 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-97f301d2-1c54-4d95-89e1-49e7e7991bc3" returned: 0 in 0.891s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:18:28 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-b92aa241-4663-4c71-a135-44472f96b3a6 tempest-CreateVolumesFromSourceVolumeTest-111434518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-97f301d2-1c54-4d95-89e1-49e7e7991bc3 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:18:28 devstack sudo[107085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-97f301d2-1c54-4d95-89e1-49e7e7991bc3 Sep 07 10:18:28 devstack sudo[107085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:18:28 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-b77ea857-fea8-4c62-929d-69882ddffafd tempest-VolumeAndVolumeTypeFromImageTest-975568629 None] Acquiring lock "cinder-879c7071-a915-4633-b091-5ce48faf8d79-delete_volume" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:18:28 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-b77ea857-fea8-4c62-929d-69882ddffafd tempest-VolumeAndVolumeTypeFromImageTest-975568629 None] Lock "cinder-879c7071-a915-4633-b091-5ce48faf8d79-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:18:28 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-b77ea857-fea8-4c62-929d-69882ddffafd tempest-VolumeAndVolumeTypeFromImageTest-975568629 None] Acquiring lock "cinder-quobyte-879c7071-a915-4633-b091-5ce48faf8d79" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:18:29 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-b77ea857-fea8-4c62-929d-69882ddffafd tempest-VolumeAndVolumeTypeFromImageTest-975568629 None] Lock "cinder-quobyte-879c7071-a915-4633-b091-5ce48faf8d79" acquired by "delete_volume" :: waited 0.037s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:18:29 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[61412586-b516-488a-8edd-7c66910cf1af]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:18:29 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-b77ea857-fea8-4c62-929d-69882ddffafd tempest-VolumeAndVolumeTypeFromImageTest-975568629 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-879c7071-a915-4633-b091-5ce48faf8d79 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:18:29 devstack sudo[107085]: pam_unix(sudo:session): session closed for user root Sep 07 10:18:29 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-b92aa241-4663-4c71-a135-44472f96b3a6 tempest-CreateVolumesFromSourceVolumeTest-111434518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-97f301d2-1c54-4d95-89e1-49e7e7991bc3" returned: 0 in 0.723s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:18:29 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-b92aa241-4663-4c71-a135-44472f96b3a6 tempest-CreateVolumesFromSourceVolumeTest-111434518 None] Lock "cinder-quobyte-97f301d2-1c54-4d95-89e1-49e7e7991bc3" released by "delete_volume" :: held 1.750s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:18:29 devstack sudo[107087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-879c7071-a915-4633-b091-5ce48faf8d79 Sep 07 10:18:29 devstack sudo[107087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:18:29 devstack cinder-volume[87515]: DEBUG cinder.quota [None req-b92aa241-4663-4c71-a135-44472f96b3a6 tempest-CreateVolumesFromSourceVolumeTest-111434518 None] Created reservations ['337c1d17-9ab7-4454-a138-bfb331821d01', '06c961e9-bceb-4455-bdef-4bddd892dfbb', 'dcebc8fb-1d27-407e-9c6a-8b359ee98534', '0f1d1a30-15e0-48a1-af26-799c037ccb94'] {{(pid=87515) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:18:29 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-b92aa241-4663-4c71-a135-44472f96b3a6 tempest-CreateVolumesFromSourceVolumeTest-111434518 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:18:29 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-b92aa241-4663-4c71-a135-44472f96b3a6 tempest-CreateVolumesFromSourceVolumeTest-111434518 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:18:29 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-b92aa241-4663-4c71-a135-44472f96b3a6 tempest-CreateVolumesFromSourceVolumeTest-111434518 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:18:29 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-b92aa241-4663-4c71-a135-44472f96b3a6 tempest-CreateVolumesFromSourceVolumeTest-111434518 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:18:29 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-b92aa241-4663-4c71-a135-44472f96b3a6 tempest-CreateVolumesFromSourceVolumeTest-111434518 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:18:29 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-b92aa241-4663-4c71-a135-44472f96b3a6 tempest-CreateVolumesFromSourceVolumeTest-111434518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:18:29 devstack sudo[107091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a Sep 07 10:18:29 devstack sudo[107091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:18:29 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-8e1d7d4a-f51b-4cfd-8238-85c5fd7e3077 tempest-CreateVolumesFromSourceVolumeTest-111434518 None] Acquiring lock "cinder-f219527b-edf2-4045-a6f9-965e0945b744-delete_volume" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:18:30 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-8e1d7d4a-f51b-4cfd-8238-85c5fd7e3077 tempest-CreateVolumesFromSourceVolumeTest-111434518 None] Lock "cinder-f219527b-edf2-4045-a6f9-965e0945b744-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:18:30 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-8e1d7d4a-f51b-4cfd-8238-85c5fd7e3077 tempest-CreateVolumesFromSourceVolumeTest-111434518 None] Acquiring lock "cinder-quobyte-f219527b-edf2-4045-a6f9-965e0945b744" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:18:30 devstack sudo[107087]: pam_unix(sudo:session): session closed for user root Sep 07 10:18:30 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-b77ea857-fea8-4c62-929d-69882ddffafd tempest-VolumeAndVolumeTypeFromImageTest-975568629 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-879c7071-a915-4633-b091-5ce48faf8d79" returned: 0 in 1.105s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:18:30 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-b77ea857-fea8-4c62-929d-69882ddffafd tempest-VolumeAndVolumeTypeFromImageTest-975568629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-879c7071-a915-4633-b091-5ce48faf8d79 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:18:30 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-8e1d7d4a-f51b-4cfd-8238-85c5fd7e3077 tempest-CreateVolumesFromSourceVolumeTest-111434518 None] Lock "cinder-quobyte-f219527b-edf2-4045-a6f9-965e0945b744" acquired by "delete_volume" :: waited 0.091s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:18:30 devstack sudo[107097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-879c7071-a915-4633-b091-5ce48faf8d79 Sep 07 10:18:30 devstack sudo[107097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:18:30 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cc53fc8-47dd-4858-947f-1a5fc21c586f]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:18:30 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-8e1d7d4a-f51b-4cfd-8238-85c5fd7e3077 tempest-CreateVolumesFromSourceVolumeTest-111434518 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-f219527b-edf2-4045-a6f9-965e0945b744 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:18:30 devstack sudo[107091]: pam_unix(sudo:session): session closed for user root Sep 07 10:18:30 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-b92aa241-4663-4c71-a135-44472f96b3a6 tempest-CreateVolumesFromSourceVolumeTest-111434518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a" returned: 0 in 0.623s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:18:30 devstack cinder-volume[87515]: DEBUG cinder.manager [None req-b92aa241-4663-4c71-a135-44472f96b3a6 tempest-CreateVolumesFromSourceVolumeTest-111434518 None] Notifying Schedulers of capabilities ... {{(pid=87515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:18:30 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-b92aa241-4663-4c71-a135-44472f96b3a6 tempest-CreateVolumesFromSourceVolumeTest-111434518 None] Deleted volume successfully. Sep 07 10:18:30 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-b92aa241-4663-4c71-a135-44472f96b3a6 tempest-CreateVolumesFromSourceVolumeTest-111434518 None] Lock "cinder-97f301d2-1c54-4d95-89e1-49e7e7991bc3-delete_volume" released by "delete_volume" :: held 3.122s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:18:30 devstack sudo[107099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-f219527b-edf2-4045-a6f9-965e0945b744 Sep 07 10:18:30 devstack sudo[107099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:18:30 devstack sudo[107004]: pam_unix(sudo:session): session closed for user root Sep 07 10:18:30 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-2c6ae0d1-e81d-4c5e-aa6f-b9542111baa6 tempest-VolumeDependencyTests-1280371773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-321e9476-3454-435c-936f-cee61f12d97f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-e93a0b2c-d426-4a44-af44-da3a7e5d09ee" returned: 0 in 6.090s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:18:30 devstack cinder-volume[87515]: DEBUG cinder.image.image_utils [None req-2c6ae0d1-e81d-4c5e-aa6f-b9542111baa6 tempest-VolumeDependencyTests-1280371773 None] Image conversion details: src /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-321e9476-3454-435c-936f-cee61f12d97f, size 1024.00 MB, duration 6.09 sec, destination /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-e93a0b2c-d426-4a44-af44-da3a7e5d09ee {{(pid=87515) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 07 10:18:30 devstack cinder-volume[87515]: INFO cinder.image.image_utils [None req-2c6ae0d1-e81d-4c5e-aa6f-b9542111baa6 tempest-VolumeDependencyTests-1280371773 None] Converted 1024.00 MB image at 168.10 MB/s Sep 07 10:18:30 devstack cinder-volume[87515]: WARNING cinder.volume.drivers.remotefs [None req-2c6ae0d1-e81d-4c5e-aa6f-b9542111baa6 tempest-VolumeDependencyTests-1280371773 None] /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-e93a0b2c-d426-4a44-af44-da3a7e5d09ee is being set with open permissions: ugo+rw Sep 07 10:18:30 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-2c6ae0d1-e81d-4c5e-aa6f-b9542111baa6 tempest-VolumeDependencyTests-1280371773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-e93a0b2c-d426-4a44-af44-da3a7e5d09ee {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:18:30 devstack sudo[107101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-e93a0b2c-d426-4a44-af44-da3a7e5d09ee Sep 07 10:18:30 devstack sudo[107101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:18:30 devstack sudo[107097]: pam_unix(sudo:session): session closed for user root Sep 07 10:18:30 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-b77ea857-fea8-4c62-929d-69882ddffafd tempest-VolumeAndVolumeTypeFromImageTest-975568629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-879c7071-a915-4633-b091-5ce48faf8d79" returned: 0 in 0.573s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:18:30 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-b77ea857-fea8-4c62-929d-69882ddffafd tempest-VolumeAndVolumeTypeFromImageTest-975568629 None] Lock "cinder-quobyte-879c7071-a915-4633-b091-5ce48faf8d79" released by "delete_volume" :: held 1.784s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:18:30 devstack cinder-volume[87515]: DEBUG cinder.quota [None req-b77ea857-fea8-4c62-929d-69882ddffafd tempest-VolumeAndVolumeTypeFromImageTest-975568629 None] Created reservations ['fe996cae-5db7-4e7c-bed8-189ed7f1579b', '95d09ca4-5b23-4ecf-8294-2ef6f293ed9d', '3f05528f-7509-4089-a9cd-b32cd53aa52b', '2e39213e-d699-43bf-8581-0641d0959ead'] {{(pid=87515) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:18:30 devstack sudo[107099]: pam_unix(sudo:session): session closed for user root Sep 07 10:18:30 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-8e1d7d4a-f51b-4cfd-8238-85c5fd7e3077 tempest-CreateVolumesFromSourceVolumeTest-111434518 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-f219527b-edf2-4045-a6f9-965e0945b744" returned: 0 in 0.584s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:18:30 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-8e1d7d4a-f51b-4cfd-8238-85c5fd7e3077 tempest-CreateVolumesFromSourceVolumeTest-111434518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-f219527b-edf2-4045-a6f9-965e0945b744 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:18:30 devstack sudo[107107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-f219527b-edf2-4045-a6f9-965e0945b744 Sep 07 10:18:30 devstack sudo[107107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:18:30 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-b77ea857-fea8-4c62-929d-69882ddffafd tempest-VolumeAndVolumeTypeFromImageTest-975568629 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:18:30 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-b77ea857-fea8-4c62-929d-69882ddffafd tempest-VolumeAndVolumeTypeFromImageTest-975568629 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:18:30 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-b77ea857-fea8-4c62-929d-69882ddffafd tempest-VolumeAndVolumeTypeFromImageTest-975568629 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:18:30 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-b77ea857-fea8-4c62-929d-69882ddffafd tempest-VolumeAndVolumeTypeFromImageTest-975568629 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:18:30 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-b77ea857-fea8-4c62-929d-69882ddffafd tempest-VolumeAndVolumeTypeFromImageTest-975568629 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:18:30 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-b77ea857-fea8-4c62-929d-69882ddffafd tempest-VolumeAndVolumeTypeFromImageTest-975568629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:18:30 devstack sudo[107101]: pam_unix(sudo:session): session closed for user root Sep 07 10:18:30 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-2c6ae0d1-e81d-4c5e-aa6f-b9542111baa6 tempest-VolumeDependencyTests-1280371773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-e93a0b2c-d426-4a44-af44-da3a7e5d09ee" returned: 0 in 0.278s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:18:30 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-2c6ae0d1-e81d-4c5e-aa6f-b9542111baa6 tempest-VolumeDependencyTests-1280371773 None] Lock "cinder-quobyte-e93a0b2c-d426-4a44-af44-da3a7e5d09ee" released by "_copy_volume_from_snapshot" :: held 7.436s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:18:30 devstack sudo[107110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a Sep 07 10:18:30 devstack sudo[107110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:18:31 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-2c6ae0d1-e81d-4c5e-aa6f-b9542111baa6 tempest-VolumeDependencyTests-1280371773 None] Lock "cinder-quobyte-3b9c86c3-3056-4110-ad20-6abc82c60cb5-e93a0b2c-d426-4a44-af44-da3a7e5d09ee" released by "_create_volume_from_snapshot" :: held 7.523s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:18:31 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-2c6ae0d1-e81d-4c5e-aa6f-b9542111baa6 tempest-VolumeDependencyTests-1280371773 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.556s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:18:31 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-38f0ccda-3d09-454b-bdc6-946ecbd3e121 tempest-CreateVolumesFromSnapshotTest-917122263 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.914s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:18:31 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-38f0ccda-3d09-454b-bdc6-946ecbd3e121 tempest-CreateVolumesFromSnapshotTest-917122263 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:18:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2141733907',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe683bd4-f454-4081-8221-c692d329cdb9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a3407d067744ab1a54f28d3320f9639',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:18:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:18:28Z,use_quota=True,user_id='ecc1196b6626463b885713d7b2091688',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3a092cd-7947-4cbf-abff-4ba9567becf0),volume_type_id=f3a092cd-7947-4cbf-abff-4ba9567becf0)}" {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 10:18:31 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-38f0ccda-3d09-454b-bdc6-946ecbd3e121 tempest-CreateVolumesFromSnapshotTest-917122263 None] Creating volume fe683bd4-f454-4081-8221-c692d329cdb9 {{(pid=87515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 10:18:31 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-38f0ccda-3d09-454b-bdc6-946ecbd3e121 tempest-CreateVolumesFromSnapshotTest-917122263 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:18:31 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-38f0ccda-3d09-454b-bdc6-946ecbd3e121 tempest-CreateVolumesFromSnapshotTest-917122263 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:18:31 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-38f0ccda-3d09-454b-bdc6-946ecbd3e121 tempest-CreateVolumesFromSnapshotTest-917122263 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:18:31 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-38f0ccda-3d09-454b-bdc6-946ecbd3e121 tempest-CreateVolumesFromSnapshotTest-917122263 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:18:31 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-38f0ccda-3d09-454b-bdc6-946ecbd3e121 tempest-CreateVolumesFromSnapshotTest-917122263 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:18:31 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-38f0ccda-3d09-454b-bdc6-946ecbd3e121 tempest-CreateVolumesFromSnapshotTest-917122263 None] Selected osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c as target Quobyte volume. {{(pid=87515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 10:18:31 devstack cinder-volume[87515]: INFO cinder.volume.drivers.remotefs [None req-38f0ccda-3d09-454b-bdc6-946ecbd3e121 tempest-CreateVolumesFromSnapshotTest-917122263 None] casted to osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c Sep 07 10:18:31 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-38f0ccda-3d09-454b-bdc6-946ecbd3e121 tempest-CreateVolumesFromSnapshotTest-917122263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-fe683bd4-f454-4081-8221-c692d329cdb9 1073741824 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:18:31 devstack sudo[107112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-fe683bd4-f454-4081-8221-c692d329cdb9 1073741824 Sep 07 10:18:31 devstack sudo[107112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:18:31 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-2c6ae0d1-e81d-4c5e-aa6f-b9542111baa6 tempest-VolumeDependencyTests-1280371773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (392d497e-c4b5-4a4c-949d-a3ea96256750) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e93a0b2c-d426-4a44-af44-da3a7e5d09ee', 'volume_size': 1, 'snapshot_id': '3b9c86c3-3056-4110-ad20-6abc82c60cb5'}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:18:31 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-2c6ae0d1-e81d-4c5e-aa6f-b9542111baa6 tempest-VolumeDependencyTests-1280371773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ed2943a-1f31-430f-9d61-d6a46a1b25c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:18:31 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-2c6ae0d1-e81d-4c5e-aa6f-b9542111baa6 tempest-VolumeDependencyTests-1280371773 None] Volume volume-e93a0b2c-d426-4a44-af44-da3a7e5d09ee (e93a0b2c-d426-4a44-af44-da3a7e5d09ee): created successfully Sep 07 10:18:31 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-2c6ae0d1-e81d-4c5e-aa6f-b9542111baa6 tempest-VolumeDependencyTests-1280371773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ed2943a-1f31-430f-9d61-d6a46a1b25c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:18:31 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-2c6ae0d1-e81d-4c5e-aa6f-b9542111baa6 tempest-VolumeDependencyTests-1280371773 None] Flow 'volume_create_manager' (f61ab3a4-f7a2-478b-ad27-fd0376cd0063) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:18:31 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-2c6ae0d1-e81d-4c5e-aa6f-b9542111baa6 tempest-VolumeDependencyTests-1280371773 None] Created volume successfully. Sep 07 10:18:31 devstack sudo[107107]: pam_unix(sudo:session): session closed for user root Sep 07 10:18:31 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-8e1d7d4a-f51b-4cfd-8238-85c5fd7e3077 tempest-CreateVolumesFromSourceVolumeTest-111434518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-f219527b-edf2-4045-a6f9-965e0945b744" returned: 0 in 0.294s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:18:31 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-8e1d7d4a-f51b-4cfd-8238-85c5fd7e3077 tempest-CreateVolumesFromSourceVolumeTest-111434518 None] Lock "cinder-quobyte-f219527b-edf2-4045-a6f9-965e0945b744" released by "delete_volume" :: held 0.995s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:18:31 devstack sudo[107110]: pam_unix(sudo:session): session closed for user root Sep 07 10:18:31 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-b77ea857-fea8-4c62-929d-69882ddffafd tempest-VolumeAndVolumeTypeFromImageTest-975568629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a" returned: 0 in 0.338s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:18:31 devstack cinder-volume[87515]: DEBUG cinder.manager [None req-b77ea857-fea8-4c62-929d-69882ddffafd tempest-VolumeAndVolumeTypeFromImageTest-975568629 None] Notifying Schedulers of capabilities ... {{(pid=87515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:18:31 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-b77ea857-fea8-4c62-929d-69882ddffafd tempest-VolumeAndVolumeTypeFromImageTest-975568629 None] Deleted volume successfully. Sep 07 10:18:31 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-b77ea857-fea8-4c62-929d-69882ddffafd tempest-VolumeAndVolumeTypeFromImageTest-975568629 None] Lock "cinder-879c7071-a915-4633-b091-5ce48faf8d79-delete_volume" released by "delete_volume" :: held 2.529s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:18:31 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-fe85f60d-6ab6-49f2-be8d-f840ccc5ec83 tempest-VolumeDependencyTests-1280371773 None] Acquiring lock "cinder-3b9c86c3-3056-4110-ad20-6abc82c60cb5-delete_snapshot" by "delete_snapshot" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:18:31 devstack cinder-volume[87515]: DEBUG cinder.quota [None req-8e1d7d4a-f51b-4cfd-8238-85c5fd7e3077 tempest-CreateVolumesFromSourceVolumeTest-111434518 None] Created reservations ['e334535e-aa52-4b23-b318-14371da384e4', '50307551-c696-4ea9-9ded-b7b1be473a27', '81fb20f9-0842-45be-bd3e-3fd035ec3f89', 'a8418540-b020-4f3b-9d09-c14b918633e4'] {{(pid=87515) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:18:31 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-fe85f60d-6ab6-49f2-be8d-f840ccc5ec83 tempest-VolumeDependencyTests-1280371773 None] Lock "cinder-3b9c86c3-3056-4110-ad20-6abc82c60cb5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.047s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:18:31 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-fe85f60d-6ab6-49f2-be8d-f840ccc5ec83 tempest-VolumeDependencyTests-1280371773 None] Acquiring lock "cinder-quobyte-321e9476-3454-435c-936f-cee61f12d97f" by "delete_snapshot" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:18:31 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-fe85f60d-6ab6-49f2-be8d-f840ccc5ec83 tempest-VolumeDependencyTests-1280371773 None] Lock "cinder-quobyte-321e9476-3454-435c-936f-cee61f12d97f" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:18:31 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-fe85f60d-6ab6-49f2-be8d-f840ccc5ec83 tempest-VolumeDependencyTests-1280371773 None] Acquiring lock "cinder-quobyte-3b9c86c3-3056-4110-ad20-6abc82c60cb5" by "_delete_snapshot" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:18:31 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-fe85f60d-6ab6-49f2-be8d-f840ccc5ec83 tempest-VolumeDependencyTests-1280371773 None] Lock "cinder-quobyte-3b9c86c3-3056-4110-ad20-6abc82c60cb5" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:18:31 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-fe85f60d-6ab6-49f2-be8d-f840ccc5ec83 tempest-VolumeDependencyTests-1280371773 None] Deleting offline snapshot 3b9c86c3-3056-4110-ad20-6abc82c60cb5 of volume 321e9476-3454-435c-936f-cee61f12d97f {{(pid=87515) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 10:18:31 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-fe85f60d-6ab6-49f2-be8d-f840ccc5ec83 tempest-VolumeDependencyTests-1280371773 None] snapshot_file for this snap is: volume-321e9476-3454-435c-936f-cee61f12d97f.3b9c86c3-3056-4110-ad20-6abc82c60cb5 {{(pid=87515) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 10:18:31 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dd42ecd-9749-4668-acb3-0452973ffee2]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:18:31 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-fe85f60d-6ab6-49f2-be8d-f840ccc5ec83 tempest-VolumeDependencyTests-1280371773 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-321e9476-3454-435c-936f-cee61f12d97f.3b9c86c3-3056-4110-ad20-6abc82c60cb5 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:18:31 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-8e1d7d4a-f51b-4cfd-8238-85c5fd7e3077 tempest-CreateVolumesFromSourceVolumeTest-111434518 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:18:31 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-8e1d7d4a-f51b-4cfd-8238-85c5fd7e3077 tempest-CreateVolumesFromSourceVolumeTest-111434518 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:18:31 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-8e1d7d4a-f51b-4cfd-8238-85c5fd7e3077 tempest-CreateVolumesFromSourceVolumeTest-111434518 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:18:31 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-8e1d7d4a-f51b-4cfd-8238-85c5fd7e3077 tempest-CreateVolumesFromSourceVolumeTest-111434518 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:18:31 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-8e1d7d4a-f51b-4cfd-8238-85c5fd7e3077 tempest-CreateVolumesFromSourceVolumeTest-111434518 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:18:31 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-8e1d7d4a-f51b-4cfd-8238-85c5fd7e3077 tempest-CreateVolumesFromSourceVolumeTest-111434518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:18:31 devstack sudo[107121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a Sep 07 10:18:31 devstack sudo[107121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:18:31 devstack sudo[107120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-321e9476-3454-435c-936f-cee61f12d97f.3b9c86c3-3056-4110-ad20-6abc82c60cb5 Sep 07 10:18:31 devstack sudo[107120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:18:31 devstack sudo[107112]: pam_unix(sudo:session): session closed for user root Sep 07 10:18:31 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-38f0ccda-3d09-454b-bdc6-946ecbd3e121 tempest-CreateVolumesFromSnapshotTest-917122263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-fe683bd4-f454-4081-8221-c692d329cdb9 1073741824" returned: 0 in 0.669s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:18:31 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-38f0ccda-3d09-454b-bdc6-946ecbd3e121 tempest-CreateVolumesFromSnapshotTest-917122263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-fe683bd4-f454-4081-8221-c692d329cdb9 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:18:31 devstack sudo[107124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-fe683bd4-f454-4081-8221-c692d329cdb9 Sep 07 10:18:31 devstack sudo[107124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:18:31 devstack sudo[107121]: pam_unix(sudo:session): session closed for user root Sep 07 10:18:31 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-8e1d7d4a-f51b-4cfd-8238-85c5fd7e3077 tempest-CreateVolumesFromSourceVolumeTest-111434518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a" returned: 0 in 0.327s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:18:31 devstack cinder-volume[87515]: DEBUG cinder.manager [None req-8e1d7d4a-f51b-4cfd-8238-85c5fd7e3077 tempest-CreateVolumesFromSourceVolumeTest-111434518 None] Notifying Schedulers of capabilities ... {{(pid=87515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:18:31 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-8e1d7d4a-f51b-4cfd-8238-85c5fd7e3077 tempest-CreateVolumesFromSourceVolumeTest-111434518 None] Deleted volume successfully. Sep 07 10:18:31 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-8e1d7d4a-f51b-4cfd-8238-85c5fd7e3077 tempest-CreateVolumesFromSourceVolumeTest-111434518 None] Lock "cinder-f219527b-edf2-4045-a6f9-965e0945b744-delete_volume" released by "delete_volume" :: held 1.938s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:18:31 devstack sudo[107120]: pam_unix(sudo:session): session closed for user root Sep 07 10:18:31 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-fe85f60d-6ab6-49f2-be8d-f840ccc5ec83 tempest-VolumeDependencyTests-1280371773 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-321e9476-3454-435c-936f-cee61f12d97f.3b9c86c3-3056-4110-ad20-6abc82c60cb5" returned: 0 in 0.439s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:18:31 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-fe85f60d-6ab6-49f2-be8d-f840ccc5ec83 tempest-VolumeDependencyTests-1280371773 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-321e9476-3454-435c-936f-cee61f12d97f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87515) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 10:18:31 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1e30227-7f02-4a87-ade9-37065bf7b687]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:18:31 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-fe85f60d-6ab6-49f2-be8d-f840ccc5ec83 tempest-VolumeDependencyTests-1280371773 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-321e9476-3454-435c-936f-cee61f12d97f {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:18:32 devstack sudo[107124]: pam_unix(sudo:session): session closed for user root Sep 07 10:18:32 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-38f0ccda-3d09-454b-bdc6-946ecbd3e121 tempest-CreateVolumesFromSnapshotTest-917122263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-fe683bd4-f454-4081-8221-c692d329cdb9" returned: 0 in 0.301s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:18:32 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-38f0ccda-3d09-454b-bdc6-946ecbd3e121 tempest-CreateVolumesFromSnapshotTest-917122263 None] <== create_volume: return (1024ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'} {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 10:18:32 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-38f0ccda-3d09-454b-bdc6-946ecbd3e121 tempest-CreateVolumesFromSnapshotTest-917122263 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.026s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:18:32 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-38f0ccda-3d09-454b-bdc6-946ecbd3e121 tempest-CreateVolumesFromSnapshotTest-917122263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5c7d2df-6dbb-4938-a573-f24e21a301a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fe683bd4-f454-4081-8221-c692d329cdb9', 'volume_size': 1}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:18:32 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-38f0ccda-3d09-454b-bdc6-946ecbd3e121 tempest-CreateVolumesFromSnapshotTest-917122263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75e0bbd1-0cbe-49e8-bcab-e579a01fe053) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:18:32 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-38f0ccda-3d09-454b-bdc6-946ecbd3e121 tempest-CreateVolumesFromSnapshotTest-917122263 None] Volume volume-fe683bd4-f454-4081-8221-c692d329cdb9 (fe683bd4-f454-4081-8221-c692d329cdb9): created successfully Sep 07 10:18:32 devstack sudo[107131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-321e9476-3454-435c-936f-cee61f12d97f Sep 07 10:18:32 devstack sudo[107131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:18:32 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-38f0ccda-3d09-454b-bdc6-946ecbd3e121 tempest-CreateVolumesFromSnapshotTest-917122263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75e0bbd1-0cbe-49e8-bcab-e579a01fe053) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:18:32 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-38f0ccda-3d09-454b-bdc6-946ecbd3e121 tempest-CreateVolumesFromSnapshotTest-917122263 None] Flow 'volume_create_manager' (feb90bcc-4b5a-4755-9cb3-2e5888522794) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:18:32 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-38f0ccda-3d09-454b-bdc6-946ecbd3e121 tempest-CreateVolumesFromSnapshotTest-917122263 None] Created volume successfully. Sep 07 10:18:32 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-d855df6d-8284-4c35-91bb-c70e490bb41f tempest-CreateVolumesFromSnapshotTest-917122263 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:18:32 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-d855df6d-8284-4c35-91bb-c70e490bb41f tempest-CreateVolumesFromSnapshotTest-917122263 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:18:32 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-d855df6d-8284-4c35-91bb-c70e490bb41f tempest-CreateVolumesFromSnapshotTest-917122263 None] Creating offline snapshot 815fa175-5ed1-4e39-b76a-a010b646d493 of volume fe683bd4-f454-4081-8221-c692d329cdb9 {{(pid=87515) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 10:18:32 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-08ecc863-9bda-4ffe-ac93-2ef48981e858 tempest-CreateVolumesFromSourceVolumeTest-111434518 None] Acquiring lock "cinder-8535c3aa-6d2b-4453-8612-6cd4c058dfeb-delete_volume" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:18:32 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa90f4e3-c62b-4599-9026-6565a6a064d5]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:18:32 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-d855df6d-8284-4c35-91bb-c70e490bb41f tempest-CreateVolumesFromSnapshotTest-917122263 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-fe683bd4-f454-4081-8221-c692d329cdb9 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:18:32 devstack sudo[107131]: pam_unix(sudo:session): session closed for user root Sep 07 10:18:32 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-08ecc863-9bda-4ffe-ac93-2ef48981e858 tempest-CreateVolumesFromSourceVolumeTest-111434518 None] Lock "cinder-8535c3aa-6d2b-4453-8612-6cd4c058dfeb-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:18:32 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-fe85f60d-6ab6-49f2-be8d-f840ccc5ec83 tempest-VolumeDependencyTests-1280371773 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-321e9476-3454-435c-936f-cee61f12d97f" returned: 0 in 0.665s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:18:32 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-fe85f60d-6ab6-49f2-be8d-f840ccc5ec83 tempest-VolumeDependencyTests-1280371773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-321e9476-3454-435c-936f-cee61f12d97f.3b9c86c3-3056-4110-ad20-6abc82c60cb5 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:18:32 devstack sudo[107138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-321e9476-3454-435c-936f-cee61f12d97f.3b9c86c3-3056-4110-ad20-6abc82c60cb5 Sep 07 10:18:32 devstack sudo[107138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:18:32 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-08ecc863-9bda-4ffe-ac93-2ef48981e858 tempest-CreateVolumesFromSourceVolumeTest-111434518 None] Acquiring lock "cinder-quobyte-8535c3aa-6d2b-4453-8612-6cd4c058dfeb" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:18:32 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-08ecc863-9bda-4ffe-ac93-2ef48981e858 tempest-CreateVolumesFromSourceVolumeTest-111434518 None] Lock "cinder-quobyte-8535c3aa-6d2b-4453-8612-6cd4c058dfeb" acquired by "delete_volume" :: waited 0.034s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:18:32 devstack sudo[107137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-fe683bd4-f454-4081-8221-c692d329cdb9 Sep 07 10:18:32 devstack sudo[107137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:18:32 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[858ee26f-3699-4001-badb-2d86d00f44d6]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:18:32 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-08ecc863-9bda-4ffe-ac93-2ef48981e858 tempest-CreateVolumesFromSourceVolumeTest-111434518 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-8535c3aa-6d2b-4453-8612-6cd4c058dfeb {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:18:33 devstack sudo[107141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-8535c3aa-6d2b-4453-8612-6cd4c058dfeb Sep 07 10:18:33 devstack sudo[107141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:18:33 devstack sudo[107137]: pam_unix(sudo:session): session closed for user root Sep 07 10:18:33 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-d855df6d-8284-4c35-91bb-c70e490bb41f tempest-CreateVolumesFromSnapshotTest-917122263 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-fe683bd4-f454-4081-8221-c692d329cdb9" returned: 0 in 0.470s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:18:33 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-d855df6d-8284-4c35-91bb-c70e490bb41f tempest-CreateVolumesFromSnapshotTest-917122263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-fe683bd4-f454-4081-8221-c692d329cdb9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-fe683bd4-f454-4081-8221-c692d329cdb9.815fa175-5ed1-4e39-b76a-a010b646d493 1G {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:18:33 devstack sudo[107138]: pam_unix(sudo:session): session closed for user root Sep 07 10:18:33 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-fe85f60d-6ab6-49f2-be8d-f840ccc5ec83 tempest-VolumeDependencyTests-1280371773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-321e9476-3454-435c-936f-cee61f12d97f.3b9c86c3-3056-4110-ad20-6abc82c60cb5" returned: 0 in 0.481s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:18:33 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-fe85f60d-6ab6-49f2-be8d-f840ccc5ec83 tempest-VolumeDependencyTests-1280371773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-321e9476-3454-435c-936f-cee61f12d97f.3b9c86c3-3056-4110-ad20-6abc82c60cb5 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:18:33 devstack sudo[107149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-fe683bd4-f454-4081-8221-c692d329cdb9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-fe683bd4-f454-4081-8221-c692d329cdb9.815fa175-5ed1-4e39-b76a-a010b646d493 1G Sep 07 10:18:33 devstack sudo[107149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:18:33 devstack sudo[107150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-321e9476-3454-435c-936f-cee61f12d97f.3b9c86c3-3056-4110-ad20-6abc82c60cb5 Sep 07 10:18:33 devstack sudo[107150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:18:33 devstack sudo[107141]: pam_unix(sudo:session): session closed for user root Sep 07 10:18:33 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-08ecc863-9bda-4ffe-ac93-2ef48981e858 tempest-CreateVolumesFromSourceVolumeTest-111434518 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-8535c3aa-6d2b-4453-8612-6cd4c058dfeb" returned: 0 in 0.478s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:18:33 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-08ecc863-9bda-4ffe-ac93-2ef48981e858 tempest-CreateVolumesFromSourceVolumeTest-111434518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-8535c3aa-6d2b-4453-8612-6cd4c058dfeb {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:18:33 devstack sudo[107156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-8535c3aa-6d2b-4453-8612-6cd4c058dfeb Sep 07 10:18:33 devstack sudo[107156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:18:33 devstack sudo[107150]: pam_unix(sudo:session): session closed for user root Sep 07 10:18:33 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-fe85f60d-6ab6-49f2-be8d-f840ccc5ec83 tempest-VolumeDependencyTests-1280371773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-321e9476-3454-435c-936f-cee61f12d97f.3b9c86c3-3056-4110-ad20-6abc82c60cb5" returned: 0 in 0.325s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:18:33 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-fe85f60d-6ab6-49f2-be8d-f840ccc5ec83 tempest-VolumeDependencyTests-1280371773 None] Lock "cinder-quobyte-3b9c86c3-3056-4110-ad20-6abc82c60cb5" released by "_delete_snapshot" :: held 2.035s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:18:33 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-fe85f60d-6ab6-49f2-be8d-f840ccc5ec83 tempest-VolumeDependencyTests-1280371773 None] Lock "cinder-quobyte-321e9476-3454-435c-936f-cee61f12d97f" released by "delete_snapshot" :: held 2.063s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:18:33 devstack cinder-volume[87515]: DEBUG cinder.quota [None req-fe85f60d-6ab6-49f2-be8d-f840ccc5ec83 tempest-VolumeDependencyTests-1280371773 None] Created reservations ['4a7dc528-c551-483b-a620-9a9d2e03e126', '2ebc2e8f-3ec7-4648-9f85-5d3885da8f17', '0b758a44-cd9e-44f5-a814-cde79a55710d', '2f21a33c-a574-4c46-8e74-5064b69626e9'] {{(pid=87515) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:18:33 devstack sudo[107149]: pam_unix(sudo:session): session closed for user root Sep 07 10:18:33 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-d855df6d-8284-4c35-91bb-c70e490bb41f tempest-CreateVolumesFromSnapshotTest-917122263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-fe683bd4-f454-4081-8221-c692d329cdb9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-fe683bd4-f454-4081-8221-c692d329cdb9.815fa175-5ed1-4e39-b76a-a010b646d493 1G" returned: 0 in 0.518s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:18:33 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-d855df6d-8284-4c35-91bb-c70e490bb41f tempest-CreateVolumesFromSnapshotTest-917122263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fe683bd4-f454-4081-8221-c692d329cdb9 -F qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-fe683bd4-f454-4081-8221-c692d329cdb9.815fa175-5ed1-4e39-b76a-a010b646d493 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:18:33 devstack sudo[107163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fe683bd4-f454-4081-8221-c692d329cdb9 -F qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-fe683bd4-f454-4081-8221-c692d329cdb9.815fa175-5ed1-4e39-b76a-a010b646d493 Sep 07 10:18:33 devstack sudo[107163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:18:33 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-fe85f60d-6ab6-49f2-be8d-f840ccc5ec83 tempest-VolumeDependencyTests-1280371773 None] Delete snapshot completed successfully. Sep 07 10:18:33 devstack sudo[107156]: pam_unix(sudo:session): session closed for user root Sep 07 10:18:33 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-fe85f60d-6ab6-49f2-be8d-f840ccc5ec83 tempest-VolumeDependencyTests-1280371773 None] Lock "cinder-3b9c86c3-3056-4110-ad20-6abc82c60cb5-delete_snapshot" released by "delete_snapshot" :: held 2.272s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:18:33 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-08ecc863-9bda-4ffe-ac93-2ef48981e858 tempest-CreateVolumesFromSourceVolumeTest-111434518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-8535c3aa-6d2b-4453-8612-6cd4c058dfeb" returned: 0 in 0.402s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:18:33 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-08ecc863-9bda-4ffe-ac93-2ef48981e858 tempest-CreateVolumesFromSourceVolumeTest-111434518 None] Lock "cinder-quobyte-8535c3aa-6d2b-4453-8612-6cd4c058dfeb" released by "delete_volume" :: held 0.948s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:18:33 devstack cinder-volume[87515]: DEBUG cinder.quota [None req-08ecc863-9bda-4ffe-ac93-2ef48981e858 tempest-CreateVolumesFromSourceVolumeTest-111434518 None] Created reservations ['01c1bbd4-d920-4c7d-91a0-b3194c5b13c4', 'd59dab39-524b-442d-8053-7b67d1e05cad', '431107e8-16c7-4dc7-ba30-a85cf1888b27', 'c1f8bccf-9f6f-4639-be5f-397645edd76b'] {{(pid=87515) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:18:33 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-08ecc863-9bda-4ffe-ac93-2ef48981e858 tempest-CreateVolumesFromSourceVolumeTest-111434518 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:18:33 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-08ecc863-9bda-4ffe-ac93-2ef48981e858 tempest-CreateVolumesFromSourceVolumeTest-111434518 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:18:33 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-08ecc863-9bda-4ffe-ac93-2ef48981e858 tempest-CreateVolumesFromSourceVolumeTest-111434518 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:18:33 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-08ecc863-9bda-4ffe-ac93-2ef48981e858 tempest-CreateVolumesFromSourceVolumeTest-111434518 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:18:33 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-08ecc863-9bda-4ffe-ac93-2ef48981e858 tempest-CreateVolumesFromSourceVolumeTest-111434518 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:18:33 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-08ecc863-9bda-4ffe-ac93-2ef48981e858 tempest-CreateVolumesFromSourceVolumeTest-111434518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:18:33 devstack sudo[107166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a Sep 07 10:18:33 devstack sudo[107166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:18:33 devstack sudo[107163]: pam_unix(sudo:session): session closed for user root Sep 07 10:18:33 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-d855df6d-8284-4c35-91bb-c70e490bb41f tempest-CreateVolumesFromSnapshotTest-917122263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fe683bd4-f454-4081-8221-c692d329cdb9 -F qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-fe683bd4-f454-4081-8221-c692d329cdb9.815fa175-5ed1-4e39-b76a-a010b646d493" returned: 0 in 0.371s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:18:33 devstack cinder-volume[87515]: WARNING cinder.volume.drivers.remotefs [None req-d855df6d-8284-4c35-91bb-c70e490bb41f tempest-CreateVolumesFromSnapshotTest-917122263 None] /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-fe683bd4-f454-4081-8221-c692d329cdb9.815fa175-5ed1-4e39-b76a-a010b646d493 is being set with open permissions: ugo+rw Sep 07 10:18:33 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-d855df6d-8284-4c35-91bb-c70e490bb41f tempest-CreateVolumesFromSnapshotTest-917122263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-fe683bd4-f454-4081-8221-c692d329cdb9.815fa175-5ed1-4e39-b76a-a010b646d493 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:18:34 devstack sudo[107172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-fe683bd4-f454-4081-8221-c692d329cdb9.815fa175-5ed1-4e39-b76a-a010b646d493 Sep 07 10:18:34 devstack sudo[107172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:18:34 devstack sudo[107166]: pam_unix(sudo:session): session closed for user root Sep 07 10:18:34 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-08ecc863-9bda-4ffe-ac93-2ef48981e858 tempest-CreateVolumesFromSourceVolumeTest-111434518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a" returned: 0 in 0.272s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:18:34 devstack cinder-volume[87515]: DEBUG cinder.manager [None req-08ecc863-9bda-4ffe-ac93-2ef48981e858 tempest-CreateVolumesFromSourceVolumeTest-111434518 None] Notifying Schedulers of capabilities ... {{(pid=87515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:18:34 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-08ecc863-9bda-4ffe-ac93-2ef48981e858 tempest-CreateVolumesFromSourceVolumeTest-111434518 None] Deleted volume successfully. Sep 07 10:18:34 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-08ecc863-9bda-4ffe-ac93-2ef48981e858 tempest-CreateVolumesFromSourceVolumeTest-111434518 None] Lock "cinder-8535c3aa-6d2b-4453-8612-6cd4c058dfeb-delete_volume" released by "delete_volume" :: held 1.532s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:18:34 devstack sudo[107172]: pam_unix(sudo:session): session closed for user root Sep 07 10:18:34 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-d855df6d-8284-4c35-91bb-c70e490bb41f tempest-CreateVolumesFromSnapshotTest-917122263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-fe683bd4-f454-4081-8221-c692d329cdb9.815fa175-5ed1-4e39-b76a-a010b646d493" returned: 0 in 0.277s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:18:34 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-d855df6d-8284-4c35-91bb-c70e490bb41f tempest-CreateVolumesFromSnapshotTest-917122263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-fe683bd4-f454-4081-8221-c692d329cdb9.info {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:18:34 devstack sudo[107176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-fe683bd4-f454-4081-8221-c692d329cdb9.info Sep 07 10:18:34 devstack sudo[107176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:18:34 devstack sudo[107176]: pam_unix(sudo:session): session closed for user root Sep 07 10:18:34 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-d855df6d-8284-4c35-91bb-c70e490bb41f tempest-CreateVolumesFromSnapshotTest-917122263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-fe683bd4-f454-4081-8221-c692d329cdb9.info" returned: 0 in 0.280s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:18:34 devstack cinder-volume[87515]: WARNING cinder.volume.drivers.remotefs [None req-d855df6d-8284-4c35-91bb-c70e490bb41f tempest-CreateVolumesFromSnapshotTest-917122263 None] /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-fe683bd4-f454-4081-8221-c692d329cdb9.info is being set with open permissions: ugo+rw Sep 07 10:18:34 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-d855df6d-8284-4c35-91bb-c70e490bb41f tempest-CreateVolumesFromSnapshotTest-917122263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-fe683bd4-f454-4081-8221-c692d329cdb9.info {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:18:34 devstack sudo[107179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-fe683bd4-f454-4081-8221-c692d329cdb9.info Sep 07 10:18:34 devstack sudo[107179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:18:34 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-574e88d4-5dd0-441c-8173-cb66bef20327 tempest-VolumeDependencyTests-1280371773 None] Acquiring lock "cinder-321e9476-3454-435c-936f-cee61f12d97f-delete_volume" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:18:34 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-574e88d4-5dd0-441c-8173-cb66bef20327 tempest-VolumeDependencyTests-1280371773 None] Lock "cinder-321e9476-3454-435c-936f-cee61f12d97f-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:18:34 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-574e88d4-5dd0-441c-8173-cb66bef20327 tempest-VolumeDependencyTests-1280371773 None] Acquiring lock "cinder-quobyte-321e9476-3454-435c-936f-cee61f12d97f" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:18:34 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-574e88d4-5dd0-441c-8173-cb66bef20327 tempest-VolumeDependencyTests-1280371773 None] Lock "cinder-quobyte-321e9476-3454-435c-936f-cee61f12d97f" acquired by "delete_volume" :: waited 0.018s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:18:34 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[70fe5f51-db89-45b4-90a6-4aef3710528f]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:18:34 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-574e88d4-5dd0-441c-8173-cb66bef20327 tempest-VolumeDependencyTests-1280371773 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-321e9476-3454-435c-936f-cee61f12d97f {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:18:34 devstack sudo[107179]: pam_unix(sudo:session): session closed for user root Sep 07 10:18:34 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-d855df6d-8284-4c35-91bb-c70e490bb41f tempest-CreateVolumesFromSnapshotTest-917122263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-fe683bd4-f454-4081-8221-c692d329cdb9.info" returned: 0 in 0.294s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:18:34 devstack sudo[107181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-321e9476-3454-435c-936f-cee61f12d97f Sep 07 10:18:34 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-d855df6d-8284-4c35-91bb-c70e490bb41f tempest-CreateVolumesFromSnapshotTest-917122263 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.350s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:18:34 devstack sudo[107181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:18:34 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-d855df6d-8284-4c35-91bb-c70e490bb41f tempest-CreateVolumesFromSnapshotTest-917122263 None] Create snapshot completed successfully Sep 07 10:18:35 devstack sudo[107181]: pam_unix(sudo:session): session closed for user root Sep 07 10:18:35 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-574e88d4-5dd0-441c-8173-cb66bef20327 tempest-VolumeDependencyTests-1280371773 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-321e9476-3454-435c-936f-cee61f12d97f" returned: 0 in 0.414s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:18:35 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-574e88d4-5dd0-441c-8173-cb66bef20327 tempest-VolumeDependencyTests-1280371773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-321e9476-3454-435c-936f-cee61f12d97f {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:18:35 devstack sudo[107187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-321e9476-3454-435c-936f-cee61f12d97f Sep 07 10:18:35 devstack sudo[107187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:18:35 devstack sudo[107187]: pam_unix(sudo:session): session closed for user root Sep 07 10:18:35 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-574e88d4-5dd0-441c-8173-cb66bef20327 tempest-VolumeDependencyTests-1280371773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-321e9476-3454-435c-936f-cee61f12d97f" returned: 0 in 0.279s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:18:35 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-574e88d4-5dd0-441c-8173-cb66bef20327 tempest-VolumeDependencyTests-1280371773 None] Lock "cinder-quobyte-321e9476-3454-435c-936f-cee61f12d97f" released by "delete_volume" :: held 0.755s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:18:35 devstack cinder-volume[87515]: DEBUG cinder.quota [None req-574e88d4-5dd0-441c-8173-cb66bef20327 tempest-VolumeDependencyTests-1280371773 None] Created reservations ['53da9d9d-e94e-48f7-a43a-f772ab0a4c52', '66323aa5-164f-4480-9b83-9d856fd92eab', '029cc0ac-b3f1-4307-8a88-f96de8efec09', '498a96f9-771e-4388-b269-1f89119390bf'] {{(pid=87515) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:18:35 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-574e88d4-5dd0-441c-8173-cb66bef20327 tempest-VolumeDependencyTests-1280371773 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:18:35 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-574e88d4-5dd0-441c-8173-cb66bef20327 tempest-VolumeDependencyTests-1280371773 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:18:35 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-574e88d4-5dd0-441c-8173-cb66bef20327 tempest-VolumeDependencyTests-1280371773 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:18:35 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-574e88d4-5dd0-441c-8173-cb66bef20327 tempest-VolumeDependencyTests-1280371773 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:18:35 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-574e88d4-5dd0-441c-8173-cb66bef20327 tempest-VolumeDependencyTests-1280371773 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:18:35 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-574e88d4-5dd0-441c-8173-cb66bef20327 tempest-VolumeDependencyTests-1280371773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:18:35 devstack sudo[107190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a Sep 07 10:18:35 devstack sudo[107190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:18:35 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-e869d746-b3d7-41bf-8f4f-f2b4c6e4a5c3 tempest-VolumeDependencyTests-1280371773 None] Acquiring lock "cinder-e93a0b2c-d426-4a44-af44-da3a7e5d09ee-delete_volume" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:18:35 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-e869d746-b3d7-41bf-8f4f-f2b4c6e4a5c3 tempest-VolumeDependencyTests-1280371773 None] Lock "cinder-e93a0b2c-d426-4a44-af44-da3a7e5d09ee-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:18:35 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-e869d746-b3d7-41bf-8f4f-f2b4c6e4a5c3 tempest-VolumeDependencyTests-1280371773 None] Acquiring lock "cinder-quobyte-e93a0b2c-d426-4a44-af44-da3a7e5d09ee" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:18:36 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-e869d746-b3d7-41bf-8f4f-f2b4c6e4a5c3 tempest-VolumeDependencyTests-1280371773 None] Lock "cinder-quobyte-e93a0b2c-d426-4a44-af44-da3a7e5d09ee" acquired by "delete_volume" :: waited 0.022s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:18:36 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[349bb1fa-ddd0-4465-8572-5e6f787bb73a]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:18:36 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-e869d746-b3d7-41bf-8f4f-f2b4c6e4a5c3 tempest-VolumeDependencyTests-1280371773 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-e93a0b2c-d426-4a44-af44-da3a7e5d09ee {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:18:36 devstack sudo[107190]: pam_unix(sudo:session): session closed for user root Sep 07 10:18:36 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-574e88d4-5dd0-441c-8173-cb66bef20327 tempest-VolumeDependencyTests-1280371773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a" returned: 0 in 0.448s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:18:36 devstack cinder-volume[87515]: DEBUG cinder.manager [None req-574e88d4-5dd0-441c-8173-cb66bef20327 tempest-VolumeDependencyTests-1280371773 None] Notifying Schedulers of capabilities ... {{(pid=87515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:18:36 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-574e88d4-5dd0-441c-8173-cb66bef20327 tempest-VolumeDependencyTests-1280371773 None] Deleted volume successfully. Sep 07 10:18:36 devstack sudo[107193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-e93a0b2c-d426-4a44-af44-da3a7e5d09ee Sep 07 10:18:36 devstack sudo[107193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:18:36 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-574e88d4-5dd0-441c-8173-cb66bef20327 tempest-VolumeDependencyTests-1280371773 None] Lock "cinder-321e9476-3454-435c-936f-cee61f12d97f-delete_volume" released by "delete_volume" :: held 1.522s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:18:36 devstack cinder-volume[87515]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a2832dc-a919-45af-8635-374dacf0340a tempest-CreateVolumesFromSnapshotTest-917122263 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 10:18:36 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-2a2832dc-a919-45af-8635-374dacf0340a tempest-CreateVolumesFromSnapshotTest-917122263 None] Flow 'volume_create_manager' (a8b8e468-b780-4664-bef0-eccfca4007c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:18:36 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-2a2832dc-a919-45af-8635-374dacf0340a tempest-CreateVolumesFromSnapshotTest-917122263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06ef9260-77dc-4a8e-8b40-1260131b260d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:18:36 devstack sudo[107193]: pam_unix(sudo:session): session closed for user root Sep 07 10:18:36 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-e869d746-b3d7-41bf-8f4f-f2b4c6e4a5c3 tempest-VolumeDependencyTests-1280371773 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-e93a0b2c-d426-4a44-af44-da3a7e5d09ee" returned: 0 in 0.608s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:18:36 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-e869d746-b3d7-41bf-8f4f-f2b4c6e4a5c3 tempest-VolumeDependencyTests-1280371773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-e93a0b2c-d426-4a44-af44-da3a7e5d09ee {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:18:36 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-2a2832dc-a919-45af-8635-374dacf0340a tempest-CreateVolumesFromSnapshotTest-917122263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06ef9260-77dc-4a8e-8b40-1260131b260d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:18:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1798685188',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91e3e882-fcd1-4e4b-bef6-5c785a1cf665,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a3407d067744ab1a54f28d3320f9639',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:18:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:18:36Z,use_quota=True,user_id='ecc1196b6626463b885713d7b2091688',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3a092cd-7947-4cbf-abff-4ba9567becf0),volume_type_id=f3a092cd-7947-4cbf-abff-4ba9567becf0)' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:18:36 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-2a2832dc-a919-45af-8635-374dacf0340a tempest-CreateVolumesFromSnapshotTest-917122263 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a81eb318-6211-44d2-9738-8918233dade1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:18:36 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-2a2832dc-a919-45af-8635-374dacf0340a tempest-CreateVolumesFromSnapshotTest-917122263 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a81eb318-6211-44d2-9738-8918233dade1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:18:36 devstack sudo[107199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-e93a0b2c-d426-4a44-af44-da3a7e5d09ee Sep 07 10:18:36 devstack sudo[107199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:18:36 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-2a2832dc-a919-45af-8635-374dacf0340a tempest-CreateVolumesFromSnapshotTest-917122263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71d20e89-cfc0-4a14-b82a-a41dcaf26783) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:18:36 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-2a2832dc-a919-45af-8635-374dacf0340a tempest-CreateVolumesFromSnapshotTest-917122263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71d20e89-cfc0-4a14-b82a-a41dcaf26783) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '91e3e882-fcd1-4e4b-bef6-5c785a1cf665', 'volume_name': 'volume-91e3e882-fcd1-4e4b-bef6-5c785a1cf665', 'volume_size': 1}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:18:36 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-2a2832dc-a919-45af-8635-374dacf0340a tempest-CreateVolumesFromSnapshotTest-917122263 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca2fd559-a26b-4fe2-b198-b59c77833171) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:18:36 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-2a2832dc-a919-45af-8635-374dacf0340a tempest-CreateVolumesFromSnapshotTest-917122263 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca2fd559-a26b-4fe2-b198-b59c77833171) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:18:36 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-2a2832dc-a919-45af-8635-374dacf0340a tempest-CreateVolumesFromSnapshotTest-917122263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9dd60fc0-7f8c-41f6-b275-035c0419f12b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:18:36 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-2a2832dc-a919-45af-8635-374dacf0340a tempest-CreateVolumesFromSnapshotTest-917122263 None] Volume 91e3e882-fcd1-4e4b-bef6-5c785a1cf665: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-91e3e882-fcd1-4e4b-bef6-5c785a1cf665', 'volume_size': 1} Sep 07 10:18:36 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-2a2832dc-a919-45af-8635-374dacf0340a tempest-CreateVolumesFromSnapshotTest-917122263 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:18:36 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-2a2832dc-a919-45af-8635-374dacf0340a tempest-CreateVolumesFromSnapshotTest-917122263 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:18:36 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-2a2832dc-a919-45af-8635-374dacf0340a tempest-CreateVolumesFromSnapshotTest-917122263 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:18:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1798685188',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91e3e882-fcd1-4e4b-bef6-5c785a1cf665,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a3407d067744ab1a54f28d3320f9639',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:18:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:18:36Z,use_quota=True,user_id='ecc1196b6626463b885713d7b2091688',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3a092cd-7947-4cbf-abff-4ba9567becf0),volume_type_id=f3a092cd-7947-4cbf-abff-4ba9567becf0)}" {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 10:18:36 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-2a2832dc-a919-45af-8635-374dacf0340a tempest-CreateVolumesFromSnapshotTest-917122263 None] Creating volume 91e3e882-fcd1-4e4b-bef6-5c785a1cf665 {{(pid=87515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 10:18:36 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-2a2832dc-a919-45af-8635-374dacf0340a tempest-CreateVolumesFromSnapshotTest-917122263 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:18:36 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-2a2832dc-a919-45af-8635-374dacf0340a tempest-CreateVolumesFromSnapshotTest-917122263 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:18:36 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-2a2832dc-a919-45af-8635-374dacf0340a tempest-CreateVolumesFromSnapshotTest-917122263 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:18:36 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-2a2832dc-a919-45af-8635-374dacf0340a tempest-CreateVolumesFromSnapshotTest-917122263 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:18:36 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-2a2832dc-a919-45af-8635-374dacf0340a tempest-CreateVolumesFromSnapshotTest-917122263 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:18:36 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-2a2832dc-a919-45af-8635-374dacf0340a tempest-CreateVolumesFromSnapshotTest-917122263 None] Selected osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c as target Quobyte volume. {{(pid=87515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 10:18:36 devstack cinder-volume[87515]: INFO cinder.volume.drivers.remotefs [None req-2a2832dc-a919-45af-8635-374dacf0340a tempest-CreateVolumesFromSnapshotTest-917122263 None] casted to osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c Sep 07 10:18:36 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-2a2832dc-a919-45af-8635-374dacf0340a tempest-CreateVolumesFromSnapshotTest-917122263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-91e3e882-fcd1-4e4b-bef6-5c785a1cf665 1073741824 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:18:36 devstack sudo[107201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-91e3e882-fcd1-4e4b-bef6-5c785a1cf665 1073741824 Sep 07 10:18:36 devstack sudo[107201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:18:37 devstack sudo[107199]: pam_unix(sudo:session): session closed for user root Sep 07 10:18:37 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-e869d746-b3d7-41bf-8f4f-f2b4c6e4a5c3 tempest-VolumeDependencyTests-1280371773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-e93a0b2c-d426-4a44-af44-da3a7e5d09ee" returned: 0 in 0.425s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:18:37 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-e869d746-b3d7-41bf-8f4f-f2b4c6e4a5c3 tempest-VolumeDependencyTests-1280371773 None] Lock "cinder-quobyte-e93a0b2c-d426-4a44-af44-da3a7e5d09ee" released by "delete_volume" :: held 1.093s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:18:37 devstack cinder-volume[87515]: DEBUG cinder.quota [None req-e869d746-b3d7-41bf-8f4f-f2b4c6e4a5c3 tempest-VolumeDependencyTests-1280371773 None] Created reservations ['10d84a0b-b123-451f-ba41-ae3bdd928225', '75c5c592-71a3-4373-a2c7-32061a640245', '6a49b520-85e4-4712-89b2-61475a23b96d', 'c2e82d55-7026-49f2-86d7-fe2cd0796989'] {{(pid=87515) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:18:37 devstack cinder-volume[87515]: DEBUG cinder.volume.flows.manager.create_volume [None req-1eb59dbe-92cb-463c-a546-287f58197aba tempest-CreateVolumesFromSnapshotTest-917122263 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 10:18:37 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-1eb59dbe-92cb-463c-a546-287f58197aba tempest-CreateVolumesFromSnapshotTest-917122263 None] Flow 'volume_create_manager' (be2ef698-e6e0-43b6-8aa0-627f5cdc7fab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:18:37 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-1eb59dbe-92cb-463c-a546-287f58197aba tempest-CreateVolumesFromSnapshotTest-917122263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b83fead-56d8-4550-b48d-bec641954450) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:18:37 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-1eb59dbe-92cb-463c-a546-287f58197aba tempest-CreateVolumesFromSnapshotTest-917122263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b83fead-56d8-4550-b48d-bec641954450) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:18:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-172075325',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b71d39f4-3a6d-4915-a5d1-193c702d503e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a3407d067744ab1a54f28d3320f9639',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:18:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:18:37Z,use_quota=True,user_id='ecc1196b6626463b885713d7b2091688',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3a092cd-7947-4cbf-abff-4ba9567becf0),volume_type_id=f3a092cd-7947-4cbf-abff-4ba9567becf0)' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:18:37 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-1eb59dbe-92cb-463c-a546-287f58197aba tempest-CreateVolumesFromSnapshotTest-917122263 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd9068b4-2a89-4a4d-9cff-5c62fa78c635) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:18:37 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-1eb59dbe-92cb-463c-a546-287f58197aba tempest-CreateVolumesFromSnapshotTest-917122263 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd9068b4-2a89-4a4d-9cff-5c62fa78c635) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:18:37 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-1eb59dbe-92cb-463c-a546-287f58197aba tempest-CreateVolumesFromSnapshotTest-917122263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c013dbb4-0b60-4f55-a8c0-12ce2f3a0341) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:18:37 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-1eb59dbe-92cb-463c-a546-287f58197aba tempest-CreateVolumesFromSnapshotTest-917122263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c013dbb4-0b60-4f55-a8c0-12ce2f3a0341) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b71d39f4-3a6d-4915-a5d1-193c702d503e', 'volume_name': 'volume-b71d39f4-3a6d-4915-a5d1-193c702d503e', 'volume_size': 1}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:18:37 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-1eb59dbe-92cb-463c-a546-287f58197aba tempest-CreateVolumesFromSnapshotTest-917122263 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (145fba21-c5f0-46ab-becb-89b8708461fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:18:37 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-1eb59dbe-92cb-463c-a546-287f58197aba tempest-CreateVolumesFromSnapshotTest-917122263 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (145fba21-c5f0-46ab-becb-89b8708461fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:18:37 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-1eb59dbe-92cb-463c-a546-287f58197aba tempest-CreateVolumesFromSnapshotTest-917122263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e882277b-a721-44e4-933d-7fea4851c004) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:18:37 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-1eb59dbe-92cb-463c-a546-287f58197aba tempest-CreateVolumesFromSnapshotTest-917122263 None] Volume b71d39f4-3a6d-4915-a5d1-193c702d503e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b71d39f4-3a6d-4915-a5d1-193c702d503e', 'volume_size': 1} Sep 07 10:18:37 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-1eb59dbe-92cb-463c-a546-287f58197aba tempest-CreateVolumesFromSnapshotTest-917122263 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:18:37 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-e869d746-b3d7-41bf-8f4f-f2b4c6e4a5c3 tempest-VolumeDependencyTests-1280371773 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:18:37 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-e869d746-b3d7-41bf-8f4f-f2b4c6e4a5c3 tempest-VolumeDependencyTests-1280371773 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:18:37 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-e869d746-b3d7-41bf-8f4f-f2b4c6e4a5c3 tempest-VolumeDependencyTests-1280371773 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:18:37 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-e869d746-b3d7-41bf-8f4f-f2b4c6e4a5c3 tempest-VolumeDependencyTests-1280371773 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:18:37 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-e869d746-b3d7-41bf-8f4f-f2b4c6e4a5c3 tempest-VolumeDependencyTests-1280371773 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:18:37 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-e869d746-b3d7-41bf-8f4f-f2b4c6e4a5c3 tempest-VolumeDependencyTests-1280371773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:18:37 devstack sudo[107208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a Sep 07 10:18:37 devstack sudo[107201]: pam_unix(sudo:session): session closed for user root Sep 07 10:18:37 devstack sudo[107208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:18:37 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-2a2832dc-a919-45af-8635-374dacf0340a tempest-CreateVolumesFromSnapshotTest-917122263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-91e3e882-fcd1-4e4b-bef6-5c785a1cf665 1073741824" returned: 0 in 0.685s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:18:37 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-2a2832dc-a919-45af-8635-374dacf0340a tempest-CreateVolumesFromSnapshotTest-917122263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-91e3e882-fcd1-4e4b-bef6-5c785a1cf665 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:18:37 devstack sudo[107210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-91e3e882-fcd1-4e4b-bef6-5c785a1cf665 Sep 07 10:18:37 devstack sudo[107210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:18:37 devstack sudo[107208]: pam_unix(sudo:session): session closed for user root Sep 07 10:18:37 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-e869d746-b3d7-41bf-8f4f-f2b4c6e4a5c3 tempest-VolumeDependencyTests-1280371773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a" returned: 0 in 0.419s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:18:37 devstack cinder-volume[87515]: DEBUG cinder.manager [None req-e869d746-b3d7-41bf-8f4f-f2b4c6e4a5c3 tempest-VolumeDependencyTests-1280371773 None] Notifying Schedulers of capabilities ... {{(pid=87515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:18:37 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-e869d746-b3d7-41bf-8f4f-f2b4c6e4a5c3 tempest-VolumeDependencyTests-1280371773 None] Deleted volume successfully. Sep 07 10:18:37 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-e869d746-b3d7-41bf-8f4f-f2b4c6e4a5c3 tempest-VolumeDependencyTests-1280371773 None] Lock "cinder-e93a0b2c-d426-4a44-af44-da3a7e5d09ee-delete_volume" released by "delete_volume" :: held 1.939s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:18:37 devstack sudo[107210]: pam_unix(sudo:session): session closed for user root Sep 07 10:18:37 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-2a2832dc-a919-45af-8635-374dacf0340a tempest-CreateVolumesFromSnapshotTest-917122263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-91e3e882-fcd1-4e4b-bef6-5c785a1cf665" returned: 0 in 0.402s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:18:37 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-2a2832dc-a919-45af-8635-374dacf0340a tempest-CreateVolumesFromSnapshotTest-917122263 None] <== create_volume: return (1168ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'} {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 10:18:37 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-2a2832dc-a919-45af-8635-374dacf0340a tempest-CreateVolumesFromSnapshotTest-917122263 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.172s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:18:37 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-1eb59dbe-92cb-463c-a546-287f58197aba tempest-CreateVolumesFromSnapshotTest-917122263 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.553s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:18:37 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-1eb59dbe-92cb-463c-a546-287f58197aba tempest-CreateVolumesFromSnapshotTest-917122263 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:18:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-172075325',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b71d39f4-3a6d-4915-a5d1-193c702d503e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a3407d067744ab1a54f28d3320f9639',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:18:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:18:37Z,use_quota=True,user_id='ecc1196b6626463b885713d7b2091688',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3a092cd-7947-4cbf-abff-4ba9567becf0),volume_type_id=f3a092cd-7947-4cbf-abff-4ba9567becf0)}" {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 10:18:37 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-1eb59dbe-92cb-463c-a546-287f58197aba tempest-CreateVolumesFromSnapshotTest-917122263 None] Creating volume b71d39f4-3a6d-4915-a5d1-193c702d503e {{(pid=87515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 10:18:37 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-1eb59dbe-92cb-463c-a546-287f58197aba tempest-CreateVolumesFromSnapshotTest-917122263 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:18:37 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-1eb59dbe-92cb-463c-a546-287f58197aba tempest-CreateVolumesFromSnapshotTest-917122263 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:18:37 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-1eb59dbe-92cb-463c-a546-287f58197aba tempest-CreateVolumesFromSnapshotTest-917122263 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:18:37 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-1eb59dbe-92cb-463c-a546-287f58197aba tempest-CreateVolumesFromSnapshotTest-917122263 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:18:37 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-1eb59dbe-92cb-463c-a546-287f58197aba tempest-CreateVolumesFromSnapshotTest-917122263 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:18:37 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-1eb59dbe-92cb-463c-a546-287f58197aba tempest-CreateVolumesFromSnapshotTest-917122263 None] Selected osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c as target Quobyte volume. {{(pid=87515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 10:18:37 devstack cinder-volume[87515]: INFO cinder.volume.drivers.remotefs [None req-1eb59dbe-92cb-463c-a546-287f58197aba tempest-CreateVolumesFromSnapshotTest-917122263 None] casted to osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c Sep 07 10:18:37 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-1eb59dbe-92cb-463c-a546-287f58197aba tempest-CreateVolumesFromSnapshotTest-917122263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-b71d39f4-3a6d-4915-a5d1-193c702d503e 1073741824 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:18:37 devstack sudo[107220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-b71d39f4-3a6d-4915-a5d1-193c702d503e 1073741824 Sep 07 10:18:37 devstack sudo[107220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:18:37 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-2a2832dc-a919-45af-8635-374dacf0340a tempest-CreateVolumesFromSnapshotTest-917122263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9dd60fc0-7f8c-41f6-b275-035c0419f12b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-91e3e882-fcd1-4e4b-bef6-5c785a1cf665', 'volume_size': 1}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:18:38 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-2a2832dc-a919-45af-8635-374dacf0340a tempest-CreateVolumesFromSnapshotTest-917122263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68886738-7ca7-4c12-a674-83bb6ec9c576) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:18:38 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-2a2832dc-a919-45af-8635-374dacf0340a tempest-CreateVolumesFromSnapshotTest-917122263 None] Volume volume-91e3e882-fcd1-4e4b-bef6-5c785a1cf665 (91e3e882-fcd1-4e4b-bef6-5c785a1cf665): created successfully Sep 07 10:18:38 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-2a2832dc-a919-45af-8635-374dacf0340a tempest-CreateVolumesFromSnapshotTest-917122263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68886738-7ca7-4c12-a674-83bb6ec9c576) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:18:38 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-2a2832dc-a919-45af-8635-374dacf0340a tempest-CreateVolumesFromSnapshotTest-917122263 None] Flow 'volume_create_manager' (a8b8e468-b780-4664-bef0-eccfca4007c5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:18:38 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-2a2832dc-a919-45af-8635-374dacf0340a tempest-CreateVolumesFromSnapshotTest-917122263 None] Created volume successfully. Sep 07 10:18:38 devstack cinder-volume[87515]: DEBUG cinder.volume.flows.manager.create_volume [None req-3cf88dec-2ab5-48a6-a35f-64b72a7c6588 tempest-CreateVolumesFromSnapshotTest-917122263 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 10:18:38 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-3cf88dec-2ab5-48a6-a35f-64b72a7c6588 tempest-CreateVolumesFromSnapshotTest-917122263 None] Flow 'volume_create_manager' (c0cae6eb-1f97-42bd-9ccc-32a8fea4a805) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:18:38 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-3cf88dec-2ab5-48a6-a35f-64b72a7c6588 tempest-CreateVolumesFromSnapshotTest-917122263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (675dd1f9-c3df-4e91-b45c-0bd51b2413ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:18:38 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-3cf88dec-2ab5-48a6-a35f-64b72a7c6588 tempest-CreateVolumesFromSnapshotTest-917122263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (675dd1f9-c3df-4e91-b45c-0bd51b2413ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:18:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-819654560',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21c79fa5-e6e1-4994-ba50-e47731dcae25,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a3407d067744ab1a54f28d3320f9639',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:18:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:18:38Z,use_quota=True,user_id='ecc1196b6626463b885713d7b2091688',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3a092cd-7947-4cbf-abff-4ba9567becf0),volume_type_id=f3a092cd-7947-4cbf-abff-4ba9567becf0)' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:18:38 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-3cf88dec-2ab5-48a6-a35f-64b72a7c6588 tempest-CreateVolumesFromSnapshotTest-917122263 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2dac6ce1-ad5b-45b7-99a3-6380e99a1554) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:18:38 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-3cf88dec-2ab5-48a6-a35f-64b72a7c6588 tempest-CreateVolumesFromSnapshotTest-917122263 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2dac6ce1-ad5b-45b7-99a3-6380e99a1554) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:18:38 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-3cf88dec-2ab5-48a6-a35f-64b72a7c6588 tempest-CreateVolumesFromSnapshotTest-917122263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7759c64-c82b-4d62-972b-28783baf5c70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:18:38 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-3cf88dec-2ab5-48a6-a35f-64b72a7c6588 tempest-CreateVolumesFromSnapshotTest-917122263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7759c64-c82b-4d62-972b-28783baf5c70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '21c79fa5-e6e1-4994-ba50-e47731dcae25', 'volume_name': 'volume-21c79fa5-e6e1-4994-ba50-e47731dcae25', 'volume_size': 1}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:18:38 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-3cf88dec-2ab5-48a6-a35f-64b72a7c6588 tempest-CreateVolumesFromSnapshotTest-917122263 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e7a5b9b-b8a6-4072-998c-b100d02050d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:18:38 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-3cf88dec-2ab5-48a6-a35f-64b72a7c6588 tempest-CreateVolumesFromSnapshotTest-917122263 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e7a5b9b-b8a6-4072-998c-b100d02050d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:18:38 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-3cf88dec-2ab5-48a6-a35f-64b72a7c6588 tempest-CreateVolumesFromSnapshotTest-917122263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (074f0aa3-e0ac-4da8-96ed-a9ecdbab64cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:18:38 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-3cf88dec-2ab5-48a6-a35f-64b72a7c6588 tempest-CreateVolumesFromSnapshotTest-917122263 None] Volume 21c79fa5-e6e1-4994-ba50-e47731dcae25: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-21c79fa5-e6e1-4994-ba50-e47731dcae25', 'volume_size': 1} Sep 07 10:18:38 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-3cf88dec-2ab5-48a6-a35f-64b72a7c6588 tempest-CreateVolumesFromSnapshotTest-917122263 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:18:38 devstack cinder-volume[87515]: DEBUG cinder.volume.flows.manager.create_volume [None req-26d42142-7a8b-446b-bbb0-ce338e0892f2 tempest-CreateVolumesFromSnapshotTest-917122263 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 10:18:38 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-26d42142-7a8b-446b-bbb0-ce338e0892f2 tempest-CreateVolumesFromSnapshotTest-917122263 None] Flow 'volume_create_manager' (3dbe6251-7921-4c8f-9a7c-272bd53afd83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:18:38 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-26d42142-7a8b-446b-bbb0-ce338e0892f2 tempest-CreateVolumesFromSnapshotTest-917122263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9bd989a-5b02-4e72-ac86-ba986789802c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:18:38 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-26d42142-7a8b-446b-bbb0-ce338e0892f2 tempest-CreateVolumesFromSnapshotTest-917122263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9bd989a-5b02-4e72-ac86-ba986789802c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:18:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-841465643',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b3a42c4-f9a8-4998-bffc-42c3d89729d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a3407d067744ab1a54f28d3320f9639',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:18:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:18:39Z,use_quota=True,user_id='ecc1196b6626463b885713d7b2091688',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3a092cd-7947-4cbf-abff-4ba9567becf0),volume_type_id=f3a092cd-7947-4cbf-abff-4ba9567becf0)' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:18:38 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-26d42142-7a8b-446b-bbb0-ce338e0892f2 tempest-CreateVolumesFromSnapshotTest-917122263 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28c67e76-3e57-404e-b6a5-a4905dbfdac8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:18:38 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-26d42142-7a8b-446b-bbb0-ce338e0892f2 tempest-CreateVolumesFromSnapshotTest-917122263 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28c67e76-3e57-404e-b6a5-a4905dbfdac8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:18:38 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-26d42142-7a8b-446b-bbb0-ce338e0892f2 tempest-CreateVolumesFromSnapshotTest-917122263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ec73fce-df72-4cc4-962b-54dc0723ac49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:18:38 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-26d42142-7a8b-446b-bbb0-ce338e0892f2 tempest-CreateVolumesFromSnapshotTest-917122263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ec73fce-df72-4cc4-962b-54dc0723ac49) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3b3a42c4-f9a8-4998-bffc-42c3d89729d2', 'volume_name': 'volume-3b3a42c4-f9a8-4998-bffc-42c3d89729d2', 'volume_size': 1}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:18:38 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-26d42142-7a8b-446b-bbb0-ce338e0892f2 tempest-CreateVolumesFromSnapshotTest-917122263 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f1cec6f-9284-48e7-a98a-ac44ad7b67cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:18:38 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-26d42142-7a8b-446b-bbb0-ce338e0892f2 tempest-CreateVolumesFromSnapshotTest-917122263 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f1cec6f-9284-48e7-a98a-ac44ad7b67cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:18:38 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-26d42142-7a8b-446b-bbb0-ce338e0892f2 tempest-CreateVolumesFromSnapshotTest-917122263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9673fac5-c619-416c-9315-7ed9802bef78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:18:38 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-26d42142-7a8b-446b-bbb0-ce338e0892f2 tempest-CreateVolumesFromSnapshotTest-917122263 None] Volume 3b3a42c4-f9a8-4998-bffc-42c3d89729d2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3b3a42c4-f9a8-4998-bffc-42c3d89729d2', 'volume_size': 1} Sep 07 10:18:38 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-26d42142-7a8b-446b-bbb0-ce338e0892f2 tempest-CreateVolumesFromSnapshotTest-917122263 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:18:38 devstack sudo[107220]: pam_unix(sudo:session): session closed for user root Sep 07 10:18:38 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-1eb59dbe-92cb-463c-a546-287f58197aba tempest-CreateVolumesFromSnapshotTest-917122263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-b71d39f4-3a6d-4915-a5d1-193c702d503e 1073741824" returned: 0 in 0.858s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:18:38 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-1eb59dbe-92cb-463c-a546-287f58197aba tempest-CreateVolumesFromSnapshotTest-917122263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-b71d39f4-3a6d-4915-a5d1-193c702d503e {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:18:38 devstack sudo[107226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-b71d39f4-3a6d-4915-a5d1-193c702d503e Sep 07 10:18:38 devstack sudo[107226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:18:38 devstack cinder-volume[87515]: DEBUG cinder.volume.flows.manager.create_volume [None req-a04a2815-131d-455a-937b-bd21414e3d7c tempest-CreateVolumesFromSnapshotTest-917122263 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 10:18:38 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-a04a2815-131d-455a-937b-bd21414e3d7c tempest-CreateVolumesFromSnapshotTest-917122263 None] Flow 'volume_create_manager' (fc3d034a-057b-4aeb-ab0c-9a065b7c0c15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:18:38 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-a04a2815-131d-455a-937b-bd21414e3d7c tempest-CreateVolumesFromSnapshotTest-917122263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a436bc7-e202-40e3-9735-eb6b6f4e8add) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:18:39 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-a04a2815-131d-455a-937b-bd21414e3d7c tempest-CreateVolumesFromSnapshotTest-917122263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a436bc7-e202-40e3-9735-eb6b6f4e8add) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:18:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-109024511',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52333871-13b4-4c1f-aab3-1eaa383b940a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a3407d067744ab1a54f28d3320f9639',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:18:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:18:39Z,use_quota=True,user_id='ecc1196b6626463b885713d7b2091688',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3a092cd-7947-4cbf-abff-4ba9567becf0),volume_type_id=f3a092cd-7947-4cbf-abff-4ba9567becf0)' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:18:39 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-a04a2815-131d-455a-937b-bd21414e3d7c tempest-CreateVolumesFromSnapshotTest-917122263 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa8d7926-1660-4166-a0ca-5372e1e3b4f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:18:39 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-a04a2815-131d-455a-937b-bd21414e3d7c tempest-CreateVolumesFromSnapshotTest-917122263 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa8d7926-1660-4166-a0ca-5372e1e3b4f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:18:39 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-a04a2815-131d-455a-937b-bd21414e3d7c tempest-CreateVolumesFromSnapshotTest-917122263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (036d59af-d53f-4eb7-ac34-897a85b541ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:18:39 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-a04a2815-131d-455a-937b-bd21414e3d7c tempest-CreateVolumesFromSnapshotTest-917122263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (036d59af-d53f-4eb7-ac34-897a85b541ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '52333871-13b4-4c1f-aab3-1eaa383b940a', 'volume_name': 'volume-52333871-13b4-4c1f-aab3-1eaa383b940a', 'volume_size': 1}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:18:39 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-a04a2815-131d-455a-937b-bd21414e3d7c tempest-CreateVolumesFromSnapshotTest-917122263 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f60fa7ac-3fb3-440e-bcd6-bf281a528fce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:18:39 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-a04a2815-131d-455a-937b-bd21414e3d7c tempest-CreateVolumesFromSnapshotTest-917122263 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f60fa7ac-3fb3-440e-bcd6-bf281a528fce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:18:39 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-a04a2815-131d-455a-937b-bd21414e3d7c tempest-CreateVolumesFromSnapshotTest-917122263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a259aefb-29d1-4ea0-8179-e7b9da8a8115) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:18:39 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-a04a2815-131d-455a-937b-bd21414e3d7c tempest-CreateVolumesFromSnapshotTest-917122263 None] Volume 52333871-13b4-4c1f-aab3-1eaa383b940a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-52333871-13b4-4c1f-aab3-1eaa383b940a', 'volume_size': 1} Sep 07 10:18:39 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-a04a2815-131d-455a-937b-bd21414e3d7c tempest-CreateVolumesFromSnapshotTest-917122263 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:18:39 devstack sudo[107226]: pam_unix(sudo:session): session closed for user root Sep 07 10:18:39 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-1eb59dbe-92cb-463c-a546-287f58197aba tempest-CreateVolumesFromSnapshotTest-917122263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-b71d39f4-3a6d-4915-a5d1-193c702d503e" returned: 0 in 0.316s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:18:39 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-1eb59dbe-92cb-463c-a546-287f58197aba tempest-CreateVolumesFromSnapshotTest-917122263 None] <== create_volume: return (1237ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'} {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 10:18:39 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-1eb59dbe-92cb-463c-a546-287f58197aba tempest-CreateVolumesFromSnapshotTest-917122263 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.242s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:18:39 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-3cf88dec-2ab5-48a6-a35f-64b72a7c6588 tempest-CreateVolumesFromSnapshotTest-917122263 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.845s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:18:39 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-3cf88dec-2ab5-48a6-a35f-64b72a7c6588 tempest-CreateVolumesFromSnapshotTest-917122263 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:18:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-819654560',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21c79fa5-e6e1-4994-ba50-e47731dcae25,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a3407d067744ab1a54f28d3320f9639',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:18:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:18:38Z,use_quota=True,user_id='ecc1196b6626463b885713d7b2091688',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3a092cd-7947-4cbf-abff-4ba9567becf0),volume_type_id=f3a092cd-7947-4cbf-abff-4ba9567becf0)}" {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 10:18:39 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-3cf88dec-2ab5-48a6-a35f-64b72a7c6588 tempest-CreateVolumesFromSnapshotTest-917122263 None] Creating volume 21c79fa5-e6e1-4994-ba50-e47731dcae25 {{(pid=87515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 10:18:39 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-3cf88dec-2ab5-48a6-a35f-64b72a7c6588 tempest-CreateVolumesFromSnapshotTest-917122263 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:18:39 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-3cf88dec-2ab5-48a6-a35f-64b72a7c6588 tempest-CreateVolumesFromSnapshotTest-917122263 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:18:39 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-3cf88dec-2ab5-48a6-a35f-64b72a7c6588 tempest-CreateVolumesFromSnapshotTest-917122263 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:18:39 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-3cf88dec-2ab5-48a6-a35f-64b72a7c6588 tempest-CreateVolumesFromSnapshotTest-917122263 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:18:39 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-3cf88dec-2ab5-48a6-a35f-64b72a7c6588 tempest-CreateVolumesFromSnapshotTest-917122263 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:18:39 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-3cf88dec-2ab5-48a6-a35f-64b72a7c6588 tempest-CreateVolumesFromSnapshotTest-917122263 None] Selected osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c as target Quobyte volume. {{(pid=87515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 10:18:39 devstack cinder-volume[87515]: INFO cinder.volume.drivers.remotefs [None req-3cf88dec-2ab5-48a6-a35f-64b72a7c6588 tempest-CreateVolumesFromSnapshotTest-917122263 None] casted to osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c Sep 07 10:18:39 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-3cf88dec-2ab5-48a6-a35f-64b72a7c6588 tempest-CreateVolumesFromSnapshotTest-917122263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-21c79fa5-e6e1-4994-ba50-e47731dcae25 1073741824 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:18:39 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-1eb59dbe-92cb-463c-a546-287f58197aba tempest-CreateVolumesFromSnapshotTest-917122263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e882277b-a721-44e4-933d-7fea4851c004) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b71d39f4-3a6d-4915-a5d1-193c702d503e', 'volume_size': 1}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:18:39 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-1eb59dbe-92cb-463c-a546-287f58197aba tempest-CreateVolumesFromSnapshotTest-917122263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f347ff5a-f87e-482e-a765-ae6212fdd129) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:18:39 devstack sudo[107229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-21c79fa5-e6e1-4994-ba50-e47731dcae25 1073741824 Sep 07 10:18:39 devstack sudo[107229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:18:39 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-1eb59dbe-92cb-463c-a546-287f58197aba tempest-CreateVolumesFromSnapshotTest-917122263 None] Volume volume-b71d39f4-3a6d-4915-a5d1-193c702d503e (b71d39f4-3a6d-4915-a5d1-193c702d503e): created successfully Sep 07 10:18:39 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-1eb59dbe-92cb-463c-a546-287f58197aba tempest-CreateVolumesFromSnapshotTest-917122263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f347ff5a-f87e-482e-a765-ae6212fdd129) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:18:39 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-1eb59dbe-92cb-463c-a546-287f58197aba tempest-CreateVolumesFromSnapshotTest-917122263 None] Flow 'volume_create_manager' (be2ef698-e6e0-43b6-8aa0-627f5cdc7fab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:18:39 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-1eb59dbe-92cb-463c-a546-287f58197aba tempest-CreateVolumesFromSnapshotTest-917122263 None] Created volume successfully. Sep 07 10:18:39 devstack sudo[107229]: pam_unix(sudo:session): session closed for user root Sep 07 10:18:39 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-3cf88dec-2ab5-48a6-a35f-64b72a7c6588 tempest-CreateVolumesFromSnapshotTest-917122263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-21c79fa5-e6e1-4994-ba50-e47731dcae25 1073741824" returned: 0 in 0.686s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:18:39 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-3cf88dec-2ab5-48a6-a35f-64b72a7c6588 tempest-CreateVolumesFromSnapshotTest-917122263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-21c79fa5-e6e1-4994-ba50-e47731dcae25 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:18:39 devstack sudo[107238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-21c79fa5-e6e1-4994-ba50-e47731dcae25 Sep 07 10:18:39 devstack sudo[107238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:18:40 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-6cdc028a-f83c-4665-8421-26cad14cdd19 tempest-ProjectAdminTests-1909920057 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.5995826721191, 'free_capacity_gb': 1773.5995826721191, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87515) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 07 10:18:40 devstack sudo[107238]: pam_unix(sudo:session): session closed for user root Sep 07 10:18:40 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-3cf88dec-2ab5-48a6-a35f-64b72a7c6588 tempest-CreateVolumesFromSnapshotTest-917122263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-21c79fa5-e6e1-4994-ba50-e47731dcae25" returned: 0 in 0.369s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:18:40 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-3cf88dec-2ab5-48a6-a35f-64b72a7c6588 tempest-CreateVolumesFromSnapshotTest-917122263 None] <== create_volume: return (1167ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'} {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 10:18:40 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-3cf88dec-2ab5-48a6-a35f-64b72a7c6588 tempest-CreateVolumesFromSnapshotTest-917122263 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.170s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:18:40 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-26d42142-7a8b-446b-bbb0-ce338e0892f2 tempest-CreateVolumesFromSnapshotTest-917122263 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.576s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:18:40 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-26d42142-7a8b-446b-bbb0-ce338e0892f2 tempest-CreateVolumesFromSnapshotTest-917122263 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:18:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-841465643',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b3a42c4-f9a8-4998-bffc-42c3d89729d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a3407d067744ab1a54f28d3320f9639',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:18:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:18:39Z,use_quota=True,user_id='ecc1196b6626463b885713d7b2091688',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3a092cd-7947-4cbf-abff-4ba9567becf0),volume_type_id=f3a092cd-7947-4cbf-abff-4ba9567becf0)}" {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 10:18:40 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-26d42142-7a8b-446b-bbb0-ce338e0892f2 tempest-CreateVolumesFromSnapshotTest-917122263 None] Creating volume 3b3a42c4-f9a8-4998-bffc-42c3d89729d2 {{(pid=87515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 10:18:40 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-26d42142-7a8b-446b-bbb0-ce338e0892f2 tempest-CreateVolumesFromSnapshotTest-917122263 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:18:40 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-26d42142-7a8b-446b-bbb0-ce338e0892f2 tempest-CreateVolumesFromSnapshotTest-917122263 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:18:40 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-26d42142-7a8b-446b-bbb0-ce338e0892f2 tempest-CreateVolumesFromSnapshotTest-917122263 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:18:40 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-26d42142-7a8b-446b-bbb0-ce338e0892f2 tempest-CreateVolumesFromSnapshotTest-917122263 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:18:40 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-26d42142-7a8b-446b-bbb0-ce338e0892f2 tempest-CreateVolumesFromSnapshotTest-917122263 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:18:40 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-26d42142-7a8b-446b-bbb0-ce338e0892f2 tempest-CreateVolumesFromSnapshotTest-917122263 None] Selected osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c as target Quobyte volume. {{(pid=87515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 10:18:40 devstack cinder-volume[87515]: INFO cinder.volume.drivers.remotefs [None req-26d42142-7a8b-446b-bbb0-ce338e0892f2 tempest-CreateVolumesFromSnapshotTest-917122263 None] casted to osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c Sep 07 10:18:40 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-26d42142-7a8b-446b-bbb0-ce338e0892f2 tempest-CreateVolumesFromSnapshotTest-917122263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-3b3a42c4-f9a8-4998-bffc-42c3d89729d2 1073741824 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:18:40 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-3cf88dec-2ab5-48a6-a35f-64b72a7c6588 tempest-CreateVolumesFromSnapshotTest-917122263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (074f0aa3-e0ac-4da8-96ed-a9ecdbab64cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-21c79fa5-e6e1-4994-ba50-e47731dcae25', 'volume_size': 1}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:18:40 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-3cf88dec-2ab5-48a6-a35f-64b72a7c6588 tempest-CreateVolumesFromSnapshotTest-917122263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (958e7aab-0f6f-4a8e-a02b-e37027790827) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:18:40 devstack sudo[107241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-3b3a42c4-f9a8-4998-bffc-42c3d89729d2 1073741824 Sep 07 10:18:40 devstack sudo[107241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:18:40 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-3cf88dec-2ab5-48a6-a35f-64b72a7c6588 tempest-CreateVolumesFromSnapshotTest-917122263 None] Volume volume-21c79fa5-e6e1-4994-ba50-e47731dcae25 (21c79fa5-e6e1-4994-ba50-e47731dcae25): created successfully Sep 07 10:18:40 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-3cf88dec-2ab5-48a6-a35f-64b72a7c6588 tempest-CreateVolumesFromSnapshotTest-917122263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (958e7aab-0f6f-4a8e-a02b-e37027790827) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:18:40 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-3cf88dec-2ab5-48a6-a35f-64b72a7c6588 tempest-CreateVolumesFromSnapshotTest-917122263 None] Flow 'volume_create_manager' (c0cae6eb-1f97-42bd-9ccc-32a8fea4a805) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:18:40 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-3cf88dec-2ab5-48a6-a35f-64b72a7c6588 tempest-CreateVolumesFromSnapshotTest-917122263 None] Created volume successfully. Sep 07 10:18:41 devstack sudo[107241]: pam_unix(sudo:session): session closed for user root Sep 07 10:18:41 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-26d42142-7a8b-446b-bbb0-ce338e0892f2 tempest-CreateVolumesFromSnapshotTest-917122263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-3b3a42c4-f9a8-4998-bffc-42c3d89729d2 1073741824" returned: 0 in 0.652s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:18:41 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-26d42142-7a8b-446b-bbb0-ce338e0892f2 tempest-CreateVolumesFromSnapshotTest-917122263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-3b3a42c4-f9a8-4998-bffc-42c3d89729d2 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:18:41 devstack sudo[107247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-3b3a42c4-f9a8-4998-bffc-42c3d89729d2 Sep 07 10:18:41 devstack sudo[107247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:18:41 devstack cinder-volume[87515]: DEBUG cinder.volume.flows.manager.create_volume [None req-f2de81c2-6a5a-4927-b13b-be28d1a2735e tempest-VolumeImageDependencyTests-742914938 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 10:18:41 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-f2de81c2-6a5a-4927-b13b-be28d1a2735e tempest-VolumeImageDependencyTests-742914938 None] Flow 'volume_create_manager' (056fa34c-ab86-468e-ab84-af175c1c489d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:18:41 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-f2de81c2-6a5a-4927-b13b-be28d1a2735e tempest-VolumeImageDependencyTests-742914938 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (138ee015-9d97-4198-81c6-3f3deb25efde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:18:41 devstack sudo[107247]: pam_unix(sudo:session): session closed for user root Sep 07 10:18:41 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-f2de81c2-6a5a-4927-b13b-be28d1a2735e tempest-VolumeImageDependencyTests-742914938 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (138ee015-9d97-4198-81c6-3f3deb25efde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:18:41Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2af6d14-db13-4dc0-8377-88f8be8e48c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d9417ed4529446eb1736ab78cc1a564',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:18:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:18:41Z,use_quota=True,user_id='42b0a0ba7600440e9812f38f55ea0709',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3a092cd-7947-4cbf-abff-4ba9567becf0),volume_type_id=f3a092cd-7947-4cbf-abff-4ba9567becf0)' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:18:41 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-f2de81c2-6a5a-4927-b13b-be28d1a2735e tempest-VolumeImageDependencyTests-742914938 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88115f27-8a03-4a73-9d52-a3731d74e4bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:18:41 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-f2de81c2-6a5a-4927-b13b-be28d1a2735e tempest-VolumeImageDependencyTests-742914938 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88115f27-8a03-4a73-9d52-a3731d74e4bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:18:41 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-f2de81c2-6a5a-4927-b13b-be28d1a2735e tempest-VolumeImageDependencyTests-742914938 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56c36ce9-6c9b-4bf7-bd8f-78005293ce6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:18:41 devstack cinder-volume[87515]: DEBUG cinder.image.glance [None req-f2de81c2-6a5a-4927-b13b-be28d1a2735e tempest-VolumeImageDependencyTests-742914938 None] Creating Keystone auth plugin from conf {{(pid=87515) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 07 10:18:41 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-26d42142-7a8b-446b-bbb0-ce338e0892f2 tempest-CreateVolumesFromSnapshotTest-917122263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-3b3a42c4-f9a8-4998-bffc-42c3d89729d2" returned: 0 in 0.374s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:18:41 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-26d42142-7a8b-446b-bbb0-ce338e0892f2 tempest-CreateVolumesFromSnapshotTest-917122263 None] <== create_volume: return (1092ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'} {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 10:18:41 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-26d42142-7a8b-446b-bbb0-ce338e0892f2 tempest-CreateVolumesFromSnapshotTest-917122263 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.097s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:18:41 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-a04a2815-131d-455a-937b-bd21414e3d7c tempest-CreateVolumesFromSnapshotTest-917122263 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.374s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:18:41 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-a04a2815-131d-455a-937b-bd21414e3d7c tempest-CreateVolumesFromSnapshotTest-917122263 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:18:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-109024511',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52333871-13b4-4c1f-aab3-1eaa383b940a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a3407d067744ab1a54f28d3320f9639',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:18:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:18:39Z,use_quota=True,user_id='ecc1196b6626463b885713d7b2091688',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3a092cd-7947-4cbf-abff-4ba9567becf0),volume_type_id=f3a092cd-7947-4cbf-abff-4ba9567becf0)}" {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 10:18:41 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-a04a2815-131d-455a-937b-bd21414e3d7c tempest-CreateVolumesFromSnapshotTest-917122263 None] Creating volume 52333871-13b4-4c1f-aab3-1eaa383b940a {{(pid=87515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 10:18:41 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-a04a2815-131d-455a-937b-bd21414e3d7c tempest-CreateVolumesFromSnapshotTest-917122263 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:18:41 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-a04a2815-131d-455a-937b-bd21414e3d7c tempest-CreateVolumesFromSnapshotTest-917122263 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:18:41 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-a04a2815-131d-455a-937b-bd21414e3d7c tempest-CreateVolumesFromSnapshotTest-917122263 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:18:41 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-a04a2815-131d-455a-937b-bd21414e3d7c tempest-CreateVolumesFromSnapshotTest-917122263 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:18:41 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-a04a2815-131d-455a-937b-bd21414e3d7c tempest-CreateVolumesFromSnapshotTest-917122263 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:18:41 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-a04a2815-131d-455a-937b-bd21414e3d7c tempest-CreateVolumesFromSnapshotTest-917122263 None] Selected osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c as target Quobyte volume. {{(pid=87515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 10:18:41 devstack cinder-volume[87515]: INFO cinder.volume.drivers.remotefs [None req-a04a2815-131d-455a-937b-bd21414e3d7c tempest-CreateVolumesFromSnapshotTest-917122263 None] casted to osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c Sep 07 10:18:41 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-a04a2815-131d-455a-937b-bd21414e3d7c tempest-CreateVolumesFromSnapshotTest-917122263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-52333871-13b4-4c1f-aab3-1eaa383b940a 1073741824 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:18:41 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-26d42142-7a8b-446b-bbb0-ce338e0892f2 tempest-CreateVolumesFromSnapshotTest-917122263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9673fac5-c619-416c-9315-7ed9802bef78) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3b3a42c4-f9a8-4998-bffc-42c3d89729d2', 'volume_size': 1}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:18:41 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-26d42142-7a8b-446b-bbb0-ce338e0892f2 tempest-CreateVolumesFromSnapshotTest-917122263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a21ef728-279a-47d7-9f94-b4ff2fd58652) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:18:41 devstack sudo[107250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-52333871-13b4-4c1f-aab3-1eaa383b940a 1073741824 Sep 07 10:18:41 devstack sudo[107250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:18:41 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-26d42142-7a8b-446b-bbb0-ce338e0892f2 tempest-CreateVolumesFromSnapshotTest-917122263 None] Volume volume-3b3a42c4-f9a8-4998-bffc-42c3d89729d2 (3b3a42c4-f9a8-4998-bffc-42c3d89729d2): created successfully Sep 07 10:18:41 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-26d42142-7a8b-446b-bbb0-ce338e0892f2 tempest-CreateVolumesFromSnapshotTest-917122263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a21ef728-279a-47d7-9f94-b4ff2fd58652) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:18:41 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-26d42142-7a8b-446b-bbb0-ce338e0892f2 tempest-CreateVolumesFromSnapshotTest-917122263 None] Flow 'volume_create_manager' (3dbe6251-7921-4c8f-9a7c-272bd53afd83) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:18:41 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-26d42142-7a8b-446b-bbb0-ce338e0892f2 tempest-CreateVolumesFromSnapshotTest-917122263 None] Created volume successfully. Sep 07 10:18:41 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-f2de81c2-6a5a-4927-b13b-be28d1a2735e tempest-VolumeImageDependencyTests-742914938 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56c36ce9-6c9b-4bf7-bd8f-78005293ce6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'b2af6d14-db13-4dc0-8377-88f8be8e48c6', 'volume_name': 'volume-b2af6d14-db13-4dc0-8377-88f8be8e48c6', 'volume_size': 1, 'image_id': '05f61a3d-3aff-4907-97d3-b4f837ca6974', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/05f61a3d-3aff-4907-97d3-b4f837ca6974', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '12531986d33c327bcc34721329543f45', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '1d9417ed4529446eb1736ab78cc1a564', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'd3c2b2a4482964fecf0417c47c32b6384b966708580483da0c87067dc1f599492c8c8c5f32fd005996087ec3809b57005a878e910380fe8b5afa379251c3b0a0', 'id': '05f61a3d-3aff-4907-97d3-b4f837ca6974', 'created_at': datetime.datetime(2026, 9, 7, 8, 18, 38, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 7, 8, 18, 40, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/05f61a3d-3aff-4907-97d3-b4f837ca6974/file', 'properties': {}}, 'image_service': }' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:18:41 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-f2de81c2-6a5a-4927-b13b-be28d1a2735e tempest-VolumeImageDependencyTests-742914938 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f8fc4e3-64e6-4871-aef8-7e2fcc573c16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:18:41 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-f2de81c2-6a5a-4927-b13b-be28d1a2735e tempest-VolumeImageDependencyTests-742914938 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f8fc4e3-64e6-4871-aef8-7e2fcc573c16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:18:41 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-f2de81c2-6a5a-4927-b13b-be28d1a2735e tempest-VolumeImageDependencyTests-742914938 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4515afb7-2c44-4c1d-8103-7dfb4f54f2b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:18:41 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-f2de81c2-6a5a-4927-b13b-be28d1a2735e tempest-VolumeImageDependencyTests-742914938 None] Volume b2af6d14-db13-4dc0-8377-88f8be8e48c6: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-b2af6d14-db13-4dc0-8377-88f8be8e48c6', 'volume_size': 1, 'image_id': '05f61a3d-3aff-4907-97d3-b4f837ca6974', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/05f61a3d-3aff-4907-97d3-b4f837ca6974', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '12531986d33c327bcc34721329543f45', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '1d9417ed4529446eb1736ab78cc1a564', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'd3c2b2a4482964fecf0417c47c32b6384b966708580483da0c87067dc1f599492c8c8c5f32fd005996087ec3809b57005a878e910380fe8b5afa379251c3b0a0', 'id': '05f61a3d-3aff-4907-97d3-b4f837ca6974', 'created_at': datetime.datetime(2026, 9, 7, 8, 18, 38, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 7, 8, 18, 40, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/05f61a3d-3aff-4907-97d3-b4f837ca6974/file', 'properties': {}}, 'image_service': } Sep 07 10:18:41 devstack cinder-volume[87515]: DEBUG cinder.volume.flows.manager.create_volume [None req-f2de81c2-6a5a-4927-b13b-be28d1a2735e tempest-VolumeImageDependencyTests-742914938 None] Trying to clone b2af6d14-db13-4dc0-8377-88f8be8e48c6 from image 05f61a3d-3aff-4907-97d3-b4f837ca6974 at location (None, [{'url': 'file:///opt/stack/data/glance/images/05f61a3d-3aff-4907-97d3-b4f837ca6974', 'metadata': {}}]). {{(pid=87515) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 07 10:18:42 devstack sudo[107250]: pam_unix(sudo:session): session closed for user root Sep 07 10:18:42 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-a04a2815-131d-455a-937b-bd21414e3d7c tempest-CreateVolumesFromSnapshotTest-917122263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-52333871-13b4-4c1f-aab3-1eaa383b940a 1073741824" returned: 0 in 0.642s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:18:42 devstack cinder-volume[87515]: DEBUG cinder.image.image_utils [None req-f2de81c2-6a5a-4927-b13b-be28d1a2735e tempest-VolumeImageDependencyTests-742914938 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_05f61a3d-3aff-4907-97d3-b4f837ca6974_cuaaoobgdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87515) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 07 10:18:42 devstack cinder-volume[87515]: INFO cinder.image.image_utils [None req-f2de81c2-6a5a-4927-b13b-be28d1a2735e tempest-VolumeImageDependencyTests-742914938 None] Image download 0.00 MB at 0.00 MB/s Sep 07 10:18:42 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-a04a2815-131d-455a-937b-bd21414e3d7c tempest-CreateVolumesFromSnapshotTest-917122263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-52333871-13b4-4c1f-aab3-1eaa383b940a {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:18:42 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[65878ae6-2753-4385-b51d-29a580d91ded]: (4, 'raw') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:18:42 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-f2de81c2-6a5a-4927-b13b-be28d1a2735e tempest-VolumeImageDependencyTests-742914938 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_05f61a3d-3aff-4907-97d3-b4f837ca6974_cuaaoobgdevstack@QuobyteHD {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:18:42 devstack sudo[107255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-52333871-13b4-4c1f-aab3-1eaa383b940a Sep 07 10:18:42 devstack sudo[107255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:18:42 devstack sudo[107256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_05f61a3d-3aff-4907-97d3-b4f837ca6974_cuaaoobgdevstack@QuobyteHD Sep 07 10:18:42 devstack sudo[107256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:18:42 devstack sudo[107256]: pam_unix(sudo:session): session closed for user root Sep 07 10:18:42 devstack sudo[107255]: pam_unix(sudo:session): session closed for user root Sep 07 10:18:42 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-a04a2815-131d-455a-937b-bd21414e3d7c tempest-CreateVolumesFromSnapshotTest-917122263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-52333871-13b4-4c1f-aab3-1eaa383b940a" returned: 0 in 0.452s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:18:42 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-a04a2815-131d-455a-937b-bd21414e3d7c tempest-CreateVolumesFromSnapshotTest-917122263 None] <== create_volume: return (1174ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'} {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 10:18:42 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-a04a2815-131d-455a-937b-bd21414e3d7c tempest-CreateVolumesFromSnapshotTest-917122263 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.177s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:18:42 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-f2de81c2-6a5a-4927-b13b-be28d1a2735e tempest-VolumeImageDependencyTests-742914938 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_05f61a3d-3aff-4907-97d3-b4f837ca6974_cuaaoobgdevstack@QuobyteHD" returned: 0 in 0.434s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:18:42 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-f2de81c2-6a5a-4927-b13b-be28d1a2735e tempest-VolumeImageDependencyTests-742914938 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_05f61a3d-3aff-4907-97d3-b4f837ca6974_cuaaoobgdevstack@QuobyteHD {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:18:42 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-a04a2815-131d-455a-937b-bd21414e3d7c tempest-CreateVolumesFromSnapshotTest-917122263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a259aefb-29d1-4ea0-8179-e7b9da8a8115) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-52333871-13b4-4c1f-aab3-1eaa383b940a', 'volume_size': 1}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:18:42 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-a04a2815-131d-455a-937b-bd21414e3d7c tempest-CreateVolumesFromSnapshotTest-917122263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a0046d6-732c-43b8-8c26-3981a2e19844) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:18:42 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-a04a2815-131d-455a-937b-bd21414e3d7c tempest-CreateVolumesFromSnapshotTest-917122263 None] Volume volume-52333871-13b4-4c1f-aab3-1eaa383b940a (52333871-13b4-4c1f-aab3-1eaa383b940a): created successfully Sep 07 10:18:42 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-a04a2815-131d-455a-937b-bd21414e3d7c tempest-CreateVolumesFromSnapshotTest-917122263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a0046d6-732c-43b8-8c26-3981a2e19844) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:18:42 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-a04a2815-131d-455a-937b-bd21414e3d7c tempest-CreateVolumesFromSnapshotTest-917122263 None] Flow 'volume_create_manager' (fc3d034a-057b-4aeb-ab0c-9a065b7c0c15) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:18:42 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-a04a2815-131d-455a-937b-bd21414e3d7c tempest-CreateVolumesFromSnapshotTest-917122263 None] Created volume successfully. Sep 07 10:18:42 devstack sudo[107262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_05f61a3d-3aff-4907-97d3-b4f837ca6974_cuaaoobgdevstack@QuobyteHD Sep 07 10:18:42 devstack sudo[107262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:18:43 devstack sudo[107262]: pam_unix(sudo:session): session closed for user root Sep 07 10:18:43 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-f2de81c2-6a5a-4927-b13b-be28d1a2735e tempest-VolumeImageDependencyTests-742914938 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_05f61a3d-3aff-4907-97d3-b4f837ca6974_cuaaoobgdevstack@QuobyteHD" returned: 1 in 0.406s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:18:43 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-f2de81c2-6a5a-4927-b13b-be28d1a2735e tempest-VolumeImageDependencyTests-742914938 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_05f61a3d-3aff-4907-97d3-b4f837ca6974_cuaaoobgdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 07 10:18:43 devstack cinder-volume[87515]: DEBUG cinder.image.image_utils [None req-f2de81c2-6a5a-4927-b13b-be28d1a2735e tempest-VolumeImageDependencyTests-742914938 None] Temporary image 05f61a3d-3aff-4907-97d3-b4f837ca6974 is fetched for user 42b0a0ba7600440e9812f38f55ea0709. {{(pid=87515) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 07 10:18:43 devstack cinder-volume[87515]: DEBUG cinder.volume.flows.manager.create_volume [None req-e8737d48-6be7-4054-a952-2cabdb8d3d3f tempest-CinderUnicodeTest-250046331 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 10:18:43 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-e8737d48-6be7-4054-a952-2cabdb8d3d3f tempest-CinderUnicodeTest-250046331 None] Flow 'volume_create_manager' (b8de36b3-c602-44e0-8eca-26cd6c875a44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:18:43 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-e8737d48-6be7-4054-a952-2cabdb8d3d3f tempest-CinderUnicodeTest-250046331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b26d13c3-cd1d-447c-889a-8396d2ce7aac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:18:43 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-e8737d48-6be7-4054-a952-2cabdb8d3d3f tempest-CinderUnicodeTest-250046331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b26d13c3-cd1d-447c-889a-8396d2ce7aac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:18:43Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da7b9c60-5425-4407-a7e0-e5173e400dd6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='252b5ccc51914b19afd6db105c218b6b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:18:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:18:43Z,use_quota=True,user_id='53b4feb8b1494dc68b49688f9bc9b8d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3a092cd-7947-4cbf-abff-4ba9567becf0),volume_type_id=f3a092cd-7947-4cbf-abff-4ba9567becf0)' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:18:43 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-e8737d48-6be7-4054-a952-2cabdb8d3d3f tempest-CinderUnicodeTest-250046331 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5c17c3d-16a4-4786-bc8a-639f9f2c31e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:18:43 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-e8737d48-6be7-4054-a952-2cabdb8d3d3f tempest-CinderUnicodeTest-250046331 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5c17c3d-16a4-4786-bc8a-639f9f2c31e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:18:43 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-e8737d48-6be7-4054-a952-2cabdb8d3d3f tempest-CinderUnicodeTest-250046331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (869561c1-5719-4964-9931-32b7cc2b4487) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:18:43 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-e8737d48-6be7-4054-a952-2cabdb8d3d3f tempest-CinderUnicodeTest-250046331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (869561c1-5719-4964-9931-32b7cc2b4487) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'da7b9c60-5425-4407-a7e0-e5173e400dd6', 'volume_name': 'volume-da7b9c60-5425-4407-a7e0-e5173e400dd6', 'volume_size': 1}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:18:43 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-e8737d48-6be7-4054-a952-2cabdb8d3d3f tempest-CinderUnicodeTest-250046331 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60aa33c6-a547-47f9-bd94-c2b148538fae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:18:43 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-e8737d48-6be7-4054-a952-2cabdb8d3d3f tempest-CinderUnicodeTest-250046331 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60aa33c6-a547-47f9-bd94-c2b148538fae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:18:43 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-e8737d48-6be7-4054-a952-2cabdb8d3d3f tempest-CinderUnicodeTest-250046331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7951bd9b-2b72-41cd-ba5c-073a06f9314b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:18:43 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-e8737d48-6be7-4054-a952-2cabdb8d3d3f tempest-CinderUnicodeTest-250046331 None] Volume da7b9c60-5425-4407-a7e0-e5173e400dd6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-da7b9c60-5425-4407-a7e0-e5173e400dd6', 'volume_size': 1} Sep 07 10:18:43 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-e8737d48-6be7-4054-a952-2cabdb8d3d3f tempest-CinderUnicodeTest-250046331 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:18:43 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-e8737d48-6be7-4054-a952-2cabdb8d3d3f tempest-CinderUnicodeTest-250046331 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:18:43 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-e8737d48-6be7-4054-a952-2cabdb8d3d3f tempest-CinderUnicodeTest-250046331 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:18:43Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da7b9c60-5425-4407-a7e0-e5173e400dd6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='252b5ccc51914b19afd6db105c218b6b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:18:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:18:43Z,use_quota=True,user_id='53b4feb8b1494dc68b49688f9bc9b8d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3a092cd-7947-4cbf-abff-4ba9567becf0),volume_type_id=f3a092cd-7947-4cbf-abff-4ba9567becf0)}" {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 10:18:43 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-e8737d48-6be7-4054-a952-2cabdb8d3d3f tempest-CinderUnicodeTest-250046331 None] Creating volume da7b9c60-5425-4407-a7e0-e5173e400dd6 {{(pid=87515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 10:18:43 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-e8737d48-6be7-4054-a952-2cabdb8d3d3f tempest-CinderUnicodeTest-250046331 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:18:43 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-e8737d48-6be7-4054-a952-2cabdb8d3d3f tempest-CinderUnicodeTest-250046331 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:18:43 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-e8737d48-6be7-4054-a952-2cabdb8d3d3f tempest-CinderUnicodeTest-250046331 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:18:43 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-e8737d48-6be7-4054-a952-2cabdb8d3d3f tempest-CinderUnicodeTest-250046331 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:18:43 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-e8737d48-6be7-4054-a952-2cabdb8d3d3f tempest-CinderUnicodeTest-250046331 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:18:43 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-e8737d48-6be7-4054-a952-2cabdb8d3d3f tempest-CinderUnicodeTest-250046331 None] Selected osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c as target Quobyte volume. {{(pid=87515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 10:18:43 devstack cinder-volume[87515]: INFO cinder.volume.drivers.remotefs [None req-e8737d48-6be7-4054-a952-2cabdb8d3d3f tempest-CinderUnicodeTest-250046331 None] casted to osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c Sep 07 10:18:43 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-e8737d48-6be7-4054-a952-2cabdb8d3d3f tempest-CinderUnicodeTest-250046331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-da7b9c60-5425-4407-a7e0-e5173e400dd6 1073741824 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:18:43 devstack sudo[107267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-da7b9c60-5425-4407-a7e0-e5173e400dd6 1073741824 Sep 07 10:18:43 devstack sudo[107267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:18:43 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[18a00556-0ad1-4a3c-ac8a-b03892c83274]: (4, 'raw') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:18:43 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-f2de81c2-6a5a-4927-b13b-be28d1a2735e tempest-VolumeImageDependencyTests-742914938 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_05f61a3d-3aff-4907-97d3-b4f837ca6974_cuaaoobgdevstack@QuobyteHD {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:18:43 devstack sudo[107269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_05f61a3d-3aff-4907-97d3-b4f837ca6974_cuaaoobgdevstack@QuobyteHD Sep 07 10:18:43 devstack sudo[107269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:18:43 devstack sudo[107269]: pam_unix(sudo:session): session closed for user root Sep 07 10:18:43 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-f2de81c2-6a5a-4927-b13b-be28d1a2735e tempest-VolumeImageDependencyTests-742914938 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_05f61a3d-3aff-4907-97d3-b4f837ca6974_cuaaoobgdevstack@QuobyteHD" returned: 0 in 0.419s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:18:43 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-f2de81c2-6a5a-4927-b13b-be28d1a2735e tempest-VolumeImageDependencyTests-742914938 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_05f61a3d-3aff-4907-97d3-b4f837ca6974_cuaaoobgdevstack@QuobyteHD {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:18:43 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-f4fd6906-45ab-4861-a2ff-d9aa5200cdd0 tempest-CreateVolumesFromSnapshotTest-917122263 None] Acquiring lock "cinder-52333871-13b4-4c1f-aab3-1eaa383b940a-delete_volume" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:18:43 devstack sudo[107267]: pam_unix(sudo:session): session closed for user root Sep 07 10:18:43 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-e8737d48-6be7-4054-a952-2cabdb8d3d3f tempest-CinderUnicodeTest-250046331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-da7b9c60-5425-4407-a7e0-e5173e400dd6 1073741824" returned: 0 in 0.548s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:18:43 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-f4fd6906-45ab-4861-a2ff-d9aa5200cdd0 tempest-CreateVolumesFromSnapshotTest-917122263 None] Lock "cinder-52333871-13b4-4c1f-aab3-1eaa383b940a-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:18:43 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-f4fd6906-45ab-4861-a2ff-d9aa5200cdd0 tempest-CreateVolumesFromSnapshotTest-917122263 None] Acquiring lock "cinder-quobyte-52333871-13b4-4c1f-aab3-1eaa383b940a" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:18:43 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-e8737d48-6be7-4054-a952-2cabdb8d3d3f tempest-CinderUnicodeTest-250046331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-da7b9c60-5425-4407-a7e0-e5173e400dd6 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:18:43 devstack sudo[107277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_05f61a3d-3aff-4907-97d3-b4f837ca6974_cuaaoobgdevstack@QuobyteHD Sep 07 10:18:43 devstack sudo[107277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:18:43 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-f4fd6906-45ab-4861-a2ff-d9aa5200cdd0 tempest-CreateVolumesFromSnapshotTest-917122263 None] Lock "cinder-quobyte-52333871-13b4-4c1f-aab3-1eaa383b940a" acquired by "delete_volume" :: waited 0.040s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:18:43 devstack sudo[107279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-da7b9c60-5425-4407-a7e0-e5173e400dd6 Sep 07 10:18:43 devstack sudo[107279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:18:43 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[931b4f1f-4566-4e7e-a459-b19f98919b7d]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:18:43 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-f4fd6906-45ab-4861-a2ff-d9aa5200cdd0 tempest-CreateVolumesFromSnapshotTest-917122263 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-52333871-13b4-4c1f-aab3-1eaa383b940a {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:18:44 devstack sudo[107281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-52333871-13b4-4c1f-aab3-1eaa383b940a Sep 07 10:18:44 devstack sudo[107281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:18:44 devstack sudo[107277]: pam_unix(sudo:session): session closed for user root Sep 07 10:18:44 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-f2de81c2-6a5a-4927-b13b-be28d1a2735e tempest-VolumeImageDependencyTests-742914938 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_05f61a3d-3aff-4907-97d3-b4f837ca6974_cuaaoobgdevstack@QuobyteHD" returned: 1 in 0.426s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:18:44 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-f2de81c2-6a5a-4927-b13b-be28d1a2735e tempest-VolumeImageDependencyTests-742914938 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_05f61a3d-3aff-4907-97d3-b4f837ca6974_cuaaoobgdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 07 10:18:44 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-f2de81c2-6a5a-4927-b13b-be28d1a2735e tempest-VolumeImageDependencyTests-742914938 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:18:44 devstack sudo[107279]: pam_unix(sudo:session): session closed for user root Sep 07 10:18:44 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-e8737d48-6be7-4054-a952-2cabdb8d3d3f tempest-CinderUnicodeTest-250046331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-da7b9c60-5425-4407-a7e0-e5173e400dd6" returned: 0 in 0.309s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:18:44 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-e8737d48-6be7-4054-a952-2cabdb8d3d3f tempest-CinderUnicodeTest-250046331 None] <== create_volume: return (938ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'} {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 10:18:44 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-e8737d48-6be7-4054-a952-2cabdb8d3d3f tempest-CinderUnicodeTest-250046331 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.941s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:18:44 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-f2de81c2-6a5a-4927-b13b-be28d1a2735e tempest-VolumeImageDependencyTests-742914938 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.032s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:18:44 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-f2de81c2-6a5a-4927-b13b-be28d1a2735e tempest-VolumeImageDependencyTests-742914938 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:18:41Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2af6d14-db13-4dc0-8377-88f8be8e48c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d9417ed4529446eb1736ab78cc1a564',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:18:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:18:41Z,use_quota=True,user_id='42b0a0ba7600440e9812f38f55ea0709',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3a092cd-7947-4cbf-abff-4ba9567becf0),volume_type_id=f3a092cd-7947-4cbf-abff-4ba9567becf0)}" {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 10:18:44 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-f2de81c2-6a5a-4927-b13b-be28d1a2735e tempest-VolumeImageDependencyTests-742914938 None] Creating volume b2af6d14-db13-4dc0-8377-88f8be8e48c6 {{(pid=87515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 10:18:44 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-f2de81c2-6a5a-4927-b13b-be28d1a2735e tempest-VolumeImageDependencyTests-742914938 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:18:44 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-f2de81c2-6a5a-4927-b13b-be28d1a2735e tempest-VolumeImageDependencyTests-742914938 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:18:44 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-f2de81c2-6a5a-4927-b13b-be28d1a2735e tempest-VolumeImageDependencyTests-742914938 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:18:44 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-f2de81c2-6a5a-4927-b13b-be28d1a2735e tempest-VolumeImageDependencyTests-742914938 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:18:44 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-f2de81c2-6a5a-4927-b13b-be28d1a2735e tempest-VolumeImageDependencyTests-742914938 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:18:44 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-f2de81c2-6a5a-4927-b13b-be28d1a2735e tempest-VolumeImageDependencyTests-742914938 None] Selected osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c as target Quobyte volume. {{(pid=87515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 10:18:44 devstack cinder-volume[87515]: INFO cinder.volume.drivers.remotefs [None req-f2de81c2-6a5a-4927-b13b-be28d1a2735e tempest-VolumeImageDependencyTests-742914938 None] casted to osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c Sep 07 10:18:44 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-f2de81c2-6a5a-4927-b13b-be28d1a2735e tempest-VolumeImageDependencyTests-742914938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-b2af6d14-db13-4dc0-8377-88f8be8e48c6 1073741824 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:18:44 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-e8737d48-6be7-4054-a952-2cabdb8d3d3f tempest-CinderUnicodeTest-250046331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7951bd9b-2b72-41cd-ba5c-073a06f9314b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-da7b9c60-5425-4407-a7e0-e5173e400dd6', 'volume_size': 1}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:18:44 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-e8737d48-6be7-4054-a952-2cabdb8d3d3f tempest-CinderUnicodeTest-250046331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (018b6e1f-d690-438e-95c9-32f489631808) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:18:44 devstack sudo[107287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-b2af6d14-db13-4dc0-8377-88f8be8e48c6 1073741824 Sep 07 10:18:44 devstack sudo[107287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:18:44 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-e8737d48-6be7-4054-a952-2cabdb8d3d3f tempest-CinderUnicodeTest-250046331 None] Volume volume-da7b9c60-5425-4407-a7e0-e5173e400dd6 (da7b9c60-5425-4407-a7e0-e5173e400dd6): created successfully Sep 07 10:18:44 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-e8737d48-6be7-4054-a952-2cabdb8d3d3f tempest-CinderUnicodeTest-250046331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (018b6e1f-d690-438e-95c9-32f489631808) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:18:44 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-e8737d48-6be7-4054-a952-2cabdb8d3d3f tempest-CinderUnicodeTest-250046331 None] Flow 'volume_create_manager' (b8de36b3-c602-44e0-8eca-26cd6c875a44) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:18:44 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-e8737d48-6be7-4054-a952-2cabdb8d3d3f tempest-CinderUnicodeTest-250046331 None] Created volume successfully. Sep 07 10:18:44 devstack sudo[107281]: pam_unix(sudo:session): session closed for user root Sep 07 10:18:44 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-f4fd6906-45ab-4861-a2ff-d9aa5200cdd0 tempest-CreateVolumesFromSnapshotTest-917122263 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-52333871-13b4-4c1f-aab3-1eaa383b940a" returned: 0 in 0.459s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:18:44 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-f4fd6906-45ab-4861-a2ff-d9aa5200cdd0 tempest-CreateVolumesFromSnapshotTest-917122263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-52333871-13b4-4c1f-aab3-1eaa383b940a {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:18:44 devstack sudo[107292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-52333871-13b4-4c1f-aab3-1eaa383b940a Sep 07 10:18:44 devstack sudo[107292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:18:44 devstack sudo[107287]: pam_unix(sudo:session): session closed for user root Sep 07 10:18:44 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-f2de81c2-6a5a-4927-b13b-be28d1a2735e tempest-VolumeImageDependencyTests-742914938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-b2af6d14-db13-4dc0-8377-88f8be8e48c6 1073741824" returned: 0 in 0.491s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:18:44 devstack sudo[107292]: pam_unix(sudo:session): session closed for user root Sep 07 10:18:44 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-f4fd6906-45ab-4861-a2ff-d9aa5200cdd0 tempest-CreateVolumesFromSnapshotTest-917122263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-52333871-13b4-4c1f-aab3-1eaa383b940a" returned: 0 in 0.292s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:18:44 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-f4fd6906-45ab-4861-a2ff-d9aa5200cdd0 tempest-CreateVolumesFromSnapshotTest-917122263 None] Lock "cinder-quobyte-52333871-13b4-4c1f-aab3-1eaa383b940a" released by "delete_volume" :: held 0.811s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:18:44 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-f2de81c2-6a5a-4927-b13b-be28d1a2735e tempest-VolumeImageDependencyTests-742914938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-b2af6d14-db13-4dc0-8377-88f8be8e48c6 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:18:44 devstack sudo[107299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-b2af6d14-db13-4dc0-8377-88f8be8e48c6 Sep 07 10:18:44 devstack sudo[107299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:18:44 devstack cinder-volume[87515]: DEBUG cinder.quota [None req-f4fd6906-45ab-4861-a2ff-d9aa5200cdd0 tempest-CreateVolumesFromSnapshotTest-917122263 None] Created reservations ['e0b6dd8b-fd24-41ab-b222-546803f8e078', 'fb7aef4a-24c5-4281-a3fd-7df004bc1dd0', 'e5eb10fb-c786-4346-911f-10584ae13de4', 'b81a81eb-c9e4-421f-8a99-32f2648b4a4c'] {{(pid=87515) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:18:44 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-f4fd6906-45ab-4861-a2ff-d9aa5200cdd0 tempest-CreateVolumesFromSnapshotTest-917122263 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:18:44 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-f4fd6906-45ab-4861-a2ff-d9aa5200cdd0 tempest-CreateVolumesFromSnapshotTest-917122263 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:18:44 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-f4fd6906-45ab-4861-a2ff-d9aa5200cdd0 tempest-CreateVolumesFromSnapshotTest-917122263 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:18:44 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-f4fd6906-45ab-4861-a2ff-d9aa5200cdd0 tempest-CreateVolumesFromSnapshotTest-917122263 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:18:44 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-f4fd6906-45ab-4861-a2ff-d9aa5200cdd0 tempest-CreateVolumesFromSnapshotTest-917122263 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:18:44 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-f4fd6906-45ab-4861-a2ff-d9aa5200cdd0 tempest-CreateVolumesFromSnapshotTest-917122263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:18:44 devstack sudo[107301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a Sep 07 10:18:44 devstack sudo[107301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:18:44 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-5cf273db-f107-4f8e-afd7-f963625cf306 tempest-CreateVolumesFromSnapshotTest-917122263 None] Acquiring lock "cinder-3b3a42c4-f9a8-4998-bffc-42c3d89729d2-delete_volume" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:18:44 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-5cf273db-f107-4f8e-afd7-f963625cf306 tempest-CreateVolumesFromSnapshotTest-917122263 None] Lock "cinder-3b3a42c4-f9a8-4998-bffc-42c3d89729d2-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:18:44 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-5cf273db-f107-4f8e-afd7-f963625cf306 tempest-CreateVolumesFromSnapshotTest-917122263 None] Acquiring lock "cinder-quobyte-3b3a42c4-f9a8-4998-bffc-42c3d89729d2" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:18:45 devstack sudo[107299]: pam_unix(sudo:session): session closed for user root Sep 07 10:18:45 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-5cf273db-f107-4f8e-afd7-f963625cf306 tempest-CreateVolumesFromSnapshotTest-917122263 None] Lock "cinder-quobyte-3b3a42c4-f9a8-4998-bffc-42c3d89729d2" acquired by "delete_volume" :: waited 0.022s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:18:45 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-f2de81c2-6a5a-4927-b13b-be28d1a2735e tempest-VolumeImageDependencyTests-742914938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-b2af6d14-db13-4dc0-8377-88f8be8e48c6" returned: 0 in 0.368s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:18:45 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-f2de81c2-6a5a-4927-b13b-be28d1a2735e tempest-VolumeImageDependencyTests-742914938 None] <== create_volume: return (919ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'} {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 10:18:45 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-f2de81c2-6a5a-4927-b13b-be28d1a2735e tempest-VolumeImageDependencyTests-742914938 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.921s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:18:45 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[57d5888e-4266-4dd8-a6a6-933d81c7ae8b]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:18:45 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-5cf273db-f107-4f8e-afd7-f963625cf306 tempest-CreateVolumesFromSnapshotTest-917122263 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-3b3a42c4-f9a8-4998-bffc-42c3d89729d2 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:18:45 devstack cinder-volume[87515]: DEBUG cinder.volume.volume_utils [None req-f2de81c2-6a5a-4927-b13b-be28d1a2735e tempest-VolumeImageDependencyTests-742914938 None] Attempting download of 05f61a3d-3aff-4907-97d3-b4f837ca6974 ((None, [{'url': 'file:///opt/stack/data/glance/images/05f61a3d-3aff-4907-97d3-b4f837ca6974', 'metadata': {}}])) to volume b2af6d14-db13-4dc0-8377-88f8be8e48c6. {{(pid=87515) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 07 10:18:45 devstack sudo[107301]: pam_unix(sudo:session): session closed for user root Sep 07 10:18:45 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-f4fd6906-45ab-4861-a2ff-d9aa5200cdd0 tempest-CreateVolumesFromSnapshotTest-917122263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a" returned: 0 in 0.371s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:18:45 devstack cinder-volume[87515]: DEBUG cinder.manager [None req-f4fd6906-45ab-4861-a2ff-d9aa5200cdd0 tempest-CreateVolumesFromSnapshotTest-917122263 None] Notifying Schedulers of capabilities ... {{(pid=87515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:18:45 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-f4fd6906-45ab-4861-a2ff-d9aa5200cdd0 tempest-CreateVolumesFromSnapshotTest-917122263 None] Deleted volume successfully. Sep 07 10:18:45 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4305347-3b39-4f46-b221-65d41629b5a0]: (4, 'raw') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:18:45 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-f2de81c2-6a5a-4927-b13b-be28d1a2735e tempest-VolumeImageDependencyTests-742914938 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_05f61a3d-3aff-4907-97d3-b4f837ca6974_5befqcui {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:18:45 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-f4fd6906-45ab-4861-a2ff-d9aa5200cdd0 tempest-CreateVolumesFromSnapshotTest-917122263 None] Lock "cinder-52333871-13b4-4c1f-aab3-1eaa383b940a-delete_volume" released by "delete_volume" :: held 1.485s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:18:45 devstack sudo[107304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-3b3a42c4-f9a8-4998-bffc-42c3d89729d2 Sep 07 10:18:45 devstack sudo[107304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:18:45 devstack sudo[107306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_05f61a3d-3aff-4907-97d3-b4f837ca6974_5befqcui Sep 07 10:18:45 devstack sudo[107306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:18:45 devstack cinder-volume[87515]: DEBUG cinder.volume.flows.manager.create_volume [None req-c0c7d5f8-a071-4c9c-a54b-7f2a3bafcef4 tempest-ProjectMemberTests-55037479 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 10:18:45 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-c0c7d5f8-a071-4c9c-a54b-7f2a3bafcef4 tempest-ProjectMemberTests-55037479 None] Flow 'volume_create_manager' (3894685e-9483-4992-b645-9d9fba0a8912) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:18:45 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-c0c7d5f8-a071-4c9c-a54b-7f2a3bafcef4 tempest-ProjectMemberTests-55037479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d53d168b-249b-4a17-a58e-d976fc56248b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:18:45 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-c0c7d5f8-a071-4c9c-a54b-7f2a3bafcef4 tempest-ProjectMemberTests-55037479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d53d168b-249b-4a17-a58e-d976fc56248b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:18:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1999857789',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b75542fa-1480-4468-9a57-c0e30515b323,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41fa4493d2f045dc87793bd97d931cff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:18:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:18:45Z,use_quota=True,user_id='5136aa4e2a7c4a1da79d4e4478cdcbf6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3a092cd-7947-4cbf-abff-4ba9567becf0),volume_type_id=f3a092cd-7947-4cbf-abff-4ba9567becf0)' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:18:45 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-c0c7d5f8-a071-4c9c-a54b-7f2a3bafcef4 tempest-ProjectMemberTests-55037479 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90863d49-57fb-4209-b714-08d378fa60d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:18:45 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-c0c7d5f8-a071-4c9c-a54b-7f2a3bafcef4 tempest-ProjectMemberTests-55037479 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90863d49-57fb-4209-b714-08d378fa60d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:18:45 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-c0c7d5f8-a071-4c9c-a54b-7f2a3bafcef4 tempest-ProjectMemberTests-55037479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08bbdc6b-a7eb-4dd9-9baa-16ff9446fc3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:18:45 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-c0c7d5f8-a071-4c9c-a54b-7f2a3bafcef4 tempest-ProjectMemberTests-55037479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08bbdc6b-a7eb-4dd9-9baa-16ff9446fc3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b75542fa-1480-4468-9a57-c0e30515b323', 'volume_name': 'volume-b75542fa-1480-4468-9a57-c0e30515b323', 'volume_size': 1}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:18:45 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-c0c7d5f8-a071-4c9c-a54b-7f2a3bafcef4 tempest-ProjectMemberTests-55037479 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7a1e4dc-1d8f-4971-b596-f1f41a3ea43a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:18:45 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-c0c7d5f8-a071-4c9c-a54b-7f2a3bafcef4 tempest-ProjectMemberTests-55037479 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7a1e4dc-1d8f-4971-b596-f1f41a3ea43a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:18:45 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-c0c7d5f8-a071-4c9c-a54b-7f2a3bafcef4 tempest-ProjectMemberTests-55037479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2211fefc-0148-46d5-8c93-0fa87fef837a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:18:45 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-c0c7d5f8-a071-4c9c-a54b-7f2a3bafcef4 tempest-ProjectMemberTests-55037479 None] Volume b75542fa-1480-4468-9a57-c0e30515b323: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b75542fa-1480-4468-9a57-c0e30515b323', 'volume_size': 1} Sep 07 10:18:45 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-c0c7d5f8-a071-4c9c-a54b-7f2a3bafcef4 tempest-ProjectMemberTests-55037479 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:18:45 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-c0c7d5f8-a071-4c9c-a54b-7f2a3bafcef4 tempest-ProjectMemberTests-55037479 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:18:45 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-c0c7d5f8-a071-4c9c-a54b-7f2a3bafcef4 tempest-ProjectMemberTests-55037479 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:18:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1999857789',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b75542fa-1480-4468-9a57-c0e30515b323,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41fa4493d2f045dc87793bd97d931cff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:18:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:18:45Z,use_quota=True,user_id='5136aa4e2a7c4a1da79d4e4478cdcbf6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3a092cd-7947-4cbf-abff-4ba9567becf0),volume_type_id=f3a092cd-7947-4cbf-abff-4ba9567becf0)}" {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 10:18:45 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-c0c7d5f8-a071-4c9c-a54b-7f2a3bafcef4 tempest-ProjectMemberTests-55037479 None] Creating volume b75542fa-1480-4468-9a57-c0e30515b323 {{(pid=87515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 10:18:45 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-c0c7d5f8-a071-4c9c-a54b-7f2a3bafcef4 tempest-ProjectMemberTests-55037479 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:18:45 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-c0c7d5f8-a071-4c9c-a54b-7f2a3bafcef4 tempest-ProjectMemberTests-55037479 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:18:45 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-c0c7d5f8-a071-4c9c-a54b-7f2a3bafcef4 tempest-ProjectMemberTests-55037479 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:18:45 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-c0c7d5f8-a071-4c9c-a54b-7f2a3bafcef4 tempest-ProjectMemberTests-55037479 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:18:45 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-c0c7d5f8-a071-4c9c-a54b-7f2a3bafcef4 tempest-ProjectMemberTests-55037479 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:18:45 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-c0c7d5f8-a071-4c9c-a54b-7f2a3bafcef4 tempest-ProjectMemberTests-55037479 None] Selected osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c as target Quobyte volume. {{(pid=87515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 10:18:45 devstack cinder-volume[87515]: INFO cinder.volume.drivers.remotefs [None req-c0c7d5f8-a071-4c9c-a54b-7f2a3bafcef4 tempest-ProjectMemberTests-55037479 None] casted to osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c Sep 07 10:18:45 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-c0c7d5f8-a071-4c9c-a54b-7f2a3bafcef4 tempest-ProjectMemberTests-55037479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-b75542fa-1480-4468-9a57-c0e30515b323 1073741824 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:18:45 devstack sudo[107311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-b75542fa-1480-4468-9a57-c0e30515b323 1073741824 Sep 07 10:18:45 devstack sudo[107311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:18:45 devstack sudo[107304]: pam_unix(sudo:session): session closed for user root Sep 07 10:18:45 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-5cf273db-f107-4f8e-afd7-f963625cf306 tempest-CreateVolumesFromSnapshotTest-917122263 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-3b3a42c4-f9a8-4998-bffc-42c3d89729d2" returned: 0 in 0.512s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:18:45 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-5cf273db-f107-4f8e-afd7-f963625cf306 tempest-CreateVolumesFromSnapshotTest-917122263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-3b3a42c4-f9a8-4998-bffc-42c3d89729d2 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:18:45 devstack sudo[107306]: pam_unix(sudo:session): session closed for user root Sep 07 10:18:45 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-f2de81c2-6a5a-4927-b13b-be28d1a2735e tempest-VolumeImageDependencyTests-742914938 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_05f61a3d-3aff-4907-97d3-b4f837ca6974_5befqcui" returned: 0 in 0.391s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:18:45 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-f2de81c2-6a5a-4927-b13b-be28d1a2735e tempest-VolumeImageDependencyTests-742914938 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_05f61a3d-3aff-4907-97d3-b4f837ca6974_5befqcui {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:18:45 devstack sudo[107316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-3b3a42c4-f9a8-4998-bffc-42c3d89729d2 Sep 07 10:18:45 devstack sudo[107316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:18:45 devstack sudo[107317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_05f61a3d-3aff-4907-97d3-b4f837ca6974_5befqcui Sep 07 10:18:45 devstack sudo[107317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:18:45 devstack cinder-volume[87515]: DEBUG cinder.volume.flows.manager.create_volume [None req-1721475c-f11b-4931-aedb-c118bc8a4973 tempest-CinderUnicodeTest-250046331 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 10:18:45 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-1721475c-f11b-4931-aedb-c118bc8a4973 tempest-CinderUnicodeTest-250046331 None] Flow 'volume_create_manager' (5aca135a-e8a2-4d4b-9cab-e3f25fd7e405) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:18:45 devstack sudo[107316]: pam_unix(sudo:session): session closed for user root Sep 07 10:18:45 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-1721475c-f11b-4931-aedb-c118bc8a4973 tempest-CinderUnicodeTest-250046331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8ab726f-6a33-4890-a2dd-5ba441fe5a3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:18:45 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-5cf273db-f107-4f8e-afd7-f963625cf306 tempest-CreateVolumesFromSnapshotTest-917122263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-3b3a42c4-f9a8-4998-bffc-42c3d89729d2" returned: 0 in 0.341s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:18:45 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-1721475c-f11b-4931-aedb-c118bc8a4973 tempest-CinderUnicodeTest-250046331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8ab726f-6a33-4890-a2dd-5ba441fe5a3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:18:45Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-28224962',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35ccd940-cf54-4017-9e2a-e041d7d529c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='252b5ccc51914b19afd6db105c218b6b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:18:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:18:46Z,use_quota=True,user_id='53b4feb8b1494dc68b49688f9bc9b8d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3a092cd-7947-4cbf-abff-4ba9567becf0),volume_type_id=f3a092cd-7947-4cbf-abff-4ba9567becf0)' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:18:45 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-1721475c-f11b-4931-aedb-c118bc8a4973 tempest-CinderUnicodeTest-250046331 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b147d963-932a-4d54-875e-3c531037b699) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:18:45 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-1721475c-f11b-4931-aedb-c118bc8a4973 tempest-CinderUnicodeTest-250046331 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b147d963-932a-4d54-875e-3c531037b699) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:18:45 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-1721475c-f11b-4931-aedb-c118bc8a4973 tempest-CinderUnicodeTest-250046331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1fe874f-a769-45c1-bf57-cf7c58545427) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:18:45 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-1721475c-f11b-4931-aedb-c118bc8a4973 tempest-CinderUnicodeTest-250046331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1fe874f-a769-45c1-bf57-cf7c58545427) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '35ccd940-cf54-4017-9e2a-e041d7d529c5', 'volume_name': 'volume-35ccd940-cf54-4017-9e2a-e041d7d529c5', 'volume_size': 1}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:18:45 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-1721475c-f11b-4931-aedb-c118bc8a4973 tempest-CinderUnicodeTest-250046331 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78057bf2-4f3b-4d34-8499-d335a0ca6987) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:18:45 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-1721475c-f11b-4931-aedb-c118bc8a4973 tempest-CinderUnicodeTest-250046331 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78057bf2-4f3b-4d34-8499-d335a0ca6987) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:18:45 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-1721475c-f11b-4931-aedb-c118bc8a4973 tempest-CinderUnicodeTest-250046331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ced5fb8-201e-4c88-942d-35c04e683bbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:18:45 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-1721475c-f11b-4931-aedb-c118bc8a4973 tempest-CinderUnicodeTest-250046331 None] Volume 35ccd940-cf54-4017-9e2a-e041d7d529c5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-35ccd940-cf54-4017-9e2a-e041d7d529c5', 'volume_size': 1} Sep 07 10:18:45 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-1721475c-f11b-4931-aedb-c118bc8a4973 tempest-CinderUnicodeTest-250046331 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:18:45 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-5cf273db-f107-4f8e-afd7-f963625cf306 tempest-CreateVolumesFromSnapshotTest-917122263 None] Lock "cinder-quobyte-3b3a42c4-f9a8-4998-bffc-42c3d89729d2" released by "delete_volume" :: held 0.971s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:18:46 devstack sudo[107311]: pam_unix(sudo:session): session closed for user root Sep 07 10:18:46 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-c0c7d5f8-a071-4c9c-a54b-7f2a3bafcef4 tempest-ProjectMemberTests-55037479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-b75542fa-1480-4468-9a57-c0e30515b323 1073741824" returned: 0 in 0.530s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:18:46 devstack sudo[107317]: pam_unix(sudo:session): session closed for user root Sep 07 10:18:46 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-f2de81c2-6a5a-4927-b13b-be28d1a2735e tempest-VolumeImageDependencyTests-742914938 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_05f61a3d-3aff-4907-97d3-b4f837ca6974_5befqcui" returned: 1 in 0.456s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:18:46 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-f2de81c2-6a5a-4927-b13b-be28d1a2735e tempest-VolumeImageDependencyTests-742914938 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_05f61a3d-3aff-4907-97d3-b4f837ca6974_5befqcui' failed. Not Retrying. {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 07 10:18:46 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-c0c7d5f8-a071-4c9c-a54b-7f2a3bafcef4 tempest-ProjectMemberTests-55037479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-b75542fa-1480-4468-9a57-c0e30515b323 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:18:46 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[cefccb77-94eb-4ecb-89df-3f272d99ecca]: (4, 'raw') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:18:46 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-f2de81c2-6a5a-4927-b13b-be28d1a2735e tempest-VolumeImageDependencyTests-742914938 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_05f61a3d-3aff-4907-97d3-b4f837ca6974_cuaaoobgdevstack@QuobyteHD {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:18:46 devstack cinder-volume[87515]: DEBUG cinder.quota [None req-5cf273db-f107-4f8e-afd7-f963625cf306 tempest-CreateVolumesFromSnapshotTest-917122263 None] Created reservations ['89913491-7c0c-4fc8-a8fd-a7a7bce3f6f8', '47c7a277-52d5-48a3-800e-194360537ab1', '96999be4-cb5c-47c6-aa55-cb8a57ebe204', 'cde36bb9-2903-4110-b12b-53262f3344ac'] {{(pid=87515) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:18:46 devstack sudo[107327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-b75542fa-1480-4468-9a57-c0e30515b323 Sep 07 10:18:46 devstack sudo[107327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:18:46 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-5cf273db-f107-4f8e-afd7-f963625cf306 tempest-CreateVolumesFromSnapshotTest-917122263 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:18:46 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-5cf273db-f107-4f8e-afd7-f963625cf306 tempest-CreateVolumesFromSnapshotTest-917122263 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:18:46 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-5cf273db-f107-4f8e-afd7-f963625cf306 tempest-CreateVolumesFromSnapshotTest-917122263 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:18:46 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-5cf273db-f107-4f8e-afd7-f963625cf306 tempest-CreateVolumesFromSnapshotTest-917122263 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:18:46 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-5cf273db-f107-4f8e-afd7-f963625cf306 tempest-CreateVolumesFromSnapshotTest-917122263 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:18:46 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-5cf273db-f107-4f8e-afd7-f963625cf306 tempest-CreateVolumesFromSnapshotTest-917122263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:18:46 devstack sudo[107330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a Sep 07 10:18:46 devstack sudo[107330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:18:46 devstack sudo[107328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_05f61a3d-3aff-4907-97d3-b4f837ca6974_cuaaoobgdevstack@QuobyteHD Sep 07 10:18:46 devstack sudo[107328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:18:46 devstack sudo[107327]: pam_unix(sudo:session): session closed for user root Sep 07 10:18:46 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-c0c7d5f8-a071-4c9c-a54b-7f2a3bafcef4 tempest-ProjectMemberTests-55037479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-b75542fa-1480-4468-9a57-c0e30515b323" returned: 0 in 0.273s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:18:46 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-c0c7d5f8-a071-4c9c-a54b-7f2a3bafcef4 tempest-ProjectMemberTests-55037479 None] <== create_volume: return (857ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'} {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 10:18:46 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-c0c7d5f8-a071-4c9c-a54b-7f2a3bafcef4 tempest-ProjectMemberTests-55037479 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.864s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:18:46 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-1721475c-f11b-4931-aedb-c118bc8a4973 tempest-CinderUnicodeTest-250046331 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.350s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:18:46 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-1721475c-f11b-4931-aedb-c118bc8a4973 tempest-CinderUnicodeTest-250046331 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:18:45Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-28224962',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35ccd940-cf54-4017-9e2a-e041d7d529c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='252b5ccc51914b19afd6db105c218b6b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:18:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:18:46Z,use_quota=True,user_id='53b4feb8b1494dc68b49688f9bc9b8d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3a092cd-7947-4cbf-abff-4ba9567becf0),volume_type_id=f3a092cd-7947-4cbf-abff-4ba9567becf0)}" {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 10:18:46 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-1721475c-f11b-4931-aedb-c118bc8a4973 tempest-CinderUnicodeTest-250046331 None] Creating volume 35ccd940-cf54-4017-9e2a-e041d7d529c5 {{(pid=87515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 10:18:46 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-1721475c-f11b-4931-aedb-c118bc8a4973 tempest-CinderUnicodeTest-250046331 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:18:46 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-1721475c-f11b-4931-aedb-c118bc8a4973 tempest-CinderUnicodeTest-250046331 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:18:46 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-1721475c-f11b-4931-aedb-c118bc8a4973 tempest-CinderUnicodeTest-250046331 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:18:46 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-1721475c-f11b-4931-aedb-c118bc8a4973 tempest-CinderUnicodeTest-250046331 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:18:46 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-1721475c-f11b-4931-aedb-c118bc8a4973 tempest-CinderUnicodeTest-250046331 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:18:46 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-1721475c-f11b-4931-aedb-c118bc8a4973 tempest-CinderUnicodeTest-250046331 None] Selected osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c as target Quobyte volume. {{(pid=87515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 10:18:46 devstack cinder-volume[87515]: INFO cinder.volume.drivers.remotefs [None req-1721475c-f11b-4931-aedb-c118bc8a4973 tempest-CinderUnicodeTest-250046331 None] casted to osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c Sep 07 10:18:46 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-1721475c-f11b-4931-aedb-c118bc8a4973 tempest-CinderUnicodeTest-250046331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-35ccd940-cf54-4017-9e2a-e041d7d529c5 1073741824 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:18:46 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-c0c7d5f8-a071-4c9c-a54b-7f2a3bafcef4 tempest-ProjectMemberTests-55037479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2211fefc-0148-46d5-8c93-0fa87fef837a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b75542fa-1480-4468-9a57-c0e30515b323', 'volume_size': 1}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:18:46 devstack sudo[107334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-35ccd940-cf54-4017-9e2a-e041d7d529c5 1073741824 Sep 07 10:18:46 devstack sudo[107334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:18:46 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-c0c7d5f8-a071-4c9c-a54b-7f2a3bafcef4 tempest-ProjectMemberTests-55037479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1501ad75-588a-4bb1-a6d5-c588350bd9d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:18:46 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-c0c7d5f8-a071-4c9c-a54b-7f2a3bafcef4 tempest-ProjectMemberTests-55037479 None] Volume volume-b75542fa-1480-4468-9a57-c0e30515b323 (b75542fa-1480-4468-9a57-c0e30515b323): created successfully Sep 07 10:18:46 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-c0c7d5f8-a071-4c9c-a54b-7f2a3bafcef4 tempest-ProjectMemberTests-55037479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1501ad75-588a-4bb1-a6d5-c588350bd9d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:18:46 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-c0c7d5f8-a071-4c9c-a54b-7f2a3bafcef4 tempest-ProjectMemberTests-55037479 None] Flow 'volume_create_manager' (3894685e-9483-4992-b645-9d9fba0a8912) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:18:46 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-c0c7d5f8-a071-4c9c-a54b-7f2a3bafcef4 tempest-ProjectMemberTests-55037479 None] Created volume successfully. Sep 07 10:18:46 devstack sudo[107330]: pam_unix(sudo:session): session closed for user root Sep 07 10:18:46 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-5cf273db-f107-4f8e-afd7-f963625cf306 tempest-CreateVolumesFromSnapshotTest-917122263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a" returned: 0 in 0.276s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:18:46 devstack cinder-volume[87515]: DEBUG cinder.manager [None req-5cf273db-f107-4f8e-afd7-f963625cf306 tempest-CreateVolumesFromSnapshotTest-917122263 None] Notifying Schedulers of capabilities ... {{(pid=87515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:18:46 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-5cf273db-f107-4f8e-afd7-f963625cf306 tempest-CreateVolumesFromSnapshotTest-917122263 None] Deleted volume successfully. Sep 07 10:18:46 devstack sudo[107328]: pam_unix(sudo:session): session closed for user root Sep 07 10:18:46 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-f2de81c2-6a5a-4927-b13b-be28d1a2735e tempest-VolumeImageDependencyTests-742914938 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_05f61a3d-3aff-4907-97d3-b4f837ca6974_cuaaoobgdevstack@QuobyteHD" returned: 0 in 0.385s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:18:46 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-f2de81c2-6a5a-4927-b13b-be28d1a2735e tempest-VolumeImageDependencyTests-742914938 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_05f61a3d-3aff-4907-97d3-b4f837ca6974_cuaaoobgdevstack@QuobyteHD {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:18:46 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-5cf273db-f107-4f8e-afd7-f963625cf306 tempest-CreateVolumesFromSnapshotTest-917122263 None] Lock "cinder-3b3a42c4-f9a8-4998-bffc-42c3d89729d2-delete_volume" released by "delete_volume" :: held 1.539s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:18:46 devstack sudo[107339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_05f61a3d-3aff-4907-97d3-b4f837ca6974_cuaaoobgdevstack@QuobyteHD Sep 07 10:18:46 devstack sudo[107339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:18:46 devstack sudo[107339]: pam_unix(sudo:session): session closed for user root Sep 07 10:18:46 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-f2de81c2-6a5a-4927-b13b-be28d1a2735e tempest-VolumeImageDependencyTests-742914938 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_05f61a3d-3aff-4907-97d3-b4f837ca6974_cuaaoobgdevstack@QuobyteHD" returned: 1 in 0.360s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:18:46 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-f2de81c2-6a5a-4927-b13b-be28d1a2735e tempest-VolumeImageDependencyTests-742914938 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_05f61a3d-3aff-4907-97d3-b4f837ca6974_cuaaoobgdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 07 10:18:46 devstack cinder-volume[87515]: DEBUG cinder.image.image_utils [None req-f2de81c2-6a5a-4927-b13b-be28d1a2735e tempest-VolumeImageDependencyTests-742914938 None] 05f61a3d-3aff-4907-97d3-b4f837ca6974 was raw, converting to qcow2 {{(pid=87515) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 07 10:18:46 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-f2de81c2-6a5a-4927-b13b-be28d1a2735e tempest-VolumeImageDependencyTests-742914938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_05f61a3d-3aff-4907-97d3-b4f837ca6974_cuaaoobgdevstack@QuobyteHD /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-b2af6d14-db13-4dc0-8377-88f8be8e48c6 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:18:46 devstack sudo[107334]: pam_unix(sudo:session): session closed for user root Sep 07 10:18:46 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-1721475c-f11b-4931-aedb-c118bc8a4973 tempest-CinderUnicodeTest-250046331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-35ccd940-cf54-4017-9e2a-e041d7d529c5 1073741824" returned: 0 in 0.487s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:18:46 devstack sudo[107347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_05f61a3d-3aff-4907-97d3-b4f837ca6974_cuaaoobgdevstack@QuobyteHD /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-b2af6d14-db13-4dc0-8377-88f8be8e48c6 Sep 07 10:18:46 devstack sudo[107347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:18:46 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-1721475c-f11b-4931-aedb-c118bc8a4973 tempest-CinderUnicodeTest-250046331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-35ccd940-cf54-4017-9e2a-e041d7d529c5 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:18:46 devstack sudo[107349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-35ccd940-cf54-4017-9e2a-e041d7d529c5 Sep 07 10:18:46 devstack sudo[107349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:18:47 devstack sudo[107349]: pam_unix(sudo:session): session closed for user root Sep 07 10:18:47 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-1721475c-f11b-4931-aedb-c118bc8a4973 tempest-CinderUnicodeTest-250046331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-35ccd940-cf54-4017-9e2a-e041d7d529c5" returned: 0 in 0.271s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:18:47 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-1721475c-f11b-4931-aedb-c118bc8a4973 tempest-CinderUnicodeTest-250046331 None] <== create_volume: return (807ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'} {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 10:18:47 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-1721475c-f11b-4931-aedb-c118bc8a4973 tempest-CinderUnicodeTest-250046331 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.810s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:18:47 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-1721475c-f11b-4931-aedb-c118bc8a4973 tempest-CinderUnicodeTest-250046331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ced5fb8-201e-4c88-942d-35c04e683bbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-35ccd940-cf54-4017-9e2a-e041d7d529c5', 'volume_size': 1}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:18:47 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-1721475c-f11b-4931-aedb-c118bc8a4973 tempest-CinderUnicodeTest-250046331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d4a7735-1b09-4687-bb7b-2e699f781880) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:18:47 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-1721475c-f11b-4931-aedb-c118bc8a4973 tempest-CinderUnicodeTest-250046331 None] Volume volume-35ccd940-cf54-4017-9e2a-e041d7d529c5 (35ccd940-cf54-4017-9e2a-e041d7d529c5): created successfully Sep 07 10:18:47 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-1721475c-f11b-4931-aedb-c118bc8a4973 tempest-CinderUnicodeTest-250046331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d4a7735-1b09-4687-bb7b-2e699f781880) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:18:47 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-1721475c-f11b-4931-aedb-c118bc8a4973 tempest-CinderUnicodeTest-250046331 None] Flow 'volume_create_manager' (5aca135a-e8a2-4d4b-9cab-e3f25fd7e405) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:18:47 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-167aefda-c05b-4a12-8270-35c71f73b50b tempest-CreateVolumesFromSnapshotTest-917122263 None] Acquiring lock "cinder-21c79fa5-e6e1-4994-ba50-e47731dcae25-delete_volume" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:18:47 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-1721475c-f11b-4931-aedb-c118bc8a4973 tempest-CinderUnicodeTest-250046331 None] Created volume successfully. Sep 07 10:18:47 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-167aefda-c05b-4a12-8270-35c71f73b50b tempest-CreateVolumesFromSnapshotTest-917122263 None] Lock "cinder-21c79fa5-e6e1-4994-ba50-e47731dcae25-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:18:47 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-167aefda-c05b-4a12-8270-35c71f73b50b tempest-CreateVolumesFromSnapshotTest-917122263 None] Acquiring lock "cinder-quobyte-21c79fa5-e6e1-4994-ba50-e47731dcae25" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:18:47 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-167aefda-c05b-4a12-8270-35c71f73b50b tempest-CreateVolumesFromSnapshotTest-917122263 None] Lock "cinder-quobyte-21c79fa5-e6e1-4994-ba50-e47731dcae25" acquired by "delete_volume" :: waited 0.019s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:18:47 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e77ee00-3148-4774-b07f-4dba33b20861]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:18:47 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-167aefda-c05b-4a12-8270-35c71f73b50b tempest-CreateVolumesFromSnapshotTest-917122263 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-21c79fa5-e6e1-4994-ba50-e47731dcae25 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:18:47 devstack sudo[107347]: pam_unix(sudo:session): session closed for user root Sep 07 10:18:47 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-f2de81c2-6a5a-4927-b13b-be28d1a2735e tempest-VolumeImageDependencyTests-742914938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_05f61a3d-3aff-4907-97d3-b4f837ca6974_cuaaoobgdevstack@QuobyteHD /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-b2af6d14-db13-4dc0-8377-88f8be8e48c6" returned: 0 in 0.533s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:18:47 devstack cinder-volume[87515]: DEBUG cinder.image.image_utils [None req-f2de81c2-6a5a-4927-b13b-be28d1a2735e tempest-VolumeImageDependencyTests-742914938 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_05f61a3d-3aff-4907-97d3-b4f837ca6974_cuaaoobgdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-b2af6d14-db13-4dc0-8377-88f8be8e48c6 {{(pid=87515) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 07 10:18:47 devstack cinder-volume[87515]: INFO cinder.image.image_utils [None req-f2de81c2-6a5a-4927-b13b-be28d1a2735e tempest-VolumeImageDependencyTests-742914938 None] Converted 0.00 MB image at 0.00 MB/s Sep 07 10:18:47 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-f2de81c2-6a5a-4927-b13b-be28d1a2735e tempest-VolumeImageDependencyTests-742914938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-b2af6d14-db13-4dc0-8377-88f8be8e48c6 1G {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:18:47 devstack sudo[107357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-b2af6d14-db13-4dc0-8377-88f8be8e48c6 1G Sep 07 10:18:47 devstack sudo[107357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:18:47 devstack sudo[107356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-21c79fa5-e6e1-4994-ba50-e47731dcae25 Sep 07 10:18:47 devstack sudo[107356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:18:47 devstack sudo[107357]: pam_unix(sudo:session): session closed for user root Sep 07 10:18:47 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-f2de81c2-6a5a-4927-b13b-be28d1a2735e tempest-VolumeImageDependencyTests-742914938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-b2af6d14-db13-4dc0-8377-88f8be8e48c6 1G" returned: 0 in 0.388s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:18:47 devstack cinder-volume[87515]: DEBUG cinder.volume.volume_utils [None req-f2de81c2-6a5a-4927-b13b-be28d1a2735e tempest-VolumeImageDependencyTests-742914938 None] Downloaded image 05f61a3d-3aff-4907-97d3-b4f837ca6974 ((None, [{'url': 'file:///opt/stack/data/glance/images/05f61a3d-3aff-4907-97d3-b4f837ca6974', 'metadata': {}}])) to volume b2af6d14-db13-4dc0-8377-88f8be8e48c6 successfully. {{(pid=87515) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 07 10:18:47 devstack cinder-volume[87515]: DEBUG cinder.image.image_utils [None req-f2de81c2-6a5a-4927-b13b-be28d1a2735e tempest-VolumeImageDependencyTests-742914938 None] Temporary image 05f61a3d-3aff-4907-97d3-b4f837ca6974 for user 42b0a0ba7600440e9812f38f55ea0709 is deleted. {{(pid=87515) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 07 10:18:47 devstack cinder-volume[87515]: DEBUG cinder.volume.volume_utils [None req-f2de81c2-6a5a-4927-b13b-be28d1a2735e tempest-VolumeImageDependencyTests-742914938 None] Marking volume b2af6d14-db13-4dc0-8377-88f8be8e48c6 as bootable. {{(pid=87515) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 07 10:18:47 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-e6e1a5bd-420d-410f-ab03-59d5457f809c tempest-ProjectMemberTests-55037479 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:18:47 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-e6e1a5bd-420d-410f-ab03-59d5457f809c tempest-ProjectMemberTests-55037479 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:18:47 devstack sudo[107356]: pam_unix(sudo:session): session closed for user root Sep 07 10:18:47 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-e6e1a5bd-420d-410f-ab03-59d5457f809c tempest-ProjectMemberTests-55037479 None] Creating offline snapshot 7cbe9941-911e-4a1a-9510-7be0e1aa32d3 of volume b75542fa-1480-4468-9a57-c0e30515b323 {{(pid=87515) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 10:18:47 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-167aefda-c05b-4a12-8270-35c71f73b50b tempest-CreateVolumesFromSnapshotTest-917122263 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-21c79fa5-e6e1-4994-ba50-e47731dcae25" returned: 0 in 0.445s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:18:47 devstack cinder-volume[87515]: DEBUG cinder.volume.flows.manager.create_volume [None req-f2de81c2-6a5a-4927-b13b-be28d1a2735e tempest-VolumeImageDependencyTests-742914938 None] Copying metadata from image 05f61a3d-3aff-4907-97d3-b4f837ca6974 to b2af6d14-db13-4dc0-8377-88f8be8e48c6. {{(pid=87515) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 07 10:18:47 devstack cinder-volume[87515]: DEBUG cinder.volume.flows.manager.create_volume [None req-f2de81c2-6a5a-4927-b13b-be28d1a2735e tempest-VolumeImageDependencyTests-742914938 None] Creating volume glance metadata for volume b2af6d14-db13-4dc0-8377-88f8be8e48c6 backed by image 05f61a3d-3aff-4907-97d3-b4f837ca6974 with: {'image_id': '05f61a3d-3aff-4907-97d3-b4f837ca6974', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '12531986d33c327bcc34721329543f45', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87515) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 07 10:18:47 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-167aefda-c05b-4a12-8270-35c71f73b50b tempest-CreateVolumesFromSnapshotTest-917122263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-21c79fa5-e6e1-4994-ba50-e47731dcae25 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:18:47 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[72b0817c-9fb9-4d90-b2d5-1d13f1cc142c]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:18:47 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-e6e1a5bd-420d-410f-ab03-59d5457f809c tempest-ProjectMemberTests-55037479 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-b75542fa-1480-4468-9a57-c0e30515b323 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:18:47 devstack sudo[107366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-21c79fa5-e6e1-4994-ba50-e47731dcae25 Sep 07 10:18:47 devstack sudo[107366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:18:47 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-f2de81c2-6a5a-4927-b13b-be28d1a2735e tempest-VolumeImageDependencyTests-742914938 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4515afb7-2c44-4c1d-8103-7dfb4f54f2b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b2af6d14-db13-4dc0-8377-88f8be8e48c6', 'volume_size': 1, 'image_id': '05f61a3d-3aff-4907-97d3-b4f837ca6974', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/05f61a3d-3aff-4907-97d3-b4f837ca6974', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '12531986d33c327bcc34721329543f45', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '1d9417ed4529446eb1736ab78cc1a564', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'd3c2b2a4482964fecf0417c47c32b6384b966708580483da0c87067dc1f599492c8c8c5f32fd005996087ec3809b57005a878e910380fe8b5afa379251c3b0a0', 'id': '05f61a3d-3aff-4907-97d3-b4f837ca6974', 'created_at': datetime.datetime(2026, 9, 7, 8, 18, 38, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 7, 8, 18, 40, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/05f61a3d-3aff-4907-97d3-b4f837ca6974/file', 'properties': {}}, 'image_service': }' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:18:47 devstack sudo[107367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-b75542fa-1480-4468-9a57-c0e30515b323 Sep 07 10:18:47 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-f2de81c2-6a5a-4927-b13b-be28d1a2735e tempest-VolumeImageDependencyTests-742914938 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (045c4274-b301-4c9f-8346-cb19312d631e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:18:47 devstack sudo[107367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:18:47 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-f2de81c2-6a5a-4927-b13b-be28d1a2735e tempest-VolumeImageDependencyTests-742914938 None] Volume volume-b2af6d14-db13-4dc0-8377-88f8be8e48c6 (b2af6d14-db13-4dc0-8377-88f8be8e48c6): created successfully Sep 07 10:18:47 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-f2de81c2-6a5a-4927-b13b-be28d1a2735e tempest-VolumeImageDependencyTests-742914938 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (045c4274-b301-4c9f-8346-cb19312d631e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:18:47 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-f2de81c2-6a5a-4927-b13b-be28d1a2735e tempest-VolumeImageDependencyTests-742914938 None] Flow 'volume_create_manager' (056fa34c-ab86-468e-ab84-af175c1c489d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:18:47 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-f2de81c2-6a5a-4927-b13b-be28d1a2735e tempest-VolumeImageDependencyTests-742914938 None] Created volume successfully. Sep 07 10:18:48 devstack sudo[107366]: pam_unix(sudo:session): session closed for user root Sep 07 10:18:48 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-167aefda-c05b-4a12-8270-35c71f73b50b tempest-CreateVolumesFromSnapshotTest-917122263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-21c79fa5-e6e1-4994-ba50-e47731dcae25" returned: 0 in 0.320s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:18:48 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-167aefda-c05b-4a12-8270-35c71f73b50b tempest-CreateVolumesFromSnapshotTest-917122263 None] Lock "cinder-quobyte-21c79fa5-e6e1-4994-ba50-e47731dcae25" released by "delete_volume" :: held 0.823s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:18:48 devstack cinder-volume[87515]: DEBUG cinder.quota [None req-167aefda-c05b-4a12-8270-35c71f73b50b tempest-CreateVolumesFromSnapshotTest-917122263 None] Created reservations ['dc6de6a8-2a22-4a10-aff0-e921c6c549c1', '4246c732-4df5-41bd-a90f-52d4d42a2e32', 'a8f24799-c1c0-401c-b713-36447312f55e', '77266ff5-79c0-44ba-ba14-de3f6c789062'] {{(pid=87515) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:18:48 devstack sudo[107367]: pam_unix(sudo:session): session closed for user root Sep 07 10:18:48 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-e6e1a5bd-420d-410f-ab03-59d5457f809c tempest-ProjectMemberTests-55037479 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-b75542fa-1480-4468-9a57-c0e30515b323" returned: 0 in 0.429s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:18:48 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-e6e1a5bd-420d-410f-ab03-59d5457f809c tempest-ProjectMemberTests-55037479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-b75542fa-1480-4468-9a57-c0e30515b323,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-b75542fa-1480-4468-9a57-c0e30515b323.7cbe9941-911e-4a1a-9510-7be0e1aa32d3 1G {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:18:48 devstack sudo[107375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-b75542fa-1480-4468-9a57-c0e30515b323,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-b75542fa-1480-4468-9a57-c0e30515b323.7cbe9941-911e-4a1a-9510-7be0e1aa32d3 1G Sep 07 10:18:48 devstack sudo[107375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:18:48 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-167aefda-c05b-4a12-8270-35c71f73b50b tempest-CreateVolumesFromSnapshotTest-917122263 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:18:48 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-167aefda-c05b-4a12-8270-35c71f73b50b tempest-CreateVolumesFromSnapshotTest-917122263 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:18:48 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-167aefda-c05b-4a12-8270-35c71f73b50b tempest-CreateVolumesFromSnapshotTest-917122263 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:18:48 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-167aefda-c05b-4a12-8270-35c71f73b50b tempest-CreateVolumesFromSnapshotTest-917122263 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:18:48 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-167aefda-c05b-4a12-8270-35c71f73b50b tempest-CreateVolumesFromSnapshotTest-917122263 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:18:48 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-167aefda-c05b-4a12-8270-35c71f73b50b tempest-CreateVolumesFromSnapshotTest-917122263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:18:48 devstack sudo[107377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a Sep 07 10:18:48 devstack sudo[107377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:18:48 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-85f63ef5-0983-4613-8c3f-5b4d5f1bf389 tempest-CinderUnicodeTest-250046331 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:18:48 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-76756f9b-36b7-43ba-9f07-52fb7c346a85 tempest-CreateVolumesFromSnapshotTest-917122263 None] Acquiring lock "cinder-b71d39f4-3a6d-4915-a5d1-193c702d503e-delete_volume" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:18:48 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-76756f9b-36b7-43ba-9f07-52fb7c346a85 tempest-CreateVolumesFromSnapshotTest-917122263 None] Lock "cinder-b71d39f4-3a6d-4915-a5d1-193c702d503e-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:18:48 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-76756f9b-36b7-43ba-9f07-52fb7c346a85 tempest-CreateVolumesFromSnapshotTest-917122263 None] Acquiring lock "cinder-quobyte-b71d39f4-3a6d-4915-a5d1-193c702d503e" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:18:48 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-76756f9b-36b7-43ba-9f07-52fb7c346a85 tempest-CreateVolumesFromSnapshotTest-917122263 None] Lock "cinder-quobyte-b71d39f4-3a6d-4915-a5d1-193c702d503e" acquired by "delete_volume" :: waited 0.016s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:18:48 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[14868b47-7a80-4474-8a4d-54627d86bcfd]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:18:48 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-76756f9b-36b7-43ba-9f07-52fb7c346a85 tempest-CreateVolumesFromSnapshotTest-917122263 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-b71d39f4-3a6d-4915-a5d1-193c702d503e {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:18:48 devstack sudo[107384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-b71d39f4-3a6d-4915-a5d1-193c702d503e Sep 07 10:18:48 devstack sudo[107384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:18:48 devstack sudo[107375]: pam_unix(sudo:session): session closed for user root Sep 07 10:18:48 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-e6e1a5bd-420d-410f-ab03-59d5457f809c tempest-ProjectMemberTests-55037479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-b75542fa-1480-4468-9a57-c0e30515b323,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-b75542fa-1480-4468-9a57-c0e30515b323.7cbe9941-911e-4a1a-9510-7be0e1aa32d3 1G" returned: 0 in 0.438s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:18:48 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-e6e1a5bd-420d-410f-ab03-59d5457f809c tempest-ProjectMemberTests-55037479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b75542fa-1480-4468-9a57-c0e30515b323 -F qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-b75542fa-1480-4468-9a57-c0e30515b323.7cbe9941-911e-4a1a-9510-7be0e1aa32d3 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:18:48 devstack sudo[107377]: pam_unix(sudo:session): session closed for user root Sep 07 10:18:48 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-167aefda-c05b-4a12-8270-35c71f73b50b tempest-CreateVolumesFromSnapshotTest-917122263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a" returned: 0 in 0.322s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:18:48 devstack cinder-volume[87515]: DEBUG cinder.manager [None req-167aefda-c05b-4a12-8270-35c71f73b50b tempest-CreateVolumesFromSnapshotTest-917122263 None] Notifying Schedulers of capabilities ... {{(pid=87515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:18:48 devstack sudo[107387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b75542fa-1480-4468-9a57-c0e30515b323 -F qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-b75542fa-1480-4468-9a57-c0e30515b323.7cbe9941-911e-4a1a-9510-7be0e1aa32d3 Sep 07 10:18:48 devstack sudo[107387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:18:48 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-167aefda-c05b-4a12-8270-35c71f73b50b tempest-CreateVolumesFromSnapshotTest-917122263 None] Deleted volume successfully. Sep 07 10:18:48 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-167aefda-c05b-4a12-8270-35c71f73b50b tempest-CreateVolumesFromSnapshotTest-917122263 None] Lock "cinder-21c79fa5-e6e1-4994-ba50-e47731dcae25-delete_volume" released by "delete_volume" :: held 1.494s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:18:48 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-f90952ef-b7aa-4ed2-a666-f9441164c529 tempest-VolumeImageDependencyTests-742914938 None] Acquiring lock "cinder-b2af6d14-db13-4dc0-8377-88f8be8e48c6-delete_volume" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:18:48 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-f90952ef-b7aa-4ed2-a666-f9441164c529 tempest-VolumeImageDependencyTests-742914938 None] Lock "cinder-b2af6d14-db13-4dc0-8377-88f8be8e48c6-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:18:48 devstack sudo[107384]: pam_unix(sudo:session): session closed for user root Sep 07 10:18:48 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-76756f9b-36b7-43ba-9f07-52fb7c346a85 tempest-CreateVolumesFromSnapshotTest-917122263 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-b71d39f4-3a6d-4915-a5d1-193c702d503e" returned: 0 in 0.449s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:18:48 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-76756f9b-36b7-43ba-9f07-52fb7c346a85 tempest-CreateVolumesFromSnapshotTest-917122263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-b71d39f4-3a6d-4915-a5d1-193c702d503e {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:18:48 devstack sudo[107387]: pam_unix(sudo:session): session closed for user root Sep 07 10:18:48 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-e6e1a5bd-420d-410f-ab03-59d5457f809c tempest-ProjectMemberTests-55037479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b75542fa-1480-4468-9a57-c0e30515b323 -F qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-b75542fa-1480-4468-9a57-c0e30515b323.7cbe9941-911e-4a1a-9510-7be0e1aa32d3" returned: 0 in 0.330s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:18:48 devstack cinder-volume[87515]: WARNING cinder.volume.drivers.remotefs [None req-e6e1a5bd-420d-410f-ab03-59d5457f809c tempest-ProjectMemberTests-55037479 None] /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-b75542fa-1480-4468-9a57-c0e30515b323.7cbe9941-911e-4a1a-9510-7be0e1aa32d3 is being set with open permissions: ugo+rw Sep 07 10:18:48 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-e6e1a5bd-420d-410f-ab03-59d5457f809c tempest-ProjectMemberTests-55037479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-b75542fa-1480-4468-9a57-c0e30515b323.7cbe9941-911e-4a1a-9510-7be0e1aa32d3 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:18:49 devstack sudo[107395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-b71d39f4-3a6d-4915-a5d1-193c702d503e Sep 07 10:18:49 devstack sudo[107395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:18:49 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-f90952ef-b7aa-4ed2-a666-f9441164c529 tempest-VolumeImageDependencyTests-742914938 None] Acquiring lock "cinder-quobyte-b2af6d14-db13-4dc0-8377-88f8be8e48c6" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:18:49 devstack sudo[107397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-b75542fa-1480-4468-9a57-c0e30515b323.7cbe9941-911e-4a1a-9510-7be0e1aa32d3 Sep 07 10:18:49 devstack sudo[107397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:18:49 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-f90952ef-b7aa-4ed2-a666-f9441164c529 tempest-VolumeImageDependencyTests-742914938 None] Lock "cinder-quobyte-b2af6d14-db13-4dc0-8377-88f8be8e48c6" acquired by "delete_volume" :: waited 0.018s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:18:49 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[8523154b-a20a-437f-9986-382f79118499]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:18:49 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-f90952ef-b7aa-4ed2-a666-f9441164c529 tempest-VolumeImageDependencyTests-742914938 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-b2af6d14-db13-4dc0-8377-88f8be8e48c6 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:18:49 devstack sudo[107399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-b2af6d14-db13-4dc0-8377-88f8be8e48c6 Sep 07 10:18:49 devstack sudo[107399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:18:49 devstack sudo[107395]: pam_unix(sudo:session): session closed for user root Sep 07 10:18:49 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-76756f9b-36b7-43ba-9f07-52fb7c346a85 tempest-CreateVolumesFromSnapshotTest-917122263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-b71d39f4-3a6d-4915-a5d1-193c702d503e" returned: 0 in 0.276s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:18:49 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-76756f9b-36b7-43ba-9f07-52fb7c346a85 tempest-CreateVolumesFromSnapshotTest-917122263 None] Lock "cinder-quobyte-b71d39f4-3a6d-4915-a5d1-193c702d503e" released by "delete_volume" :: held 0.776s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:18:49 devstack sudo[107397]: pam_unix(sudo:session): session closed for user root Sep 07 10:18:49 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-e6e1a5bd-420d-410f-ab03-59d5457f809c tempest-ProjectMemberTests-55037479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-b75542fa-1480-4468-9a57-c0e30515b323.7cbe9941-911e-4a1a-9510-7be0e1aa32d3" returned: 0 in 0.284s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:18:49 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-e6e1a5bd-420d-410f-ab03-59d5457f809c tempest-ProjectMemberTests-55037479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-b75542fa-1480-4468-9a57-c0e30515b323.info {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:18:49 devstack sudo[107405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-b75542fa-1480-4468-9a57-c0e30515b323.info Sep 07 10:18:49 devstack sudo[107405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:18:49 devstack cinder-volume[87515]: DEBUG cinder.quota [None req-76756f9b-36b7-43ba-9f07-52fb7c346a85 tempest-CreateVolumesFromSnapshotTest-917122263 None] Created reservations ['912d3447-c7ca-4002-a631-dc7f1181890e', 'db82a0f5-619b-4d45-a6b2-96b5bec9f29d', 'bafa1cbc-213c-4299-9b8a-08337018eae9', 'fe8797c0-fcb9-446f-9b22-033974199160'] {{(pid=87515) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:18:49 devstack sudo[107399]: pam_unix(sudo:session): session closed for user root Sep 07 10:18:49 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-f90952ef-b7aa-4ed2-a666-f9441164c529 tempest-VolumeImageDependencyTests-742914938 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-b2af6d14-db13-4dc0-8377-88f8be8e48c6" returned: 0 in 0.402s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:18:49 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-f90952ef-b7aa-4ed2-a666-f9441164c529 tempest-VolumeImageDependencyTests-742914938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-b2af6d14-db13-4dc0-8377-88f8be8e48c6 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:18:49 devstack sudo[107409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-b2af6d14-db13-4dc0-8377-88f8be8e48c6 Sep 07 10:18:49 devstack sudo[107409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:18:49 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-76756f9b-36b7-43ba-9f07-52fb7c346a85 tempest-CreateVolumesFromSnapshotTest-917122263 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:18:49 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-76756f9b-36b7-43ba-9f07-52fb7c346a85 tempest-CreateVolumesFromSnapshotTest-917122263 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:18:49 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-76756f9b-36b7-43ba-9f07-52fb7c346a85 tempest-CreateVolumesFromSnapshotTest-917122263 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:18:49 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-76756f9b-36b7-43ba-9f07-52fb7c346a85 tempest-CreateVolumesFromSnapshotTest-917122263 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:18:49 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-76756f9b-36b7-43ba-9f07-52fb7c346a85 tempest-CreateVolumesFromSnapshotTest-917122263 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:18:49 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-76756f9b-36b7-43ba-9f07-52fb7c346a85 tempest-CreateVolumesFromSnapshotTest-917122263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:18:49 devstack sudo[107411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a Sep 07 10:18:49 devstack sudo[107411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:18:49 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-89b8f9f1-74a0-4914-a6fa-101dd02567fc tempest-CreateVolumesFromSnapshotTest-917122263 None] Acquiring lock "cinder-91e3e882-fcd1-4e4b-bef6-5c785a1cf665-delete_volume" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:18:49 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-89b8f9f1-74a0-4914-a6fa-101dd02567fc tempest-CreateVolumesFromSnapshotTest-917122263 None] Lock "cinder-91e3e882-fcd1-4e4b-bef6-5c785a1cf665-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:18:49 devstack sudo[107405]: pam_unix(sudo:session): session closed for user root Sep 07 10:18:49 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-e6e1a5bd-420d-410f-ab03-59d5457f809c tempest-ProjectMemberTests-55037479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-b75542fa-1480-4468-9a57-c0e30515b323.info" returned: 0 in 0.317s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:18:49 devstack cinder-volume[87515]: WARNING cinder.volume.drivers.remotefs [None req-e6e1a5bd-420d-410f-ab03-59d5457f809c tempest-ProjectMemberTests-55037479 None] /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-b75542fa-1480-4468-9a57-c0e30515b323.info is being set with open permissions: ugo+rw Sep 07 10:18:49 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-e6e1a5bd-420d-410f-ab03-59d5457f809c tempest-ProjectMemberTests-55037479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-b75542fa-1480-4468-9a57-c0e30515b323.info {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:18:49 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-89b8f9f1-74a0-4914-a6fa-101dd02567fc tempest-CreateVolumesFromSnapshotTest-917122263 None] Acquiring lock "cinder-quobyte-91e3e882-fcd1-4e4b-bef6-5c785a1cf665" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:18:49 devstack sudo[107414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-b75542fa-1480-4468-9a57-c0e30515b323.info Sep 07 10:18:49 devstack sudo[107414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:18:49 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-89b8f9f1-74a0-4914-a6fa-101dd02567fc tempest-CreateVolumesFromSnapshotTest-917122263 None] Lock "cinder-quobyte-91e3e882-fcd1-4e4b-bef6-5c785a1cf665" acquired by "delete_volume" :: waited 0.028s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:18:49 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[a44b4b9b-f7d3-44f7-bd6e-332475ffea96]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:18:49 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-89b8f9f1-74a0-4914-a6fa-101dd02567fc tempest-CreateVolumesFromSnapshotTest-917122263 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-91e3e882-fcd1-4e4b-bef6-5c785a1cf665 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:18:49 devstack sudo[107409]: pam_unix(sudo:session): session closed for user root Sep 07 10:18:49 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-f90952ef-b7aa-4ed2-a666-f9441164c529 tempest-VolumeImageDependencyTests-742914938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-b2af6d14-db13-4dc0-8377-88f8be8e48c6" returned: 0 in 0.396s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:18:49 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-f90952ef-b7aa-4ed2-a666-f9441164c529 tempest-VolumeImageDependencyTests-742914938 None] Lock "cinder-quobyte-b2af6d14-db13-4dc0-8377-88f8be8e48c6" released by "delete_volume" :: held 0.853s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:18:49 devstack sudo[107411]: pam_unix(sudo:session): session closed for user root Sep 07 10:18:49 devstack sudo[107417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-91e3e882-fcd1-4e4b-bef6-5c785a1cf665 Sep 07 10:18:49 devstack sudo[107417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:18:49 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-76756f9b-36b7-43ba-9f07-52fb7c346a85 tempest-CreateVolumesFromSnapshotTest-917122263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a" returned: 0 in 0.414s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:18:49 devstack cinder-volume[87515]: DEBUG cinder.manager [None req-76756f9b-36b7-43ba-9f07-52fb7c346a85 tempest-CreateVolumesFromSnapshotTest-917122263 None] Notifying Schedulers of capabilities ... {{(pid=87515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:18:49 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-76756f9b-36b7-43ba-9f07-52fb7c346a85 tempest-CreateVolumesFromSnapshotTest-917122263 None] Deleted volume successfully. Sep 07 10:18:49 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-76756f9b-36b7-43ba-9f07-52fb7c346a85 tempest-CreateVolumesFromSnapshotTest-917122263 None] Lock "cinder-b71d39f4-3a6d-4915-a5d1-193c702d503e-delete_volume" released by "delete_volume" :: held 1.523s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:18:49 devstack cinder-volume[87515]: DEBUG cinder.quota [None req-f90952ef-b7aa-4ed2-a666-f9441164c529 tempest-VolumeImageDependencyTests-742914938 None] Created reservations ['2e25a392-bbc2-4d06-be36-ce97fd7e84c6', '5a81db8c-2397-45ac-86f0-302381761938', '0ae5fbc9-3181-4b85-ad03-c5c4fc41768e', 'f3068f3c-e4b3-451f-b2f9-e24f7fb5e6c1'] {{(pid=87515) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:18:49 devstack sudo[107414]: pam_unix(sudo:session): session closed for user root Sep 07 10:18:49 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-e6e1a5bd-420d-410f-ab03-59d5457f809c tempest-ProjectMemberTests-55037479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-b75542fa-1480-4468-9a57-c0e30515b323.info" returned: 0 in 0.298s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:18:50 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-e6e1a5bd-420d-410f-ab03-59d5457f809c tempest-ProjectMemberTests-55037479 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.244s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:18:50 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-85f63ef5-0983-4613-8c3f-5b4d5f1bf389 tempest-CinderUnicodeTest-250046331 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.602s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:18:50 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-85f63ef5-0983-4613-8c3f-5b4d5f1bf389 tempest-CinderUnicodeTest-250046331 None] Creating offline snapshot fe941684-a9d5-442a-a609-bbdbedac5662 of volume 35ccd940-cf54-4017-9e2a-e041d7d529c5 {{(pid=87515) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 10:18:50 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-e6e1a5bd-420d-410f-ab03-59d5457f809c tempest-ProjectMemberTests-55037479 None] Create snapshot completed successfully Sep 07 10:18:50 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd7f2bf0-99cc-4517-a735-12b86cea0206]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:18:50 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-85f63ef5-0983-4613-8c3f-5b4d5f1bf389 tempest-CinderUnicodeTest-250046331 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-35ccd940-cf54-4017-9e2a-e041d7d529c5 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:18:50 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-f90952ef-b7aa-4ed2-a666-f9441164c529 tempest-VolumeImageDependencyTests-742914938 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:18:50 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-f90952ef-b7aa-4ed2-a666-f9441164c529 tempest-VolumeImageDependencyTests-742914938 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:18:50 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-f90952ef-b7aa-4ed2-a666-f9441164c529 tempest-VolumeImageDependencyTests-742914938 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:18:50 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-f90952ef-b7aa-4ed2-a666-f9441164c529 tempest-VolumeImageDependencyTests-742914938 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:18:50 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-f90952ef-b7aa-4ed2-a666-f9441164c529 tempest-VolumeImageDependencyTests-742914938 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:18:50 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-f90952ef-b7aa-4ed2-a666-f9441164c529 tempest-VolumeImageDependencyTests-742914938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:18:50 devstack sudo[107422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a Sep 07 10:18:50 devstack sudo[107422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:18:50 devstack sudo[107421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-35ccd940-cf54-4017-9e2a-e041d7d529c5 Sep 07 10:18:50 devstack sudo[107421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:18:50 devstack sudo[107417]: pam_unix(sudo:session): session closed for user root Sep 07 10:18:50 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-89b8f9f1-74a0-4914-a6fa-101dd02567fc tempest-CreateVolumesFromSnapshotTest-917122263 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-91e3e882-fcd1-4e4b-bef6-5c785a1cf665" returned: 0 in 0.408s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:18:50 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-89b8f9f1-74a0-4914-a6fa-101dd02567fc tempest-CreateVolumesFromSnapshotTest-917122263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-91e3e882-fcd1-4e4b-bef6-5c785a1cf665 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:18:50 devstack sudo[107428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-91e3e882-fcd1-4e4b-bef6-5c785a1cf665 Sep 07 10:18:50 devstack sudo[107428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:18:50 devstack sudo[107422]: pam_unix(sudo:session): session closed for user root Sep 07 10:18:50 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-f90952ef-b7aa-4ed2-a666-f9441164c529 tempest-VolumeImageDependencyTests-742914938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a" returned: 0 in 0.267s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:18:50 devstack cinder-volume[87515]: DEBUG cinder.manager [None req-f90952ef-b7aa-4ed2-a666-f9441164c529 tempest-VolumeImageDependencyTests-742914938 None] Notifying Schedulers of capabilities ... {{(pid=87515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:18:50 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-f90952ef-b7aa-4ed2-a666-f9441164c529 tempest-VolumeImageDependencyTests-742914938 None] Deleted volume successfully. Sep 07 10:18:50 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-f90952ef-b7aa-4ed2-a666-f9441164c529 tempest-VolumeImageDependencyTests-742914938 None] Lock "cinder-b2af6d14-db13-4dc0-8377-88f8be8e48c6-delete_volume" released by "delete_volume" :: held 1.481s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:18:50 devstack sudo[107428]: pam_unix(sudo:session): session closed for user root Sep 07 10:18:50 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-89b8f9f1-74a0-4914-a6fa-101dd02567fc tempest-CreateVolumesFromSnapshotTest-917122263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-91e3e882-fcd1-4e4b-bef6-5c785a1cf665" returned: 0 in 0.251s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:18:50 devstack sudo[107421]: pam_unix(sudo:session): session closed for user root Sep 07 10:18:50 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-85f63ef5-0983-4613-8c3f-5b4d5f1bf389 tempest-CinderUnicodeTest-250046331 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-35ccd940-cf54-4017-9e2a-e041d7d529c5" returned: 0 in 0.411s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:18:50 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-85f63ef5-0983-4613-8c3f-5b4d5f1bf389 tempest-CinderUnicodeTest-250046331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-35ccd940-cf54-4017-9e2a-e041d7d529c5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-35ccd940-cf54-4017-9e2a-e041d7d529c5.fe941684-a9d5-442a-a609-bbdbedac5662 1G {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:18:50 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-89b8f9f1-74a0-4914-a6fa-101dd02567fc tempest-CreateVolumesFromSnapshotTest-917122263 None] Lock "cinder-quobyte-91e3e882-fcd1-4e4b-bef6-5c785a1cf665" released by "delete_volume" :: held 0.741s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:18:50 devstack sudo[107435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-35ccd940-cf54-4017-9e2a-e041d7d529c5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-35ccd940-cf54-4017-9e2a-e041d7d529c5.fe941684-a9d5-442a-a609-bbdbedac5662 1G Sep 07 10:18:50 devstack sudo[107435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:18:50 devstack cinder-volume[87515]: DEBUG cinder.quota [None req-89b8f9f1-74a0-4914-a6fa-101dd02567fc tempest-CreateVolumesFromSnapshotTest-917122263 None] Created reservations ['6310cd19-0455-45c4-92f1-f90c8c010816', '038cac26-af0f-4e99-a4b0-cff31d15655d', '7bb2e5a7-ce1e-49ac-941f-d4be033c462f', '4399fd77-5739-4885-a02d-610e7623c6e7'] {{(pid=87515) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:18:50 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-89b8f9f1-74a0-4914-a6fa-101dd02567fc tempest-CreateVolumesFromSnapshotTest-917122263 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:18:50 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-89b8f9f1-74a0-4914-a6fa-101dd02567fc tempest-CreateVolumesFromSnapshotTest-917122263 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:18:50 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-89b8f9f1-74a0-4914-a6fa-101dd02567fc tempest-CreateVolumesFromSnapshotTest-917122263 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:18:50 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-89b8f9f1-74a0-4914-a6fa-101dd02567fc tempest-CreateVolumesFromSnapshotTest-917122263 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:18:50 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-89b8f9f1-74a0-4914-a6fa-101dd02567fc tempest-CreateVolumesFromSnapshotTest-917122263 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:18:50 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-89b8f9f1-74a0-4914-a6fa-101dd02567fc tempest-CreateVolumesFromSnapshotTest-917122263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:18:50 devstack sudo[107437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a Sep 07 10:18:50 devstack sudo[107437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:18:50 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-743b24a5-41a4-4ce4-84ab-ce14cb7827bd tempest-CreateVolumesFromSnapshotTest-917122263 None] Acquiring lock "cinder-815fa175-5ed1-4e39-b76a-a010b646d493-delete_snapshot" by "delete_snapshot" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:18:50 devstack sudo[107437]: pam_unix(sudo:session): session closed for user root Sep 07 10:18:50 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-743b24a5-41a4-4ce4-84ab-ce14cb7827bd tempest-CreateVolumesFromSnapshotTest-917122263 None] Lock "cinder-815fa175-5ed1-4e39-b76a-a010b646d493-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:18:50 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-743b24a5-41a4-4ce4-84ab-ce14cb7827bd tempest-CreateVolumesFromSnapshotTest-917122263 None] Acquiring lock "cinder-quobyte-fe683bd4-f454-4081-8221-c692d329cdb9" by "delete_snapshot" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:18:50 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-89b8f9f1-74a0-4914-a6fa-101dd02567fc tempest-CreateVolumesFromSnapshotTest-917122263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a" returned: 0 in 0.288s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:18:50 devstack cinder-volume[87515]: DEBUG cinder.manager [None req-89b8f9f1-74a0-4914-a6fa-101dd02567fc tempest-CreateVolumesFromSnapshotTest-917122263 None] Notifying Schedulers of capabilities ... {{(pid=87515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:18:50 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-89b8f9f1-74a0-4914-a6fa-101dd02567fc tempest-CreateVolumesFromSnapshotTest-917122263 None] Deleted volume successfully. Sep 07 10:18:50 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-743b24a5-41a4-4ce4-84ab-ce14cb7827bd tempest-CreateVolumesFromSnapshotTest-917122263 None] Lock "cinder-quobyte-fe683bd4-f454-4081-8221-c692d329cdb9" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:18:50 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-743b24a5-41a4-4ce4-84ab-ce14cb7827bd tempest-CreateVolumesFromSnapshotTest-917122263 None] Acquiring lock "cinder-quobyte-815fa175-5ed1-4e39-b76a-a010b646d493" by "_delete_snapshot" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:18:50 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-04253bf8-ef4c-40b8-b0bd-f6cec095450c tempest-ProjectMemberTests-55037479 None] Acquiring lock "cinder-7cbe9941-911e-4a1a-9510-7be0e1aa32d3-delete_snapshot" by "delete_snapshot" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:18:50 devstack sudo[107435]: pam_unix(sudo:session): session closed for user root Sep 07 10:18:50 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-85f63ef5-0983-4613-8c3f-5b4d5f1bf389 tempest-CinderUnicodeTest-250046331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-35ccd940-cf54-4017-9e2a-e041d7d529c5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-35ccd940-cf54-4017-9e2a-e041d7d529c5.fe941684-a9d5-442a-a609-bbdbedac5662 1G" returned: 0 in 0.462s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:18:50 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-85f63ef5-0983-4613-8c3f-5b4d5f1bf389 tempest-CinderUnicodeTest-250046331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-35ccd940-cf54-4017-9e2a-e041d7d529c5 -F qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-35ccd940-cf54-4017-9e2a-e041d7d529c5.fe941684-a9d5-442a-a609-bbdbedac5662 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:18:50 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-743b24a5-41a4-4ce4-84ab-ce14cb7827bd tempest-CreateVolumesFromSnapshotTest-917122263 None] Lock "cinder-quobyte-815fa175-5ed1-4e39-b76a-a010b646d493" acquired by "_delete_snapshot" :: waited 0.046s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:18:50 devstack sudo[107444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-35ccd940-cf54-4017-9e2a-e041d7d529c5 -F qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-35ccd940-cf54-4017-9e2a-e041d7d529c5.fe941684-a9d5-442a-a609-bbdbedac5662 Sep 07 10:18:50 devstack sudo[107444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:18:50 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-743b24a5-41a4-4ce4-84ab-ce14cb7827bd tempest-CreateVolumesFromSnapshotTest-917122263 None] Deleting offline snapshot 815fa175-5ed1-4e39-b76a-a010b646d493 of volume fe683bd4-f454-4081-8221-c692d329cdb9 {{(pid=87515) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 10:18:50 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-743b24a5-41a4-4ce4-84ab-ce14cb7827bd tempest-CreateVolumesFromSnapshotTest-917122263 None] snapshot_file for this snap is: volume-fe683bd4-f454-4081-8221-c692d329cdb9.815fa175-5ed1-4e39-b76a-a010b646d493 {{(pid=87515) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 10:18:50 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-04253bf8-ef4c-40b8-b0bd-f6cec095450c tempest-ProjectMemberTests-55037479 None] Lock "cinder-7cbe9941-911e-4a1a-9510-7be0e1aa32d3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.072s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:18:50 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-04253bf8-ef4c-40b8-b0bd-f6cec095450c tempest-ProjectMemberTests-55037479 None] Acquiring lock "cinder-quobyte-b75542fa-1480-4468-9a57-c0e30515b323" by "delete_snapshot" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:18:51 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-89b8f9f1-74a0-4914-a6fa-101dd02567fc tempest-CreateVolumesFromSnapshotTest-917122263 None] Lock "cinder-91e3e882-fcd1-4e4b-bef6-5c785a1cf665-delete_volume" released by "delete_volume" :: held 1.357s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:18:51 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc235e28-529c-44a7-9e5e-8bc9b9be77d0]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:18:51 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-743b24a5-41a4-4ce4-84ab-ce14cb7827bd tempest-CreateVolumesFromSnapshotTest-917122263 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-fe683bd4-f454-4081-8221-c692d329cdb9.815fa175-5ed1-4e39-b76a-a010b646d493 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:18:51 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-04253bf8-ef4c-40b8-b0bd-f6cec095450c tempest-ProjectMemberTests-55037479 None] Lock "cinder-quobyte-b75542fa-1480-4468-9a57-c0e30515b323" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:18:51 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-04253bf8-ef4c-40b8-b0bd-f6cec095450c tempest-ProjectMemberTests-55037479 None] Acquiring lock "cinder-quobyte-7cbe9941-911e-4a1a-9510-7be0e1aa32d3" by "_delete_snapshot" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:18:51 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-04253bf8-ef4c-40b8-b0bd-f6cec095450c tempest-ProjectMemberTests-55037479 None] Lock "cinder-quobyte-7cbe9941-911e-4a1a-9510-7be0e1aa32d3" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:18:51 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-04253bf8-ef4c-40b8-b0bd-f6cec095450c tempest-ProjectMemberTests-55037479 None] Deleting offline snapshot 7cbe9941-911e-4a1a-9510-7be0e1aa32d3 of volume b75542fa-1480-4468-9a57-c0e30515b323 {{(pid=87515) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 10:18:51 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-04253bf8-ef4c-40b8-b0bd-f6cec095450c tempest-ProjectMemberTests-55037479 None] snapshot_file for this snap is: volume-b75542fa-1480-4468-9a57-c0e30515b323.7cbe9941-911e-4a1a-9510-7be0e1aa32d3 {{(pid=87515) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 10:18:51 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[829db923-df16-4545-87dd-3acba1819bae]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:18:51 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-04253bf8-ef4c-40b8-b0bd-f6cec095450c tempest-ProjectMemberTests-55037479 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-b75542fa-1480-4468-9a57-c0e30515b323.7cbe9941-911e-4a1a-9510-7be0e1aa32d3 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:18:51 devstack sudo[107446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-fe683bd4-f454-4081-8221-c692d329cdb9.815fa175-5ed1-4e39-b76a-a010b646d493 Sep 07 10:18:51 devstack sudo[107446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:18:51 devstack sudo[107448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-b75542fa-1480-4468-9a57-c0e30515b323.7cbe9941-911e-4a1a-9510-7be0e1aa32d3 Sep 07 10:18:51 devstack sudo[107448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:18:51 devstack sudo[107444]: pam_unix(sudo:session): session closed for user root Sep 07 10:18:51 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-85f63ef5-0983-4613-8c3f-5b4d5f1bf389 tempest-CinderUnicodeTest-250046331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-35ccd940-cf54-4017-9e2a-e041d7d529c5 -F qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-35ccd940-cf54-4017-9e2a-e041d7d529c5.fe941684-a9d5-442a-a609-bbdbedac5662" returned: 0 in 0.385s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:18:51 devstack cinder-volume[87515]: WARNING cinder.volume.drivers.remotefs [None req-85f63ef5-0983-4613-8c3f-5b4d5f1bf389 tempest-CinderUnicodeTest-250046331 None] /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-35ccd940-cf54-4017-9e2a-e041d7d529c5.fe941684-a9d5-442a-a609-bbdbedac5662 is being set with open permissions: ugo+rw Sep 07 10:18:51 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-85f63ef5-0983-4613-8c3f-5b4d5f1bf389 tempest-CinderUnicodeTest-250046331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-35ccd940-cf54-4017-9e2a-e041d7d529c5.fe941684-a9d5-442a-a609-bbdbedac5662 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:18:51 devstack sudo[107456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-35ccd940-cf54-4017-9e2a-e041d7d529c5.fe941684-a9d5-442a-a609-bbdbedac5662 Sep 07 10:18:51 devstack sudo[107456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:18:51 devstack sudo[107446]: pam_unix(sudo:session): session closed for user root Sep 07 10:18:51 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-743b24a5-41a4-4ce4-84ab-ce14cb7827bd tempest-CreateVolumesFromSnapshotTest-917122263 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-fe683bd4-f454-4081-8221-c692d329cdb9.815fa175-5ed1-4e39-b76a-a010b646d493" returned: 0 in 0.507s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:18:51 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-743b24a5-41a4-4ce4-84ab-ce14cb7827bd tempest-CreateVolumesFromSnapshotTest-917122263 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fe683bd4-f454-4081-8221-c692d329cdb9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87515) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 10:18:51 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[77855ee3-b428-486f-89c3-16eaa9c4c5df]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:18:51 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-743b24a5-41a4-4ce4-84ab-ce14cb7827bd tempest-CreateVolumesFromSnapshotTest-917122263 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-fe683bd4-f454-4081-8221-c692d329cdb9 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:18:51 devstack sudo[107448]: pam_unix(sudo:session): session closed for user root Sep 07 10:18:51 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-04253bf8-ef4c-40b8-b0bd-f6cec095450c tempest-ProjectMemberTests-55037479 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-b75542fa-1480-4468-9a57-c0e30515b323.7cbe9941-911e-4a1a-9510-7be0e1aa32d3" returned: 0 in 0.476s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:18:51 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-04253bf8-ef4c-40b8-b0bd-f6cec095450c tempest-ProjectMemberTests-55037479 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b75542fa-1480-4468-9a57-c0e30515b323(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87515) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 10:18:51 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ff4aa20-4b04-456b-9aa7-1652752f55c7]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:18:51 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-04253bf8-ef4c-40b8-b0bd-f6cec095450c tempest-ProjectMemberTests-55037479 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-b75542fa-1480-4468-9a57-c0e30515b323 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:18:51 devstack sudo[107456]: pam_unix(sudo:session): session closed for user root Sep 07 10:18:51 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-85f63ef5-0983-4613-8c3f-5b4d5f1bf389 tempest-CinderUnicodeTest-250046331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-35ccd940-cf54-4017-9e2a-e041d7d529c5.fe941684-a9d5-442a-a609-bbdbedac5662" returned: 0 in 0.308s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:18:51 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-85f63ef5-0983-4613-8c3f-5b4d5f1bf389 tempest-CinderUnicodeTest-250046331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-35ccd940-cf54-4017-9e2a-e041d7d529c5.info {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:18:51 devstack sudo[107465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-fe683bd4-f454-4081-8221-c692d329cdb9 Sep 07 10:18:51 devstack sudo[107465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:18:51 devstack sudo[107468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-35ccd940-cf54-4017-9e2a-e041d7d529c5.info Sep 07 10:18:51 devstack sudo[107468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:18:51 devstack sudo[107467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-b75542fa-1480-4468-9a57-c0e30515b323 Sep 07 10:18:51 devstack sudo[107467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:18:51 devstack sudo[107465]: pam_unix(sudo:session): session closed for user root Sep 07 10:18:51 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-743b24a5-41a4-4ce4-84ab-ce14cb7827bd tempest-CreateVolumesFromSnapshotTest-917122263 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-fe683bd4-f454-4081-8221-c692d329cdb9" returned: 0 in 0.444s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:18:51 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-743b24a5-41a4-4ce4-84ab-ce14cb7827bd tempest-CreateVolumesFromSnapshotTest-917122263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-fe683bd4-f454-4081-8221-c692d329cdb9.815fa175-5ed1-4e39-b76a-a010b646d493 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:18:52 devstack sudo[107468]: pam_unix(sudo:session): session closed for user root Sep 07 10:18:52 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-85f63ef5-0983-4613-8c3f-5b4d5f1bf389 tempest-CinderUnicodeTest-250046331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-35ccd940-cf54-4017-9e2a-e041d7d529c5.info" returned: 0 in 0.341s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:18:52 devstack cinder-volume[87515]: WARNING cinder.volume.drivers.remotefs [None req-85f63ef5-0983-4613-8c3f-5b4d5f1bf389 tempest-CinderUnicodeTest-250046331 None] /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-35ccd940-cf54-4017-9e2a-e041d7d529c5.info is being set with open permissions: ugo+rw Sep 07 10:18:52 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-85f63ef5-0983-4613-8c3f-5b4d5f1bf389 tempest-CinderUnicodeTest-250046331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-35ccd940-cf54-4017-9e2a-e041d7d529c5.info {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:18:52 devstack sudo[107479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-fe683bd4-f454-4081-8221-c692d329cdb9.815fa175-5ed1-4e39-b76a-a010b646d493 Sep 07 10:18:52 devstack sudo[107479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:18:52 devstack sudo[107480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-35ccd940-cf54-4017-9e2a-e041d7d529c5.info Sep 07 10:18:52 devstack sudo[107480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:18:52 devstack sudo[107467]: pam_unix(sudo:session): session closed for user root Sep 07 10:18:52 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-04253bf8-ef4c-40b8-b0bd-f6cec095450c tempest-ProjectMemberTests-55037479 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-b75542fa-1480-4468-9a57-c0e30515b323" returned: 0 in 0.488s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:18:52 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-04253bf8-ef4c-40b8-b0bd-f6cec095450c tempest-ProjectMemberTests-55037479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-b75542fa-1480-4468-9a57-c0e30515b323.7cbe9941-911e-4a1a-9510-7be0e1aa32d3 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:18:52 devstack sudo[107484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-b75542fa-1480-4468-9a57-c0e30515b323.7cbe9941-911e-4a1a-9510-7be0e1aa32d3 Sep 07 10:18:52 devstack sudo[107484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:18:52 devstack sudo[107480]: pam_unix(sudo:session): session closed for user root Sep 07 10:18:52 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-85f63ef5-0983-4613-8c3f-5b4d5f1bf389 tempest-CinderUnicodeTest-250046331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-35ccd940-cf54-4017-9e2a-e041d7d529c5.info" returned: 0 in 0.281s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:18:52 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-85f63ef5-0983-4613-8c3f-5b4d5f1bf389 tempest-CinderUnicodeTest-250046331 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.320s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:18:52 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-85f63ef5-0983-4613-8c3f-5b4d5f1bf389 tempest-CinderUnicodeTest-250046331 None] Create snapshot completed successfully Sep 07 10:18:52 devstack sudo[107479]: pam_unix(sudo:session): session closed for user root Sep 07 10:18:52 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-743b24a5-41a4-4ce4-84ab-ce14cb7827bd tempest-CreateVolumesFromSnapshotTest-917122263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-fe683bd4-f454-4081-8221-c692d329cdb9.815fa175-5ed1-4e39-b76a-a010b646d493" returned: 0 in 0.408s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:18:52 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-743b24a5-41a4-4ce4-84ab-ce14cb7827bd tempest-CreateVolumesFromSnapshotTest-917122263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-fe683bd4-f454-4081-8221-c692d329cdb9.815fa175-5ed1-4e39-b76a-a010b646d493 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:18:52 devstack sudo[107493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-fe683bd4-f454-4081-8221-c692d329cdb9.815fa175-5ed1-4e39-b76a-a010b646d493 Sep 07 10:18:52 devstack sudo[107493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:18:52 devstack sudo[107484]: pam_unix(sudo:session): session closed for user root Sep 07 10:18:52 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-04253bf8-ef4c-40b8-b0bd-f6cec095450c tempest-ProjectMemberTests-55037479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-b75542fa-1480-4468-9a57-c0e30515b323.7cbe9941-911e-4a1a-9510-7be0e1aa32d3" returned: 0 in 0.451s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:18:52 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-04253bf8-ef4c-40b8-b0bd-f6cec095450c tempest-ProjectMemberTests-55037479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-b75542fa-1480-4468-9a57-c0e30515b323.7cbe9941-911e-4a1a-9510-7be0e1aa32d3 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:18:52 devstack sudo[107495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-b75542fa-1480-4468-9a57-c0e30515b323.7cbe9941-911e-4a1a-9510-7be0e1aa32d3 Sep 07 10:18:52 devstack sudo[107495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:18:52 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-ac7d3468-e122-4701-8684-940be7851783 tempest-CinderUnicodeTest-250046331 None] Acquiring lock "cinder-fe941684-a9d5-442a-a609-bbdbedac5662-delete_snapshot" by "delete_snapshot" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:18:52 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-ac7d3468-e122-4701-8684-940be7851783 tempest-CinderUnicodeTest-250046331 None] Lock "cinder-fe941684-a9d5-442a-a609-bbdbedac5662-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:18:52 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-ac7d3468-e122-4701-8684-940be7851783 tempest-CinderUnicodeTest-250046331 None] Acquiring lock "cinder-quobyte-35ccd940-cf54-4017-9e2a-e041d7d529c5" by "delete_snapshot" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:18:52 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-ac7d3468-e122-4701-8684-940be7851783 tempest-CinderUnicodeTest-250046331 None] Lock "cinder-quobyte-35ccd940-cf54-4017-9e2a-e041d7d529c5" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:18:52 devstack sudo[107493]: pam_unix(sudo:session): session closed for user root Sep 07 10:18:52 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-ac7d3468-e122-4701-8684-940be7851783 tempest-CinderUnicodeTest-250046331 None] Acquiring lock "cinder-quobyte-fe941684-a9d5-442a-a609-bbdbedac5662" by "_delete_snapshot" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:18:52 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-743b24a5-41a4-4ce4-84ab-ce14cb7827bd tempest-CreateVolumesFromSnapshotTest-917122263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-fe683bd4-f454-4081-8221-c692d329cdb9.815fa175-5ed1-4e39-b76a-a010b646d493" returned: 0 in 0.335s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:18:52 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-ac7d3468-e122-4701-8684-940be7851783 tempest-CinderUnicodeTest-250046331 None] Lock "cinder-quobyte-fe941684-a9d5-442a-a609-bbdbedac5662" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:18:52 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-ac7d3468-e122-4701-8684-940be7851783 tempest-CinderUnicodeTest-250046331 None] Deleting offline snapshot fe941684-a9d5-442a-a609-bbdbedac5662 of volume 35ccd940-cf54-4017-9e2a-e041d7d529c5 {{(pid=87515) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 10:18:52 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-ac7d3468-e122-4701-8684-940be7851783 tempest-CinderUnicodeTest-250046331 None] snapshot_file for this snap is: volume-35ccd940-cf54-4017-9e2a-e041d7d529c5.fe941684-a9d5-442a-a609-bbdbedac5662 {{(pid=87515) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 10:18:52 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[654078b0-bb88-45cc-bce3-a016e4c16323]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:18:52 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-ac7d3468-e122-4701-8684-940be7851783 tempest-CinderUnicodeTest-250046331 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-35ccd940-cf54-4017-9e2a-e041d7d529c5.fe941684-a9d5-442a-a609-bbdbedac5662 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:18:52 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-743b24a5-41a4-4ce4-84ab-ce14cb7827bd tempest-CreateVolumesFromSnapshotTest-917122263 None] Lock "cinder-quobyte-815fa175-5ed1-4e39-b76a-a010b646d493" released by "_delete_snapshot" :: held 1.868s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:18:52 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-743b24a5-41a4-4ce4-84ab-ce14cb7827bd tempest-CreateVolumesFromSnapshotTest-917122263 None] Lock "cinder-quobyte-fe683bd4-f454-4081-8221-c692d329cdb9" released by "delete_snapshot" :: held 1.928s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:18:52 devstack sudo[107495]: pam_unix(sudo:session): session closed for user root Sep 07 10:18:52 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-04253bf8-ef4c-40b8-b0bd-f6cec095450c tempest-ProjectMemberTests-55037479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-b75542fa-1480-4468-9a57-c0e30515b323.7cbe9941-911e-4a1a-9510-7be0e1aa32d3" returned: 0 in 0.334s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:18:52 devstack sudo[107498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-35ccd940-cf54-4017-9e2a-e041d7d529c5.fe941684-a9d5-442a-a609-bbdbedac5662 Sep 07 10:18:52 devstack sudo[107498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:18:52 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-04253bf8-ef4c-40b8-b0bd-f6cec095450c tempest-ProjectMemberTests-55037479 None] Lock "cinder-quobyte-7cbe9941-911e-4a1a-9510-7be0e1aa32d3" released by "_delete_snapshot" :: held 1.918s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:18:52 devstack cinder-volume[87515]: DEBUG cinder.quota [None req-743b24a5-41a4-4ce4-84ab-ce14cb7827bd tempest-CreateVolumesFromSnapshotTest-917122263 None] Created reservations ['75143f24-46ab-4066-b226-1999066fc522', 'b4b11003-d83b-4235-8fd0-ebe32b29fd69', '22358cda-2ac2-46cd-8e94-aa1a37b129aa', '132467a4-665a-4ecb-a24a-981100d0bd99'] {{(pid=87515) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:18:52 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-04253bf8-ef4c-40b8-b0bd-f6cec095450c tempest-ProjectMemberTests-55037479 None] Lock "cinder-quobyte-b75542fa-1480-4468-9a57-c0e30515b323" released by "delete_snapshot" :: held 1.954s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:18:53 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-743b24a5-41a4-4ce4-84ab-ce14cb7827bd tempest-CreateVolumesFromSnapshotTest-917122263 None] Delete snapshot completed successfully. Sep 07 10:18:53 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-743b24a5-41a4-4ce4-84ab-ce14cb7827bd tempest-CreateVolumesFromSnapshotTest-917122263 None] Lock "cinder-815fa175-5ed1-4e39-b76a-a010b646d493-delete_snapshot" released by "delete_snapshot" :: held 2.207s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:18:53 devstack cinder-volume[87515]: DEBUG cinder.quota [None req-04253bf8-ef4c-40b8-b0bd-f6cec095450c tempest-ProjectMemberTests-55037479 None] Created reservations ['2c043015-2bb3-406c-8b10-6747bc5e4f31', 'fbd5c384-8f06-4693-bb8b-10d88cd10857', '9db2b195-c9ad-42d1-8049-7ae3364ba0fa', 'b9f87e4d-96bd-46ff-ad0a-019dc36ae60a'] {{(pid=87515) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:18:53 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-04253bf8-ef4c-40b8-b0bd-f6cec095450c tempest-ProjectMemberTests-55037479 None] Delete snapshot completed successfully. Sep 07 10:18:53 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-04253bf8-ef4c-40b8-b0bd-f6cec095450c tempest-ProjectMemberTests-55037479 None] Lock "cinder-7cbe9941-911e-4a1a-9510-7be0e1aa32d3-delete_snapshot" released by "delete_snapshot" :: held 2.181s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:18:53 devstack sudo[107498]: pam_unix(sudo:session): session closed for user root Sep 07 10:18:53 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-ac7d3468-e122-4701-8684-940be7851783 tempest-CinderUnicodeTest-250046331 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-35ccd940-cf54-4017-9e2a-e041d7d529c5.fe941684-a9d5-442a-a609-bbdbedac5662" returned: 0 in 0.439s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:18:53 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-ac7d3468-e122-4701-8684-940be7851783 tempest-CinderUnicodeTest-250046331 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-35ccd940-cf54-4017-9e2a-e041d7d529c5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87515) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 10:18:53 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[08076027-819c-46ea-beff-112a63bf5104]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:18:53 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-ac7d3468-e122-4701-8684-940be7851783 tempest-CinderUnicodeTest-250046331 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-35ccd940-cf54-4017-9e2a-e041d7d529c5 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:18:53 devstack sudo[107504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-35ccd940-cf54-4017-9e2a-e041d7d529c5 Sep 07 10:18:53 devstack sudo[107504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:18:53 devstack sudo[107504]: pam_unix(sudo:session): session closed for user root Sep 07 10:18:53 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-ac7d3468-e122-4701-8684-940be7851783 tempest-CinderUnicodeTest-250046331 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-35ccd940-cf54-4017-9e2a-e041d7d529c5" returned: 0 in 0.398s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:18:53 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-ac7d3468-e122-4701-8684-940be7851783 tempest-CinderUnicodeTest-250046331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-35ccd940-cf54-4017-9e2a-e041d7d529c5.fe941684-a9d5-442a-a609-bbdbedac5662 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:18:53 devstack sudo[107509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-35ccd940-cf54-4017-9e2a-e041d7d529c5.fe941684-a9d5-442a-a609-bbdbedac5662 Sep 07 10:18:53 devstack sudo[107509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:18:54 devstack sudo[107509]: pam_unix(sudo:session): session closed for user root Sep 07 10:18:54 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-ac7d3468-e122-4701-8684-940be7851783 tempest-CinderUnicodeTest-250046331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-35ccd940-cf54-4017-9e2a-e041d7d529c5.fe941684-a9d5-442a-a609-bbdbedac5662" returned: 0 in 0.385s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:18:54 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-ac7d3468-e122-4701-8684-940be7851783 tempest-CinderUnicodeTest-250046331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-35ccd940-cf54-4017-9e2a-e041d7d529c5.fe941684-a9d5-442a-a609-bbdbedac5662 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:18:54 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-9160500f-e8e0-4443-980d-3194dd27c0f9 tempest-CreateVolumesFromSnapshotTest-917122263 None] Acquiring lock "cinder-fe683bd4-f454-4081-8221-c692d329cdb9-delete_volume" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:18:54 devstack sudo[107514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-35ccd940-cf54-4017-9e2a-e041d7d529c5.fe941684-a9d5-442a-a609-bbdbedac5662 Sep 07 10:18:54 devstack sudo[107514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:18:54 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-9160500f-e8e0-4443-980d-3194dd27c0f9 tempest-CreateVolumesFromSnapshotTest-917122263 None] Lock "cinder-fe683bd4-f454-4081-8221-c692d329cdb9-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:18:54 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-9160500f-e8e0-4443-980d-3194dd27c0f9 tempest-CreateVolumesFromSnapshotTest-917122263 None] Acquiring lock "cinder-quobyte-fe683bd4-f454-4081-8221-c692d329cdb9" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:18:54 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-9160500f-e8e0-4443-980d-3194dd27c0f9 tempest-CreateVolumesFromSnapshotTest-917122263 None] Lock "cinder-quobyte-fe683bd4-f454-4081-8221-c692d329cdb9" acquired by "delete_volume" :: waited 0.026s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:18:54 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-84a3dab9-d1eb-487c-b4fa-46d9b9133ece tempest-ProjectMemberTests-55037479 None] Acquiring lock "cinder-b75542fa-1480-4468-9a57-c0e30515b323-delete_volume" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:18:54 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc1c3862-f602-41fa-ac19-120cc6eee181]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:18:54 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-9160500f-e8e0-4443-980d-3194dd27c0f9 tempest-CreateVolumesFromSnapshotTest-917122263 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-fe683bd4-f454-4081-8221-c692d329cdb9 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:18:54 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-84a3dab9-d1eb-487c-b4fa-46d9b9133ece tempest-ProjectMemberTests-55037479 None] Lock "cinder-b75542fa-1480-4468-9a57-c0e30515b323-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:18:54 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-84a3dab9-d1eb-487c-b4fa-46d9b9133ece tempest-ProjectMemberTests-55037479 None] Acquiring lock "cinder-quobyte-b75542fa-1480-4468-9a57-c0e30515b323" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:18:54 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-84a3dab9-d1eb-487c-b4fa-46d9b9133ece tempest-ProjectMemberTests-55037479 None] Lock "cinder-quobyte-b75542fa-1480-4468-9a57-c0e30515b323" acquired by "delete_volume" :: waited 0.022s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:18:54 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6c0dae6-895d-4123-8901-dacee41fdd8a]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:18:54 devstack sudo[107516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-fe683bd4-f454-4081-8221-c692d329cdb9 Sep 07 10:18:54 devstack sudo[107516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:18:54 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-84a3dab9-d1eb-487c-b4fa-46d9b9133ece tempest-ProjectMemberTests-55037479 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-b75542fa-1480-4468-9a57-c0e30515b323 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:18:54 devstack sudo[107514]: pam_unix(sudo:session): session closed for user root Sep 07 10:18:54 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-ac7d3468-e122-4701-8684-940be7851783 tempest-CinderUnicodeTest-250046331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-35ccd940-cf54-4017-9e2a-e041d7d529c5.fe941684-a9d5-442a-a609-bbdbedac5662" returned: 0 in 0.373s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:18:54 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-ac7d3468-e122-4701-8684-940be7851783 tempest-CinderUnicodeTest-250046331 None] Lock "cinder-quobyte-fe941684-a9d5-442a-a609-bbdbedac5662" released by "_delete_snapshot" :: held 1.742s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:18:54 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-ac7d3468-e122-4701-8684-940be7851783 tempest-CinderUnicodeTest-250046331 None] Lock "cinder-quobyte-35ccd940-cf54-4017-9e2a-e041d7d529c5" released by "delete_snapshot" :: held 1.779s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:18:54 devstack sudo[107519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-b75542fa-1480-4468-9a57-c0e30515b323 Sep 07 10:18:54 devstack sudo[107519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:18:54 devstack cinder-volume[87515]: DEBUG cinder.quota [None req-ac7d3468-e122-4701-8684-940be7851783 tempest-CinderUnicodeTest-250046331 None] Created reservations ['92163b8e-1003-4cc9-853b-fdcbb6785a0e', '87103f7d-3770-4119-ba6e-16e7f68cd363', '436416a9-f17e-4df5-8998-fd5e43955d22', 'c57824f3-1ef5-4703-9157-d58fead78064'] {{(pid=87515) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:18:54 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-ac7d3468-e122-4701-8684-940be7851783 tempest-CinderUnicodeTest-250046331 None] Delete snapshot completed successfully. Sep 07 10:18:54 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-ac7d3468-e122-4701-8684-940be7851783 tempest-CinderUnicodeTest-250046331 None] Lock "cinder-fe941684-a9d5-442a-a609-bbdbedac5662-delete_snapshot" released by "delete_snapshot" :: held 1.983s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:18:54 devstack sudo[107516]: pam_unix(sudo:session): session closed for user root Sep 07 10:18:54 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-9160500f-e8e0-4443-980d-3194dd27c0f9 tempest-CreateVolumesFromSnapshotTest-917122263 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-fe683bd4-f454-4081-8221-c692d329cdb9" returned: 0 in 0.482s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:18:54 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-9160500f-e8e0-4443-980d-3194dd27c0f9 tempest-CreateVolumesFromSnapshotTest-917122263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-fe683bd4-f454-4081-8221-c692d329cdb9 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:18:54 devstack sudo[107524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-fe683bd4-f454-4081-8221-c692d329cdb9 Sep 07 10:18:54 devstack sudo[107524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:18:54 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-c97b478d-849a-4626-abbc-15d73506e049 tempest-CinderUnicodeTest-250046331 None] Acquiring lock "cinder-35ccd940-cf54-4017-9e2a-e041d7d529c5-delete_volume" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:18:54 devstack sudo[107519]: pam_unix(sudo:session): session closed for user root Sep 07 10:18:54 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-c97b478d-849a-4626-abbc-15d73506e049 tempest-CinderUnicodeTest-250046331 None] Lock "cinder-35ccd940-cf54-4017-9e2a-e041d7d529c5-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:18:54 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-84a3dab9-d1eb-487c-b4fa-46d9b9133ece tempest-ProjectMemberTests-55037479 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-b75542fa-1480-4468-9a57-c0e30515b323" returned: 0 in 0.490s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:18:54 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-84a3dab9-d1eb-487c-b4fa-46d9b9133ece tempest-ProjectMemberTests-55037479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-b75542fa-1480-4468-9a57-c0e30515b323 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:18:54 devstack sudo[107529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-b75542fa-1480-4468-9a57-c0e30515b323 Sep 07 10:18:54 devstack sudo[107529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:18:54 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-c97b478d-849a-4626-abbc-15d73506e049 tempest-CinderUnicodeTest-250046331 None] Acquiring lock "cinder-quobyte-35ccd940-cf54-4017-9e2a-e041d7d529c5" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:18:55 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-c97b478d-849a-4626-abbc-15d73506e049 tempest-CinderUnicodeTest-250046331 None] Lock "cinder-quobyte-35ccd940-cf54-4017-9e2a-e041d7d529c5" acquired by "delete_volume" :: waited 0.024s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:18:55 devstack sudo[107524]: pam_unix(sudo:session): session closed for user root Sep 07 10:18:55 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[064ea9d2-7245-4eaf-92e6-1dd5577128be]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:18:55 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-c97b478d-849a-4626-abbc-15d73506e049 tempest-CinderUnicodeTest-250046331 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-35ccd940-cf54-4017-9e2a-e041d7d529c5 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:18:55 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-9160500f-e8e0-4443-980d-3194dd27c0f9 tempest-CreateVolumesFromSnapshotTest-917122263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-fe683bd4-f454-4081-8221-c692d329cdb9" returned: 0 in 0.314s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:18:55 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-9160500f-e8e0-4443-980d-3194dd27c0f9 tempest-CreateVolumesFromSnapshotTest-917122263 None] Lock "cinder-quobyte-fe683bd4-f454-4081-8221-c692d329cdb9" released by "delete_volume" :: held 0.890s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:18:55 devstack cinder-volume[87515]: DEBUG cinder.quota [None req-9160500f-e8e0-4443-980d-3194dd27c0f9 tempest-CreateVolumesFromSnapshotTest-917122263 None] Created reservations ['d69e8ed6-a1f3-45b4-9728-d7f233a4a65c', 'c82edb7e-3111-42c0-8c84-15d31385c0d4', 'acb9a526-77fb-4c46-b455-68e4d2f5c0d9', '0bc85a57-5c03-4eb2-b787-930346120b2a'] {{(pid=87515) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:18:55 devstack sudo[107532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-35ccd940-cf54-4017-9e2a-e041d7d529c5 Sep 07 10:18:55 devstack sudo[107532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:18:55 devstack sudo[107529]: pam_unix(sudo:session): session closed for user root Sep 07 10:18:55 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-9160500f-e8e0-4443-980d-3194dd27c0f9 tempest-CreateVolumesFromSnapshotTest-917122263 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:18:55 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-9160500f-e8e0-4443-980d-3194dd27c0f9 tempest-CreateVolumesFromSnapshotTest-917122263 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:18:55 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-9160500f-e8e0-4443-980d-3194dd27c0f9 tempest-CreateVolumesFromSnapshotTest-917122263 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:18:55 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-9160500f-e8e0-4443-980d-3194dd27c0f9 tempest-CreateVolumesFromSnapshotTest-917122263 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:18:55 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-9160500f-e8e0-4443-980d-3194dd27c0f9 tempest-CreateVolumesFromSnapshotTest-917122263 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:18:55 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-9160500f-e8e0-4443-980d-3194dd27c0f9 tempest-CreateVolumesFromSnapshotTest-917122263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:18:55 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-84a3dab9-d1eb-487c-b4fa-46d9b9133ece tempest-ProjectMemberTests-55037479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-b75542fa-1480-4468-9a57-c0e30515b323" returned: 0 in 0.359s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:18:55 devstack sudo[107535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a Sep 07 10:18:55 devstack sudo[107535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:18:55 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-84a3dab9-d1eb-487c-b4fa-46d9b9133ece tempest-ProjectMemberTests-55037479 None] Lock "cinder-quobyte-b75542fa-1480-4468-9a57-c0e30515b323" released by "delete_volume" :: held 0.952s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:18:55 devstack cinder-volume[87515]: DEBUG cinder.quota [None req-84a3dab9-d1eb-487c-b4fa-46d9b9133ece tempest-ProjectMemberTests-55037479 None] Created reservations ['8ef6c63c-647c-4681-8015-52b3fb763dba', '02885193-31d6-416f-b232-222ab8e01a05', 'b600864f-07a9-444b-bea3-2780d60b3e4c', '708413f4-590a-46f2-a04b-be8c14389e25'] {{(pid=87515) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:18:55 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-84a3dab9-d1eb-487c-b4fa-46d9b9133ece tempest-ProjectMemberTests-55037479 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:18:55 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-84a3dab9-d1eb-487c-b4fa-46d9b9133ece tempest-ProjectMemberTests-55037479 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:18:55 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-84a3dab9-d1eb-487c-b4fa-46d9b9133ece tempest-ProjectMemberTests-55037479 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:18:55 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-84a3dab9-d1eb-487c-b4fa-46d9b9133ece tempest-ProjectMemberTests-55037479 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:18:55 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-84a3dab9-d1eb-487c-b4fa-46d9b9133ece tempest-ProjectMemberTests-55037479 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:18:55 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-84a3dab9-d1eb-487c-b4fa-46d9b9133ece tempest-ProjectMemberTests-55037479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:18:55 devstack sudo[107540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a Sep 07 10:18:55 devstack sudo[107540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:18:55 devstack sudo[107532]: pam_unix(sudo:session): session closed for user root Sep 07 10:18:55 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-c97b478d-849a-4626-abbc-15d73506e049 tempest-CinderUnicodeTest-250046331 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-35ccd940-cf54-4017-9e2a-e041d7d529c5" returned: 0 in 0.577s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:18:55 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-c97b478d-849a-4626-abbc-15d73506e049 tempest-CinderUnicodeTest-250046331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-35ccd940-cf54-4017-9e2a-e041d7d529c5 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:18:55 devstack sudo[107535]: pam_unix(sudo:session): session closed for user root Sep 07 10:18:55 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-9160500f-e8e0-4443-980d-3194dd27c0f9 tempest-CreateVolumesFromSnapshotTest-917122263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a" returned: 0 in 0.391s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:18:55 devstack cinder-volume[87515]: DEBUG cinder.manager [None req-9160500f-e8e0-4443-980d-3194dd27c0f9 tempest-CreateVolumesFromSnapshotTest-917122263 None] Notifying Schedulers of capabilities ... {{(pid=87515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:18:55 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-9160500f-e8e0-4443-980d-3194dd27c0f9 tempest-CreateVolumesFromSnapshotTest-917122263 None] Deleted volume successfully. Sep 07 10:18:55 devstack sudo[107543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-35ccd940-cf54-4017-9e2a-e041d7d529c5 Sep 07 10:18:55 devstack sudo[107543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:18:55 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-9160500f-e8e0-4443-980d-3194dd27c0f9 tempest-CreateVolumesFromSnapshotTest-917122263 None] Lock "cinder-fe683bd4-f454-4081-8221-c692d329cdb9-delete_volume" released by "delete_volume" :: held 1.577s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:18:55 devstack sudo[107540]: pam_unix(sudo:session): session closed for user root Sep 07 10:18:55 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-84a3dab9-d1eb-487c-b4fa-46d9b9133ece tempest-ProjectMemberTests-55037479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a" returned: 0 in 0.337s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:18:55 devstack cinder-volume[87515]: DEBUG cinder.manager [None req-84a3dab9-d1eb-487c-b4fa-46d9b9133ece tempest-ProjectMemberTests-55037479 None] Notifying Schedulers of capabilities ... {{(pid=87515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:18:55 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-84a3dab9-d1eb-487c-b4fa-46d9b9133ece tempest-ProjectMemberTests-55037479 None] Deleted volume successfully. Sep 07 10:18:55 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-84a3dab9-d1eb-487c-b4fa-46d9b9133ece tempest-ProjectMemberTests-55037479 None] Lock "cinder-b75542fa-1480-4468-9a57-c0e30515b323-delete_volume" released by "delete_volume" :: held 1.659s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:18:55 devstack sudo[107543]: pam_unix(sudo:session): session closed for user root Sep 07 10:18:55 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-c97b478d-849a-4626-abbc-15d73506e049 tempest-CinderUnicodeTest-250046331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-35ccd940-cf54-4017-9e2a-e041d7d529c5" returned: 0 in 0.337s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:18:55 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-c97b478d-849a-4626-abbc-15d73506e049 tempest-CinderUnicodeTest-250046331 None] Lock "cinder-quobyte-35ccd940-cf54-4017-9e2a-e041d7d529c5" released by "delete_volume" :: held 0.987s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:18:56 devstack cinder-volume[87515]: DEBUG cinder.quota [None req-c97b478d-849a-4626-abbc-15d73506e049 tempest-CinderUnicodeTest-250046331 None] Created reservations ['b8c61c7a-4afa-4069-9f7b-a08c32383850', '3332368b-1e79-4781-ae2c-19aa47e6a952', 'dd6734bc-dc15-4632-9b7c-13eaa6cac2e6', 'cf975c23-4e36-4e94-a649-49b6c123be3e'] {{(pid=87515) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:18:56 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-c97b478d-849a-4626-abbc-15d73506e049 tempest-CinderUnicodeTest-250046331 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:18:56 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-c97b478d-849a-4626-abbc-15d73506e049 tempest-CinderUnicodeTest-250046331 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:18:56 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-c97b478d-849a-4626-abbc-15d73506e049 tempest-CinderUnicodeTest-250046331 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:18:56 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-c97b478d-849a-4626-abbc-15d73506e049 tempest-CinderUnicodeTest-250046331 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:18:56 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-c97b478d-849a-4626-abbc-15d73506e049 tempest-CinderUnicodeTest-250046331 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:18:56 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-c97b478d-849a-4626-abbc-15d73506e049 tempest-CinderUnicodeTest-250046331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:18:56 devstack sudo[107547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a Sep 07 10:18:56 devstack sudo[107547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:18:56 devstack sudo[107547]: pam_unix(sudo:session): session closed for user root Sep 07 10:18:56 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-c97b478d-849a-4626-abbc-15d73506e049 tempest-CinderUnicodeTest-250046331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a" returned: 0 in 0.268s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:18:56 devstack cinder-volume[87515]: DEBUG cinder.manager [None req-c97b478d-849a-4626-abbc-15d73506e049 tempest-CinderUnicodeTest-250046331 None] Notifying Schedulers of capabilities ... {{(pid=87515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:18:56 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-c97b478d-849a-4626-abbc-15d73506e049 tempest-CinderUnicodeTest-250046331 None] Deleted volume successfully. Sep 07 10:18:56 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-c97b478d-849a-4626-abbc-15d73506e049 tempest-CinderUnicodeTest-250046331 None] Lock "cinder-35ccd940-cf54-4017-9e2a-e041d7d529c5-delete_volume" released by "delete_volume" :: held 1.540s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:18:57 devstack cinder-volume[87515]: DEBUG cinder.volume.flows.manager.create_volume [None req-5ad238bd-73e8-419e-8fca-79337ffeb40b tempest-ProjectMemberTests-55037479 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 10:18:57 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-5ad238bd-73e8-419e-8fca-79337ffeb40b tempest-ProjectMemberTests-55037479 None] Flow 'volume_create_manager' (17ee7ae6-df3a-40f6-9f61-1be039fc0065) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:18:57 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-5ad238bd-73e8-419e-8fca-79337ffeb40b tempest-ProjectMemberTests-55037479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (928043de-56ce-4117-819c-83c037500cad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:18:57 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-5ad238bd-73e8-419e-8fca-79337ffeb40b tempest-ProjectMemberTests-55037479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (928043de-56ce-4117-819c-83c037500cad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:18:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1168600857',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b746f62-d86d-45c5-b625-310369791588,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41fa4493d2f045dc87793bd97d931cff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:18:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:18:57Z,use_quota=True,user_id='5136aa4e2a7c4a1da79d4e4478cdcbf6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3a092cd-7947-4cbf-abff-4ba9567becf0),volume_type_id=f3a092cd-7947-4cbf-abff-4ba9567becf0)' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:18:57 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-5ad238bd-73e8-419e-8fca-79337ffeb40b tempest-ProjectMemberTests-55037479 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a1b9577-33b4-4dab-b720-6c7fdc9c726f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:18:57 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-5ad238bd-73e8-419e-8fca-79337ffeb40b tempest-ProjectMemberTests-55037479 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a1b9577-33b4-4dab-b720-6c7fdc9c726f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:18:57 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-5ad238bd-73e8-419e-8fca-79337ffeb40b tempest-ProjectMemberTests-55037479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af7158da-5416-4fa3-be76-12fbad568557) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:18:57 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-5ad238bd-73e8-419e-8fca-79337ffeb40b tempest-ProjectMemberTests-55037479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af7158da-5416-4fa3-be76-12fbad568557) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7b746f62-d86d-45c5-b625-310369791588', 'volume_name': 'volume-7b746f62-d86d-45c5-b625-310369791588', 'volume_size': 1}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:18:57 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-5ad238bd-73e8-419e-8fca-79337ffeb40b tempest-ProjectMemberTests-55037479 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3435a2e-15a0-4a07-b2cf-13200fb3813a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:18:57 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-5ad238bd-73e8-419e-8fca-79337ffeb40b tempest-ProjectMemberTests-55037479 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3435a2e-15a0-4a07-b2cf-13200fb3813a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:18:57 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-5ad238bd-73e8-419e-8fca-79337ffeb40b tempest-ProjectMemberTests-55037479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (321cdb42-268b-47de-a3b6-2467e3bf1a34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:18:57 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-5ad238bd-73e8-419e-8fca-79337ffeb40b tempest-ProjectMemberTests-55037479 None] Volume 7b746f62-d86d-45c5-b625-310369791588: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7b746f62-d86d-45c5-b625-310369791588', 'volume_size': 1} Sep 07 10:18:57 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-5ad238bd-73e8-419e-8fca-79337ffeb40b tempest-ProjectMemberTests-55037479 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:18:57 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-5ad238bd-73e8-419e-8fca-79337ffeb40b tempest-ProjectMemberTests-55037479 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:18:57 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-5ad238bd-73e8-419e-8fca-79337ffeb40b tempest-ProjectMemberTests-55037479 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:18:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1168600857',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b746f62-d86d-45c5-b625-310369791588,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41fa4493d2f045dc87793bd97d931cff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:18:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:18:57Z,use_quota=True,user_id='5136aa4e2a7c4a1da79d4e4478cdcbf6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3a092cd-7947-4cbf-abff-4ba9567becf0),volume_type_id=f3a092cd-7947-4cbf-abff-4ba9567becf0)}" {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 10:18:57 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-5ad238bd-73e8-419e-8fca-79337ffeb40b tempest-ProjectMemberTests-55037479 None] Creating volume 7b746f62-d86d-45c5-b625-310369791588 {{(pid=87515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 10:18:57 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-5ad238bd-73e8-419e-8fca-79337ffeb40b tempest-ProjectMemberTests-55037479 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:18:57 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-5ad238bd-73e8-419e-8fca-79337ffeb40b tempest-ProjectMemberTests-55037479 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:18:57 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-5ad238bd-73e8-419e-8fca-79337ffeb40b tempest-ProjectMemberTests-55037479 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:18:57 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-5ad238bd-73e8-419e-8fca-79337ffeb40b tempest-ProjectMemberTests-55037479 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:18:57 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-5ad238bd-73e8-419e-8fca-79337ffeb40b tempest-ProjectMemberTests-55037479 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:18:57 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-5ad238bd-73e8-419e-8fca-79337ffeb40b tempest-ProjectMemberTests-55037479 None] Selected osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c as target Quobyte volume. {{(pid=87515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 10:18:57 devstack cinder-volume[87515]: INFO cinder.volume.drivers.remotefs [None req-5ad238bd-73e8-419e-8fca-79337ffeb40b tempest-ProjectMemberTests-55037479 None] casted to osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c Sep 07 10:18:57 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-5ad238bd-73e8-419e-8fca-79337ffeb40b tempest-ProjectMemberTests-55037479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-7b746f62-d86d-45c5-b625-310369791588 1073741824 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:18:57 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-349b8eb5-c072-4de1-8f07-2441ad6b5347 tempest-CinderUnicodeTest-250046331 None] Acquiring lock "cinder-da7b9c60-5425-4407-a7e0-e5173e400dd6-delete_volume" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:18:57 devstack sudo[107550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-7b746f62-d86d-45c5-b625-310369791588 1073741824 Sep 07 10:18:57 devstack sudo[107550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:18:57 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-349b8eb5-c072-4de1-8f07-2441ad6b5347 tempest-CinderUnicodeTest-250046331 None] Lock "cinder-da7b9c60-5425-4407-a7e0-e5173e400dd6-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:18:57 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-349b8eb5-c072-4de1-8f07-2441ad6b5347 tempest-CinderUnicodeTest-250046331 None] Acquiring lock "cinder-quobyte-da7b9c60-5425-4407-a7e0-e5173e400dd6" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:18:57 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-349b8eb5-c072-4de1-8f07-2441ad6b5347 tempest-CinderUnicodeTest-250046331 None] Lock "cinder-quobyte-da7b9c60-5425-4407-a7e0-e5173e400dd6" acquired by "delete_volume" :: waited 0.021s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:18:57 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[01452c28-2d5c-4211-9e60-46d07cce2051]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:18:57 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-349b8eb5-c072-4de1-8f07-2441ad6b5347 tempest-CinderUnicodeTest-250046331 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-da7b9c60-5425-4407-a7e0-e5173e400dd6 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:18:57 devstack sudo[107552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-da7b9c60-5425-4407-a7e0-e5173e400dd6 Sep 07 10:18:57 devstack sudo[107552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:18:57 devstack sudo[107550]: pam_unix(sudo:session): session closed for user root Sep 07 10:18:57 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-5ad238bd-73e8-419e-8fca-79337ffeb40b tempest-ProjectMemberTests-55037479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-7b746f62-d86d-45c5-b625-310369791588 1073741824" returned: 0 in 0.589s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:18:57 devstack sudo[107552]: pam_unix(sudo:session): session closed for user root Sep 07 10:18:57 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-349b8eb5-c072-4de1-8f07-2441ad6b5347 tempest-CinderUnicodeTest-250046331 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-da7b9c60-5425-4407-a7e0-e5173e400dd6" returned: 0 in 0.429s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:18:57 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-349b8eb5-c072-4de1-8f07-2441ad6b5347 tempest-CinderUnicodeTest-250046331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-da7b9c60-5425-4407-a7e0-e5173e400dd6 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:18:57 devstack sudo[107561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-da7b9c60-5425-4407-a7e0-e5173e400dd6 Sep 07 10:18:57 devstack sudo[107561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:18:57 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-5ad238bd-73e8-419e-8fca-79337ffeb40b tempest-ProjectMemberTests-55037479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-7b746f62-d86d-45c5-b625-310369791588 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:18:57 devstack sudo[107563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-7b746f62-d86d-45c5-b625-310369791588 Sep 07 10:18:57 devstack sudo[107563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:18:58 devstack sudo[107561]: pam_unix(sudo:session): session closed for user root Sep 07 10:18:58 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-349b8eb5-c072-4de1-8f07-2441ad6b5347 tempest-CinderUnicodeTest-250046331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-da7b9c60-5425-4407-a7e0-e5173e400dd6" returned: 0 in 0.355s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:18:58 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-349b8eb5-c072-4de1-8f07-2441ad6b5347 tempest-CinderUnicodeTest-250046331 None] Lock "cinder-quobyte-da7b9c60-5425-4407-a7e0-e5173e400dd6" released by "delete_volume" :: held 0.835s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:18:58 devstack sudo[107563]: pam_unix(sudo:session): session closed for user root Sep 07 10:18:58 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-5ad238bd-73e8-419e-8fca-79337ffeb40b tempest-ProjectMemberTests-55037479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-7b746f62-d86d-45c5-b625-310369791588" returned: 0 in 0.330s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:18:58 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-5ad238bd-73e8-419e-8fca-79337ffeb40b tempest-ProjectMemberTests-55037479 None] <== create_volume: return (1009ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'} {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 10:18:58 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-5ad238bd-73e8-419e-8fca-79337ffeb40b tempest-ProjectMemberTests-55037479 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.011s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:18:58 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-5ad238bd-73e8-419e-8fca-79337ffeb40b tempest-ProjectMemberTests-55037479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (321cdb42-268b-47de-a3b6-2467e3bf1a34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7b746f62-d86d-45c5-b625-310369791588', 'volume_size': 1}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:18:58 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-5ad238bd-73e8-419e-8fca-79337ffeb40b tempest-ProjectMemberTests-55037479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc11832d-7c92-472a-b734-c2071a289766) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:18:58 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-5ad238bd-73e8-419e-8fca-79337ffeb40b tempest-ProjectMemberTests-55037479 None] Volume volume-7b746f62-d86d-45c5-b625-310369791588 (7b746f62-d86d-45c5-b625-310369791588): created successfully Sep 07 10:18:58 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-5ad238bd-73e8-419e-8fca-79337ffeb40b tempest-ProjectMemberTests-55037479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc11832d-7c92-472a-b734-c2071a289766) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:18:58 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-5ad238bd-73e8-419e-8fca-79337ffeb40b tempest-ProjectMemberTests-55037479 None] Flow 'volume_create_manager' (17ee7ae6-df3a-40f6-9f61-1be039fc0065) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:18:58 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-5ad238bd-73e8-419e-8fca-79337ffeb40b tempest-ProjectMemberTests-55037479 None] Created volume successfully. Sep 07 10:18:58 devstack cinder-volume[87515]: DEBUG cinder.quota [None req-349b8eb5-c072-4de1-8f07-2441ad6b5347 tempest-CinderUnicodeTest-250046331 None] Created reservations ['7b0f2c54-6027-4f2a-9909-eb2e270c7482', '3c3471c8-e9a5-4263-9b98-493be3064e04', '7aeda240-1562-4861-9107-2d39ad2d0b85', 'df6f99bf-b4b7-4281-b14a-bbda0f672b32'] {{(pid=87515) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:18:58 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-349b8eb5-c072-4de1-8f07-2441ad6b5347 tempest-CinderUnicodeTest-250046331 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:18:58 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-349b8eb5-c072-4de1-8f07-2441ad6b5347 tempest-CinderUnicodeTest-250046331 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:18:58 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-349b8eb5-c072-4de1-8f07-2441ad6b5347 tempest-CinderUnicodeTest-250046331 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:18:58 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-349b8eb5-c072-4de1-8f07-2441ad6b5347 tempest-CinderUnicodeTest-250046331 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:18:58 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-349b8eb5-c072-4de1-8f07-2441ad6b5347 tempest-CinderUnicodeTest-250046331 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:18:58 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-349b8eb5-c072-4de1-8f07-2441ad6b5347 tempest-CinderUnicodeTest-250046331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:18:58 devstack sudo[107567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a Sep 07 10:18:58 devstack sudo[107567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:18:58 devstack sudo[107567]: pam_unix(sudo:session): session closed for user root Sep 07 10:18:58 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-349b8eb5-c072-4de1-8f07-2441ad6b5347 tempest-CinderUnicodeTest-250046331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a" returned: 0 in 0.312s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:18:58 devstack cinder-volume[87515]: DEBUG cinder.manager [None req-349b8eb5-c072-4de1-8f07-2441ad6b5347 tempest-CinderUnicodeTest-250046331 None] Notifying Schedulers of capabilities ... {{(pid=87515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:18:58 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-349b8eb5-c072-4de1-8f07-2441ad6b5347 tempest-CinderUnicodeTest-250046331 None] Deleted volume successfully. Sep 07 10:18:58 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-349b8eb5-c072-4de1-8f07-2441ad6b5347 tempest-CinderUnicodeTest-250046331 None] Lock "cinder-da7b9c60-5425-4407-a7e0-e5173e400dd6-delete_volume" released by "delete_volume" :: held 1.468s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:18:59 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-e067206a-ee2a-422f-b3d2-e4d541854bdf tempest-ProjectMemberTests-55037479 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:18:59 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-e067206a-ee2a-422f-b3d2-e4d541854bdf tempest-ProjectMemberTests-55037479 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:18:59 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-e067206a-ee2a-422f-b3d2-e4d541854bdf tempest-ProjectMemberTests-55037479 None] Creating offline snapshot 146294f2-8ff9-471c-b652-4fd307a0de5f of volume 7b746f62-d86d-45c5-b625-310369791588 {{(pid=87515) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 10:18:59 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8f9b1d6-0a6b-442c-ae0f-fe06a993f93e]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:18:59 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-e067206a-ee2a-422f-b3d2-e4d541854bdf tempest-ProjectMemberTests-55037479 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-7b746f62-d86d-45c5-b625-310369791588 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:18:59 devstack sudo[107571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-7b746f62-d86d-45c5-b625-310369791588 Sep 07 10:18:59 devstack sudo[107571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:18:59 devstack sudo[107571]: pam_unix(sudo:session): session closed for user root Sep 07 10:18:59 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-e067206a-ee2a-422f-b3d2-e4d541854bdf tempest-ProjectMemberTests-55037479 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-7b746f62-d86d-45c5-b625-310369791588" returned: 0 in 0.471s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:18:59 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-e067206a-ee2a-422f-b3d2-e4d541854bdf tempest-ProjectMemberTests-55037479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-7b746f62-d86d-45c5-b625-310369791588,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-7b746f62-d86d-45c5-b625-310369791588.146294f2-8ff9-471c-b652-4fd307a0de5f 1G {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:19:00 devstack sudo[107577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-7b746f62-d86d-45c5-b625-310369791588,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-7b746f62-d86d-45c5-b625-310369791588.146294f2-8ff9-471c-b652-4fd307a0de5f 1G Sep 07 10:19:00 devstack sudo[107577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:19:00 devstack sudo[107577]: pam_unix(sudo:session): session closed for user root Sep 07 10:19:00 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-e067206a-ee2a-422f-b3d2-e4d541854bdf tempest-ProjectMemberTests-55037479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-7b746f62-d86d-45c5-b625-310369791588,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-7b746f62-d86d-45c5-b625-310369791588.146294f2-8ff9-471c-b652-4fd307a0de5f 1G" returned: 0 in 0.582s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:19:00 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-e067206a-ee2a-422f-b3d2-e4d541854bdf tempest-ProjectMemberTests-55037479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7b746f62-d86d-45c5-b625-310369791588 -F qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-7b746f62-d86d-45c5-b625-310369791588.146294f2-8ff9-471c-b652-4fd307a0de5f {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:19:00 devstack sudo[107584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7b746f62-d86d-45c5-b625-310369791588 -F qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-7b746f62-d86d-45c5-b625-310369791588.146294f2-8ff9-471c-b652-4fd307a0de5f Sep 07 10:19:00 devstack sudo[107584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:19:00 devstack cinder-volume[87515]: DEBUG dbcounter [-] [87515] Writing DB stats cinder:SELECT=230,cinder:UPDATE=301,cinder:DELETE=28,cinder:INSERT=79 {{(pid=87515) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 10:19:00 devstack cinder-volume[87515]: DEBUG dbcounter [-] [87515] Writing DB stats cinder:SELECT=212,cinder:UPDATE=298,cinder:INSERT=81,cinder:DELETE=25 {{(pid=87515) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 10:19:00 devstack cinder-volume[87515]: DEBUG cinder.volume.flows.manager.create_volume [None req-2b592ef1-fd6b-4305-9c5d-40f154c4a091 tempest-ProjectReaderTests-205404938 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 10:19:00 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-2b592ef1-fd6b-4305-9c5d-40f154c4a091 tempest-ProjectReaderTests-205404938 None] Flow 'volume_create_manager' (704bdd2a-c35e-436d-b3ae-507be6e798dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:19:00 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-2b592ef1-fd6b-4305-9c5d-40f154c4a091 tempest-ProjectReaderTests-205404938 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ba2e6a6-7d32-4523-abfb-8f44ed38a8c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:19:00 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-2b592ef1-fd6b-4305-9c5d-40f154c4a091 tempest-ProjectReaderTests-205404938 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ba2e6a6-7d32-4523-abfb-8f44ed38a8c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:19:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-227175216',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de32ff69-077e-471c-9324-1e03e6121368,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4bd49c4be7a74648ab6f55922f0638c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:19:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:19:01Z,use_quota=True,user_id='0477ac649f0140bf9c034ba6d1a49938',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3a092cd-7947-4cbf-abff-4ba9567becf0),volume_type_id=f3a092cd-7947-4cbf-abff-4ba9567becf0)' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:19:00 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-2b592ef1-fd6b-4305-9c5d-40f154c4a091 tempest-ProjectReaderTests-205404938 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c70be2d-a9ef-4d5a-8204-15e2c3087c42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:19:00 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-2b592ef1-fd6b-4305-9c5d-40f154c4a091 tempest-ProjectReaderTests-205404938 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c70be2d-a9ef-4d5a-8204-15e2c3087c42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:19:00 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-2b592ef1-fd6b-4305-9c5d-40f154c4a091 tempest-ProjectReaderTests-205404938 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (512e2d8f-9477-4eef-9107-232294e78039) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:19:00 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-2b592ef1-fd6b-4305-9c5d-40f154c4a091 tempest-ProjectReaderTests-205404938 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (512e2d8f-9477-4eef-9107-232294e78039) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'de32ff69-077e-471c-9324-1e03e6121368', 'volume_name': 'volume-de32ff69-077e-471c-9324-1e03e6121368', 'volume_size': 1}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:19:00 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-2b592ef1-fd6b-4305-9c5d-40f154c4a091 tempest-ProjectReaderTests-205404938 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (070c3a6c-b2da-43c9-ba2c-41050c430203) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:19:00 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-2b592ef1-fd6b-4305-9c5d-40f154c4a091 tempest-ProjectReaderTests-205404938 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (070c3a6c-b2da-43c9-ba2c-41050c430203) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:19:00 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-2b592ef1-fd6b-4305-9c5d-40f154c4a091 tempest-ProjectReaderTests-205404938 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f46a750-26f3-467d-99b9-4cc1b2d8dc75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:19:00 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-2b592ef1-fd6b-4305-9c5d-40f154c4a091 tempest-ProjectReaderTests-205404938 None] Volume de32ff69-077e-471c-9324-1e03e6121368: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-de32ff69-077e-471c-9324-1e03e6121368', 'volume_size': 1} Sep 07 10:19:00 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-2b592ef1-fd6b-4305-9c5d-40f154c4a091 tempest-ProjectReaderTests-205404938 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:19:00 devstack sudo[107584]: pam_unix(sudo:session): session closed for user root Sep 07 10:19:00 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-e067206a-ee2a-422f-b3d2-e4d541854bdf tempest-ProjectMemberTests-55037479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7b746f62-d86d-45c5-b625-310369791588 -F qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-7b746f62-d86d-45c5-b625-310369791588.146294f2-8ff9-471c-b652-4fd307a0de5f" returned: 0 in 0.435s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:19:00 devstack cinder-volume[87515]: WARNING cinder.volume.drivers.remotefs [None req-e067206a-ee2a-422f-b3d2-e4d541854bdf tempest-ProjectMemberTests-55037479 None] /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-7b746f62-d86d-45c5-b625-310369791588.146294f2-8ff9-471c-b652-4fd307a0de5f is being set with open permissions: ugo+rw Sep 07 10:19:00 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-e067206a-ee2a-422f-b3d2-e4d541854bdf tempest-ProjectMemberTests-55037479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-7b746f62-d86d-45c5-b625-310369791588.146294f2-8ff9-471c-b652-4fd307a0de5f {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:19:01 devstack sudo[107589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-7b746f62-d86d-45c5-b625-310369791588.146294f2-8ff9-471c-b652-4fd307a0de5f Sep 07 10:19:01 devstack sudo[107589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:19:01 devstack sudo[107589]: pam_unix(sudo:session): session closed for user root Sep 07 10:19:01 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-e067206a-ee2a-422f-b3d2-e4d541854bdf tempest-ProjectMemberTests-55037479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-7b746f62-d86d-45c5-b625-310369791588.146294f2-8ff9-471c-b652-4fd307a0de5f" returned: 0 in 0.280s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:19:01 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-e067206a-ee2a-422f-b3d2-e4d541854bdf tempest-ProjectMemberTests-55037479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-7b746f62-d86d-45c5-b625-310369791588.info {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:19:01 devstack sudo[107592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-7b746f62-d86d-45c5-b625-310369791588.info Sep 07 10:19:01 devstack sudo[107592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:19:01 devstack sudo[107592]: pam_unix(sudo:session): session closed for user root Sep 07 10:19:01 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-e067206a-ee2a-422f-b3d2-e4d541854bdf tempest-ProjectMemberTests-55037479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-7b746f62-d86d-45c5-b625-310369791588.info" returned: 0 in 0.290s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:19:01 devstack cinder-volume[87515]: WARNING cinder.volume.drivers.remotefs [None req-e067206a-ee2a-422f-b3d2-e4d541854bdf tempest-ProjectMemberTests-55037479 None] /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-7b746f62-d86d-45c5-b625-310369791588.info is being set with open permissions: ugo+rw Sep 07 10:19:01 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-e067206a-ee2a-422f-b3d2-e4d541854bdf tempest-ProjectMemberTests-55037479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-7b746f62-d86d-45c5-b625-310369791588.info {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:19:01 devstack sudo[107595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-7b746f62-d86d-45c5-b625-310369791588.info Sep 07 10:19:01 devstack sudo[107595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:19:01 devstack sudo[107595]: pam_unix(sudo:session): session closed for user root Sep 07 10:19:01 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-e067206a-ee2a-422f-b3d2-e4d541854bdf tempest-ProjectMemberTests-55037479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-7b746f62-d86d-45c5-b625-310369791588.info" returned: 0 in 0.266s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:19:01 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-e067206a-ee2a-422f-b3d2-e4d541854bdf tempest-ProjectMemberTests-55037479 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.417s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:19:01 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-2b592ef1-fd6b-4305-9c5d-40f154c4a091 tempest-ProjectReaderTests-205404938 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.903s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:19:01 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-2b592ef1-fd6b-4305-9c5d-40f154c4a091 tempest-ProjectReaderTests-205404938 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:19:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-227175216',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de32ff69-077e-471c-9324-1e03e6121368,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4bd49c4be7a74648ab6f55922f0638c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:19:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:19:01Z,use_quota=True,user_id='0477ac649f0140bf9c034ba6d1a49938',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3a092cd-7947-4cbf-abff-4ba9567becf0),volume_type_id=f3a092cd-7947-4cbf-abff-4ba9567becf0)}" {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 10:19:01 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-2b592ef1-fd6b-4305-9c5d-40f154c4a091 tempest-ProjectReaderTests-205404938 None] Creating volume de32ff69-077e-471c-9324-1e03e6121368 {{(pid=87515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 10:19:01 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-2b592ef1-fd6b-4305-9c5d-40f154c4a091 tempest-ProjectReaderTests-205404938 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:19:01 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-2b592ef1-fd6b-4305-9c5d-40f154c4a091 tempest-ProjectReaderTests-205404938 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:19:01 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-2b592ef1-fd6b-4305-9c5d-40f154c4a091 tempest-ProjectReaderTests-205404938 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:19:01 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-2b592ef1-fd6b-4305-9c5d-40f154c4a091 tempest-ProjectReaderTests-205404938 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:19:01 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-2b592ef1-fd6b-4305-9c5d-40f154c4a091 tempest-ProjectReaderTests-205404938 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:19:01 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-2b592ef1-fd6b-4305-9c5d-40f154c4a091 tempest-ProjectReaderTests-205404938 None] Selected osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c as target Quobyte volume. {{(pid=87515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 10:19:01 devstack cinder-volume[87515]: INFO cinder.volume.drivers.remotefs [None req-2b592ef1-fd6b-4305-9c5d-40f154c4a091 tempest-ProjectReaderTests-205404938 None] casted to osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c Sep 07 10:19:01 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-2b592ef1-fd6b-4305-9c5d-40f154c4a091 tempest-ProjectReaderTests-205404938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-de32ff69-077e-471c-9324-1e03e6121368 1073741824 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:19:01 devstack sudo[107598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-de32ff69-077e-471c-9324-1e03e6121368 1073741824 Sep 07 10:19:01 devstack sudo[107598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:19:01 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-e067206a-ee2a-422f-b3d2-e4d541854bdf tempest-ProjectMemberTests-55037479 None] Create snapshot completed successfully Sep 07 10:19:02 devstack sudo[107598]: pam_unix(sudo:session): session closed for user root Sep 07 10:19:02 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-2b592ef1-fd6b-4305-9c5d-40f154c4a091 tempest-ProjectReaderTests-205404938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-de32ff69-077e-471c-9324-1e03e6121368 1073741824" returned: 0 in 0.498s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:19:02 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-2b592ef1-fd6b-4305-9c5d-40f154c4a091 tempest-ProjectReaderTests-205404938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-de32ff69-077e-471c-9324-1e03e6121368 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:19:02 devstack sudo[107604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-de32ff69-077e-471c-9324-1e03e6121368 Sep 07 10:19:02 devstack sudo[107604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:19:02 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-b73421b3-6ba5-4f9d-a959-a8ff5da7d4d9 tempest-ProjectMemberTests-55037479 None] Acquiring lock "cinder-146294f2-8ff9-471c-b652-4fd307a0de5f-delete_snapshot" by "delete_snapshot" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:19:02 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-b73421b3-6ba5-4f9d-a959-a8ff5da7d4d9 tempest-ProjectMemberTests-55037479 None] Lock "cinder-146294f2-8ff9-471c-b652-4fd307a0de5f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.040s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:19:02 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-b73421b3-6ba5-4f9d-a959-a8ff5da7d4d9 tempest-ProjectMemberTests-55037479 None] Acquiring lock "cinder-quobyte-7b746f62-d86d-45c5-b625-310369791588" by "delete_snapshot" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:19:02 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-b73421b3-6ba5-4f9d-a959-a8ff5da7d4d9 tempest-ProjectMemberTests-55037479 None] Lock "cinder-quobyte-7b746f62-d86d-45c5-b625-310369791588" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:19:02 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-b73421b3-6ba5-4f9d-a959-a8ff5da7d4d9 tempest-ProjectMemberTests-55037479 None] Acquiring lock "cinder-quobyte-146294f2-8ff9-471c-b652-4fd307a0de5f" by "_delete_snapshot" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:19:02 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-b73421b3-6ba5-4f9d-a959-a8ff5da7d4d9 tempest-ProjectMemberTests-55037479 None] Lock "cinder-quobyte-146294f2-8ff9-471c-b652-4fd307a0de5f" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:19:02 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-b73421b3-6ba5-4f9d-a959-a8ff5da7d4d9 tempest-ProjectMemberTests-55037479 None] Deleting offline snapshot 146294f2-8ff9-471c-b652-4fd307a0de5f of volume 7b746f62-d86d-45c5-b625-310369791588 {{(pid=87515) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 10:19:02 devstack sudo[107604]: pam_unix(sudo:session): session closed for user root Sep 07 10:19:02 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-b73421b3-6ba5-4f9d-a959-a8ff5da7d4d9 tempest-ProjectMemberTests-55037479 None] snapshot_file for this snap is: volume-7b746f62-d86d-45c5-b625-310369791588.146294f2-8ff9-471c-b652-4fd307a0de5f {{(pid=87515) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 10:19:02 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-2b592ef1-fd6b-4305-9c5d-40f154c4a091 tempest-ProjectReaderTests-205404938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-de32ff69-077e-471c-9324-1e03e6121368" returned: 0 in 0.352s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:19:02 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-2b592ef1-fd6b-4305-9c5d-40f154c4a091 tempest-ProjectReaderTests-205404938 None] <== create_volume: return (902ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'} {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 10:19:02 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-2b592ef1-fd6b-4305-9c5d-40f154c4a091 tempest-ProjectReaderTests-205404938 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.905s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:19:02 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e94a728-02d1-4841-b4e2-e6b3a863ba2b]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:19:02 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-b73421b3-6ba5-4f9d-a959-a8ff5da7d4d9 tempest-ProjectMemberTests-55037479 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-7b746f62-d86d-45c5-b625-310369791588.146294f2-8ff9-471c-b652-4fd307a0de5f {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:19:02 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-2b592ef1-fd6b-4305-9c5d-40f154c4a091 tempest-ProjectReaderTests-205404938 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f46a750-26f3-467d-99b9-4cc1b2d8dc75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-de32ff69-077e-471c-9324-1e03e6121368', 'volume_size': 1}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:19:02 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-2b592ef1-fd6b-4305-9c5d-40f154c4a091 tempest-ProjectReaderTests-205404938 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da4850fa-00fe-4fd4-8926-2479f076d965) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:19:02 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-2b592ef1-fd6b-4305-9c5d-40f154c4a091 tempest-ProjectReaderTests-205404938 None] Volume volume-de32ff69-077e-471c-9324-1e03e6121368 (de32ff69-077e-471c-9324-1e03e6121368): created successfully Sep 07 10:19:02 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-2b592ef1-fd6b-4305-9c5d-40f154c4a091 tempest-ProjectReaderTests-205404938 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da4850fa-00fe-4fd4-8926-2479f076d965) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:19:02 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-2b592ef1-fd6b-4305-9c5d-40f154c4a091 tempest-ProjectReaderTests-205404938 None] Flow 'volume_create_manager' (704bdd2a-c35e-436d-b3ae-507be6e798dc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:19:02 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-2b592ef1-fd6b-4305-9c5d-40f154c4a091 tempest-ProjectReaderTests-205404938 None] Created volume successfully. Sep 07 10:19:02 devstack sudo[107607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-7b746f62-d86d-45c5-b625-310369791588.146294f2-8ff9-471c-b652-4fd307a0de5f Sep 07 10:19:02 devstack sudo[107607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:19:03 devstack sudo[107607]: pam_unix(sudo:session): session closed for user root Sep 07 10:19:03 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-b73421b3-6ba5-4f9d-a959-a8ff5da7d4d9 tempest-ProjectMemberTests-55037479 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-7b746f62-d86d-45c5-b625-310369791588.146294f2-8ff9-471c-b652-4fd307a0de5f" returned: 0 in 0.436s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:19:03 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-b73421b3-6ba5-4f9d-a959-a8ff5da7d4d9 tempest-ProjectMemberTests-55037479 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7b746f62-d86d-45c5-b625-310369791588(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87515) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 10:19:03 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[c921ce5e-8509-4d6b-acf0-284ff5e996ae]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:19:03 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-b73421b3-6ba5-4f9d-a959-a8ff5da7d4d9 tempest-ProjectMemberTests-55037479 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-7b746f62-d86d-45c5-b625-310369791588 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:19:03 devstack sudo[107612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-7b746f62-d86d-45c5-b625-310369791588 Sep 07 10:19:03 devstack sudo[107612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:19:03 devstack sudo[107612]: pam_unix(sudo:session): session closed for user root Sep 07 10:19:03 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-b73421b3-6ba5-4f9d-a959-a8ff5da7d4d9 tempest-ProjectMemberTests-55037479 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-7b746f62-d86d-45c5-b625-310369791588" returned: 0 in 0.414s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:19:03 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-b73421b3-6ba5-4f9d-a959-a8ff5da7d4d9 tempest-ProjectMemberTests-55037479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-7b746f62-d86d-45c5-b625-310369791588.146294f2-8ff9-471c-b652-4fd307a0de5f {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:19:03 devstack sudo[107617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-7b746f62-d86d-45c5-b625-310369791588.146294f2-8ff9-471c-b652-4fd307a0de5f Sep 07 10:19:03 devstack sudo[107617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:19:04 devstack sudo[107617]: pam_unix(sudo:session): session closed for user root Sep 07 10:19:04 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-b73421b3-6ba5-4f9d-a959-a8ff5da7d4d9 tempest-ProjectMemberTests-55037479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-7b746f62-d86d-45c5-b625-310369791588.146294f2-8ff9-471c-b652-4fd307a0de5f" returned: 0 in 0.414s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:19:04 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-b73421b3-6ba5-4f9d-a959-a8ff5da7d4d9 tempest-ProjectMemberTests-55037479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-7b746f62-d86d-45c5-b625-310369791588.146294f2-8ff9-471c-b652-4fd307a0de5f {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:19:04 devstack sudo[107622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-7b746f62-d86d-45c5-b625-310369791588.146294f2-8ff9-471c-b652-4fd307a0de5f Sep 07 10:19:04 devstack sudo[107622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:19:04 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-0e2de210-61d0-4e83-ba54-10fefd95573e tempest-ProjectReaderTests-205404938 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:19:04 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-0e2de210-61d0-4e83-ba54-10fefd95573e tempest-ProjectReaderTests-205404938 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:19:04 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-0e2de210-61d0-4e83-ba54-10fefd95573e tempest-ProjectReaderTests-205404938 None] Creating offline snapshot 5cdfcacb-f750-43d4-a36c-ac875efd322f of volume de32ff69-077e-471c-9324-1e03e6121368 {{(pid=87515) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 10:19:04 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4e55741-569b-484d-8169-96dc833212d8]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:19:04 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-0e2de210-61d0-4e83-ba54-10fefd95573e tempest-ProjectReaderTests-205404938 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-de32ff69-077e-471c-9324-1e03e6121368 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:19:04 devstack sudo[107622]: pam_unix(sudo:session): session closed for user root Sep 07 10:19:04 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-b73421b3-6ba5-4f9d-a959-a8ff5da7d4d9 tempest-ProjectMemberTests-55037479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-7b746f62-d86d-45c5-b625-310369791588.146294f2-8ff9-471c-b652-4fd307a0de5f" returned: 0 in 0.322s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:19:04 devstack sudo[107624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-de32ff69-077e-471c-9324-1e03e6121368 Sep 07 10:19:04 devstack sudo[107624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:19:04 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-b73421b3-6ba5-4f9d-a959-a8ff5da7d4d9 tempest-ProjectMemberTests-55037479 None] Lock "cinder-quobyte-146294f2-8ff9-471c-b652-4fd307a0de5f" released by "_delete_snapshot" :: held 1.731s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:19:04 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-b73421b3-6ba5-4f9d-a959-a8ff5da7d4d9 tempest-ProjectMemberTests-55037479 None] Lock "cinder-quobyte-7b746f62-d86d-45c5-b625-310369791588" released by "delete_snapshot" :: held 1.769s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:19:04 devstack cinder-volume[87515]: DEBUG cinder.quota [None req-b73421b3-6ba5-4f9d-a959-a8ff5da7d4d9 tempest-ProjectMemberTests-55037479 None] Created reservations ['90e5c9a8-a63c-44a3-8554-7cd5dbeac2dd', '430b6416-6631-4fa8-9826-48515869b7bf', '14de7014-aded-4024-8a5b-2215d72977a8', '338446ae-ffb1-4da1-821f-06b83a20f96f'] {{(pid=87515) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:19:04 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-b73421b3-6ba5-4f9d-a959-a8ff5da7d4d9 tempest-ProjectMemberTests-55037479 None] Delete snapshot completed successfully. Sep 07 10:19:04 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-b73421b3-6ba5-4f9d-a959-a8ff5da7d4d9 tempest-ProjectMemberTests-55037479 None] Lock "cinder-146294f2-8ff9-471c-b652-4fd307a0de5f-delete_snapshot" released by "delete_snapshot" :: held 1.937s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:19:04 devstack sudo[107624]: pam_unix(sudo:session): session closed for user root Sep 07 10:19:04 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-0e2de210-61d0-4e83-ba54-10fefd95573e tempest-ProjectReaderTests-205404938 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-de32ff69-077e-471c-9324-1e03e6121368" returned: 0 in 0.441s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:19:04 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-0e2de210-61d0-4e83-ba54-10fefd95573e tempest-ProjectReaderTests-205404938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-de32ff69-077e-471c-9324-1e03e6121368,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-de32ff69-077e-471c-9324-1e03e6121368.5cdfcacb-f750-43d4-a36c-ac875efd322f 1G {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:19:04 devstack sudo[107630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-de32ff69-077e-471c-9324-1e03e6121368,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-de32ff69-077e-471c-9324-1e03e6121368.5cdfcacb-f750-43d4-a36c-ac875efd322f 1G Sep 07 10:19:04 devstack sudo[107630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:19:05 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-9dad1e70-a5ce-4b63-930f-099e3ea27c5e tempest-ProjectMemberTests-55037479 None] Acquiring lock "cinder-7b746f62-d86d-45c5-b625-310369791588-delete_volume" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:19:05 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-9dad1e70-a5ce-4b63-930f-099e3ea27c5e tempest-ProjectMemberTests-55037479 None] Lock "cinder-7b746f62-d86d-45c5-b625-310369791588-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:19:05 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-9dad1e70-a5ce-4b63-930f-099e3ea27c5e tempest-ProjectMemberTests-55037479 None] Acquiring lock "cinder-quobyte-7b746f62-d86d-45c5-b625-310369791588" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:19:05 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-9dad1e70-a5ce-4b63-930f-099e3ea27c5e tempest-ProjectMemberTests-55037479 None] Lock "cinder-quobyte-7b746f62-d86d-45c5-b625-310369791588" acquired by "delete_volume" :: waited 0.020s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:19:05 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[768ce030-3240-47f5-8181-907901cbe3e3]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:19:05 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-9dad1e70-a5ce-4b63-930f-099e3ea27c5e tempest-ProjectMemberTests-55037479 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-7b746f62-d86d-45c5-b625-310369791588 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:19:05 devstack sudo[107635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-7b746f62-d86d-45c5-b625-310369791588 Sep 07 10:19:05 devstack sudo[107635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:19:05 devstack sudo[107630]: pam_unix(sudo:session): session closed for user root Sep 07 10:19:05 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-0e2de210-61d0-4e83-ba54-10fefd95573e tempest-ProjectReaderTests-205404938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-de32ff69-077e-471c-9324-1e03e6121368,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-de32ff69-077e-471c-9324-1e03e6121368.5cdfcacb-f750-43d4-a36c-ac875efd322f 1G" returned: 0 in 0.623s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:19:05 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-0e2de210-61d0-4e83-ba54-10fefd95573e tempest-ProjectReaderTests-205404938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-de32ff69-077e-471c-9324-1e03e6121368 -F qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-de32ff69-077e-471c-9324-1e03e6121368.5cdfcacb-f750-43d4-a36c-ac875efd322f {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:19:05 devstack sudo[107638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-de32ff69-077e-471c-9324-1e03e6121368 -F qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-de32ff69-077e-471c-9324-1e03e6121368.5cdfcacb-f750-43d4-a36c-ac875efd322f Sep 07 10:19:05 devstack sudo[107638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:19:05 devstack sudo[107635]: pam_unix(sudo:session): session closed for user root Sep 07 10:19:05 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-9dad1e70-a5ce-4b63-930f-099e3ea27c5e tempest-ProjectMemberTests-55037479 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-7b746f62-d86d-45c5-b625-310369791588" returned: 0 in 0.510s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:19:05 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-9dad1e70-a5ce-4b63-930f-099e3ea27c5e tempest-ProjectMemberTests-55037479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-7b746f62-d86d-45c5-b625-310369791588 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:19:05 devstack sudo[107638]: pam_unix(sudo:session): session closed for user root Sep 07 10:19:05 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-0e2de210-61d0-4e83-ba54-10fefd95573e tempest-ProjectReaderTests-205404938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-de32ff69-077e-471c-9324-1e03e6121368 -F qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-de32ff69-077e-471c-9324-1e03e6121368.5cdfcacb-f750-43d4-a36c-ac875efd322f" returned: 0 in 0.349s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:19:05 devstack cinder-volume[87515]: WARNING cinder.volume.drivers.remotefs [None req-0e2de210-61d0-4e83-ba54-10fefd95573e tempest-ProjectReaderTests-205404938 None] /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-de32ff69-077e-471c-9324-1e03e6121368.5cdfcacb-f750-43d4-a36c-ac875efd322f is being set with open permissions: ugo+rw Sep 07 10:19:05 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-0e2de210-61d0-4e83-ba54-10fefd95573e tempest-ProjectReaderTests-205404938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-de32ff69-077e-471c-9324-1e03e6121368.5cdfcacb-f750-43d4-a36c-ac875efd322f {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:19:05 devstack sudo[107647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-7b746f62-d86d-45c5-b625-310369791588 Sep 07 10:19:05 devstack sudo[107647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:19:05 devstack sudo[107648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-de32ff69-077e-471c-9324-1e03e6121368.5cdfcacb-f750-43d4-a36c-ac875efd322f Sep 07 10:19:05 devstack sudo[107648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:19:06 devstack sudo[107647]: pam_unix(sudo:session): session closed for user root Sep 07 10:19:06 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-9dad1e70-a5ce-4b63-930f-099e3ea27c5e tempest-ProjectMemberTests-55037479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-7b746f62-d86d-45c5-b625-310369791588" returned: 0 in 0.295s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:19:06 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-9dad1e70-a5ce-4b63-930f-099e3ea27c5e tempest-ProjectMemberTests-55037479 None] Lock "cinder-quobyte-7b746f62-d86d-45c5-b625-310369791588" released by "delete_volume" :: held 0.878s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:19:06 devstack sudo[107648]: pam_unix(sudo:session): session closed for user root Sep 07 10:19:06 devstack cinder-volume[87515]: DEBUG cinder.quota [None req-9dad1e70-a5ce-4b63-930f-099e3ea27c5e tempest-ProjectMemberTests-55037479 None] Created reservations ['b1194485-c966-4b2e-8f6f-f480825403e5', '17c316ec-307d-4f9f-8249-c583702264fc', 'b7a2d0b1-28e1-47a0-8c84-c72c125a4e59', '09c22624-d55c-4cd5-aaeb-ddbaad85ced3'] {{(pid=87515) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:19:06 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-0e2de210-61d0-4e83-ba54-10fefd95573e tempest-ProjectReaderTests-205404938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-de32ff69-077e-471c-9324-1e03e6121368.5cdfcacb-f750-43d4-a36c-ac875efd322f" returned: 0 in 0.385s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:19:06 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-0e2de210-61d0-4e83-ba54-10fefd95573e tempest-ProjectReaderTests-205404938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-de32ff69-077e-471c-9324-1e03e6121368.info {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:19:06 devstack sudo[107653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-de32ff69-077e-471c-9324-1e03e6121368.info Sep 07 10:19:06 devstack sudo[107653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:19:06 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-9dad1e70-a5ce-4b63-930f-099e3ea27c5e tempest-ProjectMemberTests-55037479 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:19:06 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-9dad1e70-a5ce-4b63-930f-099e3ea27c5e tempest-ProjectMemberTests-55037479 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:19:06 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-9dad1e70-a5ce-4b63-930f-099e3ea27c5e tempest-ProjectMemberTests-55037479 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:19:06 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-9dad1e70-a5ce-4b63-930f-099e3ea27c5e tempest-ProjectMemberTests-55037479 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:19:06 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-9dad1e70-a5ce-4b63-930f-099e3ea27c5e tempest-ProjectMemberTests-55037479 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:19:06 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-9dad1e70-a5ce-4b63-930f-099e3ea27c5e tempest-ProjectMemberTests-55037479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:19:06 devstack sudo[107655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a Sep 07 10:19:06 devstack sudo[107655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:19:06 devstack sudo[107653]: pam_unix(sudo:session): session closed for user root Sep 07 10:19:06 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-0e2de210-61d0-4e83-ba54-10fefd95573e tempest-ProjectReaderTests-205404938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-de32ff69-077e-471c-9324-1e03e6121368.info" returned: 0 in 0.311s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:19:06 devstack cinder-volume[87515]: WARNING cinder.volume.drivers.remotefs [None req-0e2de210-61d0-4e83-ba54-10fefd95573e tempest-ProjectReaderTests-205404938 None] /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-de32ff69-077e-471c-9324-1e03e6121368.info is being set with open permissions: ugo+rw Sep 07 10:19:06 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-0e2de210-61d0-4e83-ba54-10fefd95573e tempest-ProjectReaderTests-205404938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-de32ff69-077e-471c-9324-1e03e6121368.info {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:19:06 devstack sudo[107658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-de32ff69-077e-471c-9324-1e03e6121368.info Sep 07 10:19:06 devstack sudo[107658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:19:06 devstack sudo[107655]: pam_unix(sudo:session): session closed for user root Sep 07 10:19:06 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-9dad1e70-a5ce-4b63-930f-099e3ea27c5e tempest-ProjectMemberTests-55037479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a" returned: 0 in 0.309s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:19:06 devstack cinder-volume[87515]: DEBUG cinder.manager [None req-9dad1e70-a5ce-4b63-930f-099e3ea27c5e tempest-ProjectMemberTests-55037479 None] Notifying Schedulers of capabilities ... {{(pid=87515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:19:06 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-9dad1e70-a5ce-4b63-930f-099e3ea27c5e tempest-ProjectMemberTests-55037479 None] Deleted volume successfully. Sep 07 10:19:06 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-9dad1e70-a5ce-4b63-930f-099e3ea27c5e tempest-ProjectMemberTests-55037479 None] Lock "cinder-7b746f62-d86d-45c5-b625-310369791588-delete_volume" released by "delete_volume" :: held 1.543s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:19:06 devstack sudo[107658]: pam_unix(sudo:session): session closed for user root Sep 07 10:19:06 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-0e2de210-61d0-4e83-ba54-10fefd95573e tempest-ProjectReaderTests-205404938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-de32ff69-077e-471c-9324-1e03e6121368.info" returned: 0 in 0.257s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:19:06 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-0e2de210-61d0-4e83-ba54-10fefd95573e tempest-ProjectReaderTests-205404938 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.494s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:19:06 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-0e2de210-61d0-4e83-ba54-10fefd95573e tempest-ProjectReaderTests-205404938 None] Create snapshot completed successfully Sep 07 10:19:07 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-16ad379c-f506-438a-b005-5133beae42e9 tempest-ProjectReaderTests-205404938 None] Acquiring lock "cinder-5cdfcacb-f750-43d4-a36c-ac875efd322f-delete_snapshot" by "delete_snapshot" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:19:07 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-16ad379c-f506-438a-b005-5133beae42e9 tempest-ProjectReaderTests-205404938 None] Lock "cinder-5cdfcacb-f750-43d4-a36c-ac875efd322f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:19:07 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-16ad379c-f506-438a-b005-5133beae42e9 tempest-ProjectReaderTests-205404938 None] Acquiring lock "cinder-quobyte-de32ff69-077e-471c-9324-1e03e6121368" by "delete_snapshot" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:19:07 devstack cinder-volume[87515]: DEBUG cinder.volume.flows.manager.create_volume [None req-da22de34-96f5-4d2c-b598-354ceb9415da tempest-ProjectMemberTests-55037479 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 10:19:07 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-da22de34-96f5-4d2c-b598-354ceb9415da tempest-ProjectMemberTests-55037479 None] Flow 'volume_create_manager' (9b64cd6b-1613-422b-9072-0b11bb97f5e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:19:07 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-da22de34-96f5-4d2c-b598-354ceb9415da tempest-ProjectMemberTests-55037479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4f90437-bb95-4265-91ba-09f12d38e1c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:19:07 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-16ad379c-f506-438a-b005-5133beae42e9 tempest-ProjectReaderTests-205404938 None] Lock "cinder-quobyte-de32ff69-077e-471c-9324-1e03e6121368" acquired by "delete_snapshot" :: waited 0.070s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:19:07 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-16ad379c-f506-438a-b005-5133beae42e9 tempest-ProjectReaderTests-205404938 None] Acquiring lock "cinder-quobyte-5cdfcacb-f750-43d4-a36c-ac875efd322f" by "_delete_snapshot" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:19:07 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-da22de34-96f5-4d2c-b598-354ceb9415da tempest-ProjectMemberTests-55037479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4f90437-bb95-4265-91ba-09f12d38e1c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:19:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-662250643',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb38efe8-daec-475a-86a7-6fd9027c63b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41fa4493d2f045dc87793bd97d931cff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:19:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:19:08Z,use_quota=True,user_id='5136aa4e2a7c4a1da79d4e4478cdcbf6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3a092cd-7947-4cbf-abff-4ba9567becf0),volume_type_id=f3a092cd-7947-4cbf-abff-4ba9567becf0)' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:19:07 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-da22de34-96f5-4d2c-b598-354ceb9415da tempest-ProjectMemberTests-55037479 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d13bf701-37ed-45e1-9b9f-733aff4dc839) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:19:07 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-da22de34-96f5-4d2c-b598-354ceb9415da tempest-ProjectMemberTests-55037479 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d13bf701-37ed-45e1-9b9f-733aff4dc839) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:19:07 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-da22de34-96f5-4d2c-b598-354ceb9415da tempest-ProjectMemberTests-55037479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36fc6490-4f16-4770-a294-103957faad05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:19:07 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-da22de34-96f5-4d2c-b598-354ceb9415da tempest-ProjectMemberTests-55037479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36fc6490-4f16-4770-a294-103957faad05) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cb38efe8-daec-475a-86a7-6fd9027c63b2', 'volume_name': 'volume-cb38efe8-daec-475a-86a7-6fd9027c63b2', 'volume_size': 1}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:19:07 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-da22de34-96f5-4d2c-b598-354ceb9415da tempest-ProjectMemberTests-55037479 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c93997a-de04-4617-a72a-56525cf4cf70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:19:07 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-da22de34-96f5-4d2c-b598-354ceb9415da tempest-ProjectMemberTests-55037479 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c93997a-de04-4617-a72a-56525cf4cf70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:19:07 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-da22de34-96f5-4d2c-b598-354ceb9415da tempest-ProjectMemberTests-55037479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aea0e522-3066-4738-b778-5780d608e121) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:19:07 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-da22de34-96f5-4d2c-b598-354ceb9415da tempest-ProjectMemberTests-55037479 None] Volume cb38efe8-daec-475a-86a7-6fd9027c63b2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cb38efe8-daec-475a-86a7-6fd9027c63b2', 'volume_size': 1} Sep 07 10:19:07 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-da22de34-96f5-4d2c-b598-354ceb9415da tempest-ProjectMemberTests-55037479 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:19:07 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-da22de34-96f5-4d2c-b598-354ceb9415da tempest-ProjectMemberTests-55037479 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:19:07 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-da22de34-96f5-4d2c-b598-354ceb9415da tempest-ProjectMemberTests-55037479 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:19:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-662250643',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb38efe8-daec-475a-86a7-6fd9027c63b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41fa4493d2f045dc87793bd97d931cff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:19:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:19:08Z,use_quota=True,user_id='5136aa4e2a7c4a1da79d4e4478cdcbf6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3a092cd-7947-4cbf-abff-4ba9567becf0),volume_type_id=f3a092cd-7947-4cbf-abff-4ba9567becf0)}" {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 10:19:07 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-da22de34-96f5-4d2c-b598-354ceb9415da tempest-ProjectMemberTests-55037479 None] Creating volume cb38efe8-daec-475a-86a7-6fd9027c63b2 {{(pid=87515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 10:19:07 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-da22de34-96f5-4d2c-b598-354ceb9415da tempest-ProjectMemberTests-55037479 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:19:07 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-da22de34-96f5-4d2c-b598-354ceb9415da tempest-ProjectMemberTests-55037479 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:19:07 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-da22de34-96f5-4d2c-b598-354ceb9415da tempest-ProjectMemberTests-55037479 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:19:07 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-da22de34-96f5-4d2c-b598-354ceb9415da tempest-ProjectMemberTests-55037479 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:19:07 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-da22de34-96f5-4d2c-b598-354ceb9415da tempest-ProjectMemberTests-55037479 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:19:07 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-da22de34-96f5-4d2c-b598-354ceb9415da tempest-ProjectMemberTests-55037479 None] Selected osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c as target Quobyte volume. {{(pid=87515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 10:19:07 devstack cinder-volume[87515]: INFO cinder.volume.drivers.remotefs [None req-da22de34-96f5-4d2c-b598-354ceb9415da tempest-ProjectMemberTests-55037479 None] casted to osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c Sep 07 10:19:07 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-da22de34-96f5-4d2c-b598-354ceb9415da tempest-ProjectMemberTests-55037479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-cb38efe8-daec-475a-86a7-6fd9027c63b2 1073741824 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:19:07 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-16ad379c-f506-438a-b005-5133beae42e9 tempest-ProjectReaderTests-205404938 None] Lock "cinder-quobyte-5cdfcacb-f750-43d4-a36c-ac875efd322f" acquired by "_delete_snapshot" :: waited 0.091s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:19:07 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-16ad379c-f506-438a-b005-5133beae42e9 tempest-ProjectReaderTests-205404938 None] Deleting offline snapshot 5cdfcacb-f750-43d4-a36c-ac875efd322f of volume de32ff69-077e-471c-9324-1e03e6121368 {{(pid=87515) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 10:19:07 devstack sudo[107662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-cb38efe8-daec-475a-86a7-6fd9027c63b2 1073741824 Sep 07 10:19:07 devstack sudo[107662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:19:07 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-16ad379c-f506-438a-b005-5133beae42e9 tempest-ProjectReaderTests-205404938 None] snapshot_file for this snap is: volume-de32ff69-077e-471c-9324-1e03e6121368.5cdfcacb-f750-43d4-a36c-ac875efd322f {{(pid=87515) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 10:19:08 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[be219870-a46d-4d9f-98aa-524f6a90d40b]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:19:08 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-16ad379c-f506-438a-b005-5133beae42e9 tempest-ProjectReaderTests-205404938 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-de32ff69-077e-471c-9324-1e03e6121368.5cdfcacb-f750-43d4-a36c-ac875efd322f {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:19:08 devstack sudo[107664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-de32ff69-077e-471c-9324-1e03e6121368.5cdfcacb-f750-43d4-a36c-ac875efd322f Sep 07 10:19:08 devstack sudo[107664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:19:08 devstack sudo[107664]: pam_unix(sudo:session): session closed for user root Sep 07 10:19:08 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-16ad379c-f506-438a-b005-5133beae42e9 tempest-ProjectReaderTests-205404938 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-de32ff69-077e-471c-9324-1e03e6121368.5cdfcacb-f750-43d4-a36c-ac875efd322f" returned: 0 in 0.505s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:19:08 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-16ad379c-f506-438a-b005-5133beae42e9 tempest-ProjectReaderTests-205404938 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-de32ff69-077e-471c-9324-1e03e6121368(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87515) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 10:19:08 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[9be5a97d-e32f-4762-a5ec-2e0e5af4bacc]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:19:08 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-16ad379c-f506-438a-b005-5133beae42e9 tempest-ProjectReaderTests-205404938 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-de32ff69-077e-471c-9324-1e03e6121368 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:19:08 devstack sudo[107662]: pam_unix(sudo:session): session closed for user root Sep 07 10:19:08 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-da22de34-96f5-4d2c-b598-354ceb9415da tempest-ProjectMemberTests-55037479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-cb38efe8-daec-475a-86a7-6fd9027c63b2 1073741824" returned: 0 in 0.634s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:19:08 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-da22de34-96f5-4d2c-b598-354ceb9415da tempest-ProjectMemberTests-55037479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-cb38efe8-daec-475a-86a7-6fd9027c63b2 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:19:08 devstack sudo[107675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-cb38efe8-daec-475a-86a7-6fd9027c63b2 Sep 07 10:19:08 devstack sudo[107675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:19:08 devstack sudo[107674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-de32ff69-077e-471c-9324-1e03e6121368 Sep 07 10:19:08 devstack sudo[107674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:19:08 devstack sudo[107675]: pam_unix(sudo:session): session closed for user root Sep 07 10:19:08 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-da22de34-96f5-4d2c-b598-354ceb9415da tempest-ProjectMemberTests-55037479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-cb38efe8-daec-475a-86a7-6fd9027c63b2" returned: 0 in 0.286s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:19:08 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-da22de34-96f5-4d2c-b598-354ceb9415da tempest-ProjectMemberTests-55037479 None] <== create_volume: return (972ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'} {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 10:19:08 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-da22de34-96f5-4d2c-b598-354ceb9415da tempest-ProjectMemberTests-55037479 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.974s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:19:08 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-da22de34-96f5-4d2c-b598-354ceb9415da tempest-ProjectMemberTests-55037479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aea0e522-3066-4738-b778-5780d608e121) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cb38efe8-daec-475a-86a7-6fd9027c63b2', 'volume_size': 1}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:19:08 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-da22de34-96f5-4d2c-b598-354ceb9415da tempest-ProjectMemberTests-55037479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e108b1e-6ab0-44fa-9330-6c70a93e7b9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:19:08 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-da22de34-96f5-4d2c-b598-354ceb9415da tempest-ProjectMemberTests-55037479 None] Volume volume-cb38efe8-daec-475a-86a7-6fd9027c63b2 (cb38efe8-daec-475a-86a7-6fd9027c63b2): created successfully Sep 07 10:19:08 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-da22de34-96f5-4d2c-b598-354ceb9415da tempest-ProjectMemberTests-55037479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e108b1e-6ab0-44fa-9330-6c70a93e7b9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:19:08 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-da22de34-96f5-4d2c-b598-354ceb9415da tempest-ProjectMemberTests-55037479 None] Flow 'volume_create_manager' (9b64cd6b-1613-422b-9072-0b11bb97f5e3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:19:08 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-da22de34-96f5-4d2c-b598-354ceb9415da tempest-ProjectMemberTests-55037479 None] Created volume successfully. Sep 07 10:19:09 devstack sudo[107674]: pam_unix(sudo:session): session closed for user root Sep 07 10:19:09 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-16ad379c-f506-438a-b005-5133beae42e9 tempest-ProjectReaderTests-205404938 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-de32ff69-077e-471c-9324-1e03e6121368" returned: 0 in 0.451s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:19:09 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-16ad379c-f506-438a-b005-5133beae42e9 tempest-ProjectReaderTests-205404938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-de32ff69-077e-471c-9324-1e03e6121368.5cdfcacb-f750-43d4-a36c-ac875efd322f {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:19:09 devstack sudo[107683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-de32ff69-077e-471c-9324-1e03e6121368.5cdfcacb-f750-43d4-a36c-ac875efd322f Sep 07 10:19:09 devstack sudo[107683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:19:09 devstack sudo[107683]: pam_unix(sudo:session): session closed for user root Sep 07 10:19:09 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-16ad379c-f506-438a-b005-5133beae42e9 tempest-ProjectReaderTests-205404938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-de32ff69-077e-471c-9324-1e03e6121368.5cdfcacb-f750-43d4-a36c-ac875efd322f" returned: 0 in 0.403s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:19:09 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-16ad379c-f506-438a-b005-5133beae42e9 tempest-ProjectReaderTests-205404938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-de32ff69-077e-471c-9324-1e03e6121368.5cdfcacb-f750-43d4-a36c-ac875efd322f {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:19:09 devstack sudo[107690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-de32ff69-077e-471c-9324-1e03e6121368.5cdfcacb-f750-43d4-a36c-ac875efd322f Sep 07 10:19:09 devstack sudo[107690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:19:09 devstack sudo[107690]: pam_unix(sudo:session): session closed for user root Sep 07 10:19:09 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-16ad379c-f506-438a-b005-5133beae42e9 tempest-ProjectReaderTests-205404938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-de32ff69-077e-471c-9324-1e03e6121368.5cdfcacb-f750-43d4-a36c-ac875efd322f" returned: 0 in 0.285s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:19:09 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-16ad379c-f506-438a-b005-5133beae42e9 tempest-ProjectReaderTests-205404938 None] Lock "cinder-quobyte-5cdfcacb-f750-43d4-a36c-ac875efd322f" released by "_delete_snapshot" :: held 1.774s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:19:09 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-16ad379c-f506-438a-b005-5133beae42e9 tempest-ProjectReaderTests-205404938 None] Lock "cinder-quobyte-de32ff69-077e-471c-9324-1e03e6121368" released by "delete_snapshot" :: held 1.875s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:19:09 devstack cinder-volume[87515]: DEBUG cinder.quota [None req-16ad379c-f506-438a-b005-5133beae42e9 tempest-ProjectReaderTests-205404938 None] Created reservations ['8b3398e4-e5d4-4ac2-9ecc-3cb7321e9b7e', '8288af46-f108-4579-b5dc-c3e8e5713c67', '341caca9-3991-4255-a2d3-1fe26c5e8bc2', '251e52f1-4105-41c7-9320-b409e09989db'] {{(pid=87515) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:19:09 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-16ad379c-f506-438a-b005-5133beae42e9 tempest-ProjectReaderTests-205404938 None] Delete snapshot completed successfully. Sep 07 10:19:09 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-16ad379c-f506-438a-b005-5133beae42e9 tempest-ProjectReaderTests-205404938 None] Lock "cinder-5cdfcacb-f750-43d4-a36c-ac875efd322f-delete_snapshot" released by "delete_snapshot" :: held 2.186s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:19:10 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-f9183480-316c-4d5b-932d-340b3c5655cf tempest-ProjectMemberTests-55037479 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:19:10 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-f9183480-316c-4d5b-932d-340b3c5655cf tempest-ProjectMemberTests-55037479 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:19:10 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-f9183480-316c-4d5b-932d-340b3c5655cf tempest-ProjectMemberTests-55037479 None] Creating offline snapshot 8fbcba67-5261-4992-9264-a5d45dceb9e6 of volume cb38efe8-daec-475a-86a7-6fd9027c63b2 {{(pid=87515) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 10:19:10 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[79d88546-3cea-4191-b884-9a89062e9f6a]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:19:10 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-f9183480-316c-4d5b-932d-340b3c5655cf tempest-ProjectMemberTests-55037479 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-cb38efe8-daec-475a-86a7-6fd9027c63b2 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:19:10 devstack sudo[107693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-cb38efe8-daec-475a-86a7-6fd9027c63b2 Sep 07 10:19:10 devstack sudo[107693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:19:10 devstack sudo[107693]: pam_unix(sudo:session): session closed for user root Sep 07 10:19:10 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-f9183480-316c-4d5b-932d-340b3c5655cf tempest-ProjectMemberTests-55037479 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-cb38efe8-daec-475a-86a7-6fd9027c63b2" returned: 0 in 0.402s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:19:10 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-f9183480-316c-4d5b-932d-340b3c5655cf tempest-ProjectMemberTests-55037479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-cb38efe8-daec-475a-86a7-6fd9027c63b2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-cb38efe8-daec-475a-86a7-6fd9027c63b2.8fbcba67-5261-4992-9264-a5d45dceb9e6 1G {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:19:10 devstack sudo[107698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-cb38efe8-daec-475a-86a7-6fd9027c63b2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-cb38efe8-daec-475a-86a7-6fd9027c63b2.8fbcba67-5261-4992-9264-a5d45dceb9e6 1G Sep 07 10:19:10 devstack sudo[107698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:19:11 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-b6f1520d-d9db-4652-a2cd-0910f25c9239 tempest-ProjectReaderTests-205404938 None] Acquiring lock "cinder-de32ff69-077e-471c-9324-1e03e6121368-delete_volume" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:19:11 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-b6f1520d-d9db-4652-a2cd-0910f25c9239 tempest-ProjectReaderTests-205404938 None] Lock "cinder-de32ff69-077e-471c-9324-1e03e6121368-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:19:11 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-b6f1520d-d9db-4652-a2cd-0910f25c9239 tempest-ProjectReaderTests-205404938 None] Acquiring lock "cinder-quobyte-de32ff69-077e-471c-9324-1e03e6121368" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:19:11 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-b6f1520d-d9db-4652-a2cd-0910f25c9239 tempest-ProjectReaderTests-205404938 None] Lock "cinder-quobyte-de32ff69-077e-471c-9324-1e03e6121368" acquired by "delete_volume" :: waited 0.019s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:19:11 devstack sudo[107698]: pam_unix(sudo:session): session closed for user root Sep 07 10:19:11 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-f9183480-316c-4d5b-932d-340b3c5655cf tempest-ProjectMemberTests-55037479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-cb38efe8-daec-475a-86a7-6fd9027c63b2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-cb38efe8-daec-475a-86a7-6fd9027c63b2.8fbcba67-5261-4992-9264-a5d45dceb9e6 1G" returned: 0 in 0.560s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:19:11 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-f9183480-316c-4d5b-932d-340b3c5655cf tempest-ProjectMemberTests-55037479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cb38efe8-daec-475a-86a7-6fd9027c63b2 -F qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-cb38efe8-daec-475a-86a7-6fd9027c63b2.8fbcba67-5261-4992-9264-a5d45dceb9e6 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:19:11 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[933a6c94-381f-4258-9d55-bec53b1b1345]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:19:11 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-b6f1520d-d9db-4652-a2cd-0910f25c9239 tempest-ProjectReaderTests-205404938 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-de32ff69-077e-471c-9324-1e03e6121368 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:19:11 devstack sudo[107705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cb38efe8-daec-475a-86a7-6fd9027c63b2 -F qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-cb38efe8-daec-475a-86a7-6fd9027c63b2.8fbcba67-5261-4992-9264-a5d45dceb9e6 Sep 07 10:19:11 devstack sudo[107705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:19:11 devstack sudo[107706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-de32ff69-077e-471c-9324-1e03e6121368 Sep 07 10:19:11 devstack sudo[107706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:19:11 devstack cinder-volume[87515]: DEBUG oslo_service.periodic_task [None req-cebd6a9d-3073-42a1-b65a-b38d444d85ed None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87515) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 10:19:11 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-cebd6a9d-3073-42a1-b65a-b38d444d85ed None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:19:11 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-cebd6a9d-3073-42a1-b65a-b38d444d85ed None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:19:11 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-cebd6a9d-3073-42a1-b65a-b38d444d85ed None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:19:11 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-cebd6a9d-3073-42a1-b65a-b38d444d85ed None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:19:11 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-cebd6a9d-3073-42a1-b65a-b38d444d85ed None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:19:11 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-cebd6a9d-3073-42a1-b65a-b38d444d85ed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:19:11 devstack sudo[107712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a Sep 07 10:19:11 devstack sudo[107712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:19:11 devstack sudo[107705]: pam_unix(sudo:session): session closed for user root Sep 07 10:19:11 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-f9183480-316c-4d5b-932d-340b3c5655cf tempest-ProjectMemberTests-55037479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cb38efe8-daec-475a-86a7-6fd9027c63b2 -F qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-cb38efe8-daec-475a-86a7-6fd9027c63b2.8fbcba67-5261-4992-9264-a5d45dceb9e6" returned: 0 in 0.454s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:19:11 devstack cinder-volume[87515]: WARNING cinder.volume.drivers.remotefs [None req-f9183480-316c-4d5b-932d-340b3c5655cf tempest-ProjectMemberTests-55037479 None] /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-cb38efe8-daec-475a-86a7-6fd9027c63b2.8fbcba67-5261-4992-9264-a5d45dceb9e6 is being set with open permissions: ugo+rw Sep 07 10:19:11 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-f9183480-316c-4d5b-932d-340b3c5655cf tempest-ProjectMemberTests-55037479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-cb38efe8-daec-475a-86a7-6fd9027c63b2.8fbcba67-5261-4992-9264-a5d45dceb9e6 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:19:11 devstack sudo[107718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-cb38efe8-daec-475a-86a7-6fd9027c63b2.8fbcba67-5261-4992-9264-a5d45dceb9e6 Sep 07 10:19:11 devstack sudo[107718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:19:11 devstack sudo[107706]: pam_unix(sudo:session): session closed for user root Sep 07 10:19:11 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-b6f1520d-d9db-4652-a2cd-0910f25c9239 tempest-ProjectReaderTests-205404938 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-de32ff69-077e-471c-9324-1e03e6121368" returned: 0 in 0.538s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:19:11 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-b6f1520d-d9db-4652-a2cd-0910f25c9239 tempest-ProjectReaderTests-205404938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-de32ff69-077e-471c-9324-1e03e6121368 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:19:11 devstack sudo[107720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-de32ff69-077e-471c-9324-1e03e6121368 Sep 07 10:19:11 devstack sudo[107720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:19:11 devstack sudo[107712]: pam_unix(sudo:session): session closed for user root Sep 07 10:19:11 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-cebd6a9d-3073-42a1-b65a-b38d444d85ed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a" returned: 0 in 0.422s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:19:11 devstack cinder-volume[87515]: DEBUG cinder.manager [None req-cebd6a9d-3073-42a1-b65a-b38d444d85ed None None] Notifying Schedulers of capabilities ... {{(pid=87515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:19:12 devstack cinder-volume[87515]: DEBUG oslo_service.periodic_task [None req-cebd6a9d-3073-42a1-b65a-b38d444d85ed None None] Running periodic task VolumeManager._thread_info {{(pid=87515) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 10:19:12 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-cebd6a9d-3073-42a1-b65a-b38d444d85ed None None] thread count: 29 {{(pid=87515) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 07 10:19:12 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-cebd6a9d-3073-42a1-b65a-b38d444d85ed None None] thread info: [<_MainThread(MainThread, started 131647121809536)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87515) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 07 10:19:12 devstack sudo[107718]: pam_unix(sudo:session): session closed for user root Sep 07 10:19:12 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-f9183480-316c-4d5b-932d-340b3c5655cf tempest-ProjectMemberTests-55037479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-cb38efe8-daec-475a-86a7-6fd9027c63b2.8fbcba67-5261-4992-9264-a5d45dceb9e6" returned: 0 in 0.363s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:19:12 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-f9183480-316c-4d5b-932d-340b3c5655cf tempest-ProjectMemberTests-55037479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-cb38efe8-daec-475a-86a7-6fd9027c63b2.info {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:19:12 devstack sudo[107724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-cb38efe8-daec-475a-86a7-6fd9027c63b2.info Sep 07 10:19:12 devstack sudo[107724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:19:12 devstack sudo[107720]: pam_unix(sudo:session): session closed for user root Sep 07 10:19:12 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-b6f1520d-d9db-4652-a2cd-0910f25c9239 tempest-ProjectReaderTests-205404938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-de32ff69-077e-471c-9324-1e03e6121368" returned: 0 in 0.394s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:19:12 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-b6f1520d-d9db-4652-a2cd-0910f25c9239 tempest-ProjectReaderTests-205404938 None] Lock "cinder-quobyte-de32ff69-077e-471c-9324-1e03e6121368" released by "delete_volume" :: held 1.059s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:19:12 devstack cinder-volume[87515]: DEBUG cinder.quota [None req-b6f1520d-d9db-4652-a2cd-0910f25c9239 tempest-ProjectReaderTests-205404938 None] Created reservations ['c3f4e819-4924-4207-9583-2ef32d89017a', '3eee04c8-e6ff-4ffc-a943-d2828896a856', 'd3275d9c-064c-46b4-8d8f-585d69aae9e6', 'c54cb1df-95d2-4eb7-a7c6-c091c22bab64'] {{(pid=87515) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:19:12 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-b6f1520d-d9db-4652-a2cd-0910f25c9239 tempest-ProjectReaderTests-205404938 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:19:12 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-b6f1520d-d9db-4652-a2cd-0910f25c9239 tempest-ProjectReaderTests-205404938 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:19:12 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-b6f1520d-d9db-4652-a2cd-0910f25c9239 tempest-ProjectReaderTests-205404938 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:19:12 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-b6f1520d-d9db-4652-a2cd-0910f25c9239 tempest-ProjectReaderTests-205404938 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:19:12 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-b6f1520d-d9db-4652-a2cd-0910f25c9239 tempest-ProjectReaderTests-205404938 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:19:12 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-b6f1520d-d9db-4652-a2cd-0910f25c9239 tempest-ProjectReaderTests-205404938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:19:12 devstack sudo[107724]: pam_unix(sudo:session): session closed for user root Sep 07 10:19:12 devstack sudo[107729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a Sep 07 10:19:12 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-f9183480-316c-4d5b-932d-340b3c5655cf tempest-ProjectMemberTests-55037479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-cb38efe8-daec-475a-86a7-6fd9027c63b2.info" returned: 0 in 0.376s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:19:12 devstack cinder-volume[87515]: WARNING cinder.volume.drivers.remotefs [None req-f9183480-316c-4d5b-932d-340b3c5655cf tempest-ProjectMemberTests-55037479 None] /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-cb38efe8-daec-475a-86a7-6fd9027c63b2.info is being set with open permissions: ugo+rw Sep 07 10:19:12 devstack sudo[107729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:19:12 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-f9183480-316c-4d5b-932d-340b3c5655cf tempest-ProjectMemberTests-55037479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-cb38efe8-daec-475a-86a7-6fd9027c63b2.info {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:19:12 devstack sudo[107731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-cb38efe8-daec-475a-86a7-6fd9027c63b2.info Sep 07 10:19:12 devstack sudo[107731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:19:12 devstack sudo[107729]: pam_unix(sudo:session): session closed for user root Sep 07 10:19:12 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-b6f1520d-d9db-4652-a2cd-0910f25c9239 tempest-ProjectReaderTests-205404938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a" returned: 0 in 0.314s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:19:12 devstack cinder-volume[87515]: DEBUG cinder.manager [None req-b6f1520d-d9db-4652-a2cd-0910f25c9239 tempest-ProjectReaderTests-205404938 None] Notifying Schedulers of capabilities ... {{(pid=87515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:19:12 devstack sudo[107731]: pam_unix(sudo:session): session closed for user root Sep 07 10:19:12 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-f9183480-316c-4d5b-932d-340b3c5655cf tempest-ProjectMemberTests-55037479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-cb38efe8-daec-475a-86a7-6fd9027c63b2.info" returned: 0 in 0.277s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:19:12 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-f9183480-316c-4d5b-932d-340b3c5655cf tempest-ProjectMemberTests-55037479 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.536s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:19:12 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-b6f1520d-d9db-4652-a2cd-0910f25c9239 tempest-ProjectReaderTests-205404938 None] Deleted volume successfully. Sep 07 10:19:12 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-b6f1520d-d9db-4652-a2cd-0910f25c9239 tempest-ProjectReaderTests-205404938 None] Lock "cinder-de32ff69-077e-471c-9324-1e03e6121368-delete_volume" released by "delete_volume" :: held 1.707s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:19:12 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-f9183480-316c-4d5b-932d-340b3c5655cf tempest-ProjectMemberTests-55037479 None] Create snapshot completed successfully Sep 07 10:19:13 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-b159da4f-3b5b-4d5f-bdcc-863fa16e1483 tempest-ProjectMemberTests-55037479 None] Acquiring lock "cinder-8fbcba67-5261-4992-9264-a5d45dceb9e6-delete_snapshot" by "delete_snapshot" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:19:13 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-b159da4f-3b5b-4d5f-bdcc-863fa16e1483 tempest-ProjectMemberTests-55037479 None] Lock "cinder-8fbcba67-5261-4992-9264-a5d45dceb9e6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:19:13 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-b159da4f-3b5b-4d5f-bdcc-863fa16e1483 tempest-ProjectMemberTests-55037479 None] Acquiring lock "cinder-quobyte-cb38efe8-daec-475a-86a7-6fd9027c63b2" by "delete_snapshot" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:19:13 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-b159da4f-3b5b-4d5f-bdcc-863fa16e1483 tempest-ProjectMemberTests-55037479 None] Lock "cinder-quobyte-cb38efe8-daec-475a-86a7-6fd9027c63b2" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:19:13 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-b159da4f-3b5b-4d5f-bdcc-863fa16e1483 tempest-ProjectMemberTests-55037479 None] Acquiring lock "cinder-quobyte-8fbcba67-5261-4992-9264-a5d45dceb9e6" by "_delete_snapshot" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:19:13 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-b159da4f-3b5b-4d5f-bdcc-863fa16e1483 tempest-ProjectMemberTests-55037479 None] Lock "cinder-quobyte-8fbcba67-5261-4992-9264-a5d45dceb9e6" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:19:13 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-b159da4f-3b5b-4d5f-bdcc-863fa16e1483 tempest-ProjectMemberTests-55037479 None] Deleting offline snapshot 8fbcba67-5261-4992-9264-a5d45dceb9e6 of volume cb38efe8-daec-475a-86a7-6fd9027c63b2 {{(pid=87515) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 10:19:13 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-b159da4f-3b5b-4d5f-bdcc-863fa16e1483 tempest-ProjectMemberTests-55037479 None] snapshot_file for this snap is: volume-cb38efe8-daec-475a-86a7-6fd9027c63b2.8fbcba67-5261-4992-9264-a5d45dceb9e6 {{(pid=87515) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 10:19:13 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[80c183e0-c8c8-47b7-9099-5dc859253d2a]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:19:13 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-b159da4f-3b5b-4d5f-bdcc-863fa16e1483 tempest-ProjectMemberTests-55037479 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-cb38efe8-daec-475a-86a7-6fd9027c63b2.8fbcba67-5261-4992-9264-a5d45dceb9e6 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:19:13 devstack sudo[107735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-cb38efe8-daec-475a-86a7-6fd9027c63b2.8fbcba67-5261-4992-9264-a5d45dceb9e6 Sep 07 10:19:13 devstack sudo[107735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:19:13 devstack cinder-volume[87515]: DEBUG cinder.volume.flows.manager.create_volume [None req-27562024-8386-4f69-85fa-7e7ada71b3a7 tempest-ProjectReaderTests-205404938 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 10:19:13 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-27562024-8386-4f69-85fa-7e7ada71b3a7 tempest-ProjectReaderTests-205404938 None] Flow 'volume_create_manager' (2d3845d4-cb5d-4211-b519-200d63e29951) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:19:13 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-27562024-8386-4f69-85fa-7e7ada71b3a7 tempest-ProjectReaderTests-205404938 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (119eea43-895d-4ed6-8093-7f68c0889a32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:19:13 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-27562024-8386-4f69-85fa-7e7ada71b3a7 tempest-ProjectReaderTests-205404938 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (119eea43-895d-4ed6-8093-7f68c0889a32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:19:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1658858428',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dad699db-1599-44ae-8e3f-e788743f48e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4bd49c4be7a74648ab6f55922f0638c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:19:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:19:14Z,use_quota=True,user_id='0477ac649f0140bf9c034ba6d1a49938',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3a092cd-7947-4cbf-abff-4ba9567becf0),volume_type_id=f3a092cd-7947-4cbf-abff-4ba9567becf0)' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:19:13 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-27562024-8386-4f69-85fa-7e7ada71b3a7 tempest-ProjectReaderTests-205404938 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (236cbd5f-bbb8-407c-aaee-9d7c4bfebcd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:19:13 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-27562024-8386-4f69-85fa-7e7ada71b3a7 tempest-ProjectReaderTests-205404938 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (236cbd5f-bbb8-407c-aaee-9d7c4bfebcd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:19:13 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-27562024-8386-4f69-85fa-7e7ada71b3a7 tempest-ProjectReaderTests-205404938 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (beff52f3-402f-495b-a14f-1b697e0ce2c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:19:14 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-27562024-8386-4f69-85fa-7e7ada71b3a7 tempest-ProjectReaderTests-205404938 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (beff52f3-402f-495b-a14f-1b697e0ce2c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dad699db-1599-44ae-8e3f-e788743f48e7', 'volume_name': 'volume-dad699db-1599-44ae-8e3f-e788743f48e7', 'volume_size': 1}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:19:14 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-27562024-8386-4f69-85fa-7e7ada71b3a7 tempest-ProjectReaderTests-205404938 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6fa1170d-08c5-4d53-a5ab-d94b1a38671d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:19:14 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-27562024-8386-4f69-85fa-7e7ada71b3a7 tempest-ProjectReaderTests-205404938 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6fa1170d-08c5-4d53-a5ab-d94b1a38671d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:19:14 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-27562024-8386-4f69-85fa-7e7ada71b3a7 tempest-ProjectReaderTests-205404938 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (433b4ed6-adac-44f2-94f2-9e1e6e157058) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:19:14 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-27562024-8386-4f69-85fa-7e7ada71b3a7 tempest-ProjectReaderTests-205404938 None] Volume dad699db-1599-44ae-8e3f-e788743f48e7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dad699db-1599-44ae-8e3f-e788743f48e7', 'volume_size': 1} Sep 07 10:19:14 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-27562024-8386-4f69-85fa-7e7ada71b3a7 tempest-ProjectReaderTests-205404938 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:19:14 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-27562024-8386-4f69-85fa-7e7ada71b3a7 tempest-ProjectReaderTests-205404938 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:19:14 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-27562024-8386-4f69-85fa-7e7ada71b3a7 tempest-ProjectReaderTests-205404938 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:19:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1658858428',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dad699db-1599-44ae-8e3f-e788743f48e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4bd49c4be7a74648ab6f55922f0638c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:19:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:19:14Z,use_quota=True,user_id='0477ac649f0140bf9c034ba6d1a49938',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3a092cd-7947-4cbf-abff-4ba9567becf0),volume_type_id=f3a092cd-7947-4cbf-abff-4ba9567becf0)}" {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 10:19:14 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-27562024-8386-4f69-85fa-7e7ada71b3a7 tempest-ProjectReaderTests-205404938 None] Creating volume dad699db-1599-44ae-8e3f-e788743f48e7 {{(pid=87515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 10:19:14 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-27562024-8386-4f69-85fa-7e7ada71b3a7 tempest-ProjectReaderTests-205404938 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:19:14 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-27562024-8386-4f69-85fa-7e7ada71b3a7 tempest-ProjectReaderTests-205404938 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:19:14 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-27562024-8386-4f69-85fa-7e7ada71b3a7 tempest-ProjectReaderTests-205404938 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:19:14 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-27562024-8386-4f69-85fa-7e7ada71b3a7 tempest-ProjectReaderTests-205404938 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:19:14 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-27562024-8386-4f69-85fa-7e7ada71b3a7 tempest-ProjectReaderTests-205404938 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:19:14 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-27562024-8386-4f69-85fa-7e7ada71b3a7 tempest-ProjectReaderTests-205404938 None] Selected osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c as target Quobyte volume. {{(pid=87515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 10:19:14 devstack cinder-volume[87515]: INFO cinder.volume.drivers.remotefs [None req-27562024-8386-4f69-85fa-7e7ada71b3a7 tempest-ProjectReaderTests-205404938 None] casted to osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c Sep 07 10:19:14 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-27562024-8386-4f69-85fa-7e7ada71b3a7 tempest-ProjectReaderTests-205404938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-dad699db-1599-44ae-8e3f-e788743f48e7 1073741824 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:19:14 devstack sudo[107739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-dad699db-1599-44ae-8e3f-e788743f48e7 1073741824 Sep 07 10:19:14 devstack sudo[107739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:19:14 devstack sudo[107735]: pam_unix(sudo:session): session closed for user root Sep 07 10:19:14 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-b159da4f-3b5b-4d5f-bdcc-863fa16e1483 tempest-ProjectMemberTests-55037479 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-cb38efe8-daec-475a-86a7-6fd9027c63b2.8fbcba67-5261-4992-9264-a5d45dceb9e6" returned: 0 in 0.540s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:19:14 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-b159da4f-3b5b-4d5f-bdcc-863fa16e1483 tempest-ProjectMemberTests-55037479 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cb38efe8-daec-475a-86a7-6fd9027c63b2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87515) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 10:19:14 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d9a095c-ba90-4af5-ba72-a56ea302df4c]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:19:14 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-b159da4f-3b5b-4d5f-bdcc-863fa16e1483 tempest-ProjectMemberTests-55037479 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-cb38efe8-daec-475a-86a7-6fd9027c63b2 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:19:14 devstack sudo[107742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-cb38efe8-daec-475a-86a7-6fd9027c63b2 Sep 07 10:19:14 devstack sudo[107742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:19:14 devstack sudo[107739]: pam_unix(sudo:session): session closed for user root Sep 07 10:19:14 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-27562024-8386-4f69-85fa-7e7ada71b3a7 tempest-ProjectReaderTests-205404938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-dad699db-1599-44ae-8e3f-e788743f48e7 1073741824" returned: 0 in 0.596s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:19:14 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-27562024-8386-4f69-85fa-7e7ada71b3a7 tempest-ProjectReaderTests-205404938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-dad699db-1599-44ae-8e3f-e788743f48e7 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:19:14 devstack sudo[107742]: pam_unix(sudo:session): session closed for user root Sep 07 10:19:14 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-b159da4f-3b5b-4d5f-bdcc-863fa16e1483 tempest-ProjectMemberTests-55037479 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-cb38efe8-daec-475a-86a7-6fd9027c63b2" returned: 0 in 0.511s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:19:14 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-b159da4f-3b5b-4d5f-bdcc-863fa16e1483 tempest-ProjectMemberTests-55037479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-cb38efe8-daec-475a-86a7-6fd9027c63b2.8fbcba67-5261-4992-9264-a5d45dceb9e6 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:19:14 devstack sudo[107751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-dad699db-1599-44ae-8e3f-e788743f48e7 Sep 07 10:19:14 devstack sudo[107751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:19:14 devstack sudo[107752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-cb38efe8-daec-475a-86a7-6fd9027c63b2.8fbcba67-5261-4992-9264-a5d45dceb9e6 Sep 07 10:19:14 devstack sudo[107752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:19:14 devstack sudo[107751]: pam_unix(sudo:session): session closed for user root Sep 07 10:19:14 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-27562024-8386-4f69-85fa-7e7ada71b3a7 tempest-ProjectReaderTests-205404938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-dad699db-1599-44ae-8e3f-e788743f48e7" returned: 0 in 0.284s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:19:14 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-27562024-8386-4f69-85fa-7e7ada71b3a7 tempest-ProjectReaderTests-205404938 None] <== create_volume: return (943ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'} {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 10:19:14 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-27562024-8386-4f69-85fa-7e7ada71b3a7 tempest-ProjectReaderTests-205404938 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.947s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:19:15 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-27562024-8386-4f69-85fa-7e7ada71b3a7 tempest-ProjectReaderTests-205404938 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (433b4ed6-adac-44f2-94f2-9e1e6e157058) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dad699db-1599-44ae-8e3f-e788743f48e7', 'volume_size': 1}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:19:15 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-27562024-8386-4f69-85fa-7e7ada71b3a7 tempest-ProjectReaderTests-205404938 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8ea53d6-4371-432c-a5e3-27648c49c52f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:19:15 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-27562024-8386-4f69-85fa-7e7ada71b3a7 tempest-ProjectReaderTests-205404938 None] Volume volume-dad699db-1599-44ae-8e3f-e788743f48e7 (dad699db-1599-44ae-8e3f-e788743f48e7): created successfully Sep 07 10:19:15 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-27562024-8386-4f69-85fa-7e7ada71b3a7 tempest-ProjectReaderTests-205404938 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8ea53d6-4371-432c-a5e3-27648c49c52f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:19:15 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-27562024-8386-4f69-85fa-7e7ada71b3a7 tempest-ProjectReaderTests-205404938 None] Flow 'volume_create_manager' (2d3845d4-cb5d-4211-b519-200d63e29951) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:19:15 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-27562024-8386-4f69-85fa-7e7ada71b3a7 tempest-ProjectReaderTests-205404938 None] Created volume successfully. Sep 07 10:19:15 devstack sudo[107752]: pam_unix(sudo:session): session closed for user root Sep 07 10:19:15 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-b159da4f-3b5b-4d5f-bdcc-863fa16e1483 tempest-ProjectMemberTests-55037479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-cb38efe8-daec-475a-86a7-6fd9027c63b2.8fbcba67-5261-4992-9264-a5d45dceb9e6" returned: 0 in 0.418s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:19:15 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-b159da4f-3b5b-4d5f-bdcc-863fa16e1483 tempest-ProjectMemberTests-55037479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-cb38efe8-daec-475a-86a7-6fd9027c63b2.8fbcba67-5261-4992-9264-a5d45dceb9e6 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:19:15 devstack sudo[107762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-cb38efe8-daec-475a-86a7-6fd9027c63b2.8fbcba67-5261-4992-9264-a5d45dceb9e6 Sep 07 10:19:15 devstack sudo[107762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:19:15 devstack sudo[107762]: pam_unix(sudo:session): session closed for user root Sep 07 10:19:15 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-b159da4f-3b5b-4d5f-bdcc-863fa16e1483 tempest-ProjectMemberTests-55037479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-cb38efe8-daec-475a-86a7-6fd9027c63b2.8fbcba67-5261-4992-9264-a5d45dceb9e6" returned: 0 in 0.244s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:19:15 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-b159da4f-3b5b-4d5f-bdcc-863fa16e1483 tempest-ProjectMemberTests-55037479 None] Lock "cinder-quobyte-8fbcba67-5261-4992-9264-a5d45dceb9e6" released by "_delete_snapshot" :: held 1.862s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:19:15 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-b159da4f-3b5b-4d5f-bdcc-863fa16e1483 tempest-ProjectMemberTests-55037479 None] Lock "cinder-quobyte-cb38efe8-daec-475a-86a7-6fd9027c63b2" released by "delete_snapshot" :: held 1.887s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:19:15 devstack cinder-volume[87515]: DEBUG cinder.quota [None req-b159da4f-3b5b-4d5f-bdcc-863fa16e1483 tempest-ProjectMemberTests-55037479 None] Created reservations ['162b59a0-3d85-4342-bb55-081ed70009c4', '59f74d5d-cf80-4f19-bdbb-06715d4cadba', 'abe70e82-60a1-4f79-9eb5-7c15993781fc', 'd29010f1-43e7-4ebd-a299-0a5c54231f7a'] {{(pid=87515) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:19:15 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-b159da4f-3b5b-4d5f-bdcc-863fa16e1483 tempest-ProjectMemberTests-55037479 None] Delete snapshot completed successfully. Sep 07 10:19:15 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-b159da4f-3b5b-4d5f-bdcc-863fa16e1483 tempest-ProjectMemberTests-55037479 None] Lock "cinder-8fbcba67-5261-4992-9264-a5d45dceb9e6-delete_snapshot" released by "delete_snapshot" :: held 2.038s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:19:15 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-a828144f-09df-42dc-82dc-626b0160f0bd tempest-ProjectMemberTests-55037479 None] Acquiring lock "cinder-cb38efe8-daec-475a-86a7-6fd9027c63b2-delete_volume" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:19:15 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-a828144f-09df-42dc-82dc-626b0160f0bd tempest-ProjectMemberTests-55037479 None] Lock "cinder-cb38efe8-daec-475a-86a7-6fd9027c63b2-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:19:15 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-a828144f-09df-42dc-82dc-626b0160f0bd tempest-ProjectMemberTests-55037479 None] Acquiring lock "cinder-quobyte-cb38efe8-daec-475a-86a7-6fd9027c63b2" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:19:15 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-a828144f-09df-42dc-82dc-626b0160f0bd tempest-ProjectMemberTests-55037479 None] Lock "cinder-quobyte-cb38efe8-daec-475a-86a7-6fd9027c63b2" acquired by "delete_volume" :: waited 0.017s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:19:15 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[05c01fcb-81c5-4f78-b1f2-7c5584d1db68]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:19:15 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-a828144f-09df-42dc-82dc-626b0160f0bd tempest-ProjectMemberTests-55037479 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-cb38efe8-daec-475a-86a7-6fd9027c63b2 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:19:16 devstack sudo[107765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-cb38efe8-daec-475a-86a7-6fd9027c63b2 Sep 07 10:19:16 devstack sudo[107765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:19:16 devstack sudo[107765]: pam_unix(sudo:session): session closed for user root Sep 07 10:19:16 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-a828144f-09df-42dc-82dc-626b0160f0bd tempest-ProjectMemberTests-55037479 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-cb38efe8-daec-475a-86a7-6fd9027c63b2" returned: 0 in 0.449s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:19:16 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-a828144f-09df-42dc-82dc-626b0160f0bd tempest-ProjectMemberTests-55037479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-cb38efe8-daec-475a-86a7-6fd9027c63b2 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:19:16 devstack sudo[107770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-cb38efe8-daec-475a-86a7-6fd9027c63b2 Sep 07 10:19:16 devstack sudo[107770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:19:16 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-e05192b9-0c19-4290-9db9-765472aa9b92 tempest-ProjectReaderTests-205404938 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:19:16 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-e05192b9-0c19-4290-9db9-765472aa9b92 tempest-ProjectReaderTests-205404938 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:19:16 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-e05192b9-0c19-4290-9db9-765472aa9b92 tempest-ProjectReaderTests-205404938 None] Creating offline snapshot 2c23693c-5cf7-415c-babd-b8606642ae36 of volume dad699db-1599-44ae-8e3f-e788743f48e7 {{(pid=87515) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 10:19:16 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9b500ec-04f1-4388-9d43-50f21207f58b]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:19:16 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-e05192b9-0c19-4290-9db9-765472aa9b92 tempest-ProjectReaderTests-205404938 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-dad699db-1599-44ae-8e3f-e788743f48e7 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:19:16 devstack sudo[107770]: pam_unix(sudo:session): session closed for user root Sep 07 10:19:16 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-a828144f-09df-42dc-82dc-626b0160f0bd tempest-ProjectMemberTests-55037479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-cb38efe8-daec-475a-86a7-6fd9027c63b2" returned: 0 in 0.361s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:19:16 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-a828144f-09df-42dc-82dc-626b0160f0bd tempest-ProjectMemberTests-55037479 None] Lock "cinder-quobyte-cb38efe8-daec-475a-86a7-6fd9027c63b2" released by "delete_volume" :: held 0.919s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:19:16 devstack sudo[107772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-dad699db-1599-44ae-8e3f-e788743f48e7 Sep 07 10:19:16 devstack sudo[107772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:19:16 devstack cinder-volume[87515]: DEBUG cinder.quota [None req-a828144f-09df-42dc-82dc-626b0160f0bd tempest-ProjectMemberTests-55037479 None] Created reservations ['5a6cb42a-de30-4a37-a51f-6d18671b52c7', 'fd472ed4-ed28-41a5-8e3b-ac383aad13fe', 'b80dba5d-83fd-4374-a68e-572db6d5bdac', '4db29dbb-1c6e-4541-bd26-1a0a397c2897'] {{(pid=87515) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:19:16 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-a828144f-09df-42dc-82dc-626b0160f0bd tempest-ProjectMemberTests-55037479 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:19:16 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-a828144f-09df-42dc-82dc-626b0160f0bd tempest-ProjectMemberTests-55037479 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:19:16 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-a828144f-09df-42dc-82dc-626b0160f0bd tempest-ProjectMemberTests-55037479 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:19:16 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-a828144f-09df-42dc-82dc-626b0160f0bd tempest-ProjectMemberTests-55037479 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:19:16 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-a828144f-09df-42dc-82dc-626b0160f0bd tempest-ProjectMemberTests-55037479 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:19:16 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-a828144f-09df-42dc-82dc-626b0160f0bd tempest-ProjectMemberTests-55037479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:19:17 devstack sudo[107775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a Sep 07 10:19:17 devstack sudo[107775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:19:17 devstack sudo[107772]: pam_unix(sudo:session): session closed for user root Sep 07 10:19:17 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-e05192b9-0c19-4290-9db9-765472aa9b92 tempest-ProjectReaderTests-205404938 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-dad699db-1599-44ae-8e3f-e788743f48e7" returned: 0 in 0.462s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:19:17 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-e05192b9-0c19-4290-9db9-765472aa9b92 tempest-ProjectReaderTests-205404938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-dad699db-1599-44ae-8e3f-e788743f48e7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-dad699db-1599-44ae-8e3f-e788743f48e7.2c23693c-5cf7-415c-babd-b8606642ae36 1G {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:19:17 devstack sudo[107780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-dad699db-1599-44ae-8e3f-e788743f48e7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-dad699db-1599-44ae-8e3f-e788743f48e7.2c23693c-5cf7-415c-babd-b8606642ae36 1G Sep 07 10:19:17 devstack sudo[107780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:19:17 devstack sudo[107775]: pam_unix(sudo:session): session closed for user root Sep 07 10:19:17 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-a828144f-09df-42dc-82dc-626b0160f0bd tempest-ProjectMemberTests-55037479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a" returned: 0 in 0.258s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:19:17 devstack cinder-volume[87515]: DEBUG cinder.manager [None req-a828144f-09df-42dc-82dc-626b0160f0bd tempest-ProjectMemberTests-55037479 None] Notifying Schedulers of capabilities ... {{(pid=87515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:19:17 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-a828144f-09df-42dc-82dc-626b0160f0bd tempest-ProjectMemberTests-55037479 None] Deleted volume successfully. Sep 07 10:19:17 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-a828144f-09df-42dc-82dc-626b0160f0bd tempest-ProjectMemberTests-55037479 None] Lock "cinder-cb38efe8-daec-475a-86a7-6fd9027c63b2-delete_volume" released by "delete_volume" :: held 1.484s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:19:17 devstack sudo[107780]: pam_unix(sudo:session): session closed for user root Sep 07 10:19:17 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-e05192b9-0c19-4290-9db9-765472aa9b92 tempest-ProjectReaderTests-205404938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-dad699db-1599-44ae-8e3f-e788743f48e7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-dad699db-1599-44ae-8e3f-e788743f48e7.2c23693c-5cf7-415c-babd-b8606642ae36 1G" returned: 0 in 0.413s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:19:17 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-e05192b9-0c19-4290-9db9-765472aa9b92 tempest-ProjectReaderTests-205404938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dad699db-1599-44ae-8e3f-e788743f48e7 -F qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-dad699db-1599-44ae-8e3f-e788743f48e7.2c23693c-5cf7-415c-babd-b8606642ae36 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:19:17 devstack sudo[107786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dad699db-1599-44ae-8e3f-e788743f48e7 -F qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-dad699db-1599-44ae-8e3f-e788743f48e7.2c23693c-5cf7-415c-babd-b8606642ae36 Sep 07 10:19:17 devstack sudo[107786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:19:17 devstack sudo[107786]: pam_unix(sudo:session): session closed for user root Sep 07 10:19:17 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-e05192b9-0c19-4290-9db9-765472aa9b92 tempest-ProjectReaderTests-205404938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dad699db-1599-44ae-8e3f-e788743f48e7 -F qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-dad699db-1599-44ae-8e3f-e788743f48e7.2c23693c-5cf7-415c-babd-b8606642ae36" returned: 0 in 0.294s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:19:17 devstack cinder-volume[87515]: WARNING cinder.volume.drivers.remotefs [None req-e05192b9-0c19-4290-9db9-765472aa9b92 tempest-ProjectReaderTests-205404938 None] /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-dad699db-1599-44ae-8e3f-e788743f48e7.2c23693c-5cf7-415c-babd-b8606642ae36 is being set with open permissions: ugo+rw Sep 07 10:19:17 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-e05192b9-0c19-4290-9db9-765472aa9b92 tempest-ProjectReaderTests-205404938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-dad699db-1599-44ae-8e3f-e788743f48e7.2c23693c-5cf7-415c-babd-b8606642ae36 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:19:17 devstack sudo[107791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-dad699db-1599-44ae-8e3f-e788743f48e7.2c23693c-5cf7-415c-babd-b8606642ae36 Sep 07 10:19:17 devstack sudo[107791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:19:18 devstack sudo[107791]: pam_unix(sudo:session): session closed for user root Sep 07 10:19:18 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-e05192b9-0c19-4290-9db9-765472aa9b92 tempest-ProjectReaderTests-205404938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-dad699db-1599-44ae-8e3f-e788743f48e7.2c23693c-5cf7-415c-babd-b8606642ae36" returned: 0 in 0.242s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:19:18 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-e05192b9-0c19-4290-9db9-765472aa9b92 tempest-ProjectReaderTests-205404938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-dad699db-1599-44ae-8e3f-e788743f48e7.info {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:19:18 devstack sudo[107794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-dad699db-1599-44ae-8e3f-e788743f48e7.info Sep 07 10:19:18 devstack sudo[107794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:19:18 devstack sudo[107794]: pam_unix(sudo:session): session closed for user root Sep 07 10:19:18 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-e05192b9-0c19-4290-9db9-765472aa9b92 tempest-ProjectReaderTests-205404938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-dad699db-1599-44ae-8e3f-e788743f48e7.info" returned: 0 in 0.293s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:19:18 devstack cinder-volume[87515]: WARNING cinder.volume.drivers.remotefs [None req-e05192b9-0c19-4290-9db9-765472aa9b92 tempest-ProjectReaderTests-205404938 None] /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-dad699db-1599-44ae-8e3f-e788743f48e7.info is being set with open permissions: ugo+rw Sep 07 10:19:18 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-e05192b9-0c19-4290-9db9-765472aa9b92 tempest-ProjectReaderTests-205404938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-dad699db-1599-44ae-8e3f-e788743f48e7.info {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:19:18 devstack sudo[107797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-dad699db-1599-44ae-8e3f-e788743f48e7.info Sep 07 10:19:18 devstack sudo[107797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:19:18 devstack cinder-volume[87515]: DEBUG cinder.volume.flows.manager.create_volume [None req-b82fc041-63c2-4f01-a3f7-4ddc138fd158 tempest-ProjectMemberTests-55037479 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 10:19:18 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-b82fc041-63c2-4f01-a3f7-4ddc138fd158 tempest-ProjectMemberTests-55037479 None] Flow 'volume_create_manager' (88b53643-2620-4ac2-b488-0f9fafb70032) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:19:18 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-b82fc041-63c2-4f01-a3f7-4ddc138fd158 tempest-ProjectMemberTests-55037479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1441589-38a9-4dd9-b8c4-71700b533029) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:19:18 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-b82fc041-63c2-4f01-a3f7-4ddc138fd158 tempest-ProjectMemberTests-55037479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1441589-38a9-4dd9-b8c4-71700b533029) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:19:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-515097538',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2d763d6-1f1b-4100-8467-8540037c7339,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41fa4493d2f045dc87793bd97d931cff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:19:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:19:18Z,use_quota=True,user_id='5136aa4e2a7c4a1da79d4e4478cdcbf6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3a092cd-7947-4cbf-abff-4ba9567becf0),volume_type_id=f3a092cd-7947-4cbf-abff-4ba9567becf0)' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:19:18 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-b82fc041-63c2-4f01-a3f7-4ddc138fd158 tempest-ProjectMemberTests-55037479 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb1a83d0-3089-4d77-9c6d-bbc7a815c3ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:19:18 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-b82fc041-63c2-4f01-a3f7-4ddc138fd158 tempest-ProjectMemberTests-55037479 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb1a83d0-3089-4d77-9c6d-bbc7a815c3ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:19:18 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-b82fc041-63c2-4f01-a3f7-4ddc138fd158 tempest-ProjectMemberTests-55037479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a839c37e-6d2f-4a38-95d2-82d89ab36212) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:19:18 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-b82fc041-63c2-4f01-a3f7-4ddc138fd158 tempest-ProjectMemberTests-55037479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a839c37e-6d2f-4a38-95d2-82d89ab36212) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd2d763d6-1f1b-4100-8467-8540037c7339', 'volume_name': 'volume-d2d763d6-1f1b-4100-8467-8540037c7339', 'volume_size': 1}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:19:18 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-b82fc041-63c2-4f01-a3f7-4ddc138fd158 tempest-ProjectMemberTests-55037479 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (679dcbaf-6e34-4ca1-873a-8781e1dc8338) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:19:18 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-b82fc041-63c2-4f01-a3f7-4ddc138fd158 tempest-ProjectMemberTests-55037479 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (679dcbaf-6e34-4ca1-873a-8781e1dc8338) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:19:18 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-b82fc041-63c2-4f01-a3f7-4ddc138fd158 tempest-ProjectMemberTests-55037479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96c13809-f8dc-4df5-ae19-059f692dff33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:19:18 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-b82fc041-63c2-4f01-a3f7-4ddc138fd158 tempest-ProjectMemberTests-55037479 None] Volume d2d763d6-1f1b-4100-8467-8540037c7339: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d2d763d6-1f1b-4100-8467-8540037c7339', 'volume_size': 1} Sep 07 10:19:18 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-b82fc041-63c2-4f01-a3f7-4ddc138fd158 tempest-ProjectMemberTests-55037479 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:19:18 devstack sudo[107797]: pam_unix(sudo:session): session closed for user root Sep 07 10:19:18 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-e05192b9-0c19-4290-9db9-765472aa9b92 tempest-ProjectReaderTests-205404938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-dad699db-1599-44ae-8e3f-e788743f48e7.info" returned: 0 in 0.262s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:19:18 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-e05192b9-0c19-4290-9db9-765472aa9b92 tempest-ProjectReaderTests-205404938 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.057s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:19:18 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-b82fc041-63c2-4f01-a3f7-4ddc138fd158 tempest-ProjectMemberTests-55037479 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.087s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:19:18 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-b82fc041-63c2-4f01-a3f7-4ddc138fd158 tempest-ProjectMemberTests-55037479 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:19:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-515097538',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2d763d6-1f1b-4100-8467-8540037c7339,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41fa4493d2f045dc87793bd97d931cff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:19:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:19:18Z,use_quota=True,user_id='5136aa4e2a7c4a1da79d4e4478cdcbf6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3a092cd-7947-4cbf-abff-4ba9567becf0),volume_type_id=f3a092cd-7947-4cbf-abff-4ba9567becf0)}" {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 10:19:18 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-b82fc041-63c2-4f01-a3f7-4ddc138fd158 tempest-ProjectMemberTests-55037479 None] Creating volume d2d763d6-1f1b-4100-8467-8540037c7339 {{(pid=87515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 10:19:18 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-b82fc041-63c2-4f01-a3f7-4ddc138fd158 tempest-ProjectMemberTests-55037479 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:19:18 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-b82fc041-63c2-4f01-a3f7-4ddc138fd158 tempest-ProjectMemberTests-55037479 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:19:18 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-b82fc041-63c2-4f01-a3f7-4ddc138fd158 tempest-ProjectMemberTests-55037479 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:19:18 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-b82fc041-63c2-4f01-a3f7-4ddc138fd158 tempest-ProjectMemberTests-55037479 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:19:18 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-b82fc041-63c2-4f01-a3f7-4ddc138fd158 tempest-ProjectMemberTests-55037479 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:19:18 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-b82fc041-63c2-4f01-a3f7-4ddc138fd158 tempest-ProjectMemberTests-55037479 None] Selected osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c as target Quobyte volume. {{(pid=87515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 10:19:18 devstack cinder-volume[87515]: INFO cinder.volume.drivers.remotefs [None req-b82fc041-63c2-4f01-a3f7-4ddc138fd158 tempest-ProjectMemberTests-55037479 None] casted to osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c Sep 07 10:19:18 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-b82fc041-63c2-4f01-a3f7-4ddc138fd158 tempest-ProjectMemberTests-55037479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-d2d763d6-1f1b-4100-8467-8540037c7339 1073741824 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:19:18 devstack sudo[107800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-d2d763d6-1f1b-4100-8467-8540037c7339 1073741824 Sep 07 10:19:18 devstack sudo[107800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:19:18 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-e05192b9-0c19-4290-9db9-765472aa9b92 tempest-ProjectReaderTests-205404938 None] Create snapshot completed successfully Sep 07 10:19:19 devstack sudo[107800]: pam_unix(sudo:session): session closed for user root Sep 07 10:19:19 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-b82fc041-63c2-4f01-a3f7-4ddc138fd158 tempest-ProjectMemberTests-55037479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-d2d763d6-1f1b-4100-8467-8540037c7339 1073741824" returned: 0 in 0.439s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:19:19 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-b82fc041-63c2-4f01-a3f7-4ddc138fd158 tempest-ProjectMemberTests-55037479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-d2d763d6-1f1b-4100-8467-8540037c7339 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:19:19 devstack sudo[107806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-d2d763d6-1f1b-4100-8467-8540037c7339 Sep 07 10:19:19 devstack sudo[107806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:19:19 devstack sudo[107806]: pam_unix(sudo:session): session closed for user root Sep 07 10:19:19 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-b82fc041-63c2-4f01-a3f7-4ddc138fd158 tempest-ProjectMemberTests-55037479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-d2d763d6-1f1b-4100-8467-8540037c7339" returned: 0 in 0.267s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:19:19 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-b82fc041-63c2-4f01-a3f7-4ddc138fd158 tempest-ProjectMemberTests-55037479 None] <== create_volume: return (747ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'} {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 10:19:19 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-b82fc041-63c2-4f01-a3f7-4ddc138fd158 tempest-ProjectMemberTests-55037479 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.750s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:19:19 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-b82fc041-63c2-4f01-a3f7-4ddc138fd158 tempest-ProjectMemberTests-55037479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96c13809-f8dc-4df5-ae19-059f692dff33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d2d763d6-1f1b-4100-8467-8540037c7339', 'volume_size': 1}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:19:19 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-b82fc041-63c2-4f01-a3f7-4ddc138fd158 tempest-ProjectMemberTests-55037479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (516f240f-fc6b-465c-b8e8-19b6115a34e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:19:19 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-b82fc041-63c2-4f01-a3f7-4ddc138fd158 tempest-ProjectMemberTests-55037479 None] Volume volume-d2d763d6-1f1b-4100-8467-8540037c7339 (d2d763d6-1f1b-4100-8467-8540037c7339): created successfully Sep 07 10:19:19 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-b82fc041-63c2-4f01-a3f7-4ddc138fd158 tempest-ProjectMemberTests-55037479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (516f240f-fc6b-465c-b8e8-19b6115a34e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:19:19 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-b82fc041-63c2-4f01-a3f7-4ddc138fd158 tempest-ProjectMemberTests-55037479 None] Flow 'volume_create_manager' (88b53643-2620-4ac2-b488-0f9fafb70032) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:19:19 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-b82fc041-63c2-4f01-a3f7-4ddc138fd158 tempest-ProjectMemberTests-55037479 None] Created volume successfully. Sep 07 10:19:19 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-1a9ff2b2-c4ad-47c2-b021-d5089564f24e tempest-ProjectReaderTests-205404938 None] Acquiring lock "cinder-2c23693c-5cf7-415c-babd-b8606642ae36-delete_snapshot" by "delete_snapshot" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:19:19 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-1a9ff2b2-c4ad-47c2-b021-d5089564f24e tempest-ProjectReaderTests-205404938 None] Lock "cinder-2c23693c-5cf7-415c-babd-b8606642ae36-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:19:19 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-1a9ff2b2-c4ad-47c2-b021-d5089564f24e tempest-ProjectReaderTests-205404938 None] Acquiring lock "cinder-quobyte-dad699db-1599-44ae-8e3f-e788743f48e7" by "delete_snapshot" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:19:19 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-1a9ff2b2-c4ad-47c2-b021-d5089564f24e tempest-ProjectReaderTests-205404938 None] Lock "cinder-quobyte-dad699db-1599-44ae-8e3f-e788743f48e7" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:19:19 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-1a9ff2b2-c4ad-47c2-b021-d5089564f24e tempest-ProjectReaderTests-205404938 None] Acquiring lock "cinder-quobyte-2c23693c-5cf7-415c-babd-b8606642ae36" by "_delete_snapshot" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:19:19 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-1a9ff2b2-c4ad-47c2-b021-d5089564f24e tempest-ProjectReaderTests-205404938 None] Lock "cinder-quobyte-2c23693c-5cf7-415c-babd-b8606642ae36" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:19:19 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-1a9ff2b2-c4ad-47c2-b021-d5089564f24e tempest-ProjectReaderTests-205404938 None] Deleting offline snapshot 2c23693c-5cf7-415c-babd-b8606642ae36 of volume dad699db-1599-44ae-8e3f-e788743f48e7 {{(pid=87515) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 10:19:19 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-1a9ff2b2-c4ad-47c2-b021-d5089564f24e tempest-ProjectReaderTests-205404938 None] snapshot_file for this snap is: volume-dad699db-1599-44ae-8e3f-e788743f48e7.2c23693c-5cf7-415c-babd-b8606642ae36 {{(pid=87515) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 10:19:19 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[7585c3a9-0728-4313-a492-a5cade3245e8]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:19:19 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-1a9ff2b2-c4ad-47c2-b021-d5089564f24e tempest-ProjectReaderTests-205404938 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-dad699db-1599-44ae-8e3f-e788743f48e7.2c23693c-5cf7-415c-babd-b8606642ae36 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:19:19 devstack sudo[107810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-dad699db-1599-44ae-8e3f-e788743f48e7.2c23693c-5cf7-415c-babd-b8606642ae36 Sep 07 10:19:19 devstack sudo[107810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:19:20 devstack sudo[107810]: pam_unix(sudo:session): session closed for user root Sep 07 10:19:20 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-1a9ff2b2-c4ad-47c2-b021-d5089564f24e tempest-ProjectReaderTests-205404938 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-dad699db-1599-44ae-8e3f-e788743f48e7.2c23693c-5cf7-415c-babd-b8606642ae36" returned: 0 in 0.383s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:19:20 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-1a9ff2b2-c4ad-47c2-b021-d5089564f24e tempest-ProjectReaderTests-205404938 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dad699db-1599-44ae-8e3f-e788743f48e7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87515) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 10:19:20 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[adf41924-f544-41b8-a778-d0a6d6919b1f]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:19:20 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-1a9ff2b2-c4ad-47c2-b021-d5089564f24e tempest-ProjectReaderTests-205404938 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-dad699db-1599-44ae-8e3f-e788743f48e7 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:19:20 devstack sudo[107815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-dad699db-1599-44ae-8e3f-e788743f48e7 Sep 07 10:19:20 devstack sudo[107815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:19:20 devstack sudo[107815]: pam_unix(sudo:session): session closed for user root Sep 07 10:19:20 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-1a9ff2b2-c4ad-47c2-b021-d5089564f24e tempest-ProjectReaderTests-205404938 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-dad699db-1599-44ae-8e3f-e788743f48e7" returned: 0 in 0.393s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:19:20 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-1a9ff2b2-c4ad-47c2-b021-d5089564f24e tempest-ProjectReaderTests-205404938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-dad699db-1599-44ae-8e3f-e788743f48e7.2c23693c-5cf7-415c-babd-b8606642ae36 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:19:20 devstack sudo[107820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-dad699db-1599-44ae-8e3f-e788743f48e7.2c23693c-5cf7-415c-babd-b8606642ae36 Sep 07 10:19:20 devstack sudo[107820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:19:20 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-97f5e2fb-51b3-481a-8206-35e38dc225aa tempest-ProjectMemberTests-55037479 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:19:20 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-97f5e2fb-51b3-481a-8206-35e38dc225aa tempest-ProjectMemberTests-55037479 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:19:20 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-97f5e2fb-51b3-481a-8206-35e38dc225aa tempest-ProjectMemberTests-55037479 None] Creating offline snapshot a84bbc0d-7da9-4e8a-8265-3f9fefab818a of volume d2d763d6-1f1b-4100-8467-8540037c7339 {{(pid=87515) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 10:19:20 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[78a7db15-6244-4748-890a-b1eda25572fc]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:19:20 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-97f5e2fb-51b3-481a-8206-35e38dc225aa tempest-ProjectMemberTests-55037479 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-d2d763d6-1f1b-4100-8467-8540037c7339 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:19:20 devstack sudo[107822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-d2d763d6-1f1b-4100-8467-8540037c7339 Sep 07 10:19:20 devstack sudo[107822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:19:21 devstack sudo[107820]: pam_unix(sudo:session): session closed for user root Sep 07 10:19:21 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-1a9ff2b2-c4ad-47c2-b021-d5089564f24e tempest-ProjectReaderTests-205404938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-dad699db-1599-44ae-8e3f-e788743f48e7.2c23693c-5cf7-415c-babd-b8606642ae36" returned: 0 in 0.416s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:19:21 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-1a9ff2b2-c4ad-47c2-b021-d5089564f24e tempest-ProjectReaderTests-205404938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-dad699db-1599-44ae-8e3f-e788743f48e7.2c23693c-5cf7-415c-babd-b8606642ae36 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:19:21 devstack sudo[107828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-dad699db-1599-44ae-8e3f-e788743f48e7.2c23693c-5cf7-415c-babd-b8606642ae36 Sep 07 10:19:21 devstack sudo[107828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:19:21 devstack sudo[107822]: pam_unix(sudo:session): session closed for user root Sep 07 10:19:21 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-97f5e2fb-51b3-481a-8206-35e38dc225aa tempest-ProjectMemberTests-55037479 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-d2d763d6-1f1b-4100-8467-8540037c7339" returned: 0 in 0.419s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:19:21 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-97f5e2fb-51b3-481a-8206-35e38dc225aa tempest-ProjectMemberTests-55037479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-d2d763d6-1f1b-4100-8467-8540037c7339,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-d2d763d6-1f1b-4100-8467-8540037c7339.a84bbc0d-7da9-4e8a-8265-3f9fefab818a 1G {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:19:21 devstack sudo[107833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-d2d763d6-1f1b-4100-8467-8540037c7339,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-d2d763d6-1f1b-4100-8467-8540037c7339.a84bbc0d-7da9-4e8a-8265-3f9fefab818a 1G Sep 07 10:19:21 devstack sudo[107833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:19:21 devstack sudo[107828]: pam_unix(sudo:session): session closed for user root Sep 07 10:19:21 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-1a9ff2b2-c4ad-47c2-b021-d5089564f24e tempest-ProjectReaderTests-205404938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-dad699db-1599-44ae-8e3f-e788743f48e7.2c23693c-5cf7-415c-babd-b8606642ae36" returned: 0 in 0.262s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:19:21 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-1a9ff2b2-c4ad-47c2-b021-d5089564f24e tempest-ProjectReaderTests-205404938 None] Lock "cinder-quobyte-2c23693c-5cf7-415c-babd-b8606642ae36" released by "_delete_snapshot" :: held 1.578s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:19:21 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-1a9ff2b2-c4ad-47c2-b021-d5089564f24e tempest-ProjectReaderTests-205404938 None] Lock "cinder-quobyte-dad699db-1599-44ae-8e3f-e788743f48e7" released by "delete_snapshot" :: held 1.606s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:19:21 devstack cinder-volume[87515]: DEBUG cinder.quota [None req-1a9ff2b2-c4ad-47c2-b021-d5089564f24e tempest-ProjectReaderTests-205404938 None] Created reservations ['8423de7f-47d6-4400-acbc-2113c53d9787', '2cf9e684-6171-4491-915c-d70ffc27383e', 'accafadf-8e04-4ed5-b872-7219512bd371', 'de2218d5-1ac8-405f-aa2e-d331ca6338c3'] {{(pid=87515) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:19:21 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-1a9ff2b2-c4ad-47c2-b021-d5089564f24e tempest-ProjectReaderTests-205404938 None] Delete snapshot completed successfully. Sep 07 10:19:21 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-1a9ff2b2-c4ad-47c2-b021-d5089564f24e tempest-ProjectReaderTests-205404938 None] Lock "cinder-2c23693c-5cf7-415c-babd-b8606642ae36-delete_snapshot" released by "delete_snapshot" :: held 1.780s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:19:21 devstack sudo[107833]: pam_unix(sudo:session): session closed for user root Sep 07 10:19:21 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-97f5e2fb-51b3-481a-8206-35e38dc225aa tempest-ProjectMemberTests-55037479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-d2d763d6-1f1b-4100-8467-8540037c7339,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-d2d763d6-1f1b-4100-8467-8540037c7339.a84bbc0d-7da9-4e8a-8265-3f9fefab818a 1G" returned: 0 in 0.454s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:19:21 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-97f5e2fb-51b3-481a-8206-35e38dc225aa tempest-ProjectMemberTests-55037479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d2d763d6-1f1b-4100-8467-8540037c7339 -F qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-d2d763d6-1f1b-4100-8467-8540037c7339.a84bbc0d-7da9-4e8a-8265-3f9fefab818a {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:19:21 devstack sudo[107840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d2d763d6-1f1b-4100-8467-8540037c7339 -F qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-d2d763d6-1f1b-4100-8467-8540037c7339.a84bbc0d-7da9-4e8a-8265-3f9fefab818a Sep 07 10:19:21 devstack sudo[107840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:19:21 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-9756d0e5-848f-4bd8-908d-64dd6298666f tempest-ProjectReaderTests-205404938 None] Acquiring lock "cinder-dad699db-1599-44ae-8e3f-e788743f48e7-delete_volume" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:19:22 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-9756d0e5-848f-4bd8-908d-64dd6298666f tempest-ProjectReaderTests-205404938 None] Lock "cinder-dad699db-1599-44ae-8e3f-e788743f48e7-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:19:22 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-9756d0e5-848f-4bd8-908d-64dd6298666f tempest-ProjectReaderTests-205404938 None] Acquiring lock "cinder-quobyte-dad699db-1599-44ae-8e3f-e788743f48e7" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:19:22 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-9756d0e5-848f-4bd8-908d-64dd6298666f tempest-ProjectReaderTests-205404938 None] Lock "cinder-quobyte-dad699db-1599-44ae-8e3f-e788743f48e7" acquired by "delete_volume" :: waited 0.017s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:19:22 devstack sudo[107840]: pam_unix(sudo:session): session closed for user root Sep 07 10:19:22 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-97f5e2fb-51b3-481a-8206-35e38dc225aa tempest-ProjectMemberTests-55037479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d2d763d6-1f1b-4100-8467-8540037c7339 -F qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-d2d763d6-1f1b-4100-8467-8540037c7339.a84bbc0d-7da9-4e8a-8265-3f9fefab818a" returned: 0 in 0.362s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:19:22 devstack cinder-volume[87515]: WARNING cinder.volume.drivers.remotefs [None req-97f5e2fb-51b3-481a-8206-35e38dc225aa tempest-ProjectMemberTests-55037479 None] /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-d2d763d6-1f1b-4100-8467-8540037c7339.a84bbc0d-7da9-4e8a-8265-3f9fefab818a is being set with open permissions: ugo+rw Sep 07 10:19:22 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-97f5e2fb-51b3-481a-8206-35e38dc225aa tempest-ProjectMemberTests-55037479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-d2d763d6-1f1b-4100-8467-8540037c7339.a84bbc0d-7da9-4e8a-8265-3f9fefab818a {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:19:22 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e71cbb5-6fc0-4337-836b-126bd45af7ea]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:19:22 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-9756d0e5-848f-4bd8-908d-64dd6298666f tempest-ProjectReaderTests-205404938 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-dad699db-1599-44ae-8e3f-e788743f48e7 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:19:22 devstack sudo[107846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-d2d763d6-1f1b-4100-8467-8540037c7339.a84bbc0d-7da9-4e8a-8265-3f9fefab818a Sep 07 10:19:22 devstack sudo[107846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:19:22 devstack sudo[107847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-dad699db-1599-44ae-8e3f-e788743f48e7 Sep 07 10:19:22 devstack sudo[107847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:19:22 devstack sudo[107846]: pam_unix(sudo:session): session closed for user root Sep 07 10:19:22 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-97f5e2fb-51b3-481a-8206-35e38dc225aa tempest-ProjectMemberTests-55037479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-d2d763d6-1f1b-4100-8467-8540037c7339.a84bbc0d-7da9-4e8a-8265-3f9fefab818a" returned: 0 in 0.271s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:19:22 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-97f5e2fb-51b3-481a-8206-35e38dc225aa tempest-ProjectMemberTests-55037479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-d2d763d6-1f1b-4100-8467-8540037c7339.info {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:19:22 devstack sudo[107851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-d2d763d6-1f1b-4100-8467-8540037c7339.info Sep 07 10:19:22 devstack sudo[107851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:19:22 devstack cinder-volume[87515]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a0087de-abc5-443e-8e1d-d86e20076c5c tempest-ProjectReaderTests-297640696 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 10:19:22 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-0a0087de-abc5-443e-8e1d-d86e20076c5c tempest-ProjectReaderTests-297640696 None] Flow 'volume_create_manager' (425c0056-253c-4c5e-b334-b1ba30d68623) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:19:22 devstack sudo[107847]: pam_unix(sudo:session): session closed for user root Sep 07 10:19:22 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-0a0087de-abc5-443e-8e1d-d86e20076c5c tempest-ProjectReaderTests-297640696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a19449c5-4a35-4702-b904-97e6a3bf1b91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:19:22 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-9756d0e5-848f-4bd8-908d-64dd6298666f tempest-ProjectReaderTests-205404938 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-dad699db-1599-44ae-8e3f-e788743f48e7" returned: 0 in 0.441s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:19:22 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-9756d0e5-848f-4bd8-908d-64dd6298666f tempest-ProjectReaderTests-205404938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-dad699db-1599-44ae-8e3f-e788743f48e7 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:19:22 devstack sudo[107856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-dad699db-1599-44ae-8e3f-e788743f48e7 Sep 07 10:19:22 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-0a0087de-abc5-443e-8e1d-d86e20076c5c tempest-ProjectReaderTests-297640696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a19449c5-4a35-4702-b904-97e6a3bf1b91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:19:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1595360391',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c75ea3a4-f16f-468d-abab-cdabf41fcfea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c25563867ef40fdbdf27810abb2b572',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:19:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:19:22Z,use_quota=True,user_id='17e6ed6b77514bb791ff09302ed265cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3a092cd-7947-4cbf-abff-4ba9567becf0),volume_type_id=f3a092cd-7947-4cbf-abff-4ba9567becf0)' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:19:22 devstack sudo[107856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:19:22 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-0a0087de-abc5-443e-8e1d-d86e20076c5c tempest-ProjectReaderTests-297640696 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e61c794-4613-49f3-a70b-7ad4262b7d8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:19:22 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-0a0087de-abc5-443e-8e1d-d86e20076c5c tempest-ProjectReaderTests-297640696 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e61c794-4613-49f3-a70b-7ad4262b7d8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:19:22 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-0a0087de-abc5-443e-8e1d-d86e20076c5c tempest-ProjectReaderTests-297640696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23a19879-e46c-49f8-8c18-ae930fd370da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:19:22 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-0a0087de-abc5-443e-8e1d-d86e20076c5c tempest-ProjectReaderTests-297640696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23a19879-e46c-49f8-8c18-ae930fd370da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c75ea3a4-f16f-468d-abab-cdabf41fcfea', 'volume_name': 'volume-c75ea3a4-f16f-468d-abab-cdabf41fcfea', 'volume_size': 1}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:19:22 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-0a0087de-abc5-443e-8e1d-d86e20076c5c tempest-ProjectReaderTests-297640696 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb689333-3eb1-47b7-aeba-13e2cb2eec45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:19:22 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-0a0087de-abc5-443e-8e1d-d86e20076c5c tempest-ProjectReaderTests-297640696 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb689333-3eb1-47b7-aeba-13e2cb2eec45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:19:22 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-0a0087de-abc5-443e-8e1d-d86e20076c5c tempest-ProjectReaderTests-297640696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (798be1eb-09be-4bc7-8a08-ce8a1ab685d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:19:22 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-0a0087de-abc5-443e-8e1d-d86e20076c5c tempest-ProjectReaderTests-297640696 None] Volume c75ea3a4-f16f-468d-abab-cdabf41fcfea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c75ea3a4-f16f-468d-abab-cdabf41fcfea', 'volume_size': 1} Sep 07 10:19:22 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-0a0087de-abc5-443e-8e1d-d86e20076c5c tempest-ProjectReaderTests-297640696 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:19:22 devstack sudo[107851]: pam_unix(sudo:session): session closed for user root Sep 07 10:19:22 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-97f5e2fb-51b3-481a-8206-35e38dc225aa tempest-ProjectMemberTests-55037479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-d2d763d6-1f1b-4100-8467-8540037c7339.info" returned: 0 in 0.267s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:19:22 devstack cinder-volume[87515]: WARNING cinder.volume.drivers.remotefs [None req-97f5e2fb-51b3-481a-8206-35e38dc225aa tempest-ProjectMemberTests-55037479 None] /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-d2d763d6-1f1b-4100-8467-8540037c7339.info is being set with open permissions: ugo+rw Sep 07 10:19:22 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-97f5e2fb-51b3-481a-8206-35e38dc225aa tempest-ProjectMemberTests-55037479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-d2d763d6-1f1b-4100-8467-8540037c7339.info {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:19:22 devstack sudo[107859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-d2d763d6-1f1b-4100-8467-8540037c7339.info Sep 07 10:19:22 devstack sudo[107859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:19:22 devstack sudo[107856]: pam_unix(sudo:session): session closed for user root Sep 07 10:19:22 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-9756d0e5-848f-4bd8-908d-64dd6298666f tempest-ProjectReaderTests-205404938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-dad699db-1599-44ae-8e3f-e788743f48e7" returned: 0 in 0.264s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:19:22 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-9756d0e5-848f-4bd8-908d-64dd6298666f tempest-ProjectReaderTests-205404938 None] Lock "cinder-quobyte-dad699db-1599-44ae-8e3f-e788743f48e7" released by "delete_volume" :: held 0.785s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:19:22 devstack cinder-volume[87515]: DEBUG cinder.quota [None req-9756d0e5-848f-4bd8-908d-64dd6298666f tempest-ProjectReaderTests-205404938 None] Created reservations ['3e47c031-d680-4625-8c0b-97df4298ef34', '9fb89549-99b8-426f-95e1-b7899d34a7a6', 'cde855ac-3536-4977-b7de-57e526698a06', 'c665cb82-1709-4ea2-8c9d-d0e7f0149421'] {{(pid=87515) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:19:22 devstack sudo[107859]: pam_unix(sudo:session): session closed for user root Sep 07 10:19:22 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-97f5e2fb-51b3-481a-8206-35e38dc225aa tempest-ProjectMemberTests-55037479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-d2d763d6-1f1b-4100-8467-8540037c7339.info" returned: 0 in 0.258s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:19:22 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-97f5e2fb-51b3-481a-8206-35e38dc225aa tempest-ProjectMemberTests-55037479 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.146s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:19:22 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-0a0087de-abc5-443e-8e1d-d86e20076c5c tempest-ProjectReaderTests-297640696 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.325s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:19:22 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-0a0087de-abc5-443e-8e1d-d86e20076c5c tempest-ProjectReaderTests-297640696 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:19:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1595360391',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c75ea3a4-f16f-468d-abab-cdabf41fcfea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c25563867ef40fdbdf27810abb2b572',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:19:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:19:22Z,use_quota=True,user_id='17e6ed6b77514bb791ff09302ed265cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3a092cd-7947-4cbf-abff-4ba9567becf0),volume_type_id=f3a092cd-7947-4cbf-abff-4ba9567becf0)}" {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 10:19:22 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-0a0087de-abc5-443e-8e1d-d86e20076c5c tempest-ProjectReaderTests-297640696 None] Creating volume c75ea3a4-f16f-468d-abab-cdabf41fcfea {{(pid=87515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 10:19:22 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-0a0087de-abc5-443e-8e1d-d86e20076c5c tempest-ProjectReaderTests-297640696 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:19:22 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-0a0087de-abc5-443e-8e1d-d86e20076c5c tempest-ProjectReaderTests-297640696 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:19:22 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-0a0087de-abc5-443e-8e1d-d86e20076c5c tempest-ProjectReaderTests-297640696 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:19:22 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-0a0087de-abc5-443e-8e1d-d86e20076c5c tempest-ProjectReaderTests-297640696 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:19:22 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-0a0087de-abc5-443e-8e1d-d86e20076c5c tempest-ProjectReaderTests-297640696 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:19:22 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-0a0087de-abc5-443e-8e1d-d86e20076c5c tempest-ProjectReaderTests-297640696 None] Selected osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c as target Quobyte volume. {{(pid=87515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 10:19:22 devstack cinder-volume[87515]: INFO cinder.volume.drivers.remotefs [None req-0a0087de-abc5-443e-8e1d-d86e20076c5c tempest-ProjectReaderTests-297640696 None] casted to osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c Sep 07 10:19:22 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-0a0087de-abc5-443e-8e1d-d86e20076c5c tempest-ProjectReaderTests-297640696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-c75ea3a4-f16f-468d-abab-cdabf41fcfea 1073741824 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:19:22 devstack sudo[107863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-c75ea3a4-f16f-468d-abab-cdabf41fcfea 1073741824 Sep 07 10:19:22 devstack sudo[107863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:19:23 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-9756d0e5-848f-4bd8-908d-64dd6298666f tempest-ProjectReaderTests-205404938 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:19:23 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-9756d0e5-848f-4bd8-908d-64dd6298666f tempest-ProjectReaderTests-205404938 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:19:23 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-9756d0e5-848f-4bd8-908d-64dd6298666f tempest-ProjectReaderTests-205404938 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:19:23 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-9756d0e5-848f-4bd8-908d-64dd6298666f tempest-ProjectReaderTests-205404938 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:19:23 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-9756d0e5-848f-4bd8-908d-64dd6298666f tempest-ProjectReaderTests-205404938 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:19:23 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-9756d0e5-848f-4bd8-908d-64dd6298666f tempest-ProjectReaderTests-205404938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:19:23 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-97f5e2fb-51b3-481a-8206-35e38dc225aa tempest-ProjectMemberTests-55037479 None] Create snapshot completed successfully Sep 07 10:19:23 devstack sudo[107865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a Sep 07 10:19:23 devstack sudo[107865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:19:23 devstack sudo[107865]: pam_unix(sudo:session): session closed for user root Sep 07 10:19:23 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-9756d0e5-848f-4bd8-908d-64dd6298666f tempest-ProjectReaderTests-205404938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a" returned: 0 in 0.253s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:19:23 devstack cinder-volume[87515]: DEBUG cinder.manager [None req-9756d0e5-848f-4bd8-908d-64dd6298666f tempest-ProjectReaderTests-205404938 None] Notifying Schedulers of capabilities ... {{(pid=87515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:19:23 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-9756d0e5-848f-4bd8-908d-64dd6298666f tempest-ProjectReaderTests-205404938 None] Deleted volume successfully. Sep 07 10:19:23 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-9756d0e5-848f-4bd8-908d-64dd6298666f tempest-ProjectReaderTests-205404938 None] Lock "cinder-dad699db-1599-44ae-8e3f-e788743f48e7-delete_volume" released by "delete_volume" :: held 1.296s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:19:23 devstack sudo[107863]: pam_unix(sudo:session): session closed for user root Sep 07 10:19:23 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-0a0087de-abc5-443e-8e1d-d86e20076c5c tempest-ProjectReaderTests-297640696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-c75ea3a4-f16f-468d-abab-cdabf41fcfea 1073741824" returned: 0 in 0.498s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:19:23 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-0a0087de-abc5-443e-8e1d-d86e20076c5c tempest-ProjectReaderTests-297640696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-c75ea3a4-f16f-468d-abab-cdabf41fcfea {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:19:23 devstack sudo[107872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-c75ea3a4-f16f-468d-abab-cdabf41fcfea Sep 07 10:19:23 devstack sudo[107872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:19:23 devstack cinder-volume[87515]: DEBUG cinder.volume.flows.manager.create_volume [None req-f739483d-4815-476d-bb44-c1677ccd6e38 tempest-ProjectReaderTests-205404938 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 10:19:23 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-f739483d-4815-476d-bb44-c1677ccd6e38 tempest-ProjectReaderTests-205404938 None] Flow 'volume_create_manager' (1a129570-f9e7-4917-af7f-85718747e16c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:19:23 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-f739483d-4815-476d-bb44-c1677ccd6e38 tempest-ProjectReaderTests-205404938 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (554d150b-a4fd-4ae7-b742-15c648f25a85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:19:23 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-f739483d-4815-476d-bb44-c1677ccd6e38 tempest-ProjectReaderTests-205404938 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (554d150b-a4fd-4ae7-b742-15c648f25a85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:19:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1035975187',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4733512f-33ce-4e33-9447-cf5f6a07a66f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4bd49c4be7a74648ab6f55922f0638c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:19:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:19:24Z,use_quota=True,user_id='0477ac649f0140bf9c034ba6d1a49938',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3a092cd-7947-4cbf-abff-4ba9567becf0),volume_type_id=f3a092cd-7947-4cbf-abff-4ba9567becf0)' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:19:23 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-f739483d-4815-476d-bb44-c1677ccd6e38 tempest-ProjectReaderTests-205404938 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95932700-574b-4a4d-8df6-06b9d8a50d9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:19:23 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-f739483d-4815-476d-bb44-c1677ccd6e38 tempest-ProjectReaderTests-205404938 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95932700-574b-4a4d-8df6-06b9d8a50d9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:19:23 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-f739483d-4815-476d-bb44-c1677ccd6e38 tempest-ProjectReaderTests-205404938 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46f70543-e801-4421-9860-65c5cdeed41b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:19:23 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-f739483d-4815-476d-bb44-c1677ccd6e38 tempest-ProjectReaderTests-205404938 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46f70543-e801-4421-9860-65c5cdeed41b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4733512f-33ce-4e33-9447-cf5f6a07a66f', 'volume_name': 'volume-4733512f-33ce-4e33-9447-cf5f6a07a66f', 'volume_size': 1}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:19:23 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-f739483d-4815-476d-bb44-c1677ccd6e38 tempest-ProjectReaderTests-205404938 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a47e809b-ef93-4c18-a094-d9715a17bff3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:19:23 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-f739483d-4815-476d-bb44-c1677ccd6e38 tempest-ProjectReaderTests-205404938 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a47e809b-ef93-4c18-a094-d9715a17bff3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:19:23 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-f739483d-4815-476d-bb44-c1677ccd6e38 tempest-ProjectReaderTests-205404938 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ff8e1f5-970b-4b67-8056-6ac65083a447) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:19:23 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-f739483d-4815-476d-bb44-c1677ccd6e38 tempest-ProjectReaderTests-205404938 None] Volume 4733512f-33ce-4e33-9447-cf5f6a07a66f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4733512f-33ce-4e33-9447-cf5f6a07a66f', 'volume_size': 1} Sep 07 10:19:23 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-f739483d-4815-476d-bb44-c1677ccd6e38 tempest-ProjectReaderTests-205404938 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:19:23 devstack sudo[107872]: pam_unix(sudo:session): session closed for user root Sep 07 10:19:23 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-0a0087de-abc5-443e-8e1d-d86e20076c5c tempest-ProjectReaderTests-297640696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-c75ea3a4-f16f-468d-abab-cdabf41fcfea" returned: 0 in 0.262s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:19:23 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-0a0087de-abc5-443e-8e1d-d86e20076c5c tempest-ProjectReaderTests-297640696 None] <== create_volume: return (807ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'} {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 10:19:23 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-0a0087de-abc5-443e-8e1d-d86e20076c5c tempest-ProjectReaderTests-297640696 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.810s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:19:23 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-f739483d-4815-476d-bb44-c1677ccd6e38 tempest-ProjectReaderTests-205404938 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.040s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:19:23 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-f739483d-4815-476d-bb44-c1677ccd6e38 tempest-ProjectReaderTests-205404938 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:19:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1035975187',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4733512f-33ce-4e33-9447-cf5f6a07a66f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4bd49c4be7a74648ab6f55922f0638c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:19:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:19:24Z,use_quota=True,user_id='0477ac649f0140bf9c034ba6d1a49938',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3a092cd-7947-4cbf-abff-4ba9567becf0),volume_type_id=f3a092cd-7947-4cbf-abff-4ba9567becf0)}" {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 10:19:23 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-f739483d-4815-476d-bb44-c1677ccd6e38 tempest-ProjectReaderTests-205404938 None] Creating volume 4733512f-33ce-4e33-9447-cf5f6a07a66f {{(pid=87515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 10:19:23 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-f739483d-4815-476d-bb44-c1677ccd6e38 tempest-ProjectReaderTests-205404938 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:19:23 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-f739483d-4815-476d-bb44-c1677ccd6e38 tempest-ProjectReaderTests-205404938 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:19:23 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-f739483d-4815-476d-bb44-c1677ccd6e38 tempest-ProjectReaderTests-205404938 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:19:23 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-f739483d-4815-476d-bb44-c1677ccd6e38 tempest-ProjectReaderTests-205404938 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:19:23 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-f739483d-4815-476d-bb44-c1677ccd6e38 tempest-ProjectReaderTests-205404938 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:19:23 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-f739483d-4815-476d-bb44-c1677ccd6e38 tempest-ProjectReaderTests-205404938 None] Selected osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c as target Quobyte volume. {{(pid=87515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 10:19:23 devstack cinder-volume[87515]: INFO cinder.volume.drivers.remotefs [None req-f739483d-4815-476d-bb44-c1677ccd6e38 tempest-ProjectReaderTests-205404938 None] casted to osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c Sep 07 10:19:23 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-f739483d-4815-476d-bb44-c1677ccd6e38 tempest-ProjectReaderTests-205404938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-4733512f-33ce-4e33-9447-cf5f6a07a66f 1073741824 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:19:23 devstack sudo[107875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-4733512f-33ce-4e33-9447-cf5f6a07a66f 1073741824 Sep 07 10:19:23 devstack sudo[107875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:19:23 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-0a0087de-abc5-443e-8e1d-d86e20076c5c tempest-ProjectReaderTests-297640696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (798be1eb-09be-4bc7-8a08-ce8a1ab685d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c75ea3a4-f16f-468d-abab-cdabf41fcfea', 'volume_size': 1}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:19:23 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-0a0087de-abc5-443e-8e1d-d86e20076c5c tempest-ProjectReaderTests-297640696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ffe61ba-5093-4723-834e-0965b5e09e91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:19:23 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-0a0087de-abc5-443e-8e1d-d86e20076c5c tempest-ProjectReaderTests-297640696 None] Volume volume-c75ea3a4-f16f-468d-abab-cdabf41fcfea (c75ea3a4-f16f-468d-abab-cdabf41fcfea): created successfully Sep 07 10:19:23 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-0a0087de-abc5-443e-8e1d-d86e20076c5c tempest-ProjectReaderTests-297640696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ffe61ba-5093-4723-834e-0965b5e09e91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:19:23 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-0a0087de-abc5-443e-8e1d-d86e20076c5c tempest-ProjectReaderTests-297640696 None] Flow 'volume_create_manager' (425c0056-253c-4c5e-b334-b1ba30d68623) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:19:23 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-0a0087de-abc5-443e-8e1d-d86e20076c5c tempest-ProjectReaderTests-297640696 None] Created volume successfully. Sep 07 10:19:23 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-12416292-cd5d-4a70-9f05-7faa28fdf338 tempest-ProjectMemberTests-55037479 None] Acquiring lock "cinder-a84bbc0d-7da9-4e8a-8265-3f9fefab818a-delete_snapshot" by "delete_snapshot" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:19:23 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-12416292-cd5d-4a70-9f05-7faa28fdf338 tempest-ProjectMemberTests-55037479 None] Lock "cinder-a84bbc0d-7da9-4e8a-8265-3f9fefab818a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:19:23 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-12416292-cd5d-4a70-9f05-7faa28fdf338 tempest-ProjectMemberTests-55037479 None] Acquiring lock "cinder-quobyte-d2d763d6-1f1b-4100-8467-8540037c7339" by "delete_snapshot" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:19:24 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-12416292-cd5d-4a70-9f05-7faa28fdf338 tempest-ProjectMemberTests-55037479 None] Lock "cinder-quobyte-d2d763d6-1f1b-4100-8467-8540037c7339" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:19:24 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-12416292-cd5d-4a70-9f05-7faa28fdf338 tempest-ProjectMemberTests-55037479 None] Acquiring lock "cinder-quobyte-a84bbc0d-7da9-4e8a-8265-3f9fefab818a" by "_delete_snapshot" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:19:24 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-12416292-cd5d-4a70-9f05-7faa28fdf338 tempest-ProjectMemberTests-55037479 None] Lock "cinder-quobyte-a84bbc0d-7da9-4e8a-8265-3f9fefab818a" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:19:24 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-12416292-cd5d-4a70-9f05-7faa28fdf338 tempest-ProjectMemberTests-55037479 None] Deleting offline snapshot a84bbc0d-7da9-4e8a-8265-3f9fefab818a of volume d2d763d6-1f1b-4100-8467-8540037c7339 {{(pid=87515) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 10:19:24 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-12416292-cd5d-4a70-9f05-7faa28fdf338 tempest-ProjectMemberTests-55037479 None] snapshot_file for this snap is: volume-d2d763d6-1f1b-4100-8467-8540037c7339.a84bbc0d-7da9-4e8a-8265-3f9fefab818a {{(pid=87515) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 10:19:24 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0a98700-8330-439b-a12f-57c5c0b71658]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:19:24 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-12416292-cd5d-4a70-9f05-7faa28fdf338 tempest-ProjectMemberTests-55037479 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-d2d763d6-1f1b-4100-8467-8540037c7339.a84bbc0d-7da9-4e8a-8265-3f9fefab818a {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:19:24 devstack sudo[107880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-d2d763d6-1f1b-4100-8467-8540037c7339.a84bbc0d-7da9-4e8a-8265-3f9fefab818a Sep 07 10:19:24 devstack sudo[107880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:19:24 devstack sudo[107875]: pam_unix(sudo:session): session closed for user root Sep 07 10:19:24 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-f739483d-4815-476d-bb44-c1677ccd6e38 tempest-ProjectReaderTests-205404938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-4733512f-33ce-4e33-9447-cf5f6a07a66f 1073741824" returned: 0 in 0.418s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:19:24 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-f739483d-4815-476d-bb44-c1677ccd6e38 tempest-ProjectReaderTests-205404938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-4733512f-33ce-4e33-9447-cf5f6a07a66f {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:19:24 devstack sudo[107883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-4733512f-33ce-4e33-9447-cf5f6a07a66f Sep 07 10:19:24 devstack sudo[107883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:19:24 devstack sudo[107880]: pam_unix(sudo:session): session closed for user root Sep 07 10:19:24 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-12416292-cd5d-4a70-9f05-7faa28fdf338 tempest-ProjectMemberTests-55037479 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-d2d763d6-1f1b-4100-8467-8540037c7339.a84bbc0d-7da9-4e8a-8265-3f9fefab818a" returned: 0 in 0.388s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:19:24 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-12416292-cd5d-4a70-9f05-7faa28fdf338 tempest-ProjectMemberTests-55037479 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d2d763d6-1f1b-4100-8467-8540037c7339(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87515) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 10:19:24 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e086679-d6eb-4c29-abcb-2995982b0d39]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:19:24 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-12416292-cd5d-4a70-9f05-7faa28fdf338 tempest-ProjectMemberTests-55037479 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-d2d763d6-1f1b-4100-8467-8540037c7339 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:19:24 devstack sudo[107883]: pam_unix(sudo:session): session closed for user root Sep 07 10:19:24 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-f739483d-4815-476d-bb44-c1677ccd6e38 tempest-ProjectReaderTests-205404938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-4733512f-33ce-4e33-9447-cf5f6a07a66f" returned: 0 in 0.266s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:19:24 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-f739483d-4815-476d-bb44-c1677ccd6e38 tempest-ProjectReaderTests-205404938 None] <== create_volume: return (727ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'} {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 10:19:24 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-f739483d-4815-476d-bb44-c1677ccd6e38 tempest-ProjectReaderTests-205404938 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.731s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:19:24 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-f739483d-4815-476d-bb44-c1677ccd6e38 tempest-ProjectReaderTests-205404938 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ff8e1f5-970b-4b67-8056-6ac65083a447) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4733512f-33ce-4e33-9447-cf5f6a07a66f', 'volume_size': 1}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:19:24 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-f739483d-4815-476d-bb44-c1677ccd6e38 tempest-ProjectReaderTests-205404938 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8b43b63-b485-45ce-9343-7899030d5f58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:19:24 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-f739483d-4815-476d-bb44-c1677ccd6e38 tempest-ProjectReaderTests-205404938 None] Volume volume-4733512f-33ce-4e33-9447-cf5f6a07a66f (4733512f-33ce-4e33-9447-cf5f6a07a66f): created successfully Sep 07 10:19:24 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-f739483d-4815-476d-bb44-c1677ccd6e38 tempest-ProjectReaderTests-205404938 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8b43b63-b485-45ce-9343-7899030d5f58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:19:24 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-f739483d-4815-476d-bb44-c1677ccd6e38 tempest-ProjectReaderTests-205404938 None] Flow 'volume_create_manager' (1a129570-f9e7-4917-af7f-85718747e16c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:19:24 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-f739483d-4815-476d-bb44-c1677ccd6e38 tempest-ProjectReaderTests-205404938 None] Created volume successfully. Sep 07 10:19:24 devstack sudo[107889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-d2d763d6-1f1b-4100-8467-8540037c7339 Sep 07 10:19:24 devstack sudo[107889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:19:24 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-4a2501bd-3f0a-4978-bdd4-795b76c7425d tempest-ProjectReaderTests-297640696 None] Acquiring lock "cinder-c75ea3a4-f16f-468d-abab-cdabf41fcfea-delete_volume" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:19:24 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-9a82308a-4573-4601-9e6f-d016145c5f96 tempest-ProjectReaderTests-205404938 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:19:24 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-9a82308a-4573-4601-9e6f-d016145c5f96 tempest-ProjectReaderTests-205404938 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:19:24 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-9a82308a-4573-4601-9e6f-d016145c5f96 tempest-ProjectReaderTests-205404938 None] Creating offline snapshot 2aa3dfa3-3f2f-4389-8d02-3ce16cb2344c of volume 4733512f-33ce-4e33-9447-cf5f6a07a66f {{(pid=87515) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 10:19:24 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-4a2501bd-3f0a-4978-bdd4-795b76c7425d tempest-ProjectReaderTests-297640696 None] Lock "cinder-c75ea3a4-f16f-468d-abab-cdabf41fcfea-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:19:24 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[10a59f7e-54c7-4e28-afc6-15da22bc19bb]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:19:24 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-9a82308a-4573-4601-9e6f-d016145c5f96 tempest-ProjectReaderTests-205404938 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-4733512f-33ce-4e33-9447-cf5f6a07a66f {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:19:24 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-4a2501bd-3f0a-4978-bdd4-795b76c7425d tempest-ProjectReaderTests-297640696 None] Acquiring lock "cinder-quobyte-c75ea3a4-f16f-468d-abab-cdabf41fcfea" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:19:24 devstack sudo[107889]: pam_unix(sudo:session): session closed for user root Sep 07 10:19:24 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-12416292-cd5d-4a70-9f05-7faa28fdf338 tempest-ProjectMemberTests-55037479 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-d2d763d6-1f1b-4100-8467-8540037c7339" returned: 0 in 0.451s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:19:24 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-12416292-cd5d-4a70-9f05-7faa28fdf338 tempest-ProjectMemberTests-55037479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-d2d763d6-1f1b-4100-8467-8540037c7339.a84bbc0d-7da9-4e8a-8265-3f9fefab818a {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:19:24 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-4a2501bd-3f0a-4978-bdd4-795b76c7425d tempest-ProjectReaderTests-297640696 None] Lock "cinder-quobyte-c75ea3a4-f16f-468d-abab-cdabf41fcfea" acquired by "delete_volume" :: waited 0.027s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:19:24 devstack sudo[107895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-d2d763d6-1f1b-4100-8467-8540037c7339.a84bbc0d-7da9-4e8a-8265-3f9fefab818a Sep 07 10:19:24 devstack sudo[107895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:19:24 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[c17f7f9c-fcf0-4f34-9aa6-1478857798f5]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:19:24 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-4a2501bd-3f0a-4978-bdd4-795b76c7425d tempest-ProjectReaderTests-297640696 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-c75ea3a4-f16f-468d-abab-cdabf41fcfea {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:19:25 devstack sudo[107894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-4733512f-33ce-4e33-9447-cf5f6a07a66f Sep 07 10:19:25 devstack sudo[107894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:19:25 devstack sudo[107897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-c75ea3a4-f16f-468d-abab-cdabf41fcfea Sep 07 10:19:25 devstack sudo[107897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:19:25 devstack sudo[107894]: pam_unix(sudo:session): session closed for user root Sep 07 10:19:25 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-9a82308a-4573-4601-9e6f-d016145c5f96 tempest-ProjectReaderTests-205404938 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-4733512f-33ce-4e33-9447-cf5f6a07a66f" returned: 0 in 0.378s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:19:25 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-9a82308a-4573-4601-9e6f-d016145c5f96 tempest-ProjectReaderTests-205404938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-4733512f-33ce-4e33-9447-cf5f6a07a66f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-4733512f-33ce-4e33-9447-cf5f6a07a66f.2aa3dfa3-3f2f-4389-8d02-3ce16cb2344c 1G {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:19:25 devstack sudo[107895]: pam_unix(sudo:session): session closed for user root Sep 07 10:19:25 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-12416292-cd5d-4a70-9f05-7faa28fdf338 tempest-ProjectMemberTests-55037479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-d2d763d6-1f1b-4100-8467-8540037c7339.a84bbc0d-7da9-4e8a-8265-3f9fefab818a" returned: 0 in 0.352s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:19:25 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-12416292-cd5d-4a70-9f05-7faa28fdf338 tempest-ProjectMemberTests-55037479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-d2d763d6-1f1b-4100-8467-8540037c7339.a84bbc0d-7da9-4e8a-8265-3f9fefab818a {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:19:25 devstack sudo[107906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-4733512f-33ce-4e33-9447-cf5f6a07a66f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-4733512f-33ce-4e33-9447-cf5f6a07a66f.2aa3dfa3-3f2f-4389-8d02-3ce16cb2344c 1G Sep 07 10:19:25 devstack sudo[107906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:19:25 devstack sudo[107908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-d2d763d6-1f1b-4100-8467-8540037c7339.a84bbc0d-7da9-4e8a-8265-3f9fefab818a Sep 07 10:19:25 devstack sudo[107908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:19:25 devstack sudo[107897]: pam_unix(sudo:session): session closed for user root Sep 07 10:19:25 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-4a2501bd-3f0a-4978-bdd4-795b76c7425d tempest-ProjectReaderTests-297640696 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-c75ea3a4-f16f-468d-abab-cdabf41fcfea" returned: 0 in 0.395s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:19:25 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-4a2501bd-3f0a-4978-bdd4-795b76c7425d tempest-ProjectReaderTests-297640696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-c75ea3a4-f16f-468d-abab-cdabf41fcfea {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:19:25 devstack sudo[107913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-c75ea3a4-f16f-468d-abab-cdabf41fcfea Sep 07 10:19:25 devstack sudo[107913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:19:25 devstack sudo[107908]: pam_unix(sudo:session): session closed for user root Sep 07 10:19:25 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-12416292-cd5d-4a70-9f05-7faa28fdf338 tempest-ProjectMemberTests-55037479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-d2d763d6-1f1b-4100-8467-8540037c7339.a84bbc0d-7da9-4e8a-8265-3f9fefab818a" returned: 0 in 0.278s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:19:25 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-12416292-cd5d-4a70-9f05-7faa28fdf338 tempest-ProjectMemberTests-55037479 None] Lock "cinder-quobyte-a84bbc0d-7da9-4e8a-8265-3f9fefab818a" released by "_delete_snapshot" :: held 1.556s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:19:25 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-12416292-cd5d-4a70-9f05-7faa28fdf338 tempest-ProjectMemberTests-55037479 None] Lock "cinder-quobyte-d2d763d6-1f1b-4100-8467-8540037c7339" released by "delete_snapshot" :: held 1.579s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:19:25 devstack sudo[107913]: pam_unix(sudo:session): session closed for user root Sep 07 10:19:25 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-4a2501bd-3f0a-4978-bdd4-795b76c7425d tempest-ProjectReaderTests-297640696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-c75ea3a4-f16f-468d-abab-cdabf41fcfea" returned: 0 in 0.281s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:19:25 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-4a2501bd-3f0a-4978-bdd4-795b76c7425d tempest-ProjectReaderTests-297640696 None] Lock "cinder-quobyte-c75ea3a4-f16f-468d-abab-cdabf41fcfea" released by "delete_volume" :: held 0.723s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:19:25 devstack cinder-volume[87515]: DEBUG cinder.quota [None req-12416292-cd5d-4a70-9f05-7faa28fdf338 tempest-ProjectMemberTests-55037479 None] Created reservations ['05812ca9-024c-420a-a7e0-1bd94302feea', '53fbdeef-9ea2-4d16-9dae-9e47ba8f8f0f', 'eb7e85d6-1f77-4c82-a7b9-cf8e53923605', 'c9d0abb9-e23f-4640-a49f-7bc04f06b588'] {{(pid=87515) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:19:25 devstack sudo[107906]: pam_unix(sudo:session): session closed for user root Sep 07 10:19:25 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-9a82308a-4573-4601-9e6f-d016145c5f96 tempest-ProjectReaderTests-205404938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-4733512f-33ce-4e33-9447-cf5f6a07a66f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-4733512f-33ce-4e33-9447-cf5f6a07a66f.2aa3dfa3-3f2f-4389-8d02-3ce16cb2344c 1G" returned: 0 in 0.440s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:19:25 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-9a82308a-4573-4601-9e6f-d016145c5f96 tempest-ProjectReaderTests-205404938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4733512f-33ce-4e33-9447-cf5f6a07a66f -F qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-4733512f-33ce-4e33-9447-cf5f6a07a66f.2aa3dfa3-3f2f-4389-8d02-3ce16cb2344c {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:19:25 devstack sudo[107921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4733512f-33ce-4e33-9447-cf5f6a07a66f -F qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-4733512f-33ce-4e33-9447-cf5f6a07a66f.2aa3dfa3-3f2f-4389-8d02-3ce16cb2344c Sep 07 10:19:25 devstack sudo[107921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:19:25 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-12416292-cd5d-4a70-9f05-7faa28fdf338 tempest-ProjectMemberTests-55037479 None] Delete snapshot completed successfully. Sep 07 10:19:25 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-12416292-cd5d-4a70-9f05-7faa28fdf338 tempest-ProjectMemberTests-55037479 None] Lock "cinder-a84bbc0d-7da9-4e8a-8265-3f9fefab818a-delete_snapshot" released by "delete_snapshot" :: held 1.783s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:19:25 devstack cinder-volume[87515]: DEBUG cinder.quota [None req-4a2501bd-3f0a-4978-bdd4-795b76c7425d tempest-ProjectReaderTests-297640696 None] Created reservations ['6092f18a-e65d-4cf1-a5d6-b0e259fb23e9', '2910e23c-8587-4caa-87f9-06f543f446f6', '09fff298-f65a-47ee-a2dd-d6dce64edb4d', '32f3e844-9585-46d6-ac6f-e6cb7eae699a'] {{(pid=87515) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:19:25 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-4a2501bd-3f0a-4978-bdd4-795b76c7425d tempest-ProjectReaderTests-297640696 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:19:25 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-4a2501bd-3f0a-4978-bdd4-795b76c7425d tempest-ProjectReaderTests-297640696 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:19:25 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-4a2501bd-3f0a-4978-bdd4-795b76c7425d tempest-ProjectReaderTests-297640696 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:19:25 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-4a2501bd-3f0a-4978-bdd4-795b76c7425d tempest-ProjectReaderTests-297640696 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:19:25 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-4a2501bd-3f0a-4978-bdd4-795b76c7425d tempest-ProjectReaderTests-297640696 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:19:25 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-4a2501bd-3f0a-4978-bdd4-795b76c7425d tempest-ProjectReaderTests-297640696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:19:25 devstack sudo[107923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a Sep 07 10:19:25 devstack sudo[107923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:19:26 devstack sudo[107921]: pam_unix(sudo:session): session closed for user root Sep 07 10:19:26 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-9a82308a-4573-4601-9e6f-d016145c5f96 tempest-ProjectReaderTests-205404938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4733512f-33ce-4e33-9447-cf5f6a07a66f -F qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-4733512f-33ce-4e33-9447-cf5f6a07a66f.2aa3dfa3-3f2f-4389-8d02-3ce16cb2344c" returned: 0 in 0.308s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:19:26 devstack cinder-volume[87515]: WARNING cinder.volume.drivers.remotefs [None req-9a82308a-4573-4601-9e6f-d016145c5f96 tempest-ProjectReaderTests-205404938 None] /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-4733512f-33ce-4e33-9447-cf5f6a07a66f.2aa3dfa3-3f2f-4389-8d02-3ce16cb2344c is being set with open permissions: ugo+rw Sep 07 10:19:26 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-9a82308a-4573-4601-9e6f-d016145c5f96 tempest-ProjectReaderTests-205404938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-4733512f-33ce-4e33-9447-cf5f6a07a66f.2aa3dfa3-3f2f-4389-8d02-3ce16cb2344c {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:19:26 devstack sudo[107929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-4733512f-33ce-4e33-9447-cf5f6a07a66f.2aa3dfa3-3f2f-4389-8d02-3ce16cb2344c Sep 07 10:19:26 devstack sudo[107929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:19:26 devstack sudo[107923]: pam_unix(sudo:session): session closed for user root Sep 07 10:19:26 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-4a2501bd-3f0a-4978-bdd4-795b76c7425d tempest-ProjectReaderTests-297640696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a" returned: 0 in 0.273s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:19:26 devstack cinder-volume[87515]: DEBUG cinder.manager [None req-4a2501bd-3f0a-4978-bdd4-795b76c7425d tempest-ProjectReaderTests-297640696 None] Notifying Schedulers of capabilities ... {{(pid=87515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:19:26 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-4a2501bd-3f0a-4978-bdd4-795b76c7425d tempest-ProjectReaderTests-297640696 None] Deleted volume successfully. Sep 07 10:19:26 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-f15a5139-ed49-4c51-989f-3d8cb79dfc35 tempest-ProjectMemberTests-55037479 None] Acquiring lock "cinder-d2d763d6-1f1b-4100-8467-8540037c7339-delete_volume" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:19:26 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-4a2501bd-3f0a-4978-bdd4-795b76c7425d tempest-ProjectReaderTests-297640696 None] Lock "cinder-c75ea3a4-f16f-468d-abab-cdabf41fcfea-delete_volume" released by "delete_volume" :: held 1.301s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:19:26 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-f15a5139-ed49-4c51-989f-3d8cb79dfc35 tempest-ProjectMemberTests-55037479 None] Lock "cinder-d2d763d6-1f1b-4100-8467-8540037c7339-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:19:26 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-f15a5139-ed49-4c51-989f-3d8cb79dfc35 tempest-ProjectMemberTests-55037479 None] Acquiring lock "cinder-quobyte-d2d763d6-1f1b-4100-8467-8540037c7339" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:19:26 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-f15a5139-ed49-4c51-989f-3d8cb79dfc35 tempest-ProjectMemberTests-55037479 None] Lock "cinder-quobyte-d2d763d6-1f1b-4100-8467-8540037c7339" acquired by "delete_volume" :: waited 0.017s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:19:26 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[17c666b0-e1c9-4714-a691-486d29b77e98]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:19:26 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-f15a5139-ed49-4c51-989f-3d8cb79dfc35 tempest-ProjectMemberTests-55037479 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-d2d763d6-1f1b-4100-8467-8540037c7339 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:19:26 devstack sudo[107929]: pam_unix(sudo:session): session closed for user root Sep 07 10:19:26 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-9a82308a-4573-4601-9e6f-d016145c5f96 tempest-ProjectReaderTests-205404938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-4733512f-33ce-4e33-9447-cf5f6a07a66f.2aa3dfa3-3f2f-4389-8d02-3ce16cb2344c" returned: 0 in 0.295s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:19:26 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-9a82308a-4573-4601-9e6f-d016145c5f96 tempest-ProjectReaderTests-205404938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-4733512f-33ce-4e33-9447-cf5f6a07a66f.info {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:19:26 devstack sudo[107934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-4733512f-33ce-4e33-9447-cf5f6a07a66f.info Sep 07 10:19:26 devstack sudo[107934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:19:26 devstack sudo[107933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-d2d763d6-1f1b-4100-8467-8540037c7339 Sep 07 10:19:26 devstack sudo[107933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:19:26 devstack cinder-volume[87515]: DEBUG cinder.volume.flows.manager.create_volume [None req-0bfbeb2a-58be-4d3e-be91-58ef87585edf tempest-ProjectReaderTests-297640696 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 10:19:26 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-0bfbeb2a-58be-4d3e-be91-58ef87585edf tempest-ProjectReaderTests-297640696 None] Flow 'volume_create_manager' (0c02c966-3012-4115-96ab-9780911d6a45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:19:26 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-0bfbeb2a-58be-4d3e-be91-58ef87585edf tempest-ProjectReaderTests-297640696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e583ec61-cb1a-4c47-ada6-999c20969278) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:19:26 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-0bfbeb2a-58be-4d3e-be91-58ef87585edf tempest-ProjectReaderTests-297640696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e583ec61-cb1a-4c47-ada6-999c20969278) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:19:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1519977357',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e90f1bd3-1f37-4320-93bd-ed8e30b43ac0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c25563867ef40fdbdf27810abb2b572',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:19:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:19:27Z,use_quota=True,user_id='17e6ed6b77514bb791ff09302ed265cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3a092cd-7947-4cbf-abff-4ba9567becf0),volume_type_id=f3a092cd-7947-4cbf-abff-4ba9567becf0)' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:19:26 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-0bfbeb2a-58be-4d3e-be91-58ef87585edf tempest-ProjectReaderTests-297640696 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7e6448a-19d0-4ffb-991e-4256dd3d972d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:19:26 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-0bfbeb2a-58be-4d3e-be91-58ef87585edf tempest-ProjectReaderTests-297640696 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7e6448a-19d0-4ffb-991e-4256dd3d972d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:19:26 devstack sudo[107934]: pam_unix(sudo:session): session closed for user root Sep 07 10:19:26 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-0bfbeb2a-58be-4d3e-be91-58ef87585edf tempest-ProjectReaderTests-297640696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f2331c3-de6a-4572-947f-8cbfdc2e0b91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:19:26 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-0bfbeb2a-58be-4d3e-be91-58ef87585edf tempest-ProjectReaderTests-297640696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f2331c3-de6a-4572-947f-8cbfdc2e0b91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e90f1bd3-1f37-4320-93bd-ed8e30b43ac0', 'volume_name': 'volume-e90f1bd3-1f37-4320-93bd-ed8e30b43ac0', 'volume_size': 1}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:19:26 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-0bfbeb2a-58be-4d3e-be91-58ef87585edf tempest-ProjectReaderTests-297640696 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eaa26f07-5c4c-4a0b-883d-3900fa51b822) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:19:26 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-0bfbeb2a-58be-4d3e-be91-58ef87585edf tempest-ProjectReaderTests-297640696 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eaa26f07-5c4c-4a0b-883d-3900fa51b822) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:19:26 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-0bfbeb2a-58be-4d3e-be91-58ef87585edf tempest-ProjectReaderTests-297640696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce2d9a29-406e-46cd-b656-5960a2c1d004) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:19:26 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-0bfbeb2a-58be-4d3e-be91-58ef87585edf tempest-ProjectReaderTests-297640696 None] Volume e90f1bd3-1f37-4320-93bd-ed8e30b43ac0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e90f1bd3-1f37-4320-93bd-ed8e30b43ac0', 'volume_size': 1} Sep 07 10:19:26 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-0bfbeb2a-58be-4d3e-be91-58ef87585edf tempest-ProjectReaderTests-297640696 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:19:26 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-9a82308a-4573-4601-9e6f-d016145c5f96 tempest-ProjectReaderTests-205404938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-4733512f-33ce-4e33-9447-cf5f6a07a66f.info" returned: 0 in 0.307s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:19:26 devstack cinder-volume[87515]: WARNING cinder.volume.drivers.remotefs [None req-9a82308a-4573-4601-9e6f-d016145c5f96 tempest-ProjectReaderTests-205404938 None] /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-4733512f-33ce-4e33-9447-cf5f6a07a66f.info is being set with open permissions: ugo+rw Sep 07 10:19:26 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-9a82308a-4573-4601-9e6f-d016145c5f96 tempest-ProjectReaderTests-205404938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-4733512f-33ce-4e33-9447-cf5f6a07a66f.info {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:19:26 devstack sudo[107941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-4733512f-33ce-4e33-9447-cf5f6a07a66f.info Sep 07 10:19:26 devstack sudo[107933]: pam_unix(sudo:session): session closed for user root Sep 07 10:19:26 devstack sudo[107941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:19:26 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-f15a5139-ed49-4c51-989f-3d8cb79dfc35 tempest-ProjectMemberTests-55037479 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-d2d763d6-1f1b-4100-8467-8540037c7339" returned: 0 in 0.386s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:19:26 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-f15a5139-ed49-4c51-989f-3d8cb79dfc35 tempest-ProjectMemberTests-55037479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-d2d763d6-1f1b-4100-8467-8540037c7339 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:19:26 devstack sudo[107943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-d2d763d6-1f1b-4100-8467-8540037c7339 Sep 07 10:19:26 devstack sudo[107943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:19:26 devstack sudo[107941]: pam_unix(sudo:session): session closed for user root Sep 07 10:19:26 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-9a82308a-4573-4601-9e6f-d016145c5f96 tempest-ProjectReaderTests-205404938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-4733512f-33ce-4e33-9447-cf5f6a07a66f.info" returned: 0 in 0.270s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:19:26 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-9a82308a-4573-4601-9e6f-d016145c5f96 tempest-ProjectReaderTests-205404938 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.096s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:19:26 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-0bfbeb2a-58be-4d3e-be91-58ef87585edf tempest-ProjectReaderTests-297640696 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.294s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:19:26 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-0bfbeb2a-58be-4d3e-be91-58ef87585edf tempest-ProjectReaderTests-297640696 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:19:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1519977357',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e90f1bd3-1f37-4320-93bd-ed8e30b43ac0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c25563867ef40fdbdf27810abb2b572',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:19:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:19:27Z,use_quota=True,user_id='17e6ed6b77514bb791ff09302ed265cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3a092cd-7947-4cbf-abff-4ba9567becf0),volume_type_id=f3a092cd-7947-4cbf-abff-4ba9567becf0)}" {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 10:19:26 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-0bfbeb2a-58be-4d3e-be91-58ef87585edf tempest-ProjectReaderTests-297640696 None] Creating volume e90f1bd3-1f37-4320-93bd-ed8e30b43ac0 {{(pid=87515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 10:19:26 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-0bfbeb2a-58be-4d3e-be91-58ef87585edf tempest-ProjectReaderTests-297640696 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:19:26 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-0bfbeb2a-58be-4d3e-be91-58ef87585edf tempest-ProjectReaderTests-297640696 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:19:26 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-0bfbeb2a-58be-4d3e-be91-58ef87585edf tempest-ProjectReaderTests-297640696 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:19:26 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-0bfbeb2a-58be-4d3e-be91-58ef87585edf tempest-ProjectReaderTests-297640696 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:19:26 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-0bfbeb2a-58be-4d3e-be91-58ef87585edf tempest-ProjectReaderTests-297640696 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:19:26 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-0bfbeb2a-58be-4d3e-be91-58ef87585edf tempest-ProjectReaderTests-297640696 None] Selected osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c as target Quobyte volume. {{(pid=87515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 10:19:26 devstack cinder-volume[87515]: INFO cinder.volume.drivers.remotefs [None req-0bfbeb2a-58be-4d3e-be91-58ef87585edf tempest-ProjectReaderTests-297640696 None] casted to osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c Sep 07 10:19:26 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-0bfbeb2a-58be-4d3e-be91-58ef87585edf tempest-ProjectReaderTests-297640696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-e90f1bd3-1f37-4320-93bd-ed8e30b43ac0 1073741824 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:19:26 devstack sudo[107943]: pam_unix(sudo:session): session closed for user root Sep 07 10:19:26 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-f15a5139-ed49-4c51-989f-3d8cb79dfc35 tempest-ProjectMemberTests-55037479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-d2d763d6-1f1b-4100-8467-8540037c7339" returned: 0 in 0.295s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:19:26 devstack sudo[107947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-e90f1bd3-1f37-4320-93bd-ed8e30b43ac0 1073741824 Sep 07 10:19:26 devstack sudo[107947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:19:26 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-f15a5139-ed49-4c51-989f-3d8cb79dfc35 tempest-ProjectMemberTests-55037479 None] Lock "cinder-quobyte-d2d763d6-1f1b-4100-8467-8540037c7339" released by "delete_volume" :: held 0.749s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:19:26 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-9a82308a-4573-4601-9e6f-d016145c5f96 tempest-ProjectReaderTests-205404938 None] Create snapshot completed successfully Sep 07 10:19:27 devstack cinder-volume[87515]: DEBUG cinder.quota [None req-f15a5139-ed49-4c51-989f-3d8cb79dfc35 tempest-ProjectMemberTests-55037479 None] Created reservations ['9bfc328c-88e3-4b97-9ddb-07df9bdea653', 'a1516486-a8e7-49f9-9051-c36ad77fa7f9', 'f4e0ce3b-c2b6-444e-9b63-df823caf1de9', '0e853b0b-01ac-4baf-aa23-a7ad3675b91c'] {{(pid=87515) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:19:27 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-f15a5139-ed49-4c51-989f-3d8cb79dfc35 tempest-ProjectMemberTests-55037479 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:19:27 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-f15a5139-ed49-4c51-989f-3d8cb79dfc35 tempest-ProjectMemberTests-55037479 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:19:27 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-f15a5139-ed49-4c51-989f-3d8cb79dfc35 tempest-ProjectMemberTests-55037479 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:19:27 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-f15a5139-ed49-4c51-989f-3d8cb79dfc35 tempest-ProjectMemberTests-55037479 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:19:27 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-f15a5139-ed49-4c51-989f-3d8cb79dfc35 tempest-ProjectMemberTests-55037479 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:19:27 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-f15a5139-ed49-4c51-989f-3d8cb79dfc35 tempest-ProjectMemberTests-55037479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:19:27 devstack sudo[107949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a Sep 07 10:19:27 devstack sudo[107949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:19:27 devstack sudo[107949]: pam_unix(sudo:session): session closed for user root Sep 07 10:19:27 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-f15a5139-ed49-4c51-989f-3d8cb79dfc35 tempest-ProjectMemberTests-55037479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a" returned: 0 in 0.289s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:19:27 devstack cinder-volume[87515]: DEBUG cinder.manager [None req-f15a5139-ed49-4c51-989f-3d8cb79dfc35 tempest-ProjectMemberTests-55037479 None] Notifying Schedulers of capabilities ... {{(pid=87515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:19:27 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-f15a5139-ed49-4c51-989f-3d8cb79dfc35 tempest-ProjectMemberTests-55037479 None] Deleted volume successfully. Sep 07 10:19:27 devstack sudo[107947]: pam_unix(sudo:session): session closed for user root Sep 07 10:19:27 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-0bfbeb2a-58be-4d3e-be91-58ef87585edf tempest-ProjectReaderTests-297640696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-e90f1bd3-1f37-4320-93bd-ed8e30b43ac0 1073741824" returned: 0 in 0.474s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:19:27 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-f15a5139-ed49-4c51-989f-3d8cb79dfc35 tempest-ProjectMemberTests-55037479 None] Lock "cinder-d2d763d6-1f1b-4100-8467-8540037c7339-delete_volume" released by "delete_volume" :: held 1.256s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:19:27 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-0bfbeb2a-58be-4d3e-be91-58ef87585edf tempest-ProjectReaderTests-297640696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-e90f1bd3-1f37-4320-93bd-ed8e30b43ac0 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:19:27 devstack sudo[107957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-e90f1bd3-1f37-4320-93bd-ed8e30b43ac0 Sep 07 10:19:27 devstack sudo[107957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:19:27 devstack sudo[107957]: pam_unix(sudo:session): session closed for user root Sep 07 10:19:27 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-0bfbeb2a-58be-4d3e-be91-58ef87585edf tempest-ProjectReaderTests-297640696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-e90f1bd3-1f37-4320-93bd-ed8e30b43ac0" returned: 0 in 0.279s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:19:27 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-0bfbeb2a-58be-4d3e-be91-58ef87585edf tempest-ProjectReaderTests-297640696 None] <== create_volume: return (802ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'} {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 10:19:27 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-0bfbeb2a-58be-4d3e-be91-58ef87585edf tempest-ProjectReaderTests-297640696 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.806s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:19:27 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-0bfbeb2a-58be-4d3e-be91-58ef87585edf tempest-ProjectReaderTests-297640696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce2d9a29-406e-46cd-b656-5960a2c1d004) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e90f1bd3-1f37-4320-93bd-ed8e30b43ac0', 'volume_size': 1}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:19:27 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-0bfbeb2a-58be-4d3e-be91-58ef87585edf tempest-ProjectReaderTests-297640696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c3e0fb0-810c-4f65-90b2-3f6d780e53a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:19:27 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-0bfbeb2a-58be-4d3e-be91-58ef87585edf tempest-ProjectReaderTests-297640696 None] Volume volume-e90f1bd3-1f37-4320-93bd-ed8e30b43ac0 (e90f1bd3-1f37-4320-93bd-ed8e30b43ac0): created successfully Sep 07 10:19:27 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-0bfbeb2a-58be-4d3e-be91-58ef87585edf tempest-ProjectReaderTests-297640696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c3e0fb0-810c-4f65-90b2-3f6d780e53a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:19:27 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-0bfbeb2a-58be-4d3e-be91-58ef87585edf tempest-ProjectReaderTests-297640696 None] Flow 'volume_create_manager' (0c02c966-3012-4115-96ab-9780911d6a45) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:19:27 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-0bfbeb2a-58be-4d3e-be91-58ef87585edf tempest-ProjectReaderTests-297640696 None] Created volume successfully. Sep 07 10:19:27 devstack cinder-volume[87515]: DEBUG cinder.volume.flows.manager.create_volume [None req-9fde9529-17c0-4a3d-b9a4-5b7657b37764 tempest-ProjectMemberTests-55037479 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 10:19:27 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-9fde9529-17c0-4a3d-b9a4-5b7657b37764 tempest-ProjectMemberTests-55037479 None] Flow 'volume_create_manager' (161d9ac4-d108-4afe-85f0-9b56b89d67ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:19:27 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-9fde9529-17c0-4a3d-b9a4-5b7657b37764 tempest-ProjectMemberTests-55037479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72dc1ff2-71e8-4e34-8565-db2fe018a6d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:19:27 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-9fde9529-17c0-4a3d-b9a4-5b7657b37764 tempest-ProjectMemberTests-55037479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72dc1ff2-71e8-4e34-8565-db2fe018a6d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:19:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1809854457',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79ab5473-6a82-4265-a8e8-4dcc760671fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41fa4493d2f045dc87793bd97d931cff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:19:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:19:28Z,use_quota=True,user_id='5136aa4e2a7c4a1da79d4e4478cdcbf6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3a092cd-7947-4cbf-abff-4ba9567becf0),volume_type_id=f3a092cd-7947-4cbf-abff-4ba9567becf0)' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:19:27 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-9fde9529-17c0-4a3d-b9a4-5b7657b37764 tempest-ProjectMemberTests-55037479 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87f07a5f-1ffb-4623-a8f2-66dc26e1b506) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:19:27 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-9fde9529-17c0-4a3d-b9a4-5b7657b37764 tempest-ProjectMemberTests-55037479 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87f07a5f-1ffb-4623-a8f2-66dc26e1b506) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:19:27 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-9fde9529-17c0-4a3d-b9a4-5b7657b37764 tempest-ProjectMemberTests-55037479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (124948a7-bee1-43b0-91a5-7b51434066a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:19:27 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-9fde9529-17c0-4a3d-b9a4-5b7657b37764 tempest-ProjectMemberTests-55037479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (124948a7-bee1-43b0-91a5-7b51434066a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '79ab5473-6a82-4265-a8e8-4dcc760671fe', 'volume_name': 'volume-79ab5473-6a82-4265-a8e8-4dcc760671fe', 'volume_size': 1}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:19:27 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-9fde9529-17c0-4a3d-b9a4-5b7657b37764 tempest-ProjectMemberTests-55037479 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bbff69c2-8fc5-44c9-b873-4253f969195e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:19:27 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-9fde9529-17c0-4a3d-b9a4-5b7657b37764 tempest-ProjectMemberTests-55037479 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bbff69c2-8fc5-44c9-b873-4253f969195e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:19:27 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-9fde9529-17c0-4a3d-b9a4-5b7657b37764 tempest-ProjectMemberTests-55037479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (479f1920-15c3-4d4b-92bf-46c415dcd48c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:19:27 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-9fde9529-17c0-4a3d-b9a4-5b7657b37764 tempest-ProjectMemberTests-55037479 None] Volume 79ab5473-6a82-4265-a8e8-4dcc760671fe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-79ab5473-6a82-4265-a8e8-4dcc760671fe', 'volume_size': 1} Sep 07 10:19:27 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-9fde9529-17c0-4a3d-b9a4-5b7657b37764 tempest-ProjectMemberTests-55037479 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:19:27 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-9fde9529-17c0-4a3d-b9a4-5b7657b37764 tempest-ProjectMemberTests-55037479 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:19:27 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-9fde9529-17c0-4a3d-b9a4-5b7657b37764 tempest-ProjectMemberTests-55037479 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:19:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1809854457',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79ab5473-6a82-4265-a8e8-4dcc760671fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41fa4493d2f045dc87793bd97d931cff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:19:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:19:28Z,use_quota=True,user_id='5136aa4e2a7c4a1da79d4e4478cdcbf6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3a092cd-7947-4cbf-abff-4ba9567becf0),volume_type_id=f3a092cd-7947-4cbf-abff-4ba9567becf0)}" {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 10:19:27 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-9fde9529-17c0-4a3d-b9a4-5b7657b37764 tempest-ProjectMemberTests-55037479 None] Creating volume 79ab5473-6a82-4265-a8e8-4dcc760671fe {{(pid=87515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 10:19:27 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-9fde9529-17c0-4a3d-b9a4-5b7657b37764 tempest-ProjectMemberTests-55037479 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:19:27 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-9fde9529-17c0-4a3d-b9a4-5b7657b37764 tempest-ProjectMemberTests-55037479 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:19:27 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-9fde9529-17c0-4a3d-b9a4-5b7657b37764 tempest-ProjectMemberTests-55037479 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:19:27 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-9fde9529-17c0-4a3d-b9a4-5b7657b37764 tempest-ProjectMemberTests-55037479 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:19:27 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-9fde9529-17c0-4a3d-b9a4-5b7657b37764 tempest-ProjectMemberTests-55037479 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:19:27 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-9fde9529-17c0-4a3d-b9a4-5b7657b37764 tempest-ProjectMemberTests-55037479 None] Selected osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c as target Quobyte volume. {{(pid=87515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 10:19:27 devstack cinder-volume[87515]: INFO cinder.volume.drivers.remotefs [None req-9fde9529-17c0-4a3d-b9a4-5b7657b37764 tempest-ProjectMemberTests-55037479 None] casted to osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c Sep 07 10:19:27 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-9fde9529-17c0-4a3d-b9a4-5b7657b37764 tempest-ProjectMemberTests-55037479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-79ab5473-6a82-4265-a8e8-4dcc760671fe 1073741824 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:19:27 devstack sudo[107960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-79ab5473-6a82-4265-a8e8-4dcc760671fe 1073741824 Sep 07 10:19:27 devstack sudo[107960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:19:27 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-2de9da55-e5f4-4837-8bae-758b162802f5 tempest-ProjectReaderTests-205404938 None] Acquiring lock "cinder-2aa3dfa3-3f2f-4389-8d02-3ce16cb2344c-delete_snapshot" by "delete_snapshot" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:19:28 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-2de9da55-e5f4-4837-8bae-758b162802f5 tempest-ProjectReaderTests-205404938 None] Lock "cinder-2aa3dfa3-3f2f-4389-8d02-3ce16cb2344c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:19:28 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-2de9da55-e5f4-4837-8bae-758b162802f5 tempest-ProjectReaderTests-205404938 None] Acquiring lock "cinder-quobyte-4733512f-33ce-4e33-9447-cf5f6a07a66f" by "delete_snapshot" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:19:28 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-2de9da55-e5f4-4837-8bae-758b162802f5 tempest-ProjectReaderTests-205404938 None] Lock "cinder-quobyte-4733512f-33ce-4e33-9447-cf5f6a07a66f" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:19:28 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-2de9da55-e5f4-4837-8bae-758b162802f5 tempest-ProjectReaderTests-205404938 None] Acquiring lock "cinder-quobyte-2aa3dfa3-3f2f-4389-8d02-3ce16cb2344c" by "_delete_snapshot" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:19:28 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-2de9da55-e5f4-4837-8bae-758b162802f5 tempest-ProjectReaderTests-205404938 None] Lock "cinder-quobyte-2aa3dfa3-3f2f-4389-8d02-3ce16cb2344c" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:19:28 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-2de9da55-e5f4-4837-8bae-758b162802f5 tempest-ProjectReaderTests-205404938 None] Deleting offline snapshot 2aa3dfa3-3f2f-4389-8d02-3ce16cb2344c of volume 4733512f-33ce-4e33-9447-cf5f6a07a66f {{(pid=87515) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 10:19:28 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-2de9da55-e5f4-4837-8bae-758b162802f5 tempest-ProjectReaderTests-205404938 None] snapshot_file for this snap is: volume-4733512f-33ce-4e33-9447-cf5f6a07a66f.2aa3dfa3-3f2f-4389-8d02-3ce16cb2344c {{(pid=87515) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 10:19:28 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[5573463b-d6fa-4ded-81f2-d3c75bf47e14]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:19:28 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-2de9da55-e5f4-4837-8bae-758b162802f5 tempest-ProjectReaderTests-205404938 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-4733512f-33ce-4e33-9447-cf5f6a07a66f.2aa3dfa3-3f2f-4389-8d02-3ce16cb2344c {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:19:28 devstack sudo[107962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-4733512f-33ce-4e33-9447-cf5f6a07a66f.2aa3dfa3-3f2f-4389-8d02-3ce16cb2344c Sep 07 10:19:28 devstack sudo[107962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:19:28 devstack sudo[107960]: pam_unix(sudo:session): session closed for user root Sep 07 10:19:28 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-9fde9529-17c0-4a3d-b9a4-5b7657b37764 tempest-ProjectMemberTests-55037479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-79ab5473-6a82-4265-a8e8-4dcc760671fe 1073741824" returned: 0 in 0.473s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:19:28 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-9fde9529-17c0-4a3d-b9a4-5b7657b37764 tempest-ProjectMemberTests-55037479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-79ab5473-6a82-4265-a8e8-4dcc760671fe {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:19:28 devstack sudo[107962]: pam_unix(sudo:session): session closed for user root Sep 07 10:19:28 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-2de9da55-e5f4-4837-8bae-758b162802f5 tempest-ProjectReaderTests-205404938 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-4733512f-33ce-4e33-9447-cf5f6a07a66f.2aa3dfa3-3f2f-4389-8d02-3ce16cb2344c" returned: 0 in 0.377s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:19:28 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-2de9da55-e5f4-4837-8bae-758b162802f5 tempest-ProjectReaderTests-205404938 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4733512f-33ce-4e33-9447-cf5f6a07a66f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87515) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 10:19:28 devstack sudo[107970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-79ab5473-6a82-4265-a8e8-4dcc760671fe Sep 07 10:19:28 devstack sudo[107970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:19:28 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[d03beab9-6d07-4657-8685-43132b85838e]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:19:28 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-2de9da55-e5f4-4837-8bae-758b162802f5 tempest-ProjectReaderTests-205404938 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-4733512f-33ce-4e33-9447-cf5f6a07a66f {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:19:28 devstack sudo[107972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-4733512f-33ce-4e33-9447-cf5f6a07a66f Sep 07 10:19:28 devstack sudo[107972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:19:28 devstack sudo[107970]: pam_unix(sudo:session): session closed for user root Sep 07 10:19:28 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-01f277f3-8ade-4c77-88a1-591db492cc78 tempest-ProjectReaderTests-297640696 None] Acquiring lock "cinder-e90f1bd3-1f37-4320-93bd-ed8e30b43ac0-delete_volume" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:19:28 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-9fde9529-17c0-4a3d-b9a4-5b7657b37764 tempest-ProjectMemberTests-55037479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-79ab5473-6a82-4265-a8e8-4dcc760671fe" returned: 0 in 0.274s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:19:28 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-9fde9529-17c0-4a3d-b9a4-5b7657b37764 tempest-ProjectMemberTests-55037479 None] <== create_volume: return (788ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'} {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 10:19:28 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-9fde9529-17c0-4a3d-b9a4-5b7657b37764 tempest-ProjectMemberTests-55037479 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.791s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:19:28 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-01f277f3-8ade-4c77-88a1-591db492cc78 tempest-ProjectReaderTests-297640696 None] Lock "cinder-e90f1bd3-1f37-4320-93bd-ed8e30b43ac0-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:19:28 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-9fde9529-17c0-4a3d-b9a4-5b7657b37764 tempest-ProjectMemberTests-55037479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (479f1920-15c3-4d4b-92bf-46c415dcd48c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-79ab5473-6a82-4265-a8e8-4dcc760671fe', 'volume_size': 1}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:19:28 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-9fde9529-17c0-4a3d-b9a4-5b7657b37764 tempest-ProjectMemberTests-55037479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf93dd1d-8101-4097-b41d-eba1393a25ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:19:28 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-9fde9529-17c0-4a3d-b9a4-5b7657b37764 tempest-ProjectMemberTests-55037479 None] Volume volume-79ab5473-6a82-4265-a8e8-4dcc760671fe (79ab5473-6a82-4265-a8e8-4dcc760671fe): created successfully Sep 07 10:19:28 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-9fde9529-17c0-4a3d-b9a4-5b7657b37764 tempest-ProjectMemberTests-55037479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf93dd1d-8101-4097-b41d-eba1393a25ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:19:28 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-9fde9529-17c0-4a3d-b9a4-5b7657b37764 tempest-ProjectMemberTests-55037479 None] Flow 'volume_create_manager' (161d9ac4-d108-4afe-85f0-9b56b89d67ce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:19:28 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-9fde9529-17c0-4a3d-b9a4-5b7657b37764 tempest-ProjectMemberTests-55037479 None] Created volume successfully. Sep 07 10:19:28 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-01f277f3-8ade-4c77-88a1-591db492cc78 tempest-ProjectReaderTests-297640696 None] Acquiring lock "cinder-quobyte-e90f1bd3-1f37-4320-93bd-ed8e30b43ac0" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:19:28 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-01f277f3-8ade-4c77-88a1-591db492cc78 tempest-ProjectReaderTests-297640696 None] Lock "cinder-quobyte-e90f1bd3-1f37-4320-93bd-ed8e30b43ac0" acquired by "delete_volume" :: waited 0.024s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:19:28 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[e134c009-ba62-4759-8f68-bbac52d14a06]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:19:28 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-01f277f3-8ade-4c77-88a1-591db492cc78 tempest-ProjectReaderTests-297640696 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-e90f1bd3-1f37-4320-93bd-ed8e30b43ac0 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:19:28 devstack sudo[107972]: pam_unix(sudo:session): session closed for user root Sep 07 10:19:28 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-2de9da55-e5f4-4837-8bae-758b162802f5 tempest-ProjectReaderTests-205404938 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-4733512f-33ce-4e33-9447-cf5f6a07a66f" returned: 0 in 0.425s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:19:28 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-2de9da55-e5f4-4837-8bae-758b162802f5 tempest-ProjectReaderTests-205404938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-4733512f-33ce-4e33-9447-cf5f6a07a66f.2aa3dfa3-3f2f-4389-8d02-3ce16cb2344c {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:19:28 devstack sudo[107979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-4733512f-33ce-4e33-9447-cf5f6a07a66f.2aa3dfa3-3f2f-4389-8d02-3ce16cb2344c Sep 07 10:19:28 devstack sudo[107979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:19:28 devstack sudo[107978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-e90f1bd3-1f37-4320-93bd-ed8e30b43ac0 Sep 07 10:19:28 devstack sudo[107978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:19:29 devstack sudo[107978]: pam_unix(sudo:session): session closed for user root Sep 07 10:19:29 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-01f277f3-8ade-4c77-88a1-591db492cc78 tempest-ProjectReaderTests-297640696 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-e90f1bd3-1f37-4320-93bd-ed8e30b43ac0" returned: 0 in 0.379s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:19:29 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-01f277f3-8ade-4c77-88a1-591db492cc78 tempest-ProjectReaderTests-297640696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-e90f1bd3-1f37-4320-93bd-ed8e30b43ac0 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:19:29 devstack sudo[107979]: pam_unix(sudo:session): session closed for user root Sep 07 10:19:29 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-2de9da55-e5f4-4837-8bae-758b162802f5 tempest-ProjectReaderTests-205404938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-4733512f-33ce-4e33-9447-cf5f6a07a66f.2aa3dfa3-3f2f-4389-8d02-3ce16cb2344c" returned: 0 in 0.354s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:19:29 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-2de9da55-e5f4-4837-8bae-758b162802f5 tempest-ProjectReaderTests-205404938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-4733512f-33ce-4e33-9447-cf5f6a07a66f.2aa3dfa3-3f2f-4389-8d02-3ce16cb2344c {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:19:29 devstack sudo[107989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-e90f1bd3-1f37-4320-93bd-ed8e30b43ac0 Sep 07 10:19:29 devstack sudo[107989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:19:29 devstack sudo[107991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-4733512f-33ce-4e33-9447-cf5f6a07a66f.2aa3dfa3-3f2f-4389-8d02-3ce16cb2344c Sep 07 10:19:29 devstack sudo[107991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:19:29 devstack sudo[107989]: pam_unix(sudo:session): session closed for user root Sep 07 10:19:29 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-01f277f3-8ade-4c77-88a1-591db492cc78 tempest-ProjectReaderTests-297640696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-e90f1bd3-1f37-4320-93bd-ed8e30b43ac0" returned: 0 in 0.263s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:19:29 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-01f277f3-8ade-4c77-88a1-591db492cc78 tempest-ProjectReaderTests-297640696 None] Lock "cinder-quobyte-e90f1bd3-1f37-4320-93bd-ed8e30b43ac0" released by "delete_volume" :: held 0.689s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:19:29 devstack sudo[107991]: pam_unix(sudo:session): session closed for user root Sep 07 10:19:29 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-2de9da55-e5f4-4837-8bae-758b162802f5 tempest-ProjectReaderTests-205404938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-4733512f-33ce-4e33-9447-cf5f6a07a66f.2aa3dfa3-3f2f-4389-8d02-3ce16cb2344c" returned: 0 in 0.271s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:19:29 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-2de9da55-e5f4-4837-8bae-758b162802f5 tempest-ProjectReaderTests-205404938 None] Lock "cinder-quobyte-2aa3dfa3-3f2f-4389-8d02-3ce16cb2344c" released by "_delete_snapshot" :: held 1.528s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:19:29 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-2de9da55-e5f4-4837-8bae-758b162802f5 tempest-ProjectReaderTests-205404938 None] Lock "cinder-quobyte-4733512f-33ce-4e33-9447-cf5f6a07a66f" released by "delete_snapshot" :: held 1.552s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:19:29 devstack cinder-volume[87515]: DEBUG cinder.quota [None req-01f277f3-8ade-4c77-88a1-591db492cc78 tempest-ProjectReaderTests-297640696 None] Created reservations ['742e29d4-075d-49c6-9785-beda7dea8193', 'fdba9b6a-4c16-44b2-a5c5-876b32ab9ef0', 'cebc0ec4-c516-41f9-8a53-a04ea093e878', '311953a7-a89c-4a64-83f2-c35821decf72'] {{(pid=87515) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:19:29 devstack cinder-volume[87515]: DEBUG cinder.quota [None req-2de9da55-e5f4-4837-8bae-758b162802f5 tempest-ProjectReaderTests-205404938 None] Created reservations ['d2572f2f-3e4c-4828-ba4c-9964526bb593', 'f054a491-7f4e-4eea-8a80-dd4bd3f26dc0', '657585f0-b730-4568-a1ee-c9538cb35524', '01c861b9-7a35-4177-a097-8066b98fe7c1'] {{(pid=87515) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:19:29 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-01f277f3-8ade-4c77-88a1-591db492cc78 tempest-ProjectReaderTests-297640696 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:19:29 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-01f277f3-8ade-4c77-88a1-591db492cc78 tempest-ProjectReaderTests-297640696 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:19:29 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-01f277f3-8ade-4c77-88a1-591db492cc78 tempest-ProjectReaderTests-297640696 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:19:29 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-01f277f3-8ade-4c77-88a1-591db492cc78 tempest-ProjectReaderTests-297640696 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:19:29 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-01f277f3-8ade-4c77-88a1-591db492cc78 tempest-ProjectReaderTests-297640696 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:19:29 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-01f277f3-8ade-4c77-88a1-591db492cc78 tempest-ProjectReaderTests-297640696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:19:29 devstack sudo[108032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a Sep 07 10:19:29 devstack sudo[108032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:19:29 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-2de9da55-e5f4-4837-8bae-758b162802f5 tempest-ProjectReaderTests-205404938 None] Delete snapshot completed successfully. Sep 07 10:19:29 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-2de9da55-e5f4-4837-8bae-758b162802f5 tempest-ProjectReaderTests-205404938 None] Lock "cinder-2aa3dfa3-3f2f-4389-8d02-3ce16cb2344c-delete_snapshot" released by "delete_snapshot" :: held 1.773s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:19:30 devstack sudo[108032]: pam_unix(sudo:session): session closed for user root Sep 07 10:19:30 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-01f277f3-8ade-4c77-88a1-591db492cc78 tempest-ProjectReaderTests-297640696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a" returned: 0 in 0.290s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:19:30 devstack cinder-volume[87515]: DEBUG cinder.manager [None req-01f277f3-8ade-4c77-88a1-591db492cc78 tempest-ProjectReaderTests-297640696 None] Notifying Schedulers of capabilities ... {{(pid=87515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:19:30 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-01f277f3-8ade-4c77-88a1-591db492cc78 tempest-ProjectReaderTests-297640696 None] Deleted volume successfully. Sep 07 10:19:30 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-01f277f3-8ade-4c77-88a1-591db492cc78 tempest-ProjectReaderTests-297640696 None] Lock "cinder-e90f1bd3-1f37-4320-93bd-ed8e30b43ac0-delete_volume" released by "delete_volume" :: held 1.307s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:19:30 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-ceb469d9-ab81-486c-9dbd-06380d7a6571 tempest-ProjectMemberTests-55037479 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:19:30 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-ceb469d9-ab81-486c-9dbd-06380d7a6571 tempest-ProjectMemberTests-55037479 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:19:30 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-ceb469d9-ab81-486c-9dbd-06380d7a6571 tempest-ProjectMemberTests-55037479 None] Creating offline snapshot fef6257c-9fc7-4f7e-8511-7db63dff5f45 of volume 79ab5473-6a82-4265-a8e8-4dcc760671fe {{(pid=87515) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 10:19:30 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8601a93-cd31-420a-85b1-51e455adc29b]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:19:30 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-ceb469d9-ab81-486c-9dbd-06380d7a6571 tempest-ProjectMemberTests-55037479 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-79ab5473-6a82-4265-a8e8-4dcc760671fe {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:19:30 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-ed035d56-7204-45aa-8468-a712bca8321c tempest-ProjectReaderTests-205404938 None] Acquiring lock "cinder-4733512f-33ce-4e33-9447-cf5f6a07a66f-delete_volume" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:19:30 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-ed035d56-7204-45aa-8468-a712bca8321c tempest-ProjectReaderTests-205404938 None] Lock "cinder-4733512f-33ce-4e33-9447-cf5f6a07a66f-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:19:30 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-ed035d56-7204-45aa-8468-a712bca8321c tempest-ProjectReaderTests-205404938 None] Acquiring lock "cinder-quobyte-4733512f-33ce-4e33-9447-cf5f6a07a66f" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:19:30 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-ed035d56-7204-45aa-8468-a712bca8321c tempest-ProjectReaderTests-205404938 None] Lock "cinder-quobyte-4733512f-33ce-4e33-9447-cf5f6a07a66f" acquired by "delete_volume" :: waited 0.023s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:19:30 devstack sudo[108035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-79ab5473-6a82-4265-a8e8-4dcc760671fe Sep 07 10:19:30 devstack sudo[108035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:19:30 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4e74081-ab6a-46a2-9862-7c6faa541735]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:19:30 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-ed035d56-7204-45aa-8468-a712bca8321c tempest-ProjectReaderTests-205404938 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-4733512f-33ce-4e33-9447-cf5f6a07a66f {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:19:30 devstack sudo[108037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-4733512f-33ce-4e33-9447-cf5f6a07a66f Sep 07 10:19:30 devstack sudo[108037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:19:30 devstack sudo[108035]: pam_unix(sudo:session): session closed for user root Sep 07 10:19:30 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-ceb469d9-ab81-486c-9dbd-06380d7a6571 tempest-ProjectMemberTests-55037479 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-79ab5473-6a82-4265-a8e8-4dcc760671fe" returned: 0 in 0.422s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:19:30 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-ceb469d9-ab81-486c-9dbd-06380d7a6571 tempest-ProjectMemberTests-55037479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-79ab5473-6a82-4265-a8e8-4dcc760671fe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-79ab5473-6a82-4265-a8e8-4dcc760671fe.fef6257c-9fc7-4f7e-8511-7db63dff5f45 1G {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:19:30 devstack sudo[108042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-79ab5473-6a82-4265-a8e8-4dcc760671fe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-79ab5473-6a82-4265-a8e8-4dcc760671fe.fef6257c-9fc7-4f7e-8511-7db63dff5f45 1G Sep 07 10:19:30 devstack sudo[108042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:19:30 devstack sudo[108037]: pam_unix(sudo:session): session closed for user root Sep 07 10:19:30 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-ed035d56-7204-45aa-8468-a712bca8321c tempest-ProjectReaderTests-205404938 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-4733512f-33ce-4e33-9447-cf5f6a07a66f" returned: 0 in 0.402s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:19:30 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-ed035d56-7204-45aa-8468-a712bca8321c tempest-ProjectReaderTests-205404938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-4733512f-33ce-4e33-9447-cf5f6a07a66f {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:19:30 devstack sudo[108047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-4733512f-33ce-4e33-9447-cf5f6a07a66f Sep 07 10:19:30 devstack sudo[108047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:19:30 devstack sudo[108047]: pam_unix(sudo:session): session closed for user root Sep 07 10:19:31 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-ed035d56-7204-45aa-8468-a712bca8321c tempest-ProjectReaderTests-205404938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-4733512f-33ce-4e33-9447-cf5f6a07a66f" returned: 0 in 0.281s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:19:31 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-ed035d56-7204-45aa-8468-a712bca8321c tempest-ProjectReaderTests-205404938 None] Lock "cinder-quobyte-4733512f-33ce-4e33-9447-cf5f6a07a66f" released by "delete_volume" :: held 0.763s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:19:31 devstack sudo[108042]: pam_unix(sudo:session): session closed for user root Sep 07 10:19:31 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-ceb469d9-ab81-486c-9dbd-06380d7a6571 tempest-ProjectMemberTests-55037479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-79ab5473-6a82-4265-a8e8-4dcc760671fe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-79ab5473-6a82-4265-a8e8-4dcc760671fe.fef6257c-9fc7-4f7e-8511-7db63dff5f45 1G" returned: 0 in 0.456s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:19:31 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-ceb469d9-ab81-486c-9dbd-06380d7a6571 tempest-ProjectMemberTests-55037479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-79ab5473-6a82-4265-a8e8-4dcc760671fe -F qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-79ab5473-6a82-4265-a8e8-4dcc760671fe.fef6257c-9fc7-4f7e-8511-7db63dff5f45 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:19:31 devstack sudo[108053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-79ab5473-6a82-4265-a8e8-4dcc760671fe -F qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-79ab5473-6a82-4265-a8e8-4dcc760671fe.fef6257c-9fc7-4f7e-8511-7db63dff5f45 Sep 07 10:19:31 devstack sudo[108053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:19:31 devstack cinder-volume[87515]: DEBUG cinder.quota [None req-ed035d56-7204-45aa-8468-a712bca8321c tempest-ProjectReaderTests-205404938 None] Created reservations ['0f41f8e4-6181-4307-8fc9-87c0f27e61c8', '808de5a3-21d4-47e4-af56-1711c5b103a0', '8514a428-8512-47f2-9ffb-7ef4f66af930', '3ba3fa31-c91a-4991-b23f-d9e6231b2d96'] {{(pid=87515) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:19:31 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-ed035d56-7204-45aa-8468-a712bca8321c tempest-ProjectReaderTests-205404938 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:19:31 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-ed035d56-7204-45aa-8468-a712bca8321c tempest-ProjectReaderTests-205404938 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:19:31 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-ed035d56-7204-45aa-8468-a712bca8321c tempest-ProjectReaderTests-205404938 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:19:31 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-ed035d56-7204-45aa-8468-a712bca8321c tempest-ProjectReaderTests-205404938 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:19:31 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-ed035d56-7204-45aa-8468-a712bca8321c tempest-ProjectReaderTests-205404938 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:19:31 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-ed035d56-7204-45aa-8468-a712bca8321c tempest-ProjectReaderTests-205404938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:19:31 devstack sudo[108055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a Sep 07 10:19:31 devstack sudo[108055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:19:31 devstack sudo[108053]: pam_unix(sudo:session): session closed for user root Sep 07 10:19:31 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-ceb469d9-ab81-486c-9dbd-06380d7a6571 tempest-ProjectMemberTests-55037479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-79ab5473-6a82-4265-a8e8-4dcc760671fe -F qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-79ab5473-6a82-4265-a8e8-4dcc760671fe.fef6257c-9fc7-4f7e-8511-7db63dff5f45" returned: 0 in 0.366s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:19:31 devstack cinder-volume[87515]: WARNING cinder.volume.drivers.remotefs [None req-ceb469d9-ab81-486c-9dbd-06380d7a6571 tempest-ProjectMemberTests-55037479 None] /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-79ab5473-6a82-4265-a8e8-4dcc760671fe.fef6257c-9fc7-4f7e-8511-7db63dff5f45 is being set with open permissions: ugo+rw Sep 07 10:19:31 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-ceb469d9-ab81-486c-9dbd-06380d7a6571 tempest-ProjectMemberTests-55037479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-79ab5473-6a82-4265-a8e8-4dcc760671fe.fef6257c-9fc7-4f7e-8511-7db63dff5f45 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:19:31 devstack sudo[108062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-79ab5473-6a82-4265-a8e8-4dcc760671fe.fef6257c-9fc7-4f7e-8511-7db63dff5f45 Sep 07 10:19:31 devstack sudo[108062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:19:31 devstack sudo[108055]: pam_unix(sudo:session): session closed for user root Sep 07 10:19:31 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-ed035d56-7204-45aa-8468-a712bca8321c tempest-ProjectReaderTests-205404938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a" returned: 0 in 0.340s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:19:31 devstack cinder-volume[87515]: DEBUG cinder.manager [None req-ed035d56-7204-45aa-8468-a712bca8321c tempest-ProjectReaderTests-205404938 None] Notifying Schedulers of capabilities ... {{(pid=87515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:19:31 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-ed035d56-7204-45aa-8468-a712bca8321c tempest-ProjectReaderTests-205404938 None] Deleted volume successfully. Sep 07 10:19:31 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-ed035d56-7204-45aa-8468-a712bca8321c tempest-ProjectReaderTests-205404938 None] Lock "cinder-4733512f-33ce-4e33-9447-cf5f6a07a66f-delete_volume" released by "delete_volume" :: held 1.365s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:19:31 devstack sudo[108062]: pam_unix(sudo:session): session closed for user root Sep 07 10:19:31 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-ceb469d9-ab81-486c-9dbd-06380d7a6571 tempest-ProjectMemberTests-55037479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-79ab5473-6a82-4265-a8e8-4dcc760671fe.fef6257c-9fc7-4f7e-8511-7db63dff5f45" returned: 0 in 0.363s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:19:31 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-ceb469d9-ab81-486c-9dbd-06380d7a6571 tempest-ProjectMemberTests-55037479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-79ab5473-6a82-4265-a8e8-4dcc760671fe.info {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:19:31 devstack sudo[108066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-79ab5473-6a82-4265-a8e8-4dcc760671fe.info Sep 07 10:19:31 devstack sudo[108066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:19:31 devstack cinder-volume[87515]: DEBUG cinder.volume.flows.manager.create_volume [None req-dc99a7b4-1661-4490-9e83-9d193365cc3d tempest-ProjectReaderTests-205404938 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 10:19:31 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-dc99a7b4-1661-4490-9e83-9d193365cc3d tempest-ProjectReaderTests-205404938 None] Flow 'volume_create_manager' (dce74dad-815f-469b-a49c-df86acc8b3b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:19:31 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-dc99a7b4-1661-4490-9e83-9d193365cc3d tempest-ProjectReaderTests-205404938 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57a13964-5385-43ac-96d9-e474f9621601) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:19:31 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-dc99a7b4-1661-4490-9e83-9d193365cc3d tempest-ProjectReaderTests-205404938 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57a13964-5385-43ac-96d9-e474f9621601) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:19:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-56264349',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84812d86-85bc-408f-bee4-e166e74df8b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4bd49c4be7a74648ab6f55922f0638c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:19:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:19:32Z,use_quota=True,user_id='0477ac649f0140bf9c034ba6d1a49938',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3a092cd-7947-4cbf-abff-4ba9567becf0),volume_type_id=f3a092cd-7947-4cbf-abff-4ba9567becf0)' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:19:31 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-dc99a7b4-1661-4490-9e83-9d193365cc3d tempest-ProjectReaderTests-205404938 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36558436-087a-4c00-8d02-a858387e0cee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:19:31 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-dc99a7b4-1661-4490-9e83-9d193365cc3d tempest-ProjectReaderTests-205404938 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36558436-087a-4c00-8d02-a858387e0cee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:19:31 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-dc99a7b4-1661-4490-9e83-9d193365cc3d tempest-ProjectReaderTests-205404938 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed908db2-aed2-4fea-96b2-1302d82f7d5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:19:31 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-dc99a7b4-1661-4490-9e83-9d193365cc3d tempest-ProjectReaderTests-205404938 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed908db2-aed2-4fea-96b2-1302d82f7d5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '84812d86-85bc-408f-bee4-e166e74df8b4', 'volume_name': 'volume-84812d86-85bc-408f-bee4-e166e74df8b4', 'volume_size': 1}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:19:31 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-dc99a7b4-1661-4490-9e83-9d193365cc3d tempest-ProjectReaderTests-205404938 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2734db7e-365d-4948-8ceb-2bf041d17285) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:19:32 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-dc99a7b4-1661-4490-9e83-9d193365cc3d tempest-ProjectReaderTests-205404938 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2734db7e-365d-4948-8ceb-2bf041d17285) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:19:32 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-dc99a7b4-1661-4490-9e83-9d193365cc3d tempest-ProjectReaderTests-205404938 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c795819-bf2f-4bd1-9742-5c5d97695c00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:19:32 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-dc99a7b4-1661-4490-9e83-9d193365cc3d tempest-ProjectReaderTests-205404938 None] Volume 84812d86-85bc-408f-bee4-e166e74df8b4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-84812d86-85bc-408f-bee4-e166e74df8b4', 'volume_size': 1} Sep 07 10:19:32 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-dc99a7b4-1661-4490-9e83-9d193365cc3d tempest-ProjectReaderTests-205404938 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:19:32 devstack sudo[108066]: pam_unix(sudo:session): session closed for user root Sep 07 10:19:32 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-ceb469d9-ab81-486c-9dbd-06380d7a6571 tempest-ProjectMemberTests-55037479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-79ab5473-6a82-4265-a8e8-4dcc760671fe.info" returned: 0 in 0.270s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:19:32 devstack cinder-volume[87515]: WARNING cinder.volume.drivers.remotefs [None req-ceb469d9-ab81-486c-9dbd-06380d7a6571 tempest-ProjectMemberTests-55037479 None] /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-79ab5473-6a82-4265-a8e8-4dcc760671fe.info is being set with open permissions: ugo+rw Sep 07 10:19:32 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-ceb469d9-ab81-486c-9dbd-06380d7a6571 tempest-ProjectMemberTests-55037479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-79ab5473-6a82-4265-a8e8-4dcc760671fe.info {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:19:32 devstack sudo[108069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-79ab5473-6a82-4265-a8e8-4dcc760671fe.info Sep 07 10:19:32 devstack sudo[108069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:19:32 devstack sudo[108069]: pam_unix(sudo:session): session closed for user root Sep 07 10:19:32 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-ceb469d9-ab81-486c-9dbd-06380d7a6571 tempest-ProjectMemberTests-55037479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-79ab5473-6a82-4265-a8e8-4dcc760671fe.info" returned: 0 in 0.251s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:19:32 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-ceb469d9-ab81-486c-9dbd-06380d7a6571 tempest-ProjectMemberTests-55037479 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.220s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:19:32 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-dc99a7b4-1661-4490-9e83-9d193365cc3d tempest-ProjectReaderTests-205404938 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.335s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:19:32 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-dc99a7b4-1661-4490-9e83-9d193365cc3d tempest-ProjectReaderTests-205404938 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:19:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-56264349',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84812d86-85bc-408f-bee4-e166e74df8b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4bd49c4be7a74648ab6f55922f0638c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:19:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:19:32Z,use_quota=True,user_id='0477ac649f0140bf9c034ba6d1a49938',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3a092cd-7947-4cbf-abff-4ba9567becf0),volume_type_id=f3a092cd-7947-4cbf-abff-4ba9567becf0)}" {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 10:19:32 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-dc99a7b4-1661-4490-9e83-9d193365cc3d tempest-ProjectReaderTests-205404938 None] Creating volume 84812d86-85bc-408f-bee4-e166e74df8b4 {{(pid=87515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 10:19:32 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-dc99a7b4-1661-4490-9e83-9d193365cc3d tempest-ProjectReaderTests-205404938 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:19:32 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-dc99a7b4-1661-4490-9e83-9d193365cc3d tempest-ProjectReaderTests-205404938 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:19:32 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-dc99a7b4-1661-4490-9e83-9d193365cc3d tempest-ProjectReaderTests-205404938 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:19:32 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-dc99a7b4-1661-4490-9e83-9d193365cc3d tempest-ProjectReaderTests-205404938 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:19:32 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-dc99a7b4-1661-4490-9e83-9d193365cc3d tempest-ProjectReaderTests-205404938 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:19:32 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-dc99a7b4-1661-4490-9e83-9d193365cc3d tempest-ProjectReaderTests-205404938 None] Selected osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c as target Quobyte volume. {{(pid=87515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 10:19:32 devstack cinder-volume[87515]: INFO cinder.volume.drivers.remotefs [None req-dc99a7b4-1661-4490-9e83-9d193365cc3d tempest-ProjectReaderTests-205404938 None] casted to osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c Sep 07 10:19:32 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-dc99a7b4-1661-4490-9e83-9d193365cc3d tempest-ProjectReaderTests-205404938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-84812d86-85bc-408f-bee4-e166e74df8b4 1073741824 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:19:32 devstack sudo[108072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-84812d86-85bc-408f-bee4-e166e74df8b4 1073741824 Sep 07 10:19:32 devstack sudo[108072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:19:32 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-ceb469d9-ab81-486c-9dbd-06380d7a6571 tempest-ProjectMemberTests-55037479 None] Create snapshot completed successfully Sep 07 10:19:32 devstack sudo[108072]: pam_unix(sudo:session): session closed for user root Sep 07 10:19:32 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-dc99a7b4-1661-4490-9e83-9d193365cc3d tempest-ProjectReaderTests-205404938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-84812d86-85bc-408f-bee4-e166e74df8b4 1073741824" returned: 0 in 0.401s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:19:32 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-dc99a7b4-1661-4490-9e83-9d193365cc3d tempest-ProjectReaderTests-205404938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-84812d86-85bc-408f-bee4-e166e74df8b4 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:19:32 devstack sudo[108077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-84812d86-85bc-408f-bee4-e166e74df8b4 Sep 07 10:19:32 devstack sudo[108077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:19:33 devstack sudo[108077]: pam_unix(sudo:session): session closed for user root Sep 07 10:19:33 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-dc99a7b4-1661-4490-9e83-9d193365cc3d tempest-ProjectReaderTests-205404938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-84812d86-85bc-408f-bee4-e166e74df8b4" returned: 0 in 0.244s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:19:33 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-dc99a7b4-1661-4490-9e83-9d193365cc3d tempest-ProjectReaderTests-205404938 None] <== create_volume: return (684ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'} {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 10:19:33 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-dc99a7b4-1661-4490-9e83-9d193365cc3d tempest-ProjectReaderTests-205404938 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.687s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:19:33 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-dc99a7b4-1661-4490-9e83-9d193365cc3d tempest-ProjectReaderTests-205404938 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c795819-bf2f-4bd1-9742-5c5d97695c00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-84812d86-85bc-408f-bee4-e166e74df8b4', 'volume_size': 1}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:19:33 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-dc99a7b4-1661-4490-9e83-9d193365cc3d tempest-ProjectReaderTests-205404938 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f72e9c1-3d88-4d64-b755-e6e9e8056571) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:19:33 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-dc99a7b4-1661-4490-9e83-9d193365cc3d tempest-ProjectReaderTests-205404938 None] Volume volume-84812d86-85bc-408f-bee4-e166e74df8b4 (84812d86-85bc-408f-bee4-e166e74df8b4): created successfully Sep 07 10:19:33 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-dc99a7b4-1661-4490-9e83-9d193365cc3d tempest-ProjectReaderTests-205404938 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f72e9c1-3d88-4d64-b755-e6e9e8056571) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:19:33 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-dc99a7b4-1661-4490-9e83-9d193365cc3d tempest-ProjectReaderTests-205404938 None] Flow 'volume_create_manager' (dce74dad-815f-469b-a49c-df86acc8b3b7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:19:33 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-dc99a7b4-1661-4490-9e83-9d193365cc3d tempest-ProjectReaderTests-205404938 None] Created volume successfully. Sep 07 10:19:33 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-a78b6970-26a9-4d84-856f-0f61bb5e258b tempest-ProjectMemberTests-55037479 None] Acquiring lock "cinder-fef6257c-9fc7-4f7e-8511-7db63dff5f45-delete_snapshot" by "delete_snapshot" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:19:33 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-a78b6970-26a9-4d84-856f-0f61bb5e258b tempest-ProjectMemberTests-55037479 None] Lock "cinder-fef6257c-9fc7-4f7e-8511-7db63dff5f45-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:19:33 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-a78b6970-26a9-4d84-856f-0f61bb5e258b tempest-ProjectMemberTests-55037479 None] Acquiring lock "cinder-quobyte-79ab5473-6a82-4265-a8e8-4dcc760671fe" by "delete_snapshot" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:19:33 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-a78b6970-26a9-4d84-856f-0f61bb5e258b tempest-ProjectMemberTests-55037479 None] Lock "cinder-quobyte-79ab5473-6a82-4265-a8e8-4dcc760671fe" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:19:33 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-a78b6970-26a9-4d84-856f-0f61bb5e258b tempest-ProjectMemberTests-55037479 None] Acquiring lock "cinder-quobyte-fef6257c-9fc7-4f7e-8511-7db63dff5f45" by "_delete_snapshot" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:19:33 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-a78b6970-26a9-4d84-856f-0f61bb5e258b tempest-ProjectMemberTests-55037479 None] Lock "cinder-quobyte-fef6257c-9fc7-4f7e-8511-7db63dff5f45" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:19:33 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-a78b6970-26a9-4d84-856f-0f61bb5e258b tempest-ProjectMemberTests-55037479 None] Deleting offline snapshot fef6257c-9fc7-4f7e-8511-7db63dff5f45 of volume 79ab5473-6a82-4265-a8e8-4dcc760671fe {{(pid=87515) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 10:19:33 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-a78b6970-26a9-4d84-856f-0f61bb5e258b tempest-ProjectMemberTests-55037479 None] snapshot_file for this snap is: volume-79ab5473-6a82-4265-a8e8-4dcc760671fe.fef6257c-9fc7-4f7e-8511-7db63dff5f45 {{(pid=87515) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 10:19:33 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f3d30fe-f4ce-4aed-a99e-809f4f09174f]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:19:33 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-a78b6970-26a9-4d84-856f-0f61bb5e258b tempest-ProjectMemberTests-55037479 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-79ab5473-6a82-4265-a8e8-4dcc760671fe.fef6257c-9fc7-4f7e-8511-7db63dff5f45 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:19:33 devstack sudo[108080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-79ab5473-6a82-4265-a8e8-4dcc760671fe.fef6257c-9fc7-4f7e-8511-7db63dff5f45 Sep 07 10:19:33 devstack sudo[108080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:19:33 devstack sudo[108080]: pam_unix(sudo:session): session closed for user root Sep 07 10:19:33 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-a78b6970-26a9-4d84-856f-0f61bb5e258b tempest-ProjectMemberTests-55037479 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-79ab5473-6a82-4265-a8e8-4dcc760671fe.fef6257c-9fc7-4f7e-8511-7db63dff5f45" returned: 0 in 0.343s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:19:33 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-a78b6970-26a9-4d84-856f-0f61bb5e258b tempest-ProjectMemberTests-55037479 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-79ab5473-6a82-4265-a8e8-4dcc760671fe(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87515) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 10:19:33 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[61fa55a6-98be-4f42-a6fc-d2fa5bac4d31]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:19:33 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-a78b6970-26a9-4d84-856f-0f61bb5e258b tempest-ProjectMemberTests-55037479 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-79ab5473-6a82-4265-a8e8-4dcc760671fe {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:19:33 devstack sudo[108085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-79ab5473-6a82-4265-a8e8-4dcc760671fe Sep 07 10:19:33 devstack sudo[108085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:19:34 devstack sudo[108085]: pam_unix(sudo:session): session closed for user root Sep 07 10:19:34 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-a78b6970-26a9-4d84-856f-0f61bb5e258b tempest-ProjectMemberTests-55037479 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-79ab5473-6a82-4265-a8e8-4dcc760671fe" returned: 0 in 0.392s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:19:34 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-a78b6970-26a9-4d84-856f-0f61bb5e258b tempest-ProjectMemberTests-55037479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-79ab5473-6a82-4265-a8e8-4dcc760671fe.fef6257c-9fc7-4f7e-8511-7db63dff5f45 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:19:34 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-a152adc2-0bc0-4d67-a4ec-7acd739d4e6e tempest-ProjectReaderTests-205404938 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:19:34 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-a152adc2-0bc0-4d67-a4ec-7acd739d4e6e tempest-ProjectReaderTests-205404938 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:19:34 devstack sudo[108090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-79ab5473-6a82-4265-a8e8-4dcc760671fe.fef6257c-9fc7-4f7e-8511-7db63dff5f45 Sep 07 10:19:34 devstack sudo[108090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:19:34 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-a152adc2-0bc0-4d67-a4ec-7acd739d4e6e tempest-ProjectReaderTests-205404938 None] Creating offline snapshot a07ed9a1-9f72-482a-9b8a-bfdd7fb11089 of volume 84812d86-85bc-408f-bee4-e166e74df8b4 {{(pid=87515) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 10:19:34 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3b918fd-c289-46d1-87f4-91d2a866d844]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:19:34 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-a152adc2-0bc0-4d67-a4ec-7acd739d4e6e tempest-ProjectReaderTests-205404938 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-84812d86-85bc-408f-bee4-e166e74df8b4 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:19:34 devstack sudo[108092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-84812d86-85bc-408f-bee4-e166e74df8b4 Sep 07 10:19:34 devstack sudo[108092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:19:34 devstack sudo[108090]: pam_unix(sudo:session): session closed for user root Sep 07 10:19:34 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-a78b6970-26a9-4d84-856f-0f61bb5e258b tempest-ProjectMemberTests-55037479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-79ab5473-6a82-4265-a8e8-4dcc760671fe.fef6257c-9fc7-4f7e-8511-7db63dff5f45" returned: 0 in 0.352s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:19:34 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-a78b6970-26a9-4d84-856f-0f61bb5e258b tempest-ProjectMemberTests-55037479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-79ab5473-6a82-4265-a8e8-4dcc760671fe.fef6257c-9fc7-4f7e-8511-7db63dff5f45 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:19:34 devstack sudo[108097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-79ab5473-6a82-4265-a8e8-4dcc760671fe.fef6257c-9fc7-4f7e-8511-7db63dff5f45 Sep 07 10:19:34 devstack sudo[108097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:19:34 devstack sudo[108092]: pam_unix(sudo:session): session closed for user root Sep 07 10:19:34 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-a152adc2-0bc0-4d67-a4ec-7acd739d4e6e tempest-ProjectReaderTests-205404938 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-84812d86-85bc-408f-bee4-e166e74df8b4" returned: 0 in 0.391s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:19:34 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-a152adc2-0bc0-4d67-a4ec-7acd739d4e6e tempest-ProjectReaderTests-205404938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-84812d86-85bc-408f-bee4-e166e74df8b4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-84812d86-85bc-408f-bee4-e166e74df8b4.a07ed9a1-9f72-482a-9b8a-bfdd7fb11089 1G {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:19:34 devstack sudo[108102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-84812d86-85bc-408f-bee4-e166e74df8b4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-84812d86-85bc-408f-bee4-e166e74df8b4.a07ed9a1-9f72-482a-9b8a-bfdd7fb11089 1G Sep 07 10:19:34 devstack sudo[108102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:19:34 devstack sudo[108097]: pam_unix(sudo:session): session closed for user root Sep 07 10:19:34 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-a78b6970-26a9-4d84-856f-0f61bb5e258b tempest-ProjectMemberTests-55037479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-79ab5473-6a82-4265-a8e8-4dcc760671fe.fef6257c-9fc7-4f7e-8511-7db63dff5f45" returned: 0 in 0.256s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:19:34 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-a78b6970-26a9-4d84-856f-0f61bb5e258b tempest-ProjectMemberTests-55037479 None] Lock "cinder-quobyte-fef6257c-9fc7-4f7e-8511-7db63dff5f45" released by "_delete_snapshot" :: held 1.445s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:19:34 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-a78b6970-26a9-4d84-856f-0f61bb5e258b tempest-ProjectMemberTests-55037479 None] Lock "cinder-quobyte-79ab5473-6a82-4265-a8e8-4dcc760671fe" released by "delete_snapshot" :: held 1.469s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:19:34 devstack cinder-volume[87515]: DEBUG cinder.quota [None req-a78b6970-26a9-4d84-856f-0f61bb5e258b tempest-ProjectMemberTests-55037479 None] Created reservations ['102a399b-8af2-47bb-9b4d-1e540081e3a8', '6e823722-1b2a-46a6-b26a-df0774007770', '9adc1f29-5b40-40fc-a460-269f1d923562', 'd7200187-d4e1-4959-99b2-b0ac086761ed'] {{(pid=87515) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:19:34 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-a78b6970-26a9-4d84-856f-0f61bb5e258b tempest-ProjectMemberTests-55037479 None] Delete snapshot completed successfully. Sep 07 10:19:34 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-a78b6970-26a9-4d84-856f-0f61bb5e258b tempest-ProjectMemberTests-55037479 None] Lock "cinder-fef6257c-9fc7-4f7e-8511-7db63dff5f45-delete_snapshot" released by "delete_snapshot" :: held 1.662s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:19:34 devstack sudo[108102]: pam_unix(sudo:session): session closed for user root Sep 07 10:19:34 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-a152adc2-0bc0-4d67-a4ec-7acd739d4e6e tempest-ProjectReaderTests-205404938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-84812d86-85bc-408f-bee4-e166e74df8b4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-84812d86-85bc-408f-bee4-e166e74df8b4.a07ed9a1-9f72-482a-9b8a-bfdd7fb11089 1G" returned: 0 in 0.430s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:19:34 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-a152adc2-0bc0-4d67-a4ec-7acd739d4e6e tempest-ProjectReaderTests-205404938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-84812d86-85bc-408f-bee4-e166e74df8b4 -F qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-84812d86-85bc-408f-bee4-e166e74df8b4.a07ed9a1-9f72-482a-9b8a-bfdd7fb11089 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:19:35 devstack sudo[108109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-84812d86-85bc-408f-bee4-e166e74df8b4 -F qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-84812d86-85bc-408f-bee4-e166e74df8b4.a07ed9a1-9f72-482a-9b8a-bfdd7fb11089 Sep 07 10:19:35 devstack sudo[108109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:19:35 devstack sudo[108109]: pam_unix(sudo:session): session closed for user root Sep 07 10:19:35 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-a152adc2-0bc0-4d67-a4ec-7acd739d4e6e tempest-ProjectReaderTests-205404938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-84812d86-85bc-408f-bee4-e166e74df8b4 -F qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-84812d86-85bc-408f-bee4-e166e74df8b4.a07ed9a1-9f72-482a-9b8a-bfdd7fb11089" returned: 0 in 0.281s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:19:35 devstack cinder-volume[87515]: WARNING cinder.volume.drivers.remotefs [None req-a152adc2-0bc0-4d67-a4ec-7acd739d4e6e tempest-ProjectReaderTests-205404938 None] /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-84812d86-85bc-408f-bee4-e166e74df8b4.a07ed9a1-9f72-482a-9b8a-bfdd7fb11089 is being set with open permissions: ugo+rw Sep 07 10:19:35 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-a152adc2-0bc0-4d67-a4ec-7acd739d4e6e tempest-ProjectReaderTests-205404938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-84812d86-85bc-408f-bee4-e166e74df8b4.a07ed9a1-9f72-482a-9b8a-bfdd7fb11089 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:19:35 devstack sudo[108114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-84812d86-85bc-408f-bee4-e166e74df8b4.a07ed9a1-9f72-482a-9b8a-bfdd7fb11089 Sep 07 10:19:35 devstack sudo[108114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:19:35 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-0da5b972-f048-4c3c-960c-5381c5f098f2 tempest-ProjectMemberTests-55037479 None] Acquiring lock "cinder-79ab5473-6a82-4265-a8e8-4dcc760671fe-delete_volume" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:19:35 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-0da5b972-f048-4c3c-960c-5381c5f098f2 tempest-ProjectMemberTests-55037479 None] Lock "cinder-79ab5473-6a82-4265-a8e8-4dcc760671fe-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:19:35 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-0da5b972-f048-4c3c-960c-5381c5f098f2 tempest-ProjectMemberTests-55037479 None] Acquiring lock "cinder-quobyte-79ab5473-6a82-4265-a8e8-4dcc760671fe" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:19:35 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-0da5b972-f048-4c3c-960c-5381c5f098f2 tempest-ProjectMemberTests-55037479 None] Lock "cinder-quobyte-79ab5473-6a82-4265-a8e8-4dcc760671fe" acquired by "delete_volume" :: waited 0.017s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:19:35 devstack sudo[108114]: pam_unix(sudo:session): session closed for user root Sep 07 10:19:35 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-a152adc2-0bc0-4d67-a4ec-7acd739d4e6e tempest-ProjectReaderTests-205404938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-84812d86-85bc-408f-bee4-e166e74df8b4.a07ed9a1-9f72-482a-9b8a-bfdd7fb11089" returned: 0 in 0.272s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:19:35 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[56fa7948-843d-4df2-9632-61b1a62eeb43]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:19:35 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-0da5b972-f048-4c3c-960c-5381c5f098f2 tempest-ProjectMemberTests-55037479 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-79ab5473-6a82-4265-a8e8-4dcc760671fe {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:19:35 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-a152adc2-0bc0-4d67-a4ec-7acd739d4e6e tempest-ProjectReaderTests-205404938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-84812d86-85bc-408f-bee4-e166e74df8b4.info {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:19:35 devstack sudo[108118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-84812d86-85bc-408f-bee4-e166e74df8b4.info Sep 07 10:19:35 devstack sudo[108118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:19:35 devstack sudo[108117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-79ab5473-6a82-4265-a8e8-4dcc760671fe Sep 07 10:19:35 devstack sudo[108117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:19:35 devstack sudo[108118]: pam_unix(sudo:session): session closed for user root Sep 07 10:19:35 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-a152adc2-0bc0-4d67-a4ec-7acd739d4e6e tempest-ProjectReaderTests-205404938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-84812d86-85bc-408f-bee4-e166e74df8b4.info" returned: 0 in 0.269s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:19:35 devstack cinder-volume[87515]: WARNING cinder.volume.drivers.remotefs [None req-a152adc2-0bc0-4d67-a4ec-7acd739d4e6e tempest-ProjectReaderTests-205404938 None] /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-84812d86-85bc-408f-bee4-e166e74df8b4.info is being set with open permissions: ugo+rw Sep 07 10:19:35 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-a152adc2-0bc0-4d67-a4ec-7acd739d4e6e tempest-ProjectReaderTests-205404938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-84812d86-85bc-408f-bee4-e166e74df8b4.info {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:19:35 devstack sudo[108124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-84812d86-85bc-408f-bee4-e166e74df8b4.info Sep 07 10:19:35 devstack sudo[108124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:19:35 devstack sudo[108117]: pam_unix(sudo:session): session closed for user root Sep 07 10:19:35 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-0da5b972-f048-4c3c-960c-5381c5f098f2 tempest-ProjectMemberTests-55037479 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-79ab5473-6a82-4265-a8e8-4dcc760671fe" returned: 0 in 0.369s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:19:35 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-0da5b972-f048-4c3c-960c-5381c5f098f2 tempest-ProjectMemberTests-55037479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-79ab5473-6a82-4265-a8e8-4dcc760671fe {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:19:35 devstack sudo[108127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-79ab5473-6a82-4265-a8e8-4dcc760671fe Sep 07 10:19:35 devstack sudo[108127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:19:36 devstack sudo[108124]: pam_unix(sudo:session): session closed for user root Sep 07 10:19:36 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-a152adc2-0bc0-4d67-a4ec-7acd739d4e6e tempest-ProjectReaderTests-205404938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-84812d86-85bc-408f-bee4-e166e74df8b4.info" returned: 0 in 0.244s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:19:36 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-a152adc2-0bc0-4d67-a4ec-7acd739d4e6e tempest-ProjectReaderTests-205404938 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.981s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:19:36 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-a152adc2-0bc0-4d67-a4ec-7acd739d4e6e tempest-ProjectReaderTests-205404938 None] Create snapshot completed successfully Sep 07 10:19:36 devstack sudo[108127]: pam_unix(sudo:session): session closed for user root Sep 07 10:19:36 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-0da5b972-f048-4c3c-960c-5381c5f098f2 tempest-ProjectMemberTests-55037479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-79ab5473-6a82-4265-a8e8-4dcc760671fe" returned: 0 in 0.261s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:19:36 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-0da5b972-f048-4c3c-960c-5381c5f098f2 tempest-ProjectMemberTests-55037479 None] Lock "cinder-quobyte-79ab5473-6a82-4265-a8e8-4dcc760671fe" released by "delete_volume" :: held 0.691s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:19:36 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-707912c8-fbb0-484e-be95-0c445d969043 tempest-ProjectReaderTests-205404938 None] Acquiring lock "cinder-a07ed9a1-9f72-482a-9b8a-bfdd7fb11089-delete_snapshot" by "delete_snapshot" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:19:36 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-707912c8-fbb0-484e-be95-0c445d969043 tempest-ProjectReaderTests-205404938 None] Lock "cinder-a07ed9a1-9f72-482a-9b8a-bfdd7fb11089-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:19:36 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-707912c8-fbb0-484e-be95-0c445d969043 tempest-ProjectReaderTests-205404938 None] Acquiring lock "cinder-quobyte-84812d86-85bc-408f-bee4-e166e74df8b4" by "delete_snapshot" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:19:36 devstack cinder-volume[87515]: DEBUG cinder.quota [None req-0da5b972-f048-4c3c-960c-5381c5f098f2 tempest-ProjectMemberTests-55037479 None] Created reservations ['1c398103-ebfb-418f-b7c8-cc2c80bbbc06', 'ee2c2522-a5a3-42cf-a7b3-1c4b281b2f26', '423463eb-81b4-49f2-916c-893fb587e56b', '83ad0d30-930c-4d84-ae88-09eecff5f8e6'] {{(pid=87515) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:19:36 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-707912c8-fbb0-484e-be95-0c445d969043 tempest-ProjectReaderTests-205404938 None] Lock "cinder-quobyte-84812d86-85bc-408f-bee4-e166e74df8b4" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:19:36 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-707912c8-fbb0-484e-be95-0c445d969043 tempest-ProjectReaderTests-205404938 None] Acquiring lock "cinder-quobyte-a07ed9a1-9f72-482a-9b8a-bfdd7fb11089" by "_delete_snapshot" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:19:36 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-707912c8-fbb0-484e-be95-0c445d969043 tempest-ProjectReaderTests-205404938 None] Lock "cinder-quobyte-a07ed9a1-9f72-482a-9b8a-bfdd7fb11089" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:19:36 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-707912c8-fbb0-484e-be95-0c445d969043 tempest-ProjectReaderTests-205404938 None] Deleting offline snapshot a07ed9a1-9f72-482a-9b8a-bfdd7fb11089 of volume 84812d86-85bc-408f-bee4-e166e74df8b4 {{(pid=87515) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 10:19:36 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-707912c8-fbb0-484e-be95-0c445d969043 tempest-ProjectReaderTests-205404938 None] snapshot_file for this snap is: volume-84812d86-85bc-408f-bee4-e166e74df8b4.a07ed9a1-9f72-482a-9b8a-bfdd7fb11089 {{(pid=87515) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 10:19:36 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[71055cf2-3d7a-40ad-8e2a-926575b57b9f]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:19:36 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-707912c8-fbb0-484e-be95-0c445d969043 tempest-ProjectReaderTests-205404938 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-84812d86-85bc-408f-bee4-e166e74df8b4.a07ed9a1-9f72-482a-9b8a-bfdd7fb11089 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:19:36 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-0da5b972-f048-4c3c-960c-5381c5f098f2 tempest-ProjectMemberTests-55037479 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:19:36 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-0da5b972-f048-4c3c-960c-5381c5f098f2 tempest-ProjectMemberTests-55037479 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:19:36 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-0da5b972-f048-4c3c-960c-5381c5f098f2 tempest-ProjectMemberTests-55037479 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:19:36 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-0da5b972-f048-4c3c-960c-5381c5f098f2 tempest-ProjectMemberTests-55037479 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:19:36 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-0da5b972-f048-4c3c-960c-5381c5f098f2 tempest-ProjectMemberTests-55037479 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:19:36 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-0da5b972-f048-4c3c-960c-5381c5f098f2 tempest-ProjectMemberTests-55037479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:19:36 devstack sudo[108132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a Sep 07 10:19:36 devstack sudo[108132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:19:36 devstack sudo[108131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-84812d86-85bc-408f-bee4-e166e74df8b4.a07ed9a1-9f72-482a-9b8a-bfdd7fb11089 Sep 07 10:19:36 devstack sudo[108131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:19:36 devstack sudo[108132]: pam_unix(sudo:session): session closed for user root Sep 07 10:19:36 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-0da5b972-f048-4c3c-960c-5381c5f098f2 tempest-ProjectMemberTests-55037479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a" returned: 0 in 0.255s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:19:36 devstack cinder-volume[87515]: DEBUG cinder.manager [None req-0da5b972-f048-4c3c-960c-5381c5f098f2 tempest-ProjectMemberTests-55037479 None] Notifying Schedulers of capabilities ... {{(pid=87515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:19:36 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-0da5b972-f048-4c3c-960c-5381c5f098f2 tempest-ProjectMemberTests-55037479 None] Deleted volume successfully. Sep 07 10:19:36 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-0da5b972-f048-4c3c-960c-5381c5f098f2 tempest-ProjectMemberTests-55037479 None] Lock "cinder-79ab5473-6a82-4265-a8e8-4dcc760671fe-delete_volume" released by "delete_volume" :: held 1.222s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:19:36 devstack sudo[108131]: pam_unix(sudo:session): session closed for user root Sep 07 10:19:36 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-707912c8-fbb0-484e-be95-0c445d969043 tempest-ProjectReaderTests-205404938 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-84812d86-85bc-408f-bee4-e166e74df8b4.a07ed9a1-9f72-482a-9b8a-bfdd7fb11089" returned: 0 in 0.390s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:19:36 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-707912c8-fbb0-484e-be95-0c445d969043 tempest-ProjectReaderTests-205404938 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-84812d86-85bc-408f-bee4-e166e74df8b4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87515) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 10:19:36 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[badc5adc-efb6-42c7-aaab-4f36814610cf]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:19:36 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-707912c8-fbb0-484e-be95-0c445d969043 tempest-ProjectReaderTests-205404938 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-84812d86-85bc-408f-bee4-e166e74df8b4 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:19:36 devstack sudo[108140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-84812d86-85bc-408f-bee4-e166e74df8b4 Sep 07 10:19:36 devstack sudo[108140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:19:37 devstack cinder-volume[87515]: DEBUG cinder.volume.flows.manager.create_volume [None req-184b06a0-9edc-41bb-8df3-14c777f06954 tempest-ProjectMemberTests-55037479 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 10:19:37 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-184b06a0-9edc-41bb-8df3-14c777f06954 tempest-ProjectMemberTests-55037479 None] Flow 'volume_create_manager' (80442eae-72b8-457a-8b18-11a818529e45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:19:37 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-184b06a0-9edc-41bb-8df3-14c777f06954 tempest-ProjectMemberTests-55037479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b0308a8-4b49-46af-ad01-08ee21e2fad2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:19:37 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-184b06a0-9edc-41bb-8df3-14c777f06954 tempest-ProjectMemberTests-55037479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b0308a8-4b49-46af-ad01-08ee21e2fad2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:19:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1044446850',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e573706f-1e4b-43b7-9f5a-12de559e393d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41fa4493d2f045dc87793bd97d931cff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:19:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:19:37Z,use_quota=True,user_id='5136aa4e2a7c4a1da79d4e4478cdcbf6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3a092cd-7947-4cbf-abff-4ba9567becf0),volume_type_id=f3a092cd-7947-4cbf-abff-4ba9567becf0)' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:19:37 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-184b06a0-9edc-41bb-8df3-14c777f06954 tempest-ProjectMemberTests-55037479 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b18b33fd-bbd7-4618-856a-2e5a2fcbdc8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:19:37 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-184b06a0-9edc-41bb-8df3-14c777f06954 tempest-ProjectMemberTests-55037479 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b18b33fd-bbd7-4618-856a-2e5a2fcbdc8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:19:37 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-184b06a0-9edc-41bb-8df3-14c777f06954 tempest-ProjectMemberTests-55037479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0eda1fc5-3077-4339-b46b-e3d086be13b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:19:37 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-184b06a0-9edc-41bb-8df3-14c777f06954 tempest-ProjectMemberTests-55037479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0eda1fc5-3077-4339-b46b-e3d086be13b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e573706f-1e4b-43b7-9f5a-12de559e393d', 'volume_name': 'volume-e573706f-1e4b-43b7-9f5a-12de559e393d', 'volume_size': 1}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:19:37 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-184b06a0-9edc-41bb-8df3-14c777f06954 tempest-ProjectMemberTests-55037479 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bfad3444-673f-43f9-8808-abca6ae3129c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:19:37 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-184b06a0-9edc-41bb-8df3-14c777f06954 tempest-ProjectMemberTests-55037479 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bfad3444-673f-43f9-8808-abca6ae3129c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:19:37 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-184b06a0-9edc-41bb-8df3-14c777f06954 tempest-ProjectMemberTests-55037479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c800772-43f1-418e-9e81-658365b662de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:19:37 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-184b06a0-9edc-41bb-8df3-14c777f06954 tempest-ProjectMemberTests-55037479 None] Volume e573706f-1e4b-43b7-9f5a-12de559e393d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e573706f-1e4b-43b7-9f5a-12de559e393d', 'volume_size': 1} Sep 07 10:19:37 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-184b06a0-9edc-41bb-8df3-14c777f06954 tempest-ProjectMemberTests-55037479 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:19:37 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-184b06a0-9edc-41bb-8df3-14c777f06954 tempest-ProjectMemberTests-55037479 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:19:37 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-184b06a0-9edc-41bb-8df3-14c777f06954 tempest-ProjectMemberTests-55037479 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:19:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1044446850',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e573706f-1e4b-43b7-9f5a-12de559e393d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41fa4493d2f045dc87793bd97d931cff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:19:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:19:37Z,use_quota=True,user_id='5136aa4e2a7c4a1da79d4e4478cdcbf6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3a092cd-7947-4cbf-abff-4ba9567becf0),volume_type_id=f3a092cd-7947-4cbf-abff-4ba9567becf0)}" {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 10:19:37 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-184b06a0-9edc-41bb-8df3-14c777f06954 tempest-ProjectMemberTests-55037479 None] Creating volume e573706f-1e4b-43b7-9f5a-12de559e393d {{(pid=87515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 10:19:37 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-184b06a0-9edc-41bb-8df3-14c777f06954 tempest-ProjectMemberTests-55037479 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:19:37 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-184b06a0-9edc-41bb-8df3-14c777f06954 tempest-ProjectMemberTests-55037479 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:19:37 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-184b06a0-9edc-41bb-8df3-14c777f06954 tempest-ProjectMemberTests-55037479 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:19:37 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-184b06a0-9edc-41bb-8df3-14c777f06954 tempest-ProjectMemberTests-55037479 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:19:37 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-184b06a0-9edc-41bb-8df3-14c777f06954 tempest-ProjectMemberTests-55037479 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:19:37 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-184b06a0-9edc-41bb-8df3-14c777f06954 tempest-ProjectMemberTests-55037479 None] Selected osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c as target Quobyte volume. {{(pid=87515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 10:19:37 devstack cinder-volume[87515]: INFO cinder.volume.drivers.remotefs [None req-184b06a0-9edc-41bb-8df3-14c777f06954 tempest-ProjectMemberTests-55037479 None] casted to osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c Sep 07 10:19:37 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-184b06a0-9edc-41bb-8df3-14c777f06954 tempest-ProjectMemberTests-55037479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-e573706f-1e4b-43b7-9f5a-12de559e393d 1073741824 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:19:37 devstack sudo[108140]: pam_unix(sudo:session): session closed for user root Sep 07 10:19:37 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-707912c8-fbb0-484e-be95-0c445d969043 tempest-ProjectReaderTests-205404938 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-84812d86-85bc-408f-bee4-e166e74df8b4" returned: 0 in 0.405s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:19:37 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-707912c8-fbb0-484e-be95-0c445d969043 tempest-ProjectReaderTests-205404938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-84812d86-85bc-408f-bee4-e166e74df8b4.a07ed9a1-9f72-482a-9b8a-bfdd7fb11089 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:19:37 devstack sudo[108145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-e573706f-1e4b-43b7-9f5a-12de559e393d 1073741824 Sep 07 10:19:37 devstack sudo[108145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:19:37 devstack sudo[108146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-84812d86-85bc-408f-bee4-e166e74df8b4.a07ed9a1-9f72-482a-9b8a-bfdd7fb11089 Sep 07 10:19:37 devstack sudo[108146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:19:37 devstack sudo[108146]: pam_unix(sudo:session): session closed for user root Sep 07 10:19:37 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-707912c8-fbb0-484e-be95-0c445d969043 tempest-ProjectReaderTests-205404938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-84812d86-85bc-408f-bee4-e166e74df8b4.a07ed9a1-9f72-482a-9b8a-bfdd7fb11089" returned: 0 in 0.343s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:19:37 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-707912c8-fbb0-484e-be95-0c445d969043 tempest-ProjectReaderTests-205404938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-84812d86-85bc-408f-bee4-e166e74df8b4.a07ed9a1-9f72-482a-9b8a-bfdd7fb11089 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:19:37 devstack sudo[108156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-84812d86-85bc-408f-bee4-e166e74df8b4.a07ed9a1-9f72-482a-9b8a-bfdd7fb11089 Sep 07 10:19:37 devstack sudo[108156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:19:37 devstack sudo[108145]: pam_unix(sudo:session): session closed for user root Sep 07 10:19:37 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-184b06a0-9edc-41bb-8df3-14c777f06954 tempest-ProjectMemberTests-55037479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-e573706f-1e4b-43b7-9f5a-12de559e393d 1073741824" returned: 0 in 0.438s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:19:37 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-184b06a0-9edc-41bb-8df3-14c777f06954 tempest-ProjectMemberTests-55037479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-e573706f-1e4b-43b7-9f5a-12de559e393d {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:19:37 devstack sudo[108158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-e573706f-1e4b-43b7-9f5a-12de559e393d Sep 07 10:19:37 devstack sudo[108158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:19:37 devstack sudo[108156]: pam_unix(sudo:session): session closed for user root Sep 07 10:19:37 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-707912c8-fbb0-484e-be95-0c445d969043 tempest-ProjectReaderTests-205404938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-84812d86-85bc-408f-bee4-e166e74df8b4.a07ed9a1-9f72-482a-9b8a-bfdd7fb11089" returned: 0 in 0.265s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:19:37 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-707912c8-fbb0-484e-be95-0c445d969043 tempest-ProjectReaderTests-205404938 None] Lock "cinder-quobyte-a07ed9a1-9f72-482a-9b8a-bfdd7fb11089" released by "_delete_snapshot" :: held 1.503s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:19:37 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-707912c8-fbb0-484e-be95-0c445d969043 tempest-ProjectReaderTests-205404938 None] Lock "cinder-quobyte-84812d86-85bc-408f-bee4-e166e74df8b4" released by "delete_snapshot" :: held 1.530s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:19:37 devstack cinder-volume[87515]: DEBUG cinder.quota [None req-707912c8-fbb0-484e-be95-0c445d969043 tempest-ProjectReaderTests-205404938 None] Created reservations ['b9f0c82e-e187-45f5-a826-f9518f1d9ae7', '77fe6387-0567-409d-ad35-f45a36b18285', '01611a4d-a28b-41d3-840c-1c59c6fe294a', '8a684b75-676c-439b-9873-8f1ba0bdfa36'] {{(pid=87515) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:19:37 devstack sudo[108158]: pam_unix(sudo:session): session closed for user root Sep 07 10:19:37 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-184b06a0-9edc-41bb-8df3-14c777f06954 tempest-ProjectMemberTests-55037479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-e573706f-1e4b-43b7-9f5a-12de559e393d" returned: 0 in 0.267s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:19:37 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-184b06a0-9edc-41bb-8df3-14c777f06954 tempest-ProjectMemberTests-55037479 None] <== create_volume: return (744ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'} {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 10:19:37 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-184b06a0-9edc-41bb-8df3-14c777f06954 tempest-ProjectMemberTests-55037479 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.747s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:19:37 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-184b06a0-9edc-41bb-8df3-14c777f06954 tempest-ProjectMemberTests-55037479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c800772-43f1-418e-9e81-658365b662de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e573706f-1e4b-43b7-9f5a-12de559e393d', 'volume_size': 1}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:19:37 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-184b06a0-9edc-41bb-8df3-14c777f06954 tempest-ProjectMemberTests-55037479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8be92670-19f5-4187-9f42-5a5dbda66dea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:19:37 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-184b06a0-9edc-41bb-8df3-14c777f06954 tempest-ProjectMemberTests-55037479 None] Volume volume-e573706f-1e4b-43b7-9f5a-12de559e393d (e573706f-1e4b-43b7-9f5a-12de559e393d): created successfully Sep 07 10:19:37 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-184b06a0-9edc-41bb-8df3-14c777f06954 tempest-ProjectMemberTests-55037479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8be92670-19f5-4187-9f42-5a5dbda66dea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:19:37 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-184b06a0-9edc-41bb-8df3-14c777f06954 tempest-ProjectMemberTests-55037479 None] Flow 'volume_create_manager' (80442eae-72b8-457a-8b18-11a818529e45) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:19:37 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-184b06a0-9edc-41bb-8df3-14c777f06954 tempest-ProjectMemberTests-55037479 None] Created volume successfully. Sep 07 10:19:37 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-707912c8-fbb0-484e-be95-0c445d969043 tempest-ProjectReaderTests-205404938 None] Delete snapshot completed successfully. Sep 07 10:19:37 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-707912c8-fbb0-484e-be95-0c445d969043 tempest-ProjectReaderTests-205404938 None] Lock "cinder-a07ed9a1-9f72-482a-9b8a-bfdd7fb11089-delete_snapshot" released by "delete_snapshot" :: held 1.714s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:19:38 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-2b401a08-1d2f-47f2-ab18-a5d4d617925f tempest-ProjectMemberTests-55037479 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:19:38 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-2b401a08-1d2f-47f2-ab18-a5d4d617925f tempest-ProjectMemberTests-55037479 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:19:38 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-2b401a08-1d2f-47f2-ab18-a5d4d617925f tempest-ProjectMemberTests-55037479 None] Creating offline snapshot 6dbd52f4-c219-4573-ad51-4efc1404bdfe of volume e573706f-1e4b-43b7-9f5a-12de559e393d {{(pid=87515) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 10:19:38 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[32e61155-1aa4-4f8a-98e3-a6cf2ebe0db5]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:19:38 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-2b401a08-1d2f-47f2-ab18-a5d4d617925f tempest-ProjectMemberTests-55037479 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-e573706f-1e4b-43b7-9f5a-12de559e393d {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:19:38 devstack sudo[108168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-e573706f-1e4b-43b7-9f5a-12de559e393d Sep 07 10:19:38 devstack sudo[108168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:19:38 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-ba7e4abf-d6db-4558-b4a0-0c7175fefc88 tempest-ProjectReaderTests-205404938 None] Acquiring lock "cinder-84812d86-85bc-408f-bee4-e166e74df8b4-delete_volume" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:19:38 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-ba7e4abf-d6db-4558-b4a0-0c7175fefc88 tempest-ProjectReaderTests-205404938 None] Lock "cinder-84812d86-85bc-408f-bee4-e166e74df8b4-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:19:38 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-ba7e4abf-d6db-4558-b4a0-0c7175fefc88 tempest-ProjectReaderTests-205404938 None] Acquiring lock "cinder-quobyte-84812d86-85bc-408f-bee4-e166e74df8b4" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:19:38 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-ba7e4abf-d6db-4558-b4a0-0c7175fefc88 tempest-ProjectReaderTests-205404938 None] Lock "cinder-quobyte-84812d86-85bc-408f-bee4-e166e74df8b4" acquired by "delete_volume" :: waited 0.021s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:19:38 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[904bf729-d2a3-4d63-8171-8f3e106e2371]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:19:38 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-ba7e4abf-d6db-4558-b4a0-0c7175fefc88 tempest-ProjectReaderTests-205404938 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-84812d86-85bc-408f-bee4-e166e74df8b4 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:19:38 devstack sudo[108168]: pam_unix(sudo:session): session closed for user root Sep 07 10:19:38 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-2b401a08-1d2f-47f2-ab18-a5d4d617925f tempest-ProjectMemberTests-55037479 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-e573706f-1e4b-43b7-9f5a-12de559e393d" returned: 0 in 0.374s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:19:38 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-2b401a08-1d2f-47f2-ab18-a5d4d617925f tempest-ProjectMemberTests-55037479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-e573706f-1e4b-43b7-9f5a-12de559e393d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-e573706f-1e4b-43b7-9f5a-12de559e393d.6dbd52f4-c219-4573-ad51-4efc1404bdfe 1G {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:19:38 devstack sudo[108170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-84812d86-85bc-408f-bee4-e166e74df8b4 Sep 07 10:19:38 devstack sudo[108170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:19:38 devstack sudo[108174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-e573706f-1e4b-43b7-9f5a-12de559e393d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-e573706f-1e4b-43b7-9f5a-12de559e393d.6dbd52f4-c219-4573-ad51-4efc1404bdfe 1G Sep 07 10:19:38 devstack sudo[108174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:19:38 devstack sudo[108170]: pam_unix(sudo:session): session closed for user root Sep 07 10:19:38 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-ba7e4abf-d6db-4558-b4a0-0c7175fefc88 tempest-ProjectReaderTests-205404938 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-84812d86-85bc-408f-bee4-e166e74df8b4" returned: 0 in 0.349s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:19:38 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-ba7e4abf-d6db-4558-b4a0-0c7175fefc88 tempest-ProjectReaderTests-205404938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-84812d86-85bc-408f-bee4-e166e74df8b4 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:19:38 devstack sudo[108183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-84812d86-85bc-408f-bee4-e166e74df8b4 Sep 07 10:19:38 devstack sudo[108183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:19:39 devstack sudo[108174]: pam_unix(sudo:session): session closed for user root Sep 07 10:19:39 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-2b401a08-1d2f-47f2-ab18-a5d4d617925f tempest-ProjectMemberTests-55037479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-e573706f-1e4b-43b7-9f5a-12de559e393d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-e573706f-1e4b-43b7-9f5a-12de559e393d.6dbd52f4-c219-4573-ad51-4efc1404bdfe 1G" returned: 0 in 0.409s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:19:39 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-2b401a08-1d2f-47f2-ab18-a5d4d617925f tempest-ProjectMemberTests-55037479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e573706f-1e4b-43b7-9f5a-12de559e393d -F qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-e573706f-1e4b-43b7-9f5a-12de559e393d.6dbd52f4-c219-4573-ad51-4efc1404bdfe {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:19:39 devstack sudo[108186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e573706f-1e4b-43b7-9f5a-12de559e393d -F qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-e573706f-1e4b-43b7-9f5a-12de559e393d.6dbd52f4-c219-4573-ad51-4efc1404bdfe Sep 07 10:19:39 devstack sudo[108186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:19:39 devstack sudo[108183]: pam_unix(sudo:session): session closed for user root Sep 07 10:19:39 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-ba7e4abf-d6db-4558-b4a0-0c7175fefc88 tempest-ProjectReaderTests-205404938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-84812d86-85bc-408f-bee4-e166e74df8b4" returned: 0 in 0.254s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:19:39 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-ba7e4abf-d6db-4558-b4a0-0c7175fefc88 tempest-ProjectReaderTests-205404938 None] Lock "cinder-quobyte-84812d86-85bc-408f-bee4-e166e74df8b4" released by "delete_volume" :: held 0.664s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:19:39 devstack cinder-volume[87515]: DEBUG cinder.quota [None req-ba7e4abf-d6db-4558-b4a0-0c7175fefc88 tempest-ProjectReaderTests-205404938 None] Created reservations ['bf8d835f-44bf-4ca3-b77f-c94f276dea93', '5940e99b-d39f-467f-b4ad-5ddacc5e4ac8', '62320be3-ef8c-4bc5-83bf-418f3c7a2a16', 'b3166ebc-2486-44da-9f32-3fd2bcf88299'] {{(pid=87515) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:19:39 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-ba7e4abf-d6db-4558-b4a0-0c7175fefc88 tempest-ProjectReaderTests-205404938 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:19:39 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-ba7e4abf-d6db-4558-b4a0-0c7175fefc88 tempest-ProjectReaderTests-205404938 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:19:39 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-ba7e4abf-d6db-4558-b4a0-0c7175fefc88 tempest-ProjectReaderTests-205404938 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:19:39 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-ba7e4abf-d6db-4558-b4a0-0c7175fefc88 tempest-ProjectReaderTests-205404938 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:19:39 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-ba7e4abf-d6db-4558-b4a0-0c7175fefc88 tempest-ProjectReaderTests-205404938 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:19:39 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-ba7e4abf-d6db-4558-b4a0-0c7175fefc88 tempest-ProjectReaderTests-205404938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:19:39 devstack sudo[108191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a Sep 07 10:19:39 devstack sudo[108191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:19:39 devstack sudo[108186]: pam_unix(sudo:session): session closed for user root Sep 07 10:19:39 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-2b401a08-1d2f-47f2-ab18-a5d4d617925f tempest-ProjectMemberTests-55037479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e573706f-1e4b-43b7-9f5a-12de559e393d -F qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-e573706f-1e4b-43b7-9f5a-12de559e393d.6dbd52f4-c219-4573-ad51-4efc1404bdfe" returned: 0 in 0.308s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:19:39 devstack cinder-volume[87515]: WARNING cinder.volume.drivers.remotefs [None req-2b401a08-1d2f-47f2-ab18-a5d4d617925f tempest-ProjectMemberTests-55037479 None] /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-e573706f-1e4b-43b7-9f5a-12de559e393d.6dbd52f4-c219-4573-ad51-4efc1404bdfe is being set with open permissions: ugo+rw Sep 07 10:19:39 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-2b401a08-1d2f-47f2-ab18-a5d4d617925f tempest-ProjectMemberTests-55037479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-e573706f-1e4b-43b7-9f5a-12de559e393d.6dbd52f4-c219-4573-ad51-4efc1404bdfe {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:19:39 devstack sudo[108194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-e573706f-1e4b-43b7-9f5a-12de559e393d.6dbd52f4-c219-4573-ad51-4efc1404bdfe Sep 07 10:19:39 devstack sudo[108194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:19:39 devstack sudo[108191]: pam_unix(sudo:session): session closed for user root Sep 07 10:19:39 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-ba7e4abf-d6db-4558-b4a0-0c7175fefc88 tempest-ProjectReaderTests-205404938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a" returned: 0 in 0.253s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:19:39 devstack cinder-volume[87515]: DEBUG cinder.manager [None req-ba7e4abf-d6db-4558-b4a0-0c7175fefc88 tempest-ProjectReaderTests-205404938 None] Notifying Schedulers of capabilities ... {{(pid=87515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:19:39 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-ba7e4abf-d6db-4558-b4a0-0c7175fefc88 tempest-ProjectReaderTests-205404938 None] Deleted volume successfully. Sep 07 10:19:39 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-ba7e4abf-d6db-4558-b4a0-0c7175fefc88 tempest-ProjectReaderTests-205404938 None] Lock "cinder-84812d86-85bc-408f-bee4-e166e74df8b4-delete_volume" released by "delete_volume" :: held 1.143s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:19:39 devstack sudo[108194]: pam_unix(sudo:session): session closed for user root Sep 07 10:19:39 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-2b401a08-1d2f-47f2-ab18-a5d4d617925f tempest-ProjectMemberTests-55037479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-e573706f-1e4b-43b7-9f5a-12de559e393d.6dbd52f4-c219-4573-ad51-4efc1404bdfe" returned: 0 in 0.257s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:19:39 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-2b401a08-1d2f-47f2-ab18-a5d4d617925f tempest-ProjectMemberTests-55037479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-e573706f-1e4b-43b7-9f5a-12de559e393d.info {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:19:39 devstack sudo[108199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-e573706f-1e4b-43b7-9f5a-12de559e393d.info Sep 07 10:19:39 devstack sudo[108199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:19:39 devstack sudo[108199]: pam_unix(sudo:session): session closed for user root Sep 07 10:19:39 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-2b401a08-1d2f-47f2-ab18-a5d4d617925f tempest-ProjectMemberTests-55037479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-e573706f-1e4b-43b7-9f5a-12de559e393d.info" returned: 0 in 0.270s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:19:39 devstack cinder-volume[87515]: WARNING cinder.volume.drivers.remotefs [None req-2b401a08-1d2f-47f2-ab18-a5d4d617925f tempest-ProjectMemberTests-55037479 None] /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-e573706f-1e4b-43b7-9f5a-12de559e393d.info is being set with open permissions: ugo+rw Sep 07 10:19:39 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-2b401a08-1d2f-47f2-ab18-a5d4d617925f tempest-ProjectMemberTests-55037479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-e573706f-1e4b-43b7-9f5a-12de559e393d.info {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:19:39 devstack sudo[108202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-e573706f-1e4b-43b7-9f5a-12de559e393d.info Sep 07 10:19:39 devstack sudo[108202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:19:40 devstack cinder-volume[87515]: DEBUG cinder.volume.flows.manager.create_volume [None req-b5e865e6-897f-4496-9118-b02c29917ea0 tempest-ProjectReaderTests-205404938 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 10:19:40 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-b5e865e6-897f-4496-9118-b02c29917ea0 tempest-ProjectReaderTests-205404938 None] Flow 'volume_create_manager' (f65c2541-57ce-4216-8251-304de610f1d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:19:40 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-b5e865e6-897f-4496-9118-b02c29917ea0 tempest-ProjectReaderTests-205404938 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77fc96ba-876b-4c05-b3cf-90002a1e4b00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:19:40 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-b5e865e6-897f-4496-9118-b02c29917ea0 tempest-ProjectReaderTests-205404938 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77fc96ba-876b-4c05-b3cf-90002a1e4b00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:19:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1251023049',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a408ff51-dbbd-4102-b318-819619e9a6c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4bd49c4be7a74648ab6f55922f0638c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:19:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:19:40Z,use_quota=True,user_id='0477ac649f0140bf9c034ba6d1a49938',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3a092cd-7947-4cbf-abff-4ba9567becf0),volume_type_id=f3a092cd-7947-4cbf-abff-4ba9567becf0)' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:19:40 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-b5e865e6-897f-4496-9118-b02c29917ea0 tempest-ProjectReaderTests-205404938 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b3bdd22-a4bc-4be7-ae48-35827d926f4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:19:40 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-b5e865e6-897f-4496-9118-b02c29917ea0 tempest-ProjectReaderTests-205404938 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b3bdd22-a4bc-4be7-ae48-35827d926f4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:19:40 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-b5e865e6-897f-4496-9118-b02c29917ea0 tempest-ProjectReaderTests-205404938 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ad19bc8-c3ce-46a3-b833-dbcb191f6b97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:19:40 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-b5e865e6-897f-4496-9118-b02c29917ea0 tempest-ProjectReaderTests-205404938 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ad19bc8-c3ce-46a3-b833-dbcb191f6b97) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a408ff51-dbbd-4102-b318-819619e9a6c1', 'volume_name': 'volume-a408ff51-dbbd-4102-b318-819619e9a6c1', 'volume_size': 1}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:19:40 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-b5e865e6-897f-4496-9118-b02c29917ea0 tempest-ProjectReaderTests-205404938 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23ace130-efea-432b-82f6-68acfc23554b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:19:40 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-b5e865e6-897f-4496-9118-b02c29917ea0 tempest-ProjectReaderTests-205404938 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23ace130-efea-432b-82f6-68acfc23554b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:19:40 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-b5e865e6-897f-4496-9118-b02c29917ea0 tempest-ProjectReaderTests-205404938 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b0e0624-4459-4394-b3bf-22e72cd69c15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:19:40 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-b5e865e6-897f-4496-9118-b02c29917ea0 tempest-ProjectReaderTests-205404938 None] Volume a408ff51-dbbd-4102-b318-819619e9a6c1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a408ff51-dbbd-4102-b318-819619e9a6c1', 'volume_size': 1} Sep 07 10:19:40 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-b5e865e6-897f-4496-9118-b02c29917ea0 tempest-ProjectReaderTests-205404938 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:19:40 devstack sudo[108202]: pam_unix(sudo:session): session closed for user root Sep 07 10:19:40 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-2b401a08-1d2f-47f2-ab18-a5d4d617925f tempest-ProjectMemberTests-55037479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-e573706f-1e4b-43b7-9f5a-12de559e393d.info" returned: 0 in 0.244s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:19:40 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-2b401a08-1d2f-47f2-ab18-a5d4d617925f tempest-ProjectMemberTests-55037479 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.933s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:19:40 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-b5e865e6-897f-4496-9118-b02c29917ea0 tempest-ProjectReaderTests-205404938 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.057s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:19:40 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-b5e865e6-897f-4496-9118-b02c29917ea0 tempest-ProjectReaderTests-205404938 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:19:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1251023049',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a408ff51-dbbd-4102-b318-819619e9a6c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4bd49c4be7a74648ab6f55922f0638c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:19:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:19:40Z,use_quota=True,user_id='0477ac649f0140bf9c034ba6d1a49938',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3a092cd-7947-4cbf-abff-4ba9567becf0),volume_type_id=f3a092cd-7947-4cbf-abff-4ba9567becf0)}" {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 10:19:40 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-b5e865e6-897f-4496-9118-b02c29917ea0 tempest-ProjectReaderTests-205404938 None] Creating volume a408ff51-dbbd-4102-b318-819619e9a6c1 {{(pid=87515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 10:19:40 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-b5e865e6-897f-4496-9118-b02c29917ea0 tempest-ProjectReaderTests-205404938 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:19:40 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-b5e865e6-897f-4496-9118-b02c29917ea0 tempest-ProjectReaderTests-205404938 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:19:40 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-b5e865e6-897f-4496-9118-b02c29917ea0 tempest-ProjectReaderTests-205404938 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:19:40 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-b5e865e6-897f-4496-9118-b02c29917ea0 tempest-ProjectReaderTests-205404938 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:19:40 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-b5e865e6-897f-4496-9118-b02c29917ea0 tempest-ProjectReaderTests-205404938 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:19:40 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-b5e865e6-897f-4496-9118-b02c29917ea0 tempest-ProjectReaderTests-205404938 None] Selected osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c as target Quobyte volume. {{(pid=87515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 10:19:40 devstack cinder-volume[87515]: INFO cinder.volume.drivers.remotefs [None req-b5e865e6-897f-4496-9118-b02c29917ea0 tempest-ProjectReaderTests-205404938 None] casted to osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c Sep 07 10:19:40 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-b5e865e6-897f-4496-9118-b02c29917ea0 tempest-ProjectReaderTests-205404938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-a408ff51-dbbd-4102-b318-819619e9a6c1 1073741824 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:19:40 devstack sudo[108205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-a408ff51-dbbd-4102-b318-819619e9a6c1 1073741824 Sep 07 10:19:40 devstack sudo[108205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:19:40 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-2b401a08-1d2f-47f2-ab18-a5d4d617925f tempest-ProjectMemberTests-55037479 None] Create snapshot completed successfully Sep 07 10:19:40 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-23351539-d319-4ddd-809a-d86020db2fde tempest-ProjectMemberTests-55037479 None] Acquiring lock "cinder-6dbd52f4-c219-4573-ad51-4efc1404bdfe-delete_snapshot" by "delete_snapshot" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:19:40 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-23351539-d319-4ddd-809a-d86020db2fde tempest-ProjectMemberTests-55037479 None] Lock "cinder-6dbd52f4-c219-4573-ad51-4efc1404bdfe-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:19:40 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-23351539-d319-4ddd-809a-d86020db2fde tempest-ProjectMemberTests-55037479 None] Acquiring lock "cinder-quobyte-e573706f-1e4b-43b7-9f5a-12de559e393d" by "delete_snapshot" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:19:40 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-23351539-d319-4ddd-809a-d86020db2fde tempest-ProjectMemberTests-55037479 None] Lock "cinder-quobyte-e573706f-1e4b-43b7-9f5a-12de559e393d" acquired by "delete_snapshot" :: waited 0.013s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:19:40 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-23351539-d319-4ddd-809a-d86020db2fde tempest-ProjectMemberTests-55037479 None] Acquiring lock "cinder-quobyte-6dbd52f4-c219-4573-ad51-4efc1404bdfe" by "_delete_snapshot" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:19:40 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-23351539-d319-4ddd-809a-d86020db2fde tempest-ProjectMemberTests-55037479 None] Lock "cinder-quobyte-6dbd52f4-c219-4573-ad51-4efc1404bdfe" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:19:40 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-23351539-d319-4ddd-809a-d86020db2fde tempest-ProjectMemberTests-55037479 None] Deleting offline snapshot 6dbd52f4-c219-4573-ad51-4efc1404bdfe of volume e573706f-1e4b-43b7-9f5a-12de559e393d {{(pid=87515) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 10:19:40 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-23351539-d319-4ddd-809a-d86020db2fde tempest-ProjectMemberTests-55037479 None] snapshot_file for this snap is: volume-e573706f-1e4b-43b7-9f5a-12de559e393d.6dbd52f4-c219-4573-ad51-4efc1404bdfe {{(pid=87515) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 10:19:40 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f39d81f-e622-428a-81ab-3f7a1b12a413]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:19:40 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-23351539-d319-4ddd-809a-d86020db2fde tempest-ProjectMemberTests-55037479 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-e573706f-1e4b-43b7-9f5a-12de559e393d.6dbd52f4-c219-4573-ad51-4efc1404bdfe {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:19:40 devstack sudo[108210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-e573706f-1e4b-43b7-9f5a-12de559e393d.6dbd52f4-c219-4573-ad51-4efc1404bdfe Sep 07 10:19:40 devstack sudo[108210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:19:40 devstack sudo[108205]: pam_unix(sudo:session): session closed for user root Sep 07 10:19:40 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-b5e865e6-897f-4496-9118-b02c29917ea0 tempest-ProjectReaderTests-205404938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-a408ff51-dbbd-4102-b318-819619e9a6c1 1073741824" returned: 0 in 0.415s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:19:40 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-b5e865e6-897f-4496-9118-b02c29917ea0 tempest-ProjectReaderTests-205404938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-a408ff51-dbbd-4102-b318-819619e9a6c1 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:19:40 devstack sudo[108212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-a408ff51-dbbd-4102-b318-819619e9a6c1 Sep 07 10:19:40 devstack sudo[108212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:19:40 devstack sudo[108210]: pam_unix(sudo:session): session closed for user root Sep 07 10:19:40 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-23351539-d319-4ddd-809a-d86020db2fde tempest-ProjectMemberTests-55037479 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-e573706f-1e4b-43b7-9f5a-12de559e393d.6dbd52f4-c219-4573-ad51-4efc1404bdfe" returned: 0 in 0.381s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:19:40 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-23351539-d319-4ddd-809a-d86020db2fde tempest-ProjectMemberTests-55037479 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e573706f-1e4b-43b7-9f5a-12de559e393d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87515) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 10:19:40 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dc11af8-2739-49ed-afe5-c0f7d1ad1ff0]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:19:40 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-23351539-d319-4ddd-809a-d86020db2fde tempest-ProjectMemberTests-55037479 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-e573706f-1e4b-43b7-9f5a-12de559e393d {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:19:40 devstack sudo[108212]: pam_unix(sudo:session): session closed for user root Sep 07 10:19:40 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-b5e865e6-897f-4496-9118-b02c29917ea0 tempest-ProjectReaderTests-205404938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-a408ff51-dbbd-4102-b318-819619e9a6c1" returned: 0 in 0.264s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:19:40 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-b5e865e6-897f-4496-9118-b02c29917ea0 tempest-ProjectReaderTests-205404938 None] <== create_volume: return (719ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'} {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 10:19:40 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-b5e865e6-897f-4496-9118-b02c29917ea0 tempest-ProjectReaderTests-205404938 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.722s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:19:40 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-b5e865e6-897f-4496-9118-b02c29917ea0 tempest-ProjectReaderTests-205404938 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b0e0624-4459-4394-b3bf-22e72cd69c15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a408ff51-dbbd-4102-b318-819619e9a6c1', 'volume_size': 1}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:19:40 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-b5e865e6-897f-4496-9118-b02c29917ea0 tempest-ProjectReaderTests-205404938 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3336bf9c-6cb1-4484-b039-c5737df00442) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:19:40 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-b5e865e6-897f-4496-9118-b02c29917ea0 tempest-ProjectReaderTests-205404938 None] Volume volume-a408ff51-dbbd-4102-b318-819619e9a6c1 (a408ff51-dbbd-4102-b318-819619e9a6c1): created successfully Sep 07 10:19:40 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-b5e865e6-897f-4496-9118-b02c29917ea0 tempest-ProjectReaderTests-205404938 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3336bf9c-6cb1-4484-b039-c5737df00442) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:19:40 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-b5e865e6-897f-4496-9118-b02c29917ea0 tempest-ProjectReaderTests-205404938 None] Flow 'volume_create_manager' (f65c2541-57ce-4216-8251-304de610f1d1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:19:40 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-b5e865e6-897f-4496-9118-b02c29917ea0 tempest-ProjectReaderTests-205404938 None] Created volume successfully. Sep 07 10:19:40 devstack sudo[108217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-e573706f-1e4b-43b7-9f5a-12de559e393d Sep 07 10:19:40 devstack sudo[108217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:19:41 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-82705b0f-e6ed-4887-884d-5affb739ed15 tempest-ProjectReaderTests-205404938 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:19:41 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-82705b0f-e6ed-4887-884d-5affb739ed15 tempest-ProjectReaderTests-205404938 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:19:41 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-82705b0f-e6ed-4887-884d-5affb739ed15 tempest-ProjectReaderTests-205404938 None] Creating offline snapshot a952947b-7197-4ec7-8b84-db703826378a of volume a408ff51-dbbd-4102-b318-819619e9a6c1 {{(pid=87515) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 10:19:41 devstack sudo[108217]: pam_unix(sudo:session): session closed for user root Sep 07 10:19:41 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-23351539-d319-4ddd-809a-d86020db2fde tempest-ProjectMemberTests-55037479 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-e573706f-1e4b-43b7-9f5a-12de559e393d" returned: 0 in 0.402s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:19:41 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-23351539-d319-4ddd-809a-d86020db2fde tempest-ProjectMemberTests-55037479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-e573706f-1e4b-43b7-9f5a-12de559e393d.6dbd52f4-c219-4573-ad51-4efc1404bdfe {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:19:41 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[54ad8bb9-7be3-41c5-8457-efd3d31318d1]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:19:41 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-82705b0f-e6ed-4887-884d-5affb739ed15 tempest-ProjectReaderTests-205404938 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-a408ff51-dbbd-4102-b318-819619e9a6c1 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:19:41 devstack sudo[108223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-e573706f-1e4b-43b7-9f5a-12de559e393d.6dbd52f4-c219-4573-ad51-4efc1404bdfe Sep 07 10:19:41 devstack sudo[108223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:19:41 devstack sudo[108224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-a408ff51-dbbd-4102-b318-819619e9a6c1 Sep 07 10:19:41 devstack sudo[108224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:19:41 devstack sudo[108223]: pam_unix(sudo:session): session closed for user root Sep 07 10:19:41 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-23351539-d319-4ddd-809a-d86020db2fde tempest-ProjectMemberTests-55037479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-e573706f-1e4b-43b7-9f5a-12de559e393d.6dbd52f4-c219-4573-ad51-4efc1404bdfe" returned: 0 in 0.340s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:19:41 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-23351539-d319-4ddd-809a-d86020db2fde tempest-ProjectMemberTests-55037479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-e573706f-1e4b-43b7-9f5a-12de559e393d.6dbd52f4-c219-4573-ad51-4efc1404bdfe {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:19:41 devstack sudo[108232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-e573706f-1e4b-43b7-9f5a-12de559e393d.6dbd52f4-c219-4573-ad51-4efc1404bdfe Sep 07 10:19:41 devstack sudo[108232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:19:41 devstack sudo[108224]: pam_unix(sudo:session): session closed for user root Sep 07 10:19:41 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-82705b0f-e6ed-4887-884d-5affb739ed15 tempest-ProjectReaderTests-205404938 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-a408ff51-dbbd-4102-b318-819619e9a6c1" returned: 0 in 0.401s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:19:41 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-82705b0f-e6ed-4887-884d-5affb739ed15 tempest-ProjectReaderTests-205404938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-a408ff51-dbbd-4102-b318-819619e9a6c1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-a408ff51-dbbd-4102-b318-819619e9a6c1.a952947b-7197-4ec7-8b84-db703826378a 1G {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:19:41 devstack sudo[108235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-a408ff51-dbbd-4102-b318-819619e9a6c1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-a408ff51-dbbd-4102-b318-819619e9a6c1.a952947b-7197-4ec7-8b84-db703826378a 1G Sep 07 10:19:41 devstack sudo[108235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:19:41 devstack sudo[108232]: pam_unix(sudo:session): session closed for user root Sep 07 10:19:41 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-23351539-d319-4ddd-809a-d86020db2fde tempest-ProjectMemberTests-55037479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-e573706f-1e4b-43b7-9f5a-12de559e393d.6dbd52f4-c219-4573-ad51-4efc1404bdfe" returned: 0 in 0.285s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:19:41 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-23351539-d319-4ddd-809a-d86020db2fde tempest-ProjectMemberTests-55037479 None] Lock "cinder-quobyte-6dbd52f4-c219-4573-ad51-4efc1404bdfe" released by "_delete_snapshot" :: held 1.506s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:19:41 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-23351539-d319-4ddd-809a-d86020db2fde tempest-ProjectMemberTests-55037479 None] Lock "cinder-quobyte-e573706f-1e4b-43b7-9f5a-12de559e393d" released by "delete_snapshot" :: held 1.532s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:19:41 devstack cinder-volume[87515]: DEBUG cinder.quota [None req-23351539-d319-4ddd-809a-d86020db2fde tempest-ProjectMemberTests-55037479 None] Created reservations ['2f131ac1-c13b-4c40-80c6-5d4252f960e9', '8bd2c96b-9d96-470f-a9b9-dafef39fc2f8', '84be87dc-823b-4268-a48b-513e64f8ffd2', '68fb0cf8-53d9-4702-9b49-d744042ef698'] {{(pid=87515) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:19:42 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-23351539-d319-4ddd-809a-d86020db2fde tempest-ProjectMemberTests-55037479 None] Delete snapshot completed successfully. Sep 07 10:19:42 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-23351539-d319-4ddd-809a-d86020db2fde tempest-ProjectMemberTests-55037479 None] Lock "cinder-6dbd52f4-c219-4573-ad51-4efc1404bdfe-delete_snapshot" released by "delete_snapshot" :: held 1.672s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:19:42 devstack sudo[108235]: pam_unix(sudo:session): session closed for user root Sep 07 10:19:42 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-82705b0f-e6ed-4887-884d-5affb739ed15 tempest-ProjectReaderTests-205404938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-a408ff51-dbbd-4102-b318-819619e9a6c1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-a408ff51-dbbd-4102-b318-819619e9a6c1.a952947b-7197-4ec7-8b84-db703826378a 1G" returned: 0 in 0.427s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:19:42 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-82705b0f-e6ed-4887-884d-5affb739ed15 tempest-ProjectReaderTests-205404938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a408ff51-dbbd-4102-b318-819619e9a6c1 -F qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-a408ff51-dbbd-4102-b318-819619e9a6c1.a952947b-7197-4ec7-8b84-db703826378a {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:19:42 devstack sudo[108242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a408ff51-dbbd-4102-b318-819619e9a6c1 -F qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-a408ff51-dbbd-4102-b318-819619e9a6c1.a952947b-7197-4ec7-8b84-db703826378a Sep 07 10:19:42 devstack sudo[108242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:19:42 devstack sudo[108242]: pam_unix(sudo:session): session closed for user root Sep 07 10:19:42 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-82705b0f-e6ed-4887-884d-5affb739ed15 tempest-ProjectReaderTests-205404938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a408ff51-dbbd-4102-b318-819619e9a6c1 -F qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-a408ff51-dbbd-4102-b318-819619e9a6c1.a952947b-7197-4ec7-8b84-db703826378a" returned: 0 in 0.280s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:19:42 devstack cinder-volume[87515]: WARNING cinder.volume.drivers.remotefs [None req-82705b0f-e6ed-4887-884d-5affb739ed15 tempest-ProjectReaderTests-205404938 None] /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-a408ff51-dbbd-4102-b318-819619e9a6c1.a952947b-7197-4ec7-8b84-db703826378a is being set with open permissions: ugo+rw Sep 07 10:19:42 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-82705b0f-e6ed-4887-884d-5affb739ed15 tempest-ProjectReaderTests-205404938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-a408ff51-dbbd-4102-b318-819619e9a6c1.a952947b-7197-4ec7-8b84-db703826378a {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:19:42 devstack sudo[108247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-a408ff51-dbbd-4102-b318-819619e9a6c1.a952947b-7197-4ec7-8b84-db703826378a Sep 07 10:19:42 devstack sudo[108247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:19:42 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-cca9c340-e140-4225-8640-cf474b816e73 tempest-ProjectMemberTests-55037479 None] Acquiring lock "cinder-e573706f-1e4b-43b7-9f5a-12de559e393d-delete_volume" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:19:42 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-cca9c340-e140-4225-8640-cf474b816e73 tempest-ProjectMemberTests-55037479 None] Lock "cinder-e573706f-1e4b-43b7-9f5a-12de559e393d-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:19:42 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-cca9c340-e140-4225-8640-cf474b816e73 tempest-ProjectMemberTests-55037479 None] Acquiring lock "cinder-quobyte-e573706f-1e4b-43b7-9f5a-12de559e393d" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:19:42 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-cca9c340-e140-4225-8640-cf474b816e73 tempest-ProjectMemberTests-55037479 None] Lock "cinder-quobyte-e573706f-1e4b-43b7-9f5a-12de559e393d" acquired by "delete_volume" :: waited 0.020s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:19:42 devstack sudo[108247]: pam_unix(sudo:session): session closed for user root Sep 07 10:19:42 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-82705b0f-e6ed-4887-884d-5affb739ed15 tempest-ProjectReaderTests-205404938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-a408ff51-dbbd-4102-b318-819619e9a6c1.a952947b-7197-4ec7-8b84-db703826378a" returned: 0 in 0.275s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:19:42 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2229d82-66aa-41a1-b862-48aa24a5b91e]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:19:42 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-cca9c340-e140-4225-8640-cf474b816e73 tempest-ProjectMemberTests-55037479 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-e573706f-1e4b-43b7-9f5a-12de559e393d {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:19:42 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-82705b0f-e6ed-4887-884d-5affb739ed15 tempest-ProjectReaderTests-205404938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-a408ff51-dbbd-4102-b318-819619e9a6c1.info {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:19:42 devstack sudo[108251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-a408ff51-dbbd-4102-b318-819619e9a6c1.info Sep 07 10:19:42 devstack sudo[108251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:19:42 devstack sudo[108250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-e573706f-1e4b-43b7-9f5a-12de559e393d Sep 07 10:19:42 devstack sudo[108250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:19:42 devstack sudo[108251]: pam_unix(sudo:session): session closed for user root Sep 07 10:19:42 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-82705b0f-e6ed-4887-884d-5affb739ed15 tempest-ProjectReaderTests-205404938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-a408ff51-dbbd-4102-b318-819619e9a6c1.info" returned: 0 in 0.270s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:19:42 devstack cinder-volume[87515]: WARNING cinder.volume.drivers.remotefs [None req-82705b0f-e6ed-4887-884d-5affb739ed15 tempest-ProjectReaderTests-205404938 None] /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-a408ff51-dbbd-4102-b318-819619e9a6c1.info is being set with open permissions: ugo+rw Sep 07 10:19:42 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-82705b0f-e6ed-4887-884d-5affb739ed15 tempest-ProjectReaderTests-205404938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-a408ff51-dbbd-4102-b318-819619e9a6c1.info {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:19:43 devstack sudo[108257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-a408ff51-dbbd-4102-b318-819619e9a6c1.info Sep 07 10:19:43 devstack sudo[108257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:19:43 devstack sudo[108250]: pam_unix(sudo:session): session closed for user root Sep 07 10:19:43 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-cca9c340-e140-4225-8640-cf474b816e73 tempest-ProjectMemberTests-55037479 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-e573706f-1e4b-43b7-9f5a-12de559e393d" returned: 0 in 0.367s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:19:43 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-cca9c340-e140-4225-8640-cf474b816e73 tempest-ProjectMemberTests-55037479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-e573706f-1e4b-43b7-9f5a-12de559e393d {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:19:43 devstack sudo[108260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-e573706f-1e4b-43b7-9f5a-12de559e393d Sep 07 10:19:43 devstack sudo[108260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:19:43 devstack sudo[108257]: pam_unix(sudo:session): session closed for user root Sep 07 10:19:43 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-82705b0f-e6ed-4887-884d-5affb739ed15 tempest-ProjectReaderTests-205404938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-a408ff51-dbbd-4102-b318-819619e9a6c1.info" returned: 0 in 0.248s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:19:43 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-82705b0f-e6ed-4887-884d-5affb739ed15 tempest-ProjectReaderTests-205404938 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.002s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:19:43 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-82705b0f-e6ed-4887-884d-5affb739ed15 tempest-ProjectReaderTests-205404938 None] Create snapshot completed successfully Sep 07 10:19:43 devstack sudo[108260]: pam_unix(sudo:session): session closed for user root Sep 07 10:19:43 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-cca9c340-e140-4225-8640-cf474b816e73 tempest-ProjectMemberTests-55037479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-e573706f-1e4b-43b7-9f5a-12de559e393d" returned: 0 in 0.267s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:19:43 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-cca9c340-e140-4225-8640-cf474b816e73 tempest-ProjectMemberTests-55037479 None] Lock "cinder-quobyte-e573706f-1e4b-43b7-9f5a-12de559e393d" released by "delete_volume" :: held 0.704s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:19:43 devstack cinder-volume[87515]: DEBUG cinder.quota [None req-cca9c340-e140-4225-8640-cf474b816e73 tempest-ProjectMemberTests-55037479 None] Created reservations ['cdf8000c-e420-4223-b625-2d2f960e9bad', '6e83510c-6490-4b4e-be85-0f04104e9df1', 'd4297334-b485-4e5c-99ad-b95f07471b08', '33547a96-0ba4-4400-a685-1c73b1f297d4'] {{(pid=87515) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:19:43 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-cca9c340-e140-4225-8640-cf474b816e73 tempest-ProjectMemberTests-55037479 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:19:43 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-cca9c340-e140-4225-8640-cf474b816e73 tempest-ProjectMemberTests-55037479 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:19:43 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-cca9c340-e140-4225-8640-cf474b816e73 tempest-ProjectMemberTests-55037479 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:19:43 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-cca9c340-e140-4225-8640-cf474b816e73 tempest-ProjectMemberTests-55037479 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:19:43 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-cca9c340-e140-4225-8640-cf474b816e73 tempest-ProjectMemberTests-55037479 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:19:43 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-cca9c340-e140-4225-8640-cf474b816e73 tempest-ProjectMemberTests-55037479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:19:43 devstack sudo[108264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a Sep 07 10:19:43 devstack sudo[108264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:19:43 devstack sudo[108264]: pam_unix(sudo:session): session closed for user root Sep 07 10:19:43 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-cca9c340-e140-4225-8640-cf474b816e73 tempest-ProjectMemberTests-55037479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a" returned: 0 in 0.240s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:19:43 devstack cinder-volume[87515]: DEBUG cinder.manager [None req-cca9c340-e140-4225-8640-cf474b816e73 tempest-ProjectMemberTests-55037479 None] Notifying Schedulers of capabilities ... {{(pid=87515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:19:43 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-cca9c340-e140-4225-8640-cf474b816e73 tempest-ProjectMemberTests-55037479 None] Deleted volume successfully. Sep 07 10:19:43 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-cca9c340-e140-4225-8640-cf474b816e73 tempest-ProjectMemberTests-55037479 None] Lock "cinder-e573706f-1e4b-43b7-9f5a-12de559e393d-delete_volume" released by "delete_volume" :: held 1.142s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:19:44 devstack cinder-volume[87515]: DEBUG cinder.volume.flows.manager.create_volume [None req-bf118d7e-777b-469d-9604-cac36f7bd3bf tempest-ProjectMemberTests-55037479 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 10:19:44 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-bf118d7e-777b-469d-9604-cac36f7bd3bf tempest-ProjectMemberTests-55037479 None] Flow 'volume_create_manager' (71cda6d5-3f2a-4707-964f-483bcf86a6f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:19:44 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-bf118d7e-777b-469d-9604-cac36f7bd3bf tempest-ProjectMemberTests-55037479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe28238f-3dc9-4568-b4c6-cf58c87f648e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:19:44 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-bf118d7e-777b-469d-9604-cac36f7bd3bf tempest-ProjectMemberTests-55037479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe28238f-3dc9-4568-b4c6-cf58c87f648e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:19:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1950404377',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1af10c21-189e-4090-8952-741228e41a3a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41fa4493d2f045dc87793bd97d931cff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:19:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:19:44Z,use_quota=True,user_id='5136aa4e2a7c4a1da79d4e4478cdcbf6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3a092cd-7947-4cbf-abff-4ba9567becf0),volume_type_id=f3a092cd-7947-4cbf-abff-4ba9567becf0)' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:19:44 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-bf118d7e-777b-469d-9604-cac36f7bd3bf tempest-ProjectMemberTests-55037479 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7ed5c22-a6a8-45ef-b0bf-b96fea8ff57a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:19:44 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-bf118d7e-777b-469d-9604-cac36f7bd3bf tempest-ProjectMemberTests-55037479 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7ed5c22-a6a8-45ef-b0bf-b96fea8ff57a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:19:44 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-bf118d7e-777b-469d-9604-cac36f7bd3bf tempest-ProjectMemberTests-55037479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3be1207-87e6-427c-8bf2-6e88db58f3ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:19:44 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-bf118d7e-777b-469d-9604-cac36f7bd3bf tempest-ProjectMemberTests-55037479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3be1207-87e6-427c-8bf2-6e88db58f3ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1af10c21-189e-4090-8952-741228e41a3a', 'volume_name': 'volume-1af10c21-189e-4090-8952-741228e41a3a', 'volume_size': 1}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:19:44 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-bf118d7e-777b-469d-9604-cac36f7bd3bf tempest-ProjectMemberTests-55037479 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29caaf2a-aab8-47a9-946f-2c659205d0e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:19:44 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-bf118d7e-777b-469d-9604-cac36f7bd3bf tempest-ProjectMemberTests-55037479 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29caaf2a-aab8-47a9-946f-2c659205d0e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:19:44 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-bf118d7e-777b-469d-9604-cac36f7bd3bf tempest-ProjectMemberTests-55037479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8da1e09-d9fb-4de8-a111-ab03e5838ed3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:19:44 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-bf118d7e-777b-469d-9604-cac36f7bd3bf tempest-ProjectMemberTests-55037479 None] Volume 1af10c21-189e-4090-8952-741228e41a3a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1af10c21-189e-4090-8952-741228e41a3a', 'volume_size': 1} Sep 07 10:19:44 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-bf118d7e-777b-469d-9604-cac36f7bd3bf tempest-ProjectMemberTests-55037479 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:19:44 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-bf118d7e-777b-469d-9604-cac36f7bd3bf tempest-ProjectMemberTests-55037479 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:19:44 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-bf118d7e-777b-469d-9604-cac36f7bd3bf tempest-ProjectMemberTests-55037479 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:19:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1950404377',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1af10c21-189e-4090-8952-741228e41a3a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41fa4493d2f045dc87793bd97d931cff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:19:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:19:44Z,use_quota=True,user_id='5136aa4e2a7c4a1da79d4e4478cdcbf6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3a092cd-7947-4cbf-abff-4ba9567becf0),volume_type_id=f3a092cd-7947-4cbf-abff-4ba9567becf0)}" {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 10:19:44 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-bf118d7e-777b-469d-9604-cac36f7bd3bf tempest-ProjectMemberTests-55037479 None] Creating volume 1af10c21-189e-4090-8952-741228e41a3a {{(pid=87515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 10:19:44 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-bf118d7e-777b-469d-9604-cac36f7bd3bf tempest-ProjectMemberTests-55037479 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:19:44 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-bf118d7e-777b-469d-9604-cac36f7bd3bf tempest-ProjectMemberTests-55037479 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:19:44 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-bf118d7e-777b-469d-9604-cac36f7bd3bf tempest-ProjectMemberTests-55037479 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:19:44 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-bf118d7e-777b-469d-9604-cac36f7bd3bf tempest-ProjectMemberTests-55037479 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:19:44 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-bf118d7e-777b-469d-9604-cac36f7bd3bf tempest-ProjectMemberTests-55037479 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:19:44 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-bf118d7e-777b-469d-9604-cac36f7bd3bf tempest-ProjectMemberTests-55037479 None] Selected osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c as target Quobyte volume. {{(pid=87515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 10:19:44 devstack cinder-volume[87515]: INFO cinder.volume.drivers.remotefs [None req-bf118d7e-777b-469d-9604-cac36f7bd3bf tempest-ProjectMemberTests-55037479 None] casted to osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c Sep 07 10:19:44 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-bf118d7e-777b-469d-9604-cac36f7bd3bf tempest-ProjectMemberTests-55037479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-1af10c21-189e-4090-8952-741228e41a3a 1073741824 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:19:44 devstack sudo[108267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-1af10c21-189e-4090-8952-741228e41a3a 1073741824 Sep 07 10:19:44 devstack sudo[108267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:19:44 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-940f6331-f77f-41ce-861a-e85c4be12798 tempest-ProjectReaderTests-205404938 None] Acquiring lock "cinder-a952947b-7197-4ec7-8b84-db703826378a-delete_snapshot" by "delete_snapshot" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:19:44 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-940f6331-f77f-41ce-861a-e85c4be12798 tempest-ProjectReaderTests-205404938 None] Lock "cinder-a952947b-7197-4ec7-8b84-db703826378a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:19:44 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-940f6331-f77f-41ce-861a-e85c4be12798 tempest-ProjectReaderTests-205404938 None] Acquiring lock "cinder-quobyte-a408ff51-dbbd-4102-b318-819619e9a6c1" by "delete_snapshot" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:19:44 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-940f6331-f77f-41ce-861a-e85c4be12798 tempest-ProjectReaderTests-205404938 None] Lock "cinder-quobyte-a408ff51-dbbd-4102-b318-819619e9a6c1" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:19:44 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-940f6331-f77f-41ce-861a-e85c4be12798 tempest-ProjectReaderTests-205404938 None] Acquiring lock "cinder-quobyte-a952947b-7197-4ec7-8b84-db703826378a" by "_delete_snapshot" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:19:44 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-940f6331-f77f-41ce-861a-e85c4be12798 tempest-ProjectReaderTests-205404938 None] Lock "cinder-quobyte-a952947b-7197-4ec7-8b84-db703826378a" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:19:44 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-940f6331-f77f-41ce-861a-e85c4be12798 tempest-ProjectReaderTests-205404938 None] Deleting offline snapshot a952947b-7197-4ec7-8b84-db703826378a of volume a408ff51-dbbd-4102-b318-819619e9a6c1 {{(pid=87515) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 10:19:44 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-940f6331-f77f-41ce-861a-e85c4be12798 tempest-ProjectReaderTests-205404938 None] snapshot_file for this snap is: volume-a408ff51-dbbd-4102-b318-819619e9a6c1.a952947b-7197-4ec7-8b84-db703826378a {{(pid=87515) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 10:19:44 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f986a90-e969-4ea6-881c-ca5c7ed3449c]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:19:44 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-940f6331-f77f-41ce-861a-e85c4be12798 tempest-ProjectReaderTests-205404938 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-a408ff51-dbbd-4102-b318-819619e9a6c1.a952947b-7197-4ec7-8b84-db703826378a {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:19:44 devstack sudo[108272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-a408ff51-dbbd-4102-b318-819619e9a6c1.a952947b-7197-4ec7-8b84-db703826378a Sep 07 10:19:44 devstack sudo[108272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:19:44 devstack sudo[108267]: pam_unix(sudo:session): session closed for user root Sep 07 10:19:44 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-bf118d7e-777b-469d-9604-cac36f7bd3bf tempest-ProjectMemberTests-55037479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-1af10c21-189e-4090-8952-741228e41a3a 1073741824" returned: 0 in 0.433s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:19:44 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-bf118d7e-777b-469d-9604-cac36f7bd3bf tempest-ProjectMemberTests-55037479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-1af10c21-189e-4090-8952-741228e41a3a {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:19:44 devstack sudo[108275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-1af10c21-189e-4090-8952-741228e41a3a Sep 07 10:19:44 devstack sudo[108275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:19:44 devstack sudo[108272]: pam_unix(sudo:session): session closed for user root Sep 07 10:19:44 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-940f6331-f77f-41ce-861a-e85c4be12798 tempest-ProjectReaderTests-205404938 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-a408ff51-dbbd-4102-b318-819619e9a6c1.a952947b-7197-4ec7-8b84-db703826378a" returned: 0 in 0.393s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:19:44 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-940f6331-f77f-41ce-861a-e85c4be12798 tempest-ProjectReaderTests-205404938 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a408ff51-dbbd-4102-b318-819619e9a6c1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87515) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 10:19:44 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f8b80db-3542-42db-a212-6b8adaf9013a]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:19:44 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-940f6331-f77f-41ce-861a-e85c4be12798 tempest-ProjectReaderTests-205404938 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-a408ff51-dbbd-4102-b318-819619e9a6c1 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:19:44 devstack sudo[108275]: pam_unix(sudo:session): session closed for user root Sep 07 10:19:44 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-bf118d7e-777b-469d-9604-cac36f7bd3bf tempest-ProjectMemberTests-55037479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-1af10c21-189e-4090-8952-741228e41a3a" returned: 0 in 0.264s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:19:44 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-bf118d7e-777b-469d-9604-cac36f7bd3bf tempest-ProjectMemberTests-55037479 None] <== create_volume: return (738ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'} {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 10:19:44 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-bf118d7e-777b-469d-9604-cac36f7bd3bf tempest-ProjectMemberTests-55037479 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.741s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:19:44 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-bf118d7e-777b-469d-9604-cac36f7bd3bf tempest-ProjectMemberTests-55037479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8da1e09-d9fb-4de8-a111-ab03e5838ed3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1af10c21-189e-4090-8952-741228e41a3a', 'volume_size': 1}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:19:44 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-bf118d7e-777b-469d-9604-cac36f7bd3bf tempest-ProjectMemberTests-55037479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88030579-3d0e-4833-ae90-83215bf11604) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:19:45 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-bf118d7e-777b-469d-9604-cac36f7bd3bf tempest-ProjectMemberTests-55037479 None] Volume volume-1af10c21-189e-4090-8952-741228e41a3a (1af10c21-189e-4090-8952-741228e41a3a): created successfully Sep 07 10:19:45 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-bf118d7e-777b-469d-9604-cac36f7bd3bf tempest-ProjectMemberTests-55037479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88030579-3d0e-4833-ae90-83215bf11604) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:19:45 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-bf118d7e-777b-469d-9604-cac36f7bd3bf tempest-ProjectMemberTests-55037479 None] Flow 'volume_create_manager' (71cda6d5-3f2a-4707-964f-483bcf86a6f7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:19:45 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-bf118d7e-777b-469d-9604-cac36f7bd3bf tempest-ProjectMemberTests-55037479 None] Created volume successfully. Sep 07 10:19:45 devstack sudo[108281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-a408ff51-dbbd-4102-b318-819619e9a6c1 Sep 07 10:19:45 devstack sudo[108281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:19:45 devstack sudo[108281]: pam_unix(sudo:session): session closed for user root Sep 07 10:19:45 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-940f6331-f77f-41ce-861a-e85c4be12798 tempest-ProjectReaderTests-205404938 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-a408ff51-dbbd-4102-b318-819619e9a6c1" returned: 0 in 0.392s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:19:45 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-940f6331-f77f-41ce-861a-e85c4be12798 tempest-ProjectReaderTests-205404938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-a408ff51-dbbd-4102-b318-819619e9a6c1.a952947b-7197-4ec7-8b84-db703826378a {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:19:45 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-d71d9480-a5e8-4feb-8d5f-9df52b890e88 tempest-ProjectMemberTests-55037479 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:19:45 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-d71d9480-a5e8-4feb-8d5f-9df52b890e88 tempest-ProjectMemberTests-55037479 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:19:45 devstack sudo[108286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-a408ff51-dbbd-4102-b318-819619e9a6c1.a952947b-7197-4ec7-8b84-db703826378a Sep 07 10:19:45 devstack sudo[108286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:19:45 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-d71d9480-a5e8-4feb-8d5f-9df52b890e88 tempest-ProjectMemberTests-55037479 None] Creating offline snapshot c420e8e9-dc49-492e-b5cb-d28d08bded14 of volume 1af10c21-189e-4090-8952-741228e41a3a {{(pid=87515) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 10:19:45 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d285370-5d29-40df-a69a-f633514a2e1c]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:19:45 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-d71d9480-a5e8-4feb-8d5f-9df52b890e88 tempest-ProjectMemberTests-55037479 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-1af10c21-189e-4090-8952-741228e41a3a {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:19:45 devstack sudo[108288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-1af10c21-189e-4090-8952-741228e41a3a Sep 07 10:19:45 devstack sudo[108288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:19:45 devstack sudo[108286]: pam_unix(sudo:session): session closed for user root Sep 07 10:19:45 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-940f6331-f77f-41ce-861a-e85c4be12798 tempest-ProjectReaderTests-205404938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-a408ff51-dbbd-4102-b318-819619e9a6c1.a952947b-7197-4ec7-8b84-db703826378a" returned: 0 in 0.329s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:19:45 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-940f6331-f77f-41ce-861a-e85c4be12798 tempest-ProjectReaderTests-205404938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-a408ff51-dbbd-4102-b318-819619e9a6c1.a952947b-7197-4ec7-8b84-db703826378a {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:19:45 devstack sudo[108293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-a408ff51-dbbd-4102-b318-819619e9a6c1.a952947b-7197-4ec7-8b84-db703826378a Sep 07 10:19:45 devstack sudo[108293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:19:45 devstack sudo[108288]: pam_unix(sudo:session): session closed for user root Sep 07 10:19:45 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-d71d9480-a5e8-4feb-8d5f-9df52b890e88 tempest-ProjectMemberTests-55037479 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-1af10c21-189e-4090-8952-741228e41a3a" returned: 0 in 0.374s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:19:45 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-d71d9480-a5e8-4feb-8d5f-9df52b890e88 tempest-ProjectMemberTests-55037479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-1af10c21-189e-4090-8952-741228e41a3a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-1af10c21-189e-4090-8952-741228e41a3a.c420e8e9-dc49-492e-b5cb-d28d08bded14 1G {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:19:45 devstack sudo[108298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-1af10c21-189e-4090-8952-741228e41a3a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-1af10c21-189e-4090-8952-741228e41a3a.c420e8e9-dc49-492e-b5cb-d28d08bded14 1G Sep 07 10:19:45 devstack sudo[108298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:19:45 devstack sudo[108293]: pam_unix(sudo:session): session closed for user root Sep 07 10:19:45 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-940f6331-f77f-41ce-861a-e85c4be12798 tempest-ProjectReaderTests-205404938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-a408ff51-dbbd-4102-b318-819619e9a6c1.a952947b-7197-4ec7-8b84-db703826378a" returned: 0 in 0.259s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:19:45 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-940f6331-f77f-41ce-861a-e85c4be12798 tempest-ProjectReaderTests-205404938 None] Lock "cinder-quobyte-a952947b-7197-4ec7-8b84-db703826378a" released by "_delete_snapshot" :: held 1.459s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:19:45 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-940f6331-f77f-41ce-861a-e85c4be12798 tempest-ProjectReaderTests-205404938 None] Lock "cinder-quobyte-a408ff51-dbbd-4102-b318-819619e9a6c1" released by "delete_snapshot" :: held 1.482s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:19:45 devstack cinder-volume[87515]: DEBUG cinder.quota [None req-940f6331-f77f-41ce-861a-e85c4be12798 tempest-ProjectReaderTests-205404938 None] Created reservations ['d551ce86-fa75-4135-b881-0886c33739e6', '6df8efbc-ed61-4b9f-8256-1f3cab8f8b05', 'bdb2153b-68e6-4ae8-9245-6ad3e6ed44bc', '2ea19965-78a2-400f-afd7-edcb41498563'] {{(pid=87515) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:19:46 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-940f6331-f77f-41ce-861a-e85c4be12798 tempest-ProjectReaderTests-205404938 None] Delete snapshot completed successfully. Sep 07 10:19:46 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-940f6331-f77f-41ce-861a-e85c4be12798 tempest-ProjectReaderTests-205404938 None] Lock "cinder-a952947b-7197-4ec7-8b84-db703826378a-delete_snapshot" released by "delete_snapshot" :: held 1.618s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:19:46 devstack sudo[108298]: pam_unix(sudo:session): session closed for user root Sep 07 10:19:46 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-d71d9480-a5e8-4feb-8d5f-9df52b890e88 tempest-ProjectMemberTests-55037479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-1af10c21-189e-4090-8952-741228e41a3a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-1af10c21-189e-4090-8952-741228e41a3a.c420e8e9-dc49-492e-b5cb-d28d08bded14 1G" returned: 0 in 0.408s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:19:46 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-d71d9480-a5e8-4feb-8d5f-9df52b890e88 tempest-ProjectMemberTests-55037479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1af10c21-189e-4090-8952-741228e41a3a -F qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-1af10c21-189e-4090-8952-741228e41a3a.c420e8e9-dc49-492e-b5cb-d28d08bded14 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:19:46 devstack sudo[108305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1af10c21-189e-4090-8952-741228e41a3a -F qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-1af10c21-189e-4090-8952-741228e41a3a.c420e8e9-dc49-492e-b5cb-d28d08bded14 Sep 07 10:19:46 devstack sudo[108305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:19:46 devstack sudo[108305]: pam_unix(sudo:session): session closed for user root Sep 07 10:19:46 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-d71d9480-a5e8-4feb-8d5f-9df52b890e88 tempest-ProjectMemberTests-55037479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1af10c21-189e-4090-8952-741228e41a3a -F qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-1af10c21-189e-4090-8952-741228e41a3a.c420e8e9-dc49-492e-b5cb-d28d08bded14" returned: 0 in 0.289s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:19:46 devstack cinder-volume[87515]: WARNING cinder.volume.drivers.remotefs [None req-d71d9480-a5e8-4feb-8d5f-9df52b890e88 tempest-ProjectMemberTests-55037479 None] /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-1af10c21-189e-4090-8952-741228e41a3a.c420e8e9-dc49-492e-b5cb-d28d08bded14 is being set with open permissions: ugo+rw Sep 07 10:19:46 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-d71d9480-a5e8-4feb-8d5f-9df52b890e88 tempest-ProjectMemberTests-55037479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-1af10c21-189e-4090-8952-741228e41a3a.c420e8e9-dc49-492e-b5cb-d28d08bded14 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:19:46 devstack sudo[108311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-1af10c21-189e-4090-8952-741228e41a3a.c420e8e9-dc49-492e-b5cb-d28d08bded14 Sep 07 10:19:46 devstack sudo[108311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:19:46 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-5245a7cb-6cd3-4fba-aaeb-b1cd6dd15a66 tempest-ProjectReaderTests-205404938 None] Acquiring lock "cinder-a408ff51-dbbd-4102-b318-819619e9a6c1-delete_volume" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:19:46 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-5245a7cb-6cd3-4fba-aaeb-b1cd6dd15a66 tempest-ProjectReaderTests-205404938 None] Lock "cinder-a408ff51-dbbd-4102-b318-819619e9a6c1-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:19:46 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-5245a7cb-6cd3-4fba-aaeb-b1cd6dd15a66 tempest-ProjectReaderTests-205404938 None] Acquiring lock "cinder-quobyte-a408ff51-dbbd-4102-b318-819619e9a6c1" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:19:46 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-5245a7cb-6cd3-4fba-aaeb-b1cd6dd15a66 tempest-ProjectReaderTests-205404938 None] Lock "cinder-quobyte-a408ff51-dbbd-4102-b318-819619e9a6c1" acquired by "delete_volume" :: waited 0.014s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:19:46 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[13cb0e67-9ab2-45a0-8fa4-9ee05c44f611]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:19:46 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-5245a7cb-6cd3-4fba-aaeb-b1cd6dd15a66 tempest-ProjectReaderTests-205404938 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-a408ff51-dbbd-4102-b318-819619e9a6c1 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:19:46 devstack sudo[108311]: pam_unix(sudo:session): session closed for user root Sep 07 10:19:46 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-d71d9480-a5e8-4feb-8d5f-9df52b890e88 tempest-ProjectMemberTests-55037479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-1af10c21-189e-4090-8952-741228e41a3a.c420e8e9-dc49-492e-b5cb-d28d08bded14" returned: 0 in 0.268s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:19:46 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-d71d9480-a5e8-4feb-8d5f-9df52b890e88 tempest-ProjectMemberTests-55037479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-1af10c21-189e-4090-8952-741228e41a3a.info {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:19:46 devstack sudo[108315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-1af10c21-189e-4090-8952-741228e41a3a.info Sep 07 10:19:46 devstack sudo[108315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:19:46 devstack sudo[108314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-a408ff51-dbbd-4102-b318-819619e9a6c1 Sep 07 10:19:46 devstack sudo[108314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:19:46 devstack sudo[108315]: pam_unix(sudo:session): session closed for user root Sep 07 10:19:46 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-d71d9480-a5e8-4feb-8d5f-9df52b890e88 tempest-ProjectMemberTests-55037479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-1af10c21-189e-4090-8952-741228e41a3a.info" returned: 0 in 0.260s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:19:46 devstack cinder-volume[87515]: WARNING cinder.volume.drivers.remotefs [None req-d71d9480-a5e8-4feb-8d5f-9df52b890e88 tempest-ProjectMemberTests-55037479 None] /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-1af10c21-189e-4090-8952-741228e41a3a.info is being set with open permissions: ugo+rw Sep 07 10:19:46 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-d71d9480-a5e8-4feb-8d5f-9df52b890e88 tempest-ProjectMemberTests-55037479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-1af10c21-189e-4090-8952-741228e41a3a.info {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:19:47 devstack sudo[108321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-1af10c21-189e-4090-8952-741228e41a3a.info Sep 07 10:19:47 devstack sudo[108321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:19:47 devstack sudo[108314]: pam_unix(sudo:session): session closed for user root Sep 07 10:19:47 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-5245a7cb-6cd3-4fba-aaeb-b1cd6dd15a66 tempest-ProjectReaderTests-205404938 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-a408ff51-dbbd-4102-b318-819619e9a6c1" returned: 0 in 0.369s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:19:47 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-5245a7cb-6cd3-4fba-aaeb-b1cd6dd15a66 tempest-ProjectReaderTests-205404938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-a408ff51-dbbd-4102-b318-819619e9a6c1 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:19:47 devstack sudo[108324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-a408ff51-dbbd-4102-b318-819619e9a6c1 Sep 07 10:19:47 devstack sudo[108324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:19:47 devstack sudo[108321]: pam_unix(sudo:session): session closed for user root Sep 07 10:19:47 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-d71d9480-a5e8-4feb-8d5f-9df52b890e88 tempest-ProjectMemberTests-55037479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-1af10c21-189e-4090-8952-741228e41a3a.info" returned: 0 in 0.259s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:19:47 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-d71d9480-a5e8-4feb-8d5f-9df52b890e88 tempest-ProjectMemberTests-55037479 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.948s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:19:47 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-d71d9480-a5e8-4feb-8d5f-9df52b890e88 tempest-ProjectMemberTests-55037479 None] Create snapshot completed successfully Sep 07 10:19:47 devstack sudo[108324]: pam_unix(sudo:session): session closed for user root Sep 07 10:19:47 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-5245a7cb-6cd3-4fba-aaeb-b1cd6dd15a66 tempest-ProjectReaderTests-205404938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-a408ff51-dbbd-4102-b318-819619e9a6c1" returned: 0 in 0.261s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:19:47 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-5245a7cb-6cd3-4fba-aaeb-b1cd6dd15a66 tempest-ProjectReaderTests-205404938 None] Lock "cinder-quobyte-a408ff51-dbbd-4102-b318-819619e9a6c1" released by "delete_volume" :: held 0.692s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:19:47 devstack cinder-volume[87515]: DEBUG cinder.quota [None req-5245a7cb-6cd3-4fba-aaeb-b1cd6dd15a66 tempest-ProjectReaderTests-205404938 None] Created reservations ['6d1e7030-6bfb-4ece-a45d-ef6d41ae1a6d', 'b68dcd90-8f3a-476d-ab78-28895976982f', 'e2bc7244-e305-4dca-ab83-60ed485aec7b', '8cb73083-dff8-46a3-acfb-0df70be29b91'] {{(pid=87515) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:19:47 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-511eada9-8dec-4c31-af54-c6ca6d90acbe tempest-ProjectMemberTests-55037479 None] Acquiring lock "cinder-c420e8e9-dc49-492e-b5cb-d28d08bded14-delete_snapshot" by "delete_snapshot" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:19:47 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-5245a7cb-6cd3-4fba-aaeb-b1cd6dd15a66 tempest-ProjectReaderTests-205404938 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:19:47 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-5245a7cb-6cd3-4fba-aaeb-b1cd6dd15a66 tempest-ProjectReaderTests-205404938 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:19:47 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-5245a7cb-6cd3-4fba-aaeb-b1cd6dd15a66 tempest-ProjectReaderTests-205404938 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:19:47 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-5245a7cb-6cd3-4fba-aaeb-b1cd6dd15a66 tempest-ProjectReaderTests-205404938 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:19:47 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-5245a7cb-6cd3-4fba-aaeb-b1cd6dd15a66 tempest-ProjectReaderTests-205404938 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:19:47 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-5245a7cb-6cd3-4fba-aaeb-b1cd6dd15a66 tempest-ProjectReaderTests-205404938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:19:47 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-511eada9-8dec-4c31-af54-c6ca6d90acbe tempest-ProjectMemberTests-55037479 None] Lock "cinder-c420e8e9-dc49-492e-b5cb-d28d08bded14-delete_snapshot" acquired by "delete_snapshot" :: waited 0.041s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:19:47 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-511eada9-8dec-4c31-af54-c6ca6d90acbe tempest-ProjectMemberTests-55037479 None] Acquiring lock "cinder-quobyte-1af10c21-189e-4090-8952-741228e41a3a" by "delete_snapshot" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:19:47 devstack sudo[108328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a Sep 07 10:19:47 devstack sudo[108328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:19:47 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-511eada9-8dec-4c31-af54-c6ca6d90acbe tempest-ProjectMemberTests-55037479 None] Lock "cinder-quobyte-1af10c21-189e-4090-8952-741228e41a3a" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:19:47 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-511eada9-8dec-4c31-af54-c6ca6d90acbe tempest-ProjectMemberTests-55037479 None] Acquiring lock "cinder-quobyte-c420e8e9-dc49-492e-b5cb-d28d08bded14" by "_delete_snapshot" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:19:47 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-511eada9-8dec-4c31-af54-c6ca6d90acbe tempest-ProjectMemberTests-55037479 None] Lock "cinder-quobyte-c420e8e9-dc49-492e-b5cb-d28d08bded14" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:19:47 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-511eada9-8dec-4c31-af54-c6ca6d90acbe tempest-ProjectMemberTests-55037479 None] Deleting offline snapshot c420e8e9-dc49-492e-b5cb-d28d08bded14 of volume 1af10c21-189e-4090-8952-741228e41a3a {{(pid=87515) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 10:19:47 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-511eada9-8dec-4c31-af54-c6ca6d90acbe tempest-ProjectMemberTests-55037479 None] snapshot_file for this snap is: volume-1af10c21-189e-4090-8952-741228e41a3a.c420e8e9-dc49-492e-b5cb-d28d08bded14 {{(pid=87515) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 10:19:47 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ba18256-941e-4e14-b551-4bdb0ec707e9]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:19:47 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-511eada9-8dec-4c31-af54-c6ca6d90acbe tempest-ProjectMemberTests-55037479 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-1af10c21-189e-4090-8952-741228e41a3a.c420e8e9-dc49-492e-b5cb-d28d08bded14 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:19:47 devstack sudo[108330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-1af10c21-189e-4090-8952-741228e41a3a.c420e8e9-dc49-492e-b5cb-d28d08bded14 Sep 07 10:19:47 devstack sudo[108330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:19:47 devstack sudo[108328]: pam_unix(sudo:session): session closed for user root Sep 07 10:19:47 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-5245a7cb-6cd3-4fba-aaeb-b1cd6dd15a66 tempest-ProjectReaderTests-205404938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a" returned: 0 in 0.259s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:19:47 devstack cinder-volume[87515]: DEBUG cinder.manager [None req-5245a7cb-6cd3-4fba-aaeb-b1cd6dd15a66 tempest-ProjectReaderTests-205404938 None] Notifying Schedulers of capabilities ... {{(pid=87515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:19:47 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-5245a7cb-6cd3-4fba-aaeb-b1cd6dd15a66 tempest-ProjectReaderTests-205404938 None] Deleted volume successfully. Sep 07 10:19:47 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-5245a7cb-6cd3-4fba-aaeb-b1cd6dd15a66 tempest-ProjectReaderTests-205404938 None] Lock "cinder-a408ff51-dbbd-4102-b318-819619e9a6c1-delete_volume" released by "delete_volume" :: held 1.184s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:19:47 devstack sudo[108330]: pam_unix(sudo:session): session closed for user root Sep 07 10:19:47 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-511eada9-8dec-4c31-af54-c6ca6d90acbe tempest-ProjectMemberTests-55037479 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-1af10c21-189e-4090-8952-741228e41a3a.c420e8e9-dc49-492e-b5cb-d28d08bded14" returned: 0 in 0.394s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:19:47 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-511eada9-8dec-4c31-af54-c6ca6d90acbe tempest-ProjectMemberTests-55037479 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1af10c21-189e-4090-8952-741228e41a3a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87515) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 10:19:47 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[82363b7b-ab07-4be5-906b-5d3c804caf3d]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:19:47 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-511eada9-8dec-4c31-af54-c6ca6d90acbe tempest-ProjectMemberTests-55037479 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-1af10c21-189e-4090-8952-741228e41a3a {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:19:48 devstack sudo[108336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-1af10c21-189e-4090-8952-741228e41a3a Sep 07 10:19:48 devstack sudo[108336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:19:48 devstack sudo[108336]: pam_unix(sudo:session): session closed for user root Sep 07 10:19:48 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-511eada9-8dec-4c31-af54-c6ca6d90acbe tempest-ProjectMemberTests-55037479 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-1af10c21-189e-4090-8952-741228e41a3a" returned: 0 in 0.366s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:19:48 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-511eada9-8dec-4c31-af54-c6ca6d90acbe tempest-ProjectMemberTests-55037479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-1af10c21-189e-4090-8952-741228e41a3a.c420e8e9-dc49-492e-b5cb-d28d08bded14 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:19:48 devstack sudo[108341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-1af10c21-189e-4090-8952-741228e41a3a.c420e8e9-dc49-492e-b5cb-d28d08bded14 Sep 07 10:19:48 devstack sudo[108341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:19:48 devstack sudo[108341]: pam_unix(sudo:session): session closed for user root Sep 07 10:19:48 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-511eada9-8dec-4c31-af54-c6ca6d90acbe tempest-ProjectMemberTests-55037479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-1af10c21-189e-4090-8952-741228e41a3a.c420e8e9-dc49-492e-b5cb-d28d08bded14" returned: 0 in 0.367s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:19:48 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-511eada9-8dec-4c31-af54-c6ca6d90acbe tempest-ProjectMemberTests-55037479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-1af10c21-189e-4090-8952-741228e41a3a.c420e8e9-dc49-492e-b5cb-d28d08bded14 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:19:48 devstack sudo[108347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-1af10c21-189e-4090-8952-741228e41a3a.c420e8e9-dc49-492e-b5cb-d28d08bded14 Sep 07 10:19:48 devstack sudo[108347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:19:48 devstack sudo[108347]: pam_unix(sudo:session): session closed for user root Sep 07 10:19:48 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-511eada9-8dec-4c31-af54-c6ca6d90acbe tempest-ProjectMemberTests-55037479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-1af10c21-189e-4090-8952-741228e41a3a.c420e8e9-dc49-492e-b5cb-d28d08bded14" returned: 0 in 0.262s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:19:49 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-511eada9-8dec-4c31-af54-c6ca6d90acbe tempest-ProjectMemberTests-55037479 None] Lock "cinder-quobyte-c420e8e9-dc49-492e-b5cb-d28d08bded14" released by "_delete_snapshot" :: held 1.486s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:19:49 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-511eada9-8dec-4c31-af54-c6ca6d90acbe tempest-ProjectMemberTests-55037479 None] Lock "cinder-quobyte-1af10c21-189e-4090-8952-741228e41a3a" released by "delete_snapshot" :: held 1.511s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:19:49 devstack cinder-volume[87515]: DEBUG cinder.quota [None req-511eada9-8dec-4c31-af54-c6ca6d90acbe tempest-ProjectMemberTests-55037479 None] Created reservations ['039260cf-f1b8-41d6-b821-c28c17e01de6', '2e9194ac-4eef-460a-82af-7300a29d41fc', '76692a67-1cfd-4e31-90d3-d6e9e8411fdd', 'b30821bb-2e85-47e5-875a-72bfdb46152d'] {{(pid=87515) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:19:49 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-511eada9-8dec-4c31-af54-c6ca6d90acbe tempest-ProjectMemberTests-55037479 None] Delete snapshot completed successfully. Sep 07 10:19:49 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-511eada9-8dec-4c31-af54-c6ca6d90acbe tempest-ProjectMemberTests-55037479 None] Lock "cinder-c420e8e9-dc49-492e-b5cb-d28d08bded14-delete_snapshot" released by "delete_snapshot" :: held 1.664s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:19:49 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-152d339b-75ac-4e76-9d03-1038ae4773f4 tempest-ProjectMemberTests-55037479 None] Acquiring lock "cinder-1af10c21-189e-4090-8952-741228e41a3a-delete_volume" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:19:49 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-152d339b-75ac-4e76-9d03-1038ae4773f4 tempest-ProjectMemberTests-55037479 None] Lock "cinder-1af10c21-189e-4090-8952-741228e41a3a-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:19:49 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-152d339b-75ac-4e76-9d03-1038ae4773f4 tempest-ProjectMemberTests-55037479 None] Acquiring lock "cinder-quobyte-1af10c21-189e-4090-8952-741228e41a3a" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:19:49 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-152d339b-75ac-4e76-9d03-1038ae4773f4 tempest-ProjectMemberTests-55037479 None] Lock "cinder-quobyte-1af10c21-189e-4090-8952-741228e41a3a" acquired by "delete_volume" :: waited 0.017s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:19:49 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[d70667ff-d9f2-4985-8ffd-c210d8c3717f]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:19:49 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-152d339b-75ac-4e76-9d03-1038ae4773f4 tempest-ProjectMemberTests-55037479 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-1af10c21-189e-4090-8952-741228e41a3a {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:19:49 devstack sudo[108351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-1af10c21-189e-4090-8952-741228e41a3a Sep 07 10:19:49 devstack sudo[108351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:19:50 devstack sudo[108351]: pam_unix(sudo:session): session closed for user root Sep 07 10:19:50 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-152d339b-75ac-4e76-9d03-1038ae4773f4 tempest-ProjectMemberTests-55037479 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-1af10c21-189e-4090-8952-741228e41a3a" returned: 0 in 0.377s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:19:50 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-152d339b-75ac-4e76-9d03-1038ae4773f4 tempest-ProjectMemberTests-55037479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-1af10c21-189e-4090-8952-741228e41a3a {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:19:50 devstack sudo[108356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-1af10c21-189e-4090-8952-741228e41a3a Sep 07 10:19:50 devstack sudo[108356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:19:50 devstack sudo[108356]: pam_unix(sudo:session): session closed for user root Sep 07 10:19:50 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-152d339b-75ac-4e76-9d03-1038ae4773f4 tempest-ProjectMemberTests-55037479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-1af10c21-189e-4090-8952-741228e41a3a" returned: 0 in 0.248s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:19:50 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-152d339b-75ac-4e76-9d03-1038ae4773f4 tempest-ProjectMemberTests-55037479 None] Lock "cinder-quobyte-1af10c21-189e-4090-8952-741228e41a3a" released by "delete_volume" :: held 0.694s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:19:50 devstack cinder-volume[87515]: DEBUG cinder.quota [None req-152d339b-75ac-4e76-9d03-1038ae4773f4 tempest-ProjectMemberTests-55037479 None] Created reservations ['54881921-453e-4c88-a371-0547e810c7a3', 'a4378d85-927f-4e11-87b4-a9c4a01df1f2', '2b134073-1d6b-4061-8ba1-bd0eccff6baf', 'a1ab9f46-fd0b-4e68-b1f7-3f5fc2c6a640'] {{(pid=87515) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:19:50 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-152d339b-75ac-4e76-9d03-1038ae4773f4 tempest-ProjectMemberTests-55037479 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:19:50 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-152d339b-75ac-4e76-9d03-1038ae4773f4 tempest-ProjectMemberTests-55037479 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:19:50 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-152d339b-75ac-4e76-9d03-1038ae4773f4 tempest-ProjectMemberTests-55037479 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:19:50 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-152d339b-75ac-4e76-9d03-1038ae4773f4 tempest-ProjectMemberTests-55037479 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:19:50 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-152d339b-75ac-4e76-9d03-1038ae4773f4 tempest-ProjectMemberTests-55037479 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:19:50 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-152d339b-75ac-4e76-9d03-1038ae4773f4 tempest-ProjectMemberTests-55037479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:19:50 devstack sudo[108359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a Sep 07 10:19:50 devstack sudo[108359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:19:50 devstack sudo[108359]: pam_unix(sudo:session): session closed for user root Sep 07 10:19:50 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-152d339b-75ac-4e76-9d03-1038ae4773f4 tempest-ProjectMemberTests-55037479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a" returned: 0 in 0.259s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:19:50 devstack cinder-volume[87515]: DEBUG cinder.manager [None req-152d339b-75ac-4e76-9d03-1038ae4773f4 tempest-ProjectMemberTests-55037479 None] Notifying Schedulers of capabilities ... {{(pid=87515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:19:50 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-152d339b-75ac-4e76-9d03-1038ae4773f4 tempest-ProjectMemberTests-55037479 None] Deleted volume successfully. Sep 07 10:19:50 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-152d339b-75ac-4e76-9d03-1038ae4773f4 tempest-ProjectMemberTests-55037479 None] Lock "cinder-1af10c21-189e-4090-8952-741228e41a3a-delete_volume" released by "delete_volume" :: held 1.186s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:19:51 devstack cinder-volume[87515]: DEBUG cinder.volume.flows.manager.create_volume [None req-52718992-b26a-4e9d-a428-b35b38a099df tempest-ProjectMemberTests-55037479 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 10:19:51 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-52718992-b26a-4e9d-a428-b35b38a099df tempest-ProjectMemberTests-55037479 None] Flow 'volume_create_manager' (fde13d2d-ba08-4205-87a3-4b445f481ab2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:19:51 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-52718992-b26a-4e9d-a428-b35b38a099df tempest-ProjectMemberTests-55037479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b93d39d9-0b52-41ef-9837-19b7ad93a232) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:19:51 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-52718992-b26a-4e9d-a428-b35b38a099df tempest-ProjectMemberTests-55037479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b93d39d9-0b52-41ef-9837-19b7ad93a232) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:19:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1765312492',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5bf4ec62-0ec0-458a-85ad-aa8e9bf1d145,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41fa4493d2f045dc87793bd97d931cff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:19:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:19:51Z,use_quota=True,user_id='5136aa4e2a7c4a1da79d4e4478cdcbf6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3a092cd-7947-4cbf-abff-4ba9567becf0),volume_type_id=f3a092cd-7947-4cbf-abff-4ba9567becf0)' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:19:51 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-52718992-b26a-4e9d-a428-b35b38a099df tempest-ProjectMemberTests-55037479 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (719a5810-3cb8-47c1-abcb-5be09c0cbab2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:19:51 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-52718992-b26a-4e9d-a428-b35b38a099df tempest-ProjectMemberTests-55037479 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (719a5810-3cb8-47c1-abcb-5be09c0cbab2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:19:51 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-52718992-b26a-4e9d-a428-b35b38a099df tempest-ProjectMemberTests-55037479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3c69522-a1ed-42a9-900a-f3c773ba2b17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:19:51 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-52718992-b26a-4e9d-a428-b35b38a099df tempest-ProjectMemberTests-55037479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3c69522-a1ed-42a9-900a-f3c773ba2b17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5bf4ec62-0ec0-458a-85ad-aa8e9bf1d145', 'volume_name': 'volume-5bf4ec62-0ec0-458a-85ad-aa8e9bf1d145', 'volume_size': 1}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:19:51 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-52718992-b26a-4e9d-a428-b35b38a099df tempest-ProjectMemberTests-55037479 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ea07c26-2309-4ae1-afd9-91639044cf5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:19:51 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-52718992-b26a-4e9d-a428-b35b38a099df tempest-ProjectMemberTests-55037479 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ea07c26-2309-4ae1-afd9-91639044cf5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:19:51 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-52718992-b26a-4e9d-a428-b35b38a099df tempest-ProjectMemberTests-55037479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe0444fb-af49-4ca4-9007-70ec91332b71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:19:51 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-52718992-b26a-4e9d-a428-b35b38a099df tempest-ProjectMemberTests-55037479 None] Volume 5bf4ec62-0ec0-458a-85ad-aa8e9bf1d145: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5bf4ec62-0ec0-458a-85ad-aa8e9bf1d145', 'volume_size': 1} Sep 07 10:19:51 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-52718992-b26a-4e9d-a428-b35b38a099df tempest-ProjectMemberTests-55037479 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:19:51 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-52718992-b26a-4e9d-a428-b35b38a099df tempest-ProjectMemberTests-55037479 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:19:51 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-52718992-b26a-4e9d-a428-b35b38a099df tempest-ProjectMemberTests-55037479 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:19:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1765312492',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5bf4ec62-0ec0-458a-85ad-aa8e9bf1d145,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41fa4493d2f045dc87793bd97d931cff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:19:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:19:51Z,use_quota=True,user_id='5136aa4e2a7c4a1da79d4e4478cdcbf6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3a092cd-7947-4cbf-abff-4ba9567becf0),volume_type_id=f3a092cd-7947-4cbf-abff-4ba9567becf0)}" {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 10:19:51 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-52718992-b26a-4e9d-a428-b35b38a099df tempest-ProjectMemberTests-55037479 None] Creating volume 5bf4ec62-0ec0-458a-85ad-aa8e9bf1d145 {{(pid=87515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 10:19:51 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-52718992-b26a-4e9d-a428-b35b38a099df tempest-ProjectMemberTests-55037479 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:19:51 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-52718992-b26a-4e9d-a428-b35b38a099df tempest-ProjectMemberTests-55037479 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:19:51 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-52718992-b26a-4e9d-a428-b35b38a099df tempest-ProjectMemberTests-55037479 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:19:51 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-52718992-b26a-4e9d-a428-b35b38a099df tempest-ProjectMemberTests-55037479 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:19:51 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-52718992-b26a-4e9d-a428-b35b38a099df tempest-ProjectMemberTests-55037479 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:19:51 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-52718992-b26a-4e9d-a428-b35b38a099df tempest-ProjectMemberTests-55037479 None] Selected osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c as target Quobyte volume. {{(pid=87515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 10:19:51 devstack cinder-volume[87515]: INFO cinder.volume.drivers.remotefs [None req-52718992-b26a-4e9d-a428-b35b38a099df tempest-ProjectMemberTests-55037479 None] casted to osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c Sep 07 10:19:51 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-52718992-b26a-4e9d-a428-b35b38a099df tempest-ProjectMemberTests-55037479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-5bf4ec62-0ec0-458a-85ad-aa8e9bf1d145 1073741824 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:19:51 devstack sudo[108364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-5bf4ec62-0ec0-458a-85ad-aa8e9bf1d145 1073741824 Sep 07 10:19:51 devstack sudo[108364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:19:51 devstack sudo[108364]: pam_unix(sudo:session): session closed for user root Sep 07 10:19:51 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-52718992-b26a-4e9d-a428-b35b38a099df tempest-ProjectMemberTests-55037479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-5bf4ec62-0ec0-458a-85ad-aa8e9bf1d145 1073741824" returned: 0 in 0.457s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:19:51 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-52718992-b26a-4e9d-a428-b35b38a099df tempest-ProjectMemberTests-55037479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-5bf4ec62-0ec0-458a-85ad-aa8e9bf1d145 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:19:51 devstack sudo[108370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-5bf4ec62-0ec0-458a-85ad-aa8e9bf1d145 Sep 07 10:19:51 devstack sudo[108370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:19:52 devstack sudo[108370]: pam_unix(sudo:session): session closed for user root Sep 07 10:19:52 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-52718992-b26a-4e9d-a428-b35b38a099df tempest-ProjectMemberTests-55037479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-5bf4ec62-0ec0-458a-85ad-aa8e9bf1d145" returned: 0 in 0.249s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:19:52 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-52718992-b26a-4e9d-a428-b35b38a099df tempest-ProjectMemberTests-55037479 None] <== create_volume: return (761ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'} {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 10:19:52 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-52718992-b26a-4e9d-a428-b35b38a099df tempest-ProjectMemberTests-55037479 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.764s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:19:52 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-52718992-b26a-4e9d-a428-b35b38a099df tempest-ProjectMemberTests-55037479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe0444fb-af49-4ca4-9007-70ec91332b71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5bf4ec62-0ec0-458a-85ad-aa8e9bf1d145', 'volume_size': 1}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:19:52 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-52718992-b26a-4e9d-a428-b35b38a099df tempest-ProjectMemberTests-55037479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9bf6c4d1-a9cd-4271-8a92-09a764a97cc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:19:52 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-52718992-b26a-4e9d-a428-b35b38a099df tempest-ProjectMemberTests-55037479 None] Volume volume-5bf4ec62-0ec0-458a-85ad-aa8e9bf1d145 (5bf4ec62-0ec0-458a-85ad-aa8e9bf1d145): created successfully Sep 07 10:19:52 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-52718992-b26a-4e9d-a428-b35b38a099df tempest-ProjectMemberTests-55037479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9bf6c4d1-a9cd-4271-8a92-09a764a97cc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:19:52 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-52718992-b26a-4e9d-a428-b35b38a099df tempest-ProjectMemberTests-55037479 None] Flow 'volume_create_manager' (fde13d2d-ba08-4205-87a3-4b445f481ab2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:19:52 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-52718992-b26a-4e9d-a428-b35b38a099df tempest-ProjectMemberTests-55037479 None] Created volume successfully. Sep 07 10:19:52 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-2d81bf61-2fc7-4df1-8613-ae61004a1251 tempest-ProjectMemberTests-55037479 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:19:52 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-2d81bf61-2fc7-4df1-8613-ae61004a1251 tempest-ProjectMemberTests-55037479 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:19:52 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-2d81bf61-2fc7-4df1-8613-ae61004a1251 tempest-ProjectMemberTests-55037479 None] Creating offline snapshot c61a4326-cdd8-47e1-b5a4-1e9e1031b038 of volume 5bf4ec62-0ec0-458a-85ad-aa8e9bf1d145 {{(pid=87515) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 10:19:52 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[091b2220-3821-45ae-9ae2-602733c30f87]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:19:52 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-2d81bf61-2fc7-4df1-8613-ae61004a1251 tempest-ProjectMemberTests-55037479 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-5bf4ec62-0ec0-458a-85ad-aa8e9bf1d145 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:19:52 devstack sudo[108373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-5bf4ec62-0ec0-458a-85ad-aa8e9bf1d145 Sep 07 10:19:52 devstack sudo[108373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:19:52 devstack sudo[108373]: pam_unix(sudo:session): session closed for user root Sep 07 10:19:52 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-2d81bf61-2fc7-4df1-8613-ae61004a1251 tempest-ProjectMemberTests-55037479 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-5bf4ec62-0ec0-458a-85ad-aa8e9bf1d145" returned: 0 in 0.381s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:19:52 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-2d81bf61-2fc7-4df1-8613-ae61004a1251 tempest-ProjectMemberTests-55037479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-5bf4ec62-0ec0-458a-85ad-aa8e9bf1d145,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-5bf4ec62-0ec0-458a-85ad-aa8e9bf1d145.c61a4326-cdd8-47e1-b5a4-1e9e1031b038 1G {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:19:52 devstack sudo[108379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-5bf4ec62-0ec0-458a-85ad-aa8e9bf1d145,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-5bf4ec62-0ec0-458a-85ad-aa8e9bf1d145.c61a4326-cdd8-47e1-b5a4-1e9e1031b038 1G Sep 07 10:19:52 devstack sudo[108379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:19:53 devstack sudo[108379]: pam_unix(sudo:session): session closed for user root Sep 07 10:19:53 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-2d81bf61-2fc7-4df1-8613-ae61004a1251 tempest-ProjectMemberTests-55037479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-5bf4ec62-0ec0-458a-85ad-aa8e9bf1d145,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-5bf4ec62-0ec0-458a-85ad-aa8e9bf1d145.c61a4326-cdd8-47e1-b5a4-1e9e1031b038 1G" returned: 0 in 0.418s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:19:53 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-2d81bf61-2fc7-4df1-8613-ae61004a1251 tempest-ProjectMemberTests-55037479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5bf4ec62-0ec0-458a-85ad-aa8e9bf1d145 -F qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-5bf4ec62-0ec0-458a-85ad-aa8e9bf1d145.c61a4326-cdd8-47e1-b5a4-1e9e1031b038 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:19:53 devstack sudo[108384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5bf4ec62-0ec0-458a-85ad-aa8e9bf1d145 -F qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-5bf4ec62-0ec0-458a-85ad-aa8e9bf1d145.c61a4326-cdd8-47e1-b5a4-1e9e1031b038 Sep 07 10:19:53 devstack sudo[108384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:19:53 devstack sudo[108384]: pam_unix(sudo:session): session closed for user root Sep 07 10:19:53 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-2d81bf61-2fc7-4df1-8613-ae61004a1251 tempest-ProjectMemberTests-55037479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5bf4ec62-0ec0-458a-85ad-aa8e9bf1d145 -F qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-5bf4ec62-0ec0-458a-85ad-aa8e9bf1d145.c61a4326-cdd8-47e1-b5a4-1e9e1031b038" returned: 0 in 0.359s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:19:53 devstack cinder-volume[87515]: WARNING cinder.volume.drivers.remotefs [None req-2d81bf61-2fc7-4df1-8613-ae61004a1251 tempest-ProjectMemberTests-55037479 None] /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-5bf4ec62-0ec0-458a-85ad-aa8e9bf1d145.c61a4326-cdd8-47e1-b5a4-1e9e1031b038 is being set with open permissions: ugo+rw Sep 07 10:19:53 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-2d81bf61-2fc7-4df1-8613-ae61004a1251 tempest-ProjectMemberTests-55037479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-5bf4ec62-0ec0-458a-85ad-aa8e9bf1d145.c61a4326-cdd8-47e1-b5a4-1e9e1031b038 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:19:53 devstack sudo[108390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-5bf4ec62-0ec0-458a-85ad-aa8e9bf1d145.c61a4326-cdd8-47e1-b5a4-1e9e1031b038 Sep 07 10:19:53 devstack sudo[108390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:19:53 devstack sudo[108390]: pam_unix(sudo:session): session closed for user root Sep 07 10:19:53 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-2d81bf61-2fc7-4df1-8613-ae61004a1251 tempest-ProjectMemberTests-55037479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-5bf4ec62-0ec0-458a-85ad-aa8e9bf1d145.c61a4326-cdd8-47e1-b5a4-1e9e1031b038" returned: 0 in 0.255s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:19:54 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-2d81bf61-2fc7-4df1-8613-ae61004a1251 tempest-ProjectMemberTests-55037479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-5bf4ec62-0ec0-458a-85ad-aa8e9bf1d145.info {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:19:54 devstack sudo[108393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-5bf4ec62-0ec0-458a-85ad-aa8e9bf1d145.info Sep 07 10:19:54 devstack sudo[108393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:19:54 devstack sudo[108393]: pam_unix(sudo:session): session closed for user root Sep 07 10:19:54 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-2d81bf61-2fc7-4df1-8613-ae61004a1251 tempest-ProjectMemberTests-55037479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-5bf4ec62-0ec0-458a-85ad-aa8e9bf1d145.info" returned: 0 in 0.258s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:19:54 devstack cinder-volume[87515]: WARNING cinder.volume.drivers.remotefs [None req-2d81bf61-2fc7-4df1-8613-ae61004a1251 tempest-ProjectMemberTests-55037479 None] /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-5bf4ec62-0ec0-458a-85ad-aa8e9bf1d145.info is being set with open permissions: ugo+rw Sep 07 10:19:54 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-2d81bf61-2fc7-4df1-8613-ae61004a1251 tempest-ProjectMemberTests-55037479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-5bf4ec62-0ec0-458a-85ad-aa8e9bf1d145.info {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:19:54 devstack sudo[108396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-5bf4ec62-0ec0-458a-85ad-aa8e9bf1d145.info Sep 07 10:19:54 devstack sudo[108396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:19:54 devstack sudo[108396]: pam_unix(sudo:session): session closed for user root Sep 07 10:19:54 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-2d81bf61-2fc7-4df1-8613-ae61004a1251 tempest-ProjectMemberTests-55037479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-5bf4ec62-0ec0-458a-85ad-aa8e9bf1d145.info" returned: 0 in 0.243s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:19:54 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-2d81bf61-2fc7-4df1-8613-ae61004a1251 tempest-ProjectMemberTests-55037479 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.010s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:19:54 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-2d81bf61-2fc7-4df1-8613-ae61004a1251 tempest-ProjectMemberTests-55037479 None] Create snapshot completed successfully Sep 07 10:19:55 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-8017fccf-e16f-40b9-b80e-efe92949205c tempest-ProjectMemberTests-55037479 None] Acquiring lock "cinder-c61a4326-cdd8-47e1-b5a4-1e9e1031b038-delete_snapshot" by "delete_snapshot" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:19:55 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-8017fccf-e16f-40b9-b80e-efe92949205c tempest-ProjectMemberTests-55037479 None] Lock "cinder-c61a4326-cdd8-47e1-b5a4-1e9e1031b038-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:19:55 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-8017fccf-e16f-40b9-b80e-efe92949205c tempest-ProjectMemberTests-55037479 None] Acquiring lock "cinder-quobyte-5bf4ec62-0ec0-458a-85ad-aa8e9bf1d145" by "delete_snapshot" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:19:55 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-8017fccf-e16f-40b9-b80e-efe92949205c tempest-ProjectMemberTests-55037479 None] Lock "cinder-quobyte-5bf4ec62-0ec0-458a-85ad-aa8e9bf1d145" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:19:55 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-8017fccf-e16f-40b9-b80e-efe92949205c tempest-ProjectMemberTests-55037479 None] Acquiring lock "cinder-quobyte-c61a4326-cdd8-47e1-b5a4-1e9e1031b038" by "_delete_snapshot" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:19:55 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-8017fccf-e16f-40b9-b80e-efe92949205c tempest-ProjectMemberTests-55037479 None] Lock "cinder-quobyte-c61a4326-cdd8-47e1-b5a4-1e9e1031b038" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:19:55 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-8017fccf-e16f-40b9-b80e-efe92949205c tempest-ProjectMemberTests-55037479 None] Deleting offline snapshot c61a4326-cdd8-47e1-b5a4-1e9e1031b038 of volume 5bf4ec62-0ec0-458a-85ad-aa8e9bf1d145 {{(pid=87515) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 10:19:55 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-8017fccf-e16f-40b9-b80e-efe92949205c tempest-ProjectMemberTests-55037479 None] snapshot_file for this snap is: volume-5bf4ec62-0ec0-458a-85ad-aa8e9bf1d145.c61a4326-cdd8-47e1-b5a4-1e9e1031b038 {{(pid=87515) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 10:19:55 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[de75757a-9f6c-46a4-9400-8a52b51853e2]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:19:55 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-8017fccf-e16f-40b9-b80e-efe92949205c tempest-ProjectMemberTests-55037479 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-5bf4ec62-0ec0-458a-85ad-aa8e9bf1d145.c61a4326-cdd8-47e1-b5a4-1e9e1031b038 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:19:55 devstack sudo[108399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-5bf4ec62-0ec0-458a-85ad-aa8e9bf1d145.c61a4326-cdd8-47e1-b5a4-1e9e1031b038 Sep 07 10:19:55 devstack sudo[108399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:19:56 devstack sudo[108399]: pam_unix(sudo:session): session closed for user root Sep 07 10:19:56 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-8017fccf-e16f-40b9-b80e-efe92949205c tempest-ProjectMemberTests-55037479 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-5bf4ec62-0ec0-458a-85ad-aa8e9bf1d145.c61a4326-cdd8-47e1-b5a4-1e9e1031b038" returned: 0 in 0.380s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:19:56 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-8017fccf-e16f-40b9-b80e-efe92949205c tempest-ProjectMemberTests-55037479 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5bf4ec62-0ec0-458a-85ad-aa8e9bf1d145(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87515) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 10:19:56 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[16b42bdb-2a34-4f0e-88f2-971c3ca92780]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:19:56 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-8017fccf-e16f-40b9-b80e-efe92949205c tempest-ProjectMemberTests-55037479 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-5bf4ec62-0ec0-458a-85ad-aa8e9bf1d145 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:19:56 devstack sudo[108404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-5bf4ec62-0ec0-458a-85ad-aa8e9bf1d145 Sep 07 10:19:56 devstack sudo[108404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:19:56 devstack sudo[108404]: pam_unix(sudo:session): session closed for user root Sep 07 10:19:56 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-8017fccf-e16f-40b9-b80e-efe92949205c tempest-ProjectMemberTests-55037479 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-5bf4ec62-0ec0-458a-85ad-aa8e9bf1d145" returned: 0 in 0.417s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:19:56 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-8017fccf-e16f-40b9-b80e-efe92949205c tempest-ProjectMemberTests-55037479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-5bf4ec62-0ec0-458a-85ad-aa8e9bf1d145.c61a4326-cdd8-47e1-b5a4-1e9e1031b038 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:19:56 devstack sudo[108409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-5bf4ec62-0ec0-458a-85ad-aa8e9bf1d145.c61a4326-cdd8-47e1-b5a4-1e9e1031b038 Sep 07 10:19:56 devstack sudo[108409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:19:57 devstack sudo[108409]: pam_unix(sudo:session): session closed for user root Sep 07 10:19:57 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-8017fccf-e16f-40b9-b80e-efe92949205c tempest-ProjectMemberTests-55037479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-5bf4ec62-0ec0-458a-85ad-aa8e9bf1d145.c61a4326-cdd8-47e1-b5a4-1e9e1031b038" returned: 0 in 0.370s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:19:57 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-8017fccf-e16f-40b9-b80e-efe92949205c tempest-ProjectMemberTests-55037479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-5bf4ec62-0ec0-458a-85ad-aa8e9bf1d145.c61a4326-cdd8-47e1-b5a4-1e9e1031b038 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:19:57 devstack sudo[108415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-5bf4ec62-0ec0-458a-85ad-aa8e9bf1d145.c61a4326-cdd8-47e1-b5a4-1e9e1031b038 Sep 07 10:19:57 devstack sudo[108415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:19:57 devstack sudo[108415]: pam_unix(sudo:session): session closed for user root Sep 07 10:19:57 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-8017fccf-e16f-40b9-b80e-efe92949205c tempest-ProjectMemberTests-55037479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-5bf4ec62-0ec0-458a-85ad-aa8e9bf1d145.c61a4326-cdd8-47e1-b5a4-1e9e1031b038" returned: 0 in 0.254s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:19:57 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-8017fccf-e16f-40b9-b80e-efe92949205c tempest-ProjectMemberTests-55037479 None] Lock "cinder-quobyte-c61a4326-cdd8-47e1-b5a4-1e9e1031b038" released by "_delete_snapshot" :: held 1.527s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:19:57 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-8017fccf-e16f-40b9-b80e-efe92949205c tempest-ProjectMemberTests-55037479 None] Lock "cinder-quobyte-5bf4ec62-0ec0-458a-85ad-aa8e9bf1d145" released by "delete_snapshot" :: held 1.555s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:19:57 devstack cinder-volume[87515]: DEBUG cinder.quota [None req-8017fccf-e16f-40b9-b80e-efe92949205c tempest-ProjectMemberTests-55037479 None] Created reservations ['42210610-c185-4197-ad4d-f6719c11f321', 'b7843e40-3bf9-4593-b66d-2b9145a12b09', 'c4ba8e81-4be4-479c-86df-5200e7326950', '5351d9f7-a721-4133-8b46-c5b2a47a801c'] {{(pid=87515) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:19:57 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-8017fccf-e16f-40b9-b80e-efe92949205c tempest-ProjectMemberTests-55037479 None] Delete snapshot completed successfully. Sep 07 10:19:57 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-8017fccf-e16f-40b9-b80e-efe92949205c tempest-ProjectMemberTests-55037479 None] Lock "cinder-c61a4326-cdd8-47e1-b5a4-1e9e1031b038-delete_snapshot" released by "delete_snapshot" :: held 1.716s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:19:57 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-8d0660d9-e267-4d71-a91c-d97e0a8c53b1 tempest-ProjectMemberTests-55037479 None] Acquiring lock "cinder-5bf4ec62-0ec0-458a-85ad-aa8e9bf1d145-delete_volume" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:19:57 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-8d0660d9-e267-4d71-a91c-d97e0a8c53b1 tempest-ProjectMemberTests-55037479 None] Lock "cinder-5bf4ec62-0ec0-458a-85ad-aa8e9bf1d145-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:19:57 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-8d0660d9-e267-4d71-a91c-d97e0a8c53b1 tempest-ProjectMemberTests-55037479 None] Acquiring lock "cinder-quobyte-5bf4ec62-0ec0-458a-85ad-aa8e9bf1d145" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:19:58 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-8d0660d9-e267-4d71-a91c-d97e0a8c53b1 tempest-ProjectMemberTests-55037479 None] Lock "cinder-quobyte-5bf4ec62-0ec0-458a-85ad-aa8e9bf1d145" acquired by "delete_volume" :: waited 0.022s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:19:58 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[6839886a-83da-42da-a53a-079ad346a910]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:19:58 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-8d0660d9-e267-4d71-a91c-d97e0a8c53b1 tempest-ProjectMemberTests-55037479 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-5bf4ec62-0ec0-458a-85ad-aa8e9bf1d145 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:19:58 devstack sudo[108418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-5bf4ec62-0ec0-458a-85ad-aa8e9bf1d145 Sep 07 10:19:58 devstack sudo[108418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:19:58 devstack sudo[108418]: pam_unix(sudo:session): session closed for user root Sep 07 10:19:58 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-8d0660d9-e267-4d71-a91c-d97e0a8c53b1 tempest-ProjectMemberTests-55037479 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-5bf4ec62-0ec0-458a-85ad-aa8e9bf1d145" returned: 0 in 0.370s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:19:58 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-8d0660d9-e267-4d71-a91c-d97e0a8c53b1 tempest-ProjectMemberTests-55037479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-5bf4ec62-0ec0-458a-85ad-aa8e9bf1d145 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:19:58 devstack sudo[108423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-5bf4ec62-0ec0-458a-85ad-aa8e9bf1d145 Sep 07 10:19:58 devstack sudo[108423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:19:58 devstack sudo[108423]: pam_unix(sudo:session): session closed for user root Sep 07 10:19:58 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-8d0660d9-e267-4d71-a91c-d97e0a8c53b1 tempest-ProjectMemberTests-55037479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-5bf4ec62-0ec0-458a-85ad-aa8e9bf1d145" returned: 0 in 0.264s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:19:58 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-8d0660d9-e267-4d71-a91c-d97e0a8c53b1 tempest-ProjectMemberTests-55037479 None] Lock "cinder-quobyte-5bf4ec62-0ec0-458a-85ad-aa8e9bf1d145" released by "delete_volume" :: held 0.700s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:19:58 devstack cinder-volume[87515]: DEBUG cinder.quota [None req-8d0660d9-e267-4d71-a91c-d97e0a8c53b1 tempest-ProjectMemberTests-55037479 None] Created reservations ['4fe53614-a0e1-493f-90d4-e8a5c3eceae9', '512258fe-8003-4609-af17-63ae950c9f5c', 'bc576539-60d2-4c9f-8e5a-3f51e0a1bd26', '474d814a-357c-4336-86bb-cd5c5d6cc05d'] {{(pid=87515) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:19:58 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-8d0660d9-e267-4d71-a91c-d97e0a8c53b1 tempest-ProjectMemberTests-55037479 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:19:58 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-8d0660d9-e267-4d71-a91c-d97e0a8c53b1 tempest-ProjectMemberTests-55037479 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:19:58 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-8d0660d9-e267-4d71-a91c-d97e0a8c53b1 tempest-ProjectMemberTests-55037479 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:19:58 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-8d0660d9-e267-4d71-a91c-d97e0a8c53b1 tempest-ProjectMemberTests-55037479 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:19:58 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-8d0660d9-e267-4d71-a91c-d97e0a8c53b1 tempest-ProjectMemberTests-55037479 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:19:58 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-8d0660d9-e267-4d71-a91c-d97e0a8c53b1 tempest-ProjectMemberTests-55037479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:19:58 devstack sudo[108426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a Sep 07 10:19:58 devstack sudo[108426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:19:59 devstack sudo[108426]: pam_unix(sudo:session): session closed for user root Sep 07 10:19:59 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-8d0660d9-e267-4d71-a91c-d97e0a8c53b1 tempest-ProjectMemberTests-55037479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a" returned: 0 in 0.290s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:19:59 devstack cinder-volume[87515]: DEBUG cinder.manager [None req-8d0660d9-e267-4d71-a91c-d97e0a8c53b1 tempest-ProjectMemberTests-55037479 None] Notifying Schedulers of capabilities ... {{(pid=87515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:19:59 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-8d0660d9-e267-4d71-a91c-d97e0a8c53b1 tempest-ProjectMemberTests-55037479 None] Deleted volume successfully. Sep 07 10:19:59 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-8d0660d9-e267-4d71-a91c-d97e0a8c53b1 tempest-ProjectMemberTests-55037479 None] Lock "cinder-5bf4ec62-0ec0-458a-85ad-aa8e9bf1d145-delete_volume" released by "delete_volume" :: held 1.217s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:19:59 devstack cinder-volume[87515]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f32d1f1-30d9-492c-be7e-e2464278a33e tempest-ProjectMemberTests-55037479 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 10:19:59 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-1f32d1f1-30d9-492c-be7e-e2464278a33e tempest-ProjectMemberTests-55037479 None] Flow 'volume_create_manager' (26082c63-ad41-49d4-b939-4c585c5f9869) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:19:59 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-1f32d1f1-30d9-492c-be7e-e2464278a33e tempest-ProjectMemberTests-55037479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b3c1ece-311b-458c-8486-caebd81f68ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:19:59 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-1f32d1f1-30d9-492c-be7e-e2464278a33e tempest-ProjectMemberTests-55037479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b3c1ece-311b-458c-8486-caebd81f68ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:19:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1686317469',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9da9fa4-a0fc-410f-9da9-c2e235215feb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41fa4493d2f045dc87793bd97d931cff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:20:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:20:00Z,use_quota=True,user_id='5136aa4e2a7c4a1da79d4e4478cdcbf6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3a092cd-7947-4cbf-abff-4ba9567becf0),volume_type_id=f3a092cd-7947-4cbf-abff-4ba9567becf0)' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:19:59 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-1f32d1f1-30d9-492c-be7e-e2464278a33e tempest-ProjectMemberTests-55037479 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3dba940e-0857-4715-a806-8a6757497d75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:19:59 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-1f32d1f1-30d9-492c-be7e-e2464278a33e tempest-ProjectMemberTests-55037479 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3dba940e-0857-4715-a806-8a6757497d75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:19:59 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-1f32d1f1-30d9-492c-be7e-e2464278a33e tempest-ProjectMemberTests-55037479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75284359-f52a-4d4d-a182-169da5b58cbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:19:59 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-1f32d1f1-30d9-492c-be7e-e2464278a33e tempest-ProjectMemberTests-55037479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75284359-f52a-4d4d-a182-169da5b58cbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b9da9fa4-a0fc-410f-9da9-c2e235215feb', 'volume_name': 'volume-b9da9fa4-a0fc-410f-9da9-c2e235215feb', 'volume_size': 1}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:19:59 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-1f32d1f1-30d9-492c-be7e-e2464278a33e tempest-ProjectMemberTests-55037479 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac61442d-ea8d-4d6b-bdb8-2f27f6aa5cc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:19:59 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-1f32d1f1-30d9-492c-be7e-e2464278a33e tempest-ProjectMemberTests-55037479 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac61442d-ea8d-4d6b-bdb8-2f27f6aa5cc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:19:59 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-1f32d1f1-30d9-492c-be7e-e2464278a33e tempest-ProjectMemberTests-55037479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3a416fc-6cbe-4028-a0dd-6537f1059a01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:19:59 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-1f32d1f1-30d9-492c-be7e-e2464278a33e tempest-ProjectMemberTests-55037479 None] Volume b9da9fa4-a0fc-410f-9da9-c2e235215feb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b9da9fa4-a0fc-410f-9da9-c2e235215feb', 'volume_size': 1} Sep 07 10:19:59 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-1f32d1f1-30d9-492c-be7e-e2464278a33e tempest-ProjectMemberTests-55037479 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:19:59 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-1f32d1f1-30d9-492c-be7e-e2464278a33e tempest-ProjectMemberTests-55037479 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:19:59 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-1f32d1f1-30d9-492c-be7e-e2464278a33e tempest-ProjectMemberTests-55037479 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:19:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1686317469',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9da9fa4-a0fc-410f-9da9-c2e235215feb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41fa4493d2f045dc87793bd97d931cff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:20:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:20:00Z,use_quota=True,user_id='5136aa4e2a7c4a1da79d4e4478cdcbf6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3a092cd-7947-4cbf-abff-4ba9567becf0),volume_type_id=f3a092cd-7947-4cbf-abff-4ba9567becf0)}" {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 10:19:59 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-1f32d1f1-30d9-492c-be7e-e2464278a33e tempest-ProjectMemberTests-55037479 None] Creating volume b9da9fa4-a0fc-410f-9da9-c2e235215feb {{(pid=87515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 10:19:59 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-1f32d1f1-30d9-492c-be7e-e2464278a33e tempest-ProjectMemberTests-55037479 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:19:59 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-1f32d1f1-30d9-492c-be7e-e2464278a33e tempest-ProjectMemberTests-55037479 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:19:59 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-1f32d1f1-30d9-492c-be7e-e2464278a33e tempest-ProjectMemberTests-55037479 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:19:59 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-1f32d1f1-30d9-492c-be7e-e2464278a33e tempest-ProjectMemberTests-55037479 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:19:59 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-1f32d1f1-30d9-492c-be7e-e2464278a33e tempest-ProjectMemberTests-55037479 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:19:59 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-1f32d1f1-30d9-492c-be7e-e2464278a33e tempest-ProjectMemberTests-55037479 None] Selected osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c as target Quobyte volume. {{(pid=87515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 10:19:59 devstack cinder-volume[87515]: INFO cinder.volume.drivers.remotefs [None req-1f32d1f1-30d9-492c-be7e-e2464278a33e tempest-ProjectMemberTests-55037479 None] casted to osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c Sep 07 10:19:59 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-1f32d1f1-30d9-492c-be7e-e2464278a33e tempest-ProjectMemberTests-55037479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-b9da9fa4-a0fc-410f-9da9-c2e235215feb 1073741824 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:19:59 devstack sudo[108430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-b9da9fa4-a0fc-410f-9da9-c2e235215feb 1073741824 Sep 07 10:19:59 devstack sudo[108430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:20:00 devstack sudo[108430]: pam_unix(sudo:session): session closed for user root Sep 07 10:20:00 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-1f32d1f1-30d9-492c-be7e-e2464278a33e tempest-ProjectMemberTests-55037479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-b9da9fa4-a0fc-410f-9da9-c2e235215feb 1073741824" returned: 0 in 0.459s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:20:00 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-1f32d1f1-30d9-492c-be7e-e2464278a33e tempest-ProjectMemberTests-55037479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-b9da9fa4-a0fc-410f-9da9-c2e235215feb {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:20:00 devstack sudo[108436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-b9da9fa4-a0fc-410f-9da9-c2e235215feb Sep 07 10:20:00 devstack sudo[108436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:20:00 devstack sudo[108436]: pam_unix(sudo:session): session closed for user root Sep 07 10:20:00 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-1f32d1f1-30d9-492c-be7e-e2464278a33e tempest-ProjectMemberTests-55037479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-b9da9fa4-a0fc-410f-9da9-c2e235215feb" returned: 0 in 0.278s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:20:00 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-1f32d1f1-30d9-492c-be7e-e2464278a33e tempest-ProjectMemberTests-55037479 None] <== create_volume: return (786ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'} {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 10:20:00 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-1f32d1f1-30d9-492c-be7e-e2464278a33e tempest-ProjectMemberTests-55037479 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.792s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:20:00 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-1f32d1f1-30d9-492c-be7e-e2464278a33e tempest-ProjectMemberTests-55037479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3a416fc-6cbe-4028-a0dd-6537f1059a01) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b9da9fa4-a0fc-410f-9da9-c2e235215feb', 'volume_size': 1}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:20:00 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-1f32d1f1-30d9-492c-be7e-e2464278a33e tempest-ProjectMemberTests-55037479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad88f795-1bcb-4fa8-9fc8-af1c6a2997ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:20:00 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-1f32d1f1-30d9-492c-be7e-e2464278a33e tempest-ProjectMemberTests-55037479 None] Volume volume-b9da9fa4-a0fc-410f-9da9-c2e235215feb (b9da9fa4-a0fc-410f-9da9-c2e235215feb): created successfully Sep 07 10:20:00 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-1f32d1f1-30d9-492c-be7e-e2464278a33e tempest-ProjectMemberTests-55037479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad88f795-1bcb-4fa8-9fc8-af1c6a2997ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:20:00 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-1f32d1f1-30d9-492c-be7e-e2464278a33e tempest-ProjectMemberTests-55037479 None] Flow 'volume_create_manager' (26082c63-ad41-49d4-b939-4c585c5f9869) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:20:00 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-1f32d1f1-30d9-492c-be7e-e2464278a33e tempest-ProjectMemberTests-55037479 None] Created volume successfully. Sep 07 10:20:01 devstack cinder-volume[87515]: DEBUG dbcounter [-] [87515] Writing DB stats cinder:SELECT=193,cinder:INSERT=62,cinder:UPDATE=245,cinder:DELETE=16 {{(pid=87515) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 10:20:01 devstack cinder-volume[87515]: DEBUG dbcounter [-] [87515] Writing DB stats cinder:SELECT=171,cinder:UPDATE=230,cinder:DELETE=24,cinder:INSERT=68 {{(pid=87515) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 10:20:01 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-58784bae-a1d7-4675-88f5-a36cee214e46 tempest-ProjectMemberTests-55037479 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:20:01 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-58784bae-a1d7-4675-88f5-a36cee214e46 tempest-ProjectMemberTests-55037479 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:20:01 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-58784bae-a1d7-4675-88f5-a36cee214e46 tempest-ProjectMemberTests-55037479 None] Creating offline snapshot d1d61df6-780c-4856-80ff-54aed27609ab of volume b9da9fa4-a0fc-410f-9da9-c2e235215feb {{(pid=87515) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 10:20:01 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[757c1229-1a69-459e-b5ab-4f217956505f]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:20:01 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-58784bae-a1d7-4675-88f5-a36cee214e46 tempest-ProjectMemberTests-55037479 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-b9da9fa4-a0fc-410f-9da9-c2e235215feb {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:20:02 devstack sudo[108439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-b9da9fa4-a0fc-410f-9da9-c2e235215feb Sep 07 10:20:02 devstack sudo[108439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:20:02 devstack sudo[108439]: pam_unix(sudo:session): session closed for user root Sep 07 10:20:02 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-58784bae-a1d7-4675-88f5-a36cee214e46 tempest-ProjectMemberTests-55037479 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-b9da9fa4-a0fc-410f-9da9-c2e235215feb" returned: 0 in 0.397s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:20:02 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-58784bae-a1d7-4675-88f5-a36cee214e46 tempest-ProjectMemberTests-55037479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-b9da9fa4-a0fc-410f-9da9-c2e235215feb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-b9da9fa4-a0fc-410f-9da9-c2e235215feb.d1d61df6-780c-4856-80ff-54aed27609ab 1G {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:20:02 devstack sudo[108444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-b9da9fa4-a0fc-410f-9da9-c2e235215feb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-b9da9fa4-a0fc-410f-9da9-c2e235215feb.d1d61df6-780c-4856-80ff-54aed27609ab 1G Sep 07 10:20:02 devstack sudo[108444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:20:02 devstack sudo[108444]: pam_unix(sudo:session): session closed for user root Sep 07 10:20:02 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-58784bae-a1d7-4675-88f5-a36cee214e46 tempest-ProjectMemberTests-55037479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-b9da9fa4-a0fc-410f-9da9-c2e235215feb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-b9da9fa4-a0fc-410f-9da9-c2e235215feb.d1d61df6-780c-4856-80ff-54aed27609ab 1G" returned: 0 in 0.472s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:20:02 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-58784bae-a1d7-4675-88f5-a36cee214e46 tempest-ProjectMemberTests-55037479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b9da9fa4-a0fc-410f-9da9-c2e235215feb -F qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-b9da9fa4-a0fc-410f-9da9-c2e235215feb.d1d61df6-780c-4856-80ff-54aed27609ab {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:20:02 devstack sudo[108450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b9da9fa4-a0fc-410f-9da9-c2e235215feb -F qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-b9da9fa4-a0fc-410f-9da9-c2e235215feb.d1d61df6-780c-4856-80ff-54aed27609ab Sep 07 10:20:02 devstack sudo[108450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:20:03 devstack sudo[108450]: pam_unix(sudo:session): session closed for user root Sep 07 10:20:03 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-58784bae-a1d7-4675-88f5-a36cee214e46 tempest-ProjectMemberTests-55037479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b9da9fa4-a0fc-410f-9da9-c2e235215feb -F qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-b9da9fa4-a0fc-410f-9da9-c2e235215feb.d1d61df6-780c-4856-80ff-54aed27609ab" returned: 0 in 0.295s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:20:03 devstack cinder-volume[87515]: WARNING cinder.volume.drivers.remotefs [None req-58784bae-a1d7-4675-88f5-a36cee214e46 tempest-ProjectMemberTests-55037479 None] /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-b9da9fa4-a0fc-410f-9da9-c2e235215feb.d1d61df6-780c-4856-80ff-54aed27609ab is being set with open permissions: ugo+rw Sep 07 10:20:03 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-58784bae-a1d7-4675-88f5-a36cee214e46 tempest-ProjectMemberTests-55037479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-b9da9fa4-a0fc-410f-9da9-c2e235215feb.d1d61df6-780c-4856-80ff-54aed27609ab {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:20:03 devstack sudo[108458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-b9da9fa4-a0fc-410f-9da9-c2e235215feb.d1d61df6-780c-4856-80ff-54aed27609ab Sep 07 10:20:03 devstack sudo[108458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:20:03 devstack sudo[108458]: pam_unix(sudo:session): session closed for user root Sep 07 10:20:03 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-58784bae-a1d7-4675-88f5-a36cee214e46 tempest-ProjectMemberTests-55037479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-b9da9fa4-a0fc-410f-9da9-c2e235215feb.d1d61df6-780c-4856-80ff-54aed27609ab" returned: 0 in 0.260s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:20:03 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-58784bae-a1d7-4675-88f5-a36cee214e46 tempest-ProjectMemberTests-55037479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-b9da9fa4-a0fc-410f-9da9-c2e235215feb.info {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:20:03 devstack sudo[108461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-b9da9fa4-a0fc-410f-9da9-c2e235215feb.info Sep 07 10:20:03 devstack sudo[108461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:20:03 devstack sudo[108461]: pam_unix(sudo:session): session closed for user root Sep 07 10:20:03 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-58784bae-a1d7-4675-88f5-a36cee214e46 tempest-ProjectMemberTests-55037479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-b9da9fa4-a0fc-410f-9da9-c2e235215feb.info" returned: 0 in 0.266s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:20:03 devstack cinder-volume[87515]: WARNING cinder.volume.drivers.remotefs [None req-58784bae-a1d7-4675-88f5-a36cee214e46 tempest-ProjectMemberTests-55037479 None] /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-b9da9fa4-a0fc-410f-9da9-c2e235215feb.info is being set with open permissions: ugo+rw Sep 07 10:20:03 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-58784bae-a1d7-4675-88f5-a36cee214e46 tempest-ProjectMemberTests-55037479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-b9da9fa4-a0fc-410f-9da9-c2e235215feb.info {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:20:03 devstack sudo[108465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-b9da9fa4-a0fc-410f-9da9-c2e235215feb.info Sep 07 10:20:03 devstack sudo[108465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:20:03 devstack sudo[108465]: pam_unix(sudo:session): session closed for user root Sep 07 10:20:03 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-58784bae-a1d7-4675-88f5-a36cee214e46 tempest-ProjectMemberTests-55037479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-b9da9fa4-a0fc-410f-9da9-c2e235215feb.info" returned: 0 in 0.276s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:20:04 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-58784bae-a1d7-4675-88f5-a36cee214e46 tempest-ProjectMemberTests-55037479 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.061s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:20:04 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-58784bae-a1d7-4675-88f5-a36cee214e46 tempest-ProjectMemberTests-55037479 None] Create snapshot completed successfully Sep 07 10:20:05 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-164db040-146c-4aee-9ad6-6b139a35d2e6 tempest-ProjectMemberTests-55037479 None] Acquiring lock "cinder-d1d61df6-780c-4856-80ff-54aed27609ab-delete_snapshot" by "delete_snapshot" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:20:05 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-164db040-146c-4aee-9ad6-6b139a35d2e6 tempest-ProjectMemberTests-55037479 None] Lock "cinder-d1d61df6-780c-4856-80ff-54aed27609ab-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:20:05 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-164db040-146c-4aee-9ad6-6b139a35d2e6 tempest-ProjectMemberTests-55037479 None] Acquiring lock "cinder-quobyte-b9da9fa4-a0fc-410f-9da9-c2e235215feb" by "delete_snapshot" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:20:05 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-164db040-146c-4aee-9ad6-6b139a35d2e6 tempest-ProjectMemberTests-55037479 None] Lock "cinder-quobyte-b9da9fa4-a0fc-410f-9da9-c2e235215feb" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:20:05 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-164db040-146c-4aee-9ad6-6b139a35d2e6 tempest-ProjectMemberTests-55037479 None] Acquiring lock "cinder-quobyte-d1d61df6-780c-4856-80ff-54aed27609ab" by "_delete_snapshot" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:20:05 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-164db040-146c-4aee-9ad6-6b139a35d2e6 tempest-ProjectMemberTests-55037479 None] Lock "cinder-quobyte-d1d61df6-780c-4856-80ff-54aed27609ab" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:20:05 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-164db040-146c-4aee-9ad6-6b139a35d2e6 tempest-ProjectMemberTests-55037479 None] Deleting offline snapshot d1d61df6-780c-4856-80ff-54aed27609ab of volume b9da9fa4-a0fc-410f-9da9-c2e235215feb {{(pid=87515) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 10:20:05 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-164db040-146c-4aee-9ad6-6b139a35d2e6 tempest-ProjectMemberTests-55037479 None] snapshot_file for this snap is: volume-b9da9fa4-a0fc-410f-9da9-c2e235215feb.d1d61df6-780c-4856-80ff-54aed27609ab {{(pid=87515) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 10:20:05 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc742e40-f780-45e6-ac60-fc8a9e602b11]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:20:05 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-164db040-146c-4aee-9ad6-6b139a35d2e6 tempest-ProjectMemberTests-55037479 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-b9da9fa4-a0fc-410f-9da9-c2e235215feb.d1d61df6-780c-4856-80ff-54aed27609ab {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:20:05 devstack sudo[108468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-b9da9fa4-a0fc-410f-9da9-c2e235215feb.d1d61df6-780c-4856-80ff-54aed27609ab Sep 07 10:20:05 devstack sudo[108468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:20:05 devstack sudo[108468]: pam_unix(sudo:session): session closed for user root Sep 07 10:20:05 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-164db040-146c-4aee-9ad6-6b139a35d2e6 tempest-ProjectMemberTests-55037479 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-b9da9fa4-a0fc-410f-9da9-c2e235215feb.d1d61df6-780c-4856-80ff-54aed27609ab" returned: 0 in 0.362s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:20:05 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-164db040-146c-4aee-9ad6-6b139a35d2e6 tempest-ProjectMemberTests-55037479 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b9da9fa4-a0fc-410f-9da9-c2e235215feb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87515) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 10:20:05 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a6434ba-5dae-4bcb-a56c-625c02c8cbe9]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:20:05 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-164db040-146c-4aee-9ad6-6b139a35d2e6 tempest-ProjectMemberTests-55037479 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-b9da9fa4-a0fc-410f-9da9-c2e235215feb {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:20:05 devstack sudo[108473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-b9da9fa4-a0fc-410f-9da9-c2e235215feb Sep 07 10:20:05 devstack sudo[108473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:20:06 devstack sudo[108473]: pam_unix(sudo:session): session closed for user root Sep 07 10:20:06 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-164db040-146c-4aee-9ad6-6b139a35d2e6 tempest-ProjectMemberTests-55037479 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-b9da9fa4-a0fc-410f-9da9-c2e235215feb" returned: 0 in 0.454s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:20:06 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-164db040-146c-4aee-9ad6-6b139a35d2e6 tempest-ProjectMemberTests-55037479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-b9da9fa4-a0fc-410f-9da9-c2e235215feb.d1d61df6-780c-4856-80ff-54aed27609ab {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:20:06 devstack sudo[108478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-b9da9fa4-a0fc-410f-9da9-c2e235215feb.d1d61df6-780c-4856-80ff-54aed27609ab Sep 07 10:20:06 devstack sudo[108478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:20:06 devstack sudo[108478]: pam_unix(sudo:session): session closed for user root Sep 07 10:20:06 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-164db040-146c-4aee-9ad6-6b139a35d2e6 tempest-ProjectMemberTests-55037479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-b9da9fa4-a0fc-410f-9da9-c2e235215feb.d1d61df6-780c-4856-80ff-54aed27609ab" returned: 0 in 0.355s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:20:06 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-164db040-146c-4aee-9ad6-6b139a35d2e6 tempest-ProjectMemberTests-55037479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-b9da9fa4-a0fc-410f-9da9-c2e235215feb.d1d61df6-780c-4856-80ff-54aed27609ab {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:20:06 devstack sudo[108483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-b9da9fa4-a0fc-410f-9da9-c2e235215feb.d1d61df6-780c-4856-80ff-54aed27609ab Sep 07 10:20:06 devstack sudo[108483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:20:06 devstack sudo[108483]: pam_unix(sudo:session): session closed for user root Sep 07 10:20:06 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-164db040-146c-4aee-9ad6-6b139a35d2e6 tempest-ProjectMemberTests-55037479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-b9da9fa4-a0fc-410f-9da9-c2e235215feb.d1d61df6-780c-4856-80ff-54aed27609ab" returned: 0 in 0.267s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:20:06 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-164db040-146c-4aee-9ad6-6b139a35d2e6 tempest-ProjectMemberTests-55037479 None] Lock "cinder-quobyte-d1d61df6-780c-4856-80ff-54aed27609ab" released by "_delete_snapshot" :: held 1.540s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:20:06 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-164db040-146c-4aee-9ad6-6b139a35d2e6 tempest-ProjectMemberTests-55037479 None] Lock "cinder-quobyte-b9da9fa4-a0fc-410f-9da9-c2e235215feb" released by "delete_snapshot" :: held 1.571s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:20:06 devstack cinder-volume[87515]: DEBUG cinder.quota [None req-164db040-146c-4aee-9ad6-6b139a35d2e6 tempest-ProjectMemberTests-55037479 None] Created reservations ['00bbaf23-4f2e-4e29-a0c4-242d89a89653', '624bcc53-8076-48d9-a54b-50cfa1b64021', '2fa40297-38ed-42f5-bcfc-6ef5c8dea9dd', '96ff735c-f10e-4cee-8e8b-149405474453'] {{(pid=87515) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:20:06 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-164db040-146c-4aee-9ad6-6b139a35d2e6 tempest-ProjectMemberTests-55037479 None] Delete snapshot completed successfully. Sep 07 10:20:06 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-164db040-146c-4aee-9ad6-6b139a35d2e6 tempest-ProjectMemberTests-55037479 None] Lock "cinder-d1d61df6-780c-4856-80ff-54aed27609ab-delete_snapshot" released by "delete_snapshot" :: held 1.732s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:20:07 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-b891353a-b86f-4ba6-8477-9852ec6e3ebb tempest-ProjectMemberTests-55037479 None] Acquiring lock "cinder-b9da9fa4-a0fc-410f-9da9-c2e235215feb-delete_volume" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:20:07 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-b891353a-b86f-4ba6-8477-9852ec6e3ebb tempest-ProjectMemberTests-55037479 None] Lock "cinder-b9da9fa4-a0fc-410f-9da9-c2e235215feb-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:20:07 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-b891353a-b86f-4ba6-8477-9852ec6e3ebb tempest-ProjectMemberTests-55037479 None] Acquiring lock "cinder-quobyte-b9da9fa4-a0fc-410f-9da9-c2e235215feb" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:20:07 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-b891353a-b86f-4ba6-8477-9852ec6e3ebb tempest-ProjectMemberTests-55037479 None] Lock "cinder-quobyte-b9da9fa4-a0fc-410f-9da9-c2e235215feb" acquired by "delete_volume" :: waited 0.020s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:20:07 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[45ae74ac-62f9-4b79-8463-e90f1e5fde25]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:20:07 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-b891353a-b86f-4ba6-8477-9852ec6e3ebb tempest-ProjectMemberTests-55037479 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-b9da9fa4-a0fc-410f-9da9-c2e235215feb {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:20:07 devstack sudo[108486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-b9da9fa4-a0fc-410f-9da9-c2e235215feb Sep 07 10:20:07 devstack sudo[108486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:20:07 devstack sudo[108486]: pam_unix(sudo:session): session closed for user root Sep 07 10:20:07 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-b891353a-b86f-4ba6-8477-9852ec6e3ebb tempest-ProjectMemberTests-55037479 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-b9da9fa4-a0fc-410f-9da9-c2e235215feb" returned: 0 in 0.358s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:20:07 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-b891353a-b86f-4ba6-8477-9852ec6e3ebb tempest-ProjectMemberTests-55037479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-b9da9fa4-a0fc-410f-9da9-c2e235215feb {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:20:07 devstack sudo[108491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-b9da9fa4-a0fc-410f-9da9-c2e235215feb Sep 07 10:20:07 devstack sudo[108491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:20:08 devstack sudo[108491]: pam_unix(sudo:session): session closed for user root Sep 07 10:20:08 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-b891353a-b86f-4ba6-8477-9852ec6e3ebb tempest-ProjectMemberTests-55037479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-b9da9fa4-a0fc-410f-9da9-c2e235215feb" returned: 0 in 0.238s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:20:08 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-b891353a-b86f-4ba6-8477-9852ec6e3ebb tempest-ProjectMemberTests-55037479 None] Lock "cinder-quobyte-b9da9fa4-a0fc-410f-9da9-c2e235215feb" released by "delete_volume" :: held 0.659s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:20:08 devstack cinder-volume[87515]: DEBUG cinder.quota [None req-b891353a-b86f-4ba6-8477-9852ec6e3ebb tempest-ProjectMemberTests-55037479 None] Created reservations ['a989a6c8-0f5f-444b-a962-278f01f2329e', '39b1aaf2-3724-4807-a599-ff25bcd22f1a', 'c2662a22-572c-4c8b-ae27-00701387b9a7', '858d058f-77e9-4cde-8571-effbbd397f9f'] {{(pid=87515) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:20:08 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-b891353a-b86f-4ba6-8477-9852ec6e3ebb tempest-ProjectMemberTests-55037479 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:20:08 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-b891353a-b86f-4ba6-8477-9852ec6e3ebb tempest-ProjectMemberTests-55037479 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:20:08 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-b891353a-b86f-4ba6-8477-9852ec6e3ebb tempest-ProjectMemberTests-55037479 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:20:08 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-b891353a-b86f-4ba6-8477-9852ec6e3ebb tempest-ProjectMemberTests-55037479 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:20:08 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-b891353a-b86f-4ba6-8477-9852ec6e3ebb tempest-ProjectMemberTests-55037479 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:20:08 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-b891353a-b86f-4ba6-8477-9852ec6e3ebb tempest-ProjectMemberTests-55037479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:20:08 devstack sudo[108494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a Sep 07 10:20:08 devstack sudo[108494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:20:08 devstack sudo[108494]: pam_unix(sudo:session): session closed for user root Sep 07 10:20:08 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-b891353a-b86f-4ba6-8477-9852ec6e3ebb tempest-ProjectMemberTests-55037479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a" returned: 0 in 0.277s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:20:08 devstack cinder-volume[87515]: DEBUG cinder.manager [None req-b891353a-b86f-4ba6-8477-9852ec6e3ebb tempest-ProjectMemberTests-55037479 None] Notifying Schedulers of capabilities ... {{(pid=87515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:20:08 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-b891353a-b86f-4ba6-8477-9852ec6e3ebb tempest-ProjectMemberTests-55037479 None] Deleted volume successfully. Sep 07 10:20:08 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-b891353a-b86f-4ba6-8477-9852ec6e3ebb tempest-ProjectMemberTests-55037479 None] Lock "cinder-b9da9fa4-a0fc-410f-9da9-c2e235215feb-delete_volume" released by "delete_volume" :: held 1.148s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:20:11 devstack cinder-volume[87515]: DEBUG oslo_service.periodic_task [None req-cebd6a9d-3073-42a1-b65a-b38d444d85ed None None] Running periodic task VolumeManager._thread_info {{(pid=87515) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 10:20:11 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-cebd6a9d-3073-42a1-b65a-b38d444d85ed None None] thread count: 29 {{(pid=87515) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 07 10:20:11 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-cebd6a9d-3073-42a1-b65a-b38d444d85ed None None] thread info: [<_MainThread(MainThread, started 131647121809536)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87515) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 07 10:20:12 devstack cinder-volume[87515]: DEBUG cinder.volume.flows.manager.create_volume [None req-de3a9f2d-3be8-474c-b7bf-5bc9035a7729 tempest-SnapshotDependencyTests-1405016702 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 10:20:12 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-de3a9f2d-3be8-474c-b7bf-5bc9035a7729 tempest-SnapshotDependencyTests-1405016702 None] Flow 'volume_create_manager' (40d952e9-4af6-40ec-84bb-4ba5094e268d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:20:12 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-de3a9f2d-3be8-474c-b7bf-5bc9035a7729 tempest-SnapshotDependencyTests-1405016702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (030362d9-d67c-4991-afb6-0e0a9905a985) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:20:12 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-de3a9f2d-3be8-474c-b7bf-5bc9035a7729 tempest-SnapshotDependencyTests-1405016702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (030362d9-d67c-4991-afb6-0e0a9905a985) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:20:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-841316130',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cbb9b9d6-9f8b-4c15-b4c6-7797e78e2b98,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a0f85c1cbf44db1a37d73b9094c8993',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:20:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:20:13Z,use_quota=True,user_id='338eaabf46524a8a9d145ff5270e952d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3a092cd-7947-4cbf-abff-4ba9567becf0),volume_type_id=f3a092cd-7947-4cbf-abff-4ba9567becf0)' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:20:12 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-de3a9f2d-3be8-474c-b7bf-5bc9035a7729 tempest-SnapshotDependencyTests-1405016702 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e5df3a4-769f-4ad2-a19a-13b17c751f9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:20:12 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-de3a9f2d-3be8-474c-b7bf-5bc9035a7729 tempest-SnapshotDependencyTests-1405016702 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e5df3a4-769f-4ad2-a19a-13b17c751f9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:20:12 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-de3a9f2d-3be8-474c-b7bf-5bc9035a7729 tempest-SnapshotDependencyTests-1405016702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc639756-dfa5-457f-8e9c-1348d0e6c796) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:20:12 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-de3a9f2d-3be8-474c-b7bf-5bc9035a7729 tempest-SnapshotDependencyTests-1405016702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc639756-dfa5-457f-8e9c-1348d0e6c796) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cbb9b9d6-9f8b-4c15-b4c6-7797e78e2b98', 'volume_name': 'volume-cbb9b9d6-9f8b-4c15-b4c6-7797e78e2b98', 'volume_size': 1}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:20:12 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-de3a9f2d-3be8-474c-b7bf-5bc9035a7729 tempest-SnapshotDependencyTests-1405016702 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cfc1fcba-840a-45a7-9fe5-df4d2bec7d99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:20:12 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-de3a9f2d-3be8-474c-b7bf-5bc9035a7729 tempest-SnapshotDependencyTests-1405016702 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cfc1fcba-840a-45a7-9fe5-df4d2bec7d99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:20:12 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-de3a9f2d-3be8-474c-b7bf-5bc9035a7729 tempest-SnapshotDependencyTests-1405016702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5ac7ce5-2cb5-42e3-924c-59bc06490c8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:20:12 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-de3a9f2d-3be8-474c-b7bf-5bc9035a7729 tempest-SnapshotDependencyTests-1405016702 None] Volume cbb9b9d6-9f8b-4c15-b4c6-7797e78e2b98: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cbb9b9d6-9f8b-4c15-b4c6-7797e78e2b98', 'volume_size': 1} Sep 07 10:20:12 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-de3a9f2d-3be8-474c-b7bf-5bc9035a7729 tempest-SnapshotDependencyTests-1405016702 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:20:12 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-de3a9f2d-3be8-474c-b7bf-5bc9035a7729 tempest-SnapshotDependencyTests-1405016702 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:20:12 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-de3a9f2d-3be8-474c-b7bf-5bc9035a7729 tempest-SnapshotDependencyTests-1405016702 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:20:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-841316130',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cbb9b9d6-9f8b-4c15-b4c6-7797e78e2b98,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a0f85c1cbf44db1a37d73b9094c8993',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:20:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:20:13Z,use_quota=True,user_id='338eaabf46524a8a9d145ff5270e952d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3a092cd-7947-4cbf-abff-4ba9567becf0),volume_type_id=f3a092cd-7947-4cbf-abff-4ba9567becf0)}" {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 10:20:12 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-de3a9f2d-3be8-474c-b7bf-5bc9035a7729 tempest-SnapshotDependencyTests-1405016702 None] Creating volume cbb9b9d6-9f8b-4c15-b4c6-7797e78e2b98 {{(pid=87515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 10:20:12 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-de3a9f2d-3be8-474c-b7bf-5bc9035a7729 tempest-SnapshotDependencyTests-1405016702 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:20:12 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-de3a9f2d-3be8-474c-b7bf-5bc9035a7729 tempest-SnapshotDependencyTests-1405016702 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:20:12 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-de3a9f2d-3be8-474c-b7bf-5bc9035a7729 tempest-SnapshotDependencyTests-1405016702 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:20:12 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-de3a9f2d-3be8-474c-b7bf-5bc9035a7729 tempest-SnapshotDependencyTests-1405016702 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:20:12 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-de3a9f2d-3be8-474c-b7bf-5bc9035a7729 tempest-SnapshotDependencyTests-1405016702 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:20:12 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-de3a9f2d-3be8-474c-b7bf-5bc9035a7729 tempest-SnapshotDependencyTests-1405016702 None] Selected osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c as target Quobyte volume. {{(pid=87515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 10:20:12 devstack cinder-volume[87515]: INFO cinder.volume.drivers.remotefs [None req-de3a9f2d-3be8-474c-b7bf-5bc9035a7729 tempest-SnapshotDependencyTests-1405016702 None] casted to osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c Sep 07 10:20:12 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-de3a9f2d-3be8-474c-b7bf-5bc9035a7729 tempest-SnapshotDependencyTests-1405016702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-cbb9b9d6-9f8b-4c15-b4c6-7797e78e2b98 1073741824 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:20:12 devstack sudo[108499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-cbb9b9d6-9f8b-4c15-b4c6-7797e78e2b98 1073741824 Sep 07 10:20:12 devstack sudo[108499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:20:13 devstack sudo[108499]: pam_unix(sudo:session): session closed for user root Sep 07 10:20:13 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-de3a9f2d-3be8-474c-b7bf-5bc9035a7729 tempest-SnapshotDependencyTests-1405016702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-cbb9b9d6-9f8b-4c15-b4c6-7797e78e2b98 1073741824" returned: 0 in 0.410s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:20:13 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-de3a9f2d-3be8-474c-b7bf-5bc9035a7729 tempest-SnapshotDependencyTests-1405016702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-cbb9b9d6-9f8b-4c15-b4c6-7797e78e2b98 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:20:13 devstack sudo[108505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-cbb9b9d6-9f8b-4c15-b4c6-7797e78e2b98 Sep 07 10:20:13 devstack sudo[108505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:20:13 devstack sudo[108505]: pam_unix(sudo:session): session closed for user root Sep 07 10:20:13 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-de3a9f2d-3be8-474c-b7bf-5bc9035a7729 tempest-SnapshotDependencyTests-1405016702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-cbb9b9d6-9f8b-4c15-b4c6-7797e78e2b98" returned: 0 in 0.263s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:20:13 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-de3a9f2d-3be8-474c-b7bf-5bc9035a7729 tempest-SnapshotDependencyTests-1405016702 None] <== create_volume: return (718ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'} {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 10:20:13 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-de3a9f2d-3be8-474c-b7bf-5bc9035a7729 tempest-SnapshotDependencyTests-1405016702 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.721s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:20:13 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-de3a9f2d-3be8-474c-b7bf-5bc9035a7729 tempest-SnapshotDependencyTests-1405016702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5ac7ce5-2cb5-42e3-924c-59bc06490c8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cbb9b9d6-9f8b-4c15-b4c6-7797e78e2b98', 'volume_size': 1}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:20:13 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-de3a9f2d-3be8-474c-b7bf-5bc9035a7729 tempest-SnapshotDependencyTests-1405016702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e832653b-2360-4cf9-8450-309e8f833d7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:20:13 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-de3a9f2d-3be8-474c-b7bf-5bc9035a7729 tempest-SnapshotDependencyTests-1405016702 None] Volume volume-cbb9b9d6-9f8b-4c15-b4c6-7797e78e2b98 (cbb9b9d6-9f8b-4c15-b4c6-7797e78e2b98): created successfully Sep 07 10:20:13 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-de3a9f2d-3be8-474c-b7bf-5bc9035a7729 tempest-SnapshotDependencyTests-1405016702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e832653b-2360-4cf9-8450-309e8f833d7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:20:13 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-de3a9f2d-3be8-474c-b7bf-5bc9035a7729 tempest-SnapshotDependencyTests-1405016702 None] Flow 'volume_create_manager' (40d952e9-4af6-40ec-84bb-4ba5094e268d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:20:13 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-de3a9f2d-3be8-474c-b7bf-5bc9035a7729 tempest-SnapshotDependencyTests-1405016702 None] Created volume successfully. Sep 07 10:20:14 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-c64d08a2-20db-4d00-9bae-8f30e5ac439f tempest-SnapshotDependencyTests-1405016702 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:20:14 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-c64d08a2-20db-4d00-9bae-8f30e5ac439f tempest-SnapshotDependencyTests-1405016702 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:20:14 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-c64d08a2-20db-4d00-9bae-8f30e5ac439f tempest-SnapshotDependencyTests-1405016702 None] Creating offline snapshot cef94ea7-fefc-4735-9e5a-fc3dbfd9f534 of volume cbb9b9d6-9f8b-4c15-b4c6-7797e78e2b98 {{(pid=87515) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 10:20:14 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2feed26-8c59-4880-a1e7-14c2e27dd88d]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:20:14 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-c64d08a2-20db-4d00-9bae-8f30e5ac439f tempest-SnapshotDependencyTests-1405016702 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-cbb9b9d6-9f8b-4c15-b4c6-7797e78e2b98 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:20:14 devstack sudo[108508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-cbb9b9d6-9f8b-4c15-b4c6-7797e78e2b98 Sep 07 10:20:14 devstack sudo[108508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:20:14 devstack sudo[108508]: pam_unix(sudo:session): session closed for user root Sep 07 10:20:14 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-c64d08a2-20db-4d00-9bae-8f30e5ac439f tempest-SnapshotDependencyTests-1405016702 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-cbb9b9d6-9f8b-4c15-b4c6-7797e78e2b98" returned: 0 in 0.358s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:20:14 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-c64d08a2-20db-4d00-9bae-8f30e5ac439f tempest-SnapshotDependencyTests-1405016702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-cbb9b9d6-9f8b-4c15-b4c6-7797e78e2b98,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-cbb9b9d6-9f8b-4c15-b4c6-7797e78e2b98.cef94ea7-fefc-4735-9e5a-fc3dbfd9f534 1G {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:20:14 devstack sudo[108513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-cbb9b9d6-9f8b-4c15-b4c6-7797e78e2b98,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-cbb9b9d6-9f8b-4c15-b4c6-7797e78e2b98.cef94ea7-fefc-4735-9e5a-fc3dbfd9f534 1G Sep 07 10:20:14 devstack sudo[108513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:20:15 devstack sudo[108513]: pam_unix(sudo:session): session closed for user root Sep 07 10:20:15 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-c64d08a2-20db-4d00-9bae-8f30e5ac439f tempest-SnapshotDependencyTests-1405016702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-cbb9b9d6-9f8b-4c15-b4c6-7797e78e2b98,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-cbb9b9d6-9f8b-4c15-b4c6-7797e78e2b98.cef94ea7-fefc-4735-9e5a-fc3dbfd9f534 1G" returned: 0 in 0.388s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:20:15 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-c64d08a2-20db-4d00-9bae-8f30e5ac439f tempest-SnapshotDependencyTests-1405016702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cbb9b9d6-9f8b-4c15-b4c6-7797e78e2b98 -F qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-cbb9b9d6-9f8b-4c15-b4c6-7797e78e2b98.cef94ea7-fefc-4735-9e5a-fc3dbfd9f534 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:20:15 devstack sudo[108518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cbb9b9d6-9f8b-4c15-b4c6-7797e78e2b98 -F qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-cbb9b9d6-9f8b-4c15-b4c6-7797e78e2b98.cef94ea7-fefc-4735-9e5a-fc3dbfd9f534 Sep 07 10:20:15 devstack sudo[108518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:20:15 devstack sudo[108518]: pam_unix(sudo:session): session closed for user root Sep 07 10:20:15 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-c64d08a2-20db-4d00-9bae-8f30e5ac439f tempest-SnapshotDependencyTests-1405016702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cbb9b9d6-9f8b-4c15-b4c6-7797e78e2b98 -F qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-cbb9b9d6-9f8b-4c15-b4c6-7797e78e2b98.cef94ea7-fefc-4735-9e5a-fc3dbfd9f534" returned: 0 in 0.310s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:20:15 devstack cinder-volume[87515]: WARNING cinder.volume.drivers.remotefs [None req-c64d08a2-20db-4d00-9bae-8f30e5ac439f tempest-SnapshotDependencyTests-1405016702 None] /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-cbb9b9d6-9f8b-4c15-b4c6-7797e78e2b98.cef94ea7-fefc-4735-9e5a-fc3dbfd9f534 is being set with open permissions: ugo+rw Sep 07 10:20:15 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-c64d08a2-20db-4d00-9bae-8f30e5ac439f tempest-SnapshotDependencyTests-1405016702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-cbb9b9d6-9f8b-4c15-b4c6-7797e78e2b98.cef94ea7-fefc-4735-9e5a-fc3dbfd9f534 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:20:15 devstack sudo[108523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-cbb9b9d6-9f8b-4c15-b4c6-7797e78e2b98.cef94ea7-fefc-4735-9e5a-fc3dbfd9f534 Sep 07 10:20:15 devstack sudo[108523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:20:15 devstack sudo[108523]: pam_unix(sudo:session): session closed for user root Sep 07 10:20:15 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-c64d08a2-20db-4d00-9bae-8f30e5ac439f tempest-SnapshotDependencyTests-1405016702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-cbb9b9d6-9f8b-4c15-b4c6-7797e78e2b98.cef94ea7-fefc-4735-9e5a-fc3dbfd9f534" returned: 0 in 0.248s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:20:15 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-c64d08a2-20db-4d00-9bae-8f30e5ac439f tempest-SnapshotDependencyTests-1405016702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-cbb9b9d6-9f8b-4c15-b4c6-7797e78e2b98.info {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:20:15 devstack sudo[108526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-cbb9b9d6-9f8b-4c15-b4c6-7797e78e2b98.info Sep 07 10:20:15 devstack sudo[108526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:20:15 devstack sudo[108526]: pam_unix(sudo:session): session closed for user root Sep 07 10:20:15 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-c64d08a2-20db-4d00-9bae-8f30e5ac439f tempest-SnapshotDependencyTests-1405016702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-cbb9b9d6-9f8b-4c15-b4c6-7797e78e2b98.info" returned: 0 in 0.298s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:20:15 devstack cinder-volume[87515]: WARNING cinder.volume.drivers.remotefs [None req-c64d08a2-20db-4d00-9bae-8f30e5ac439f tempest-SnapshotDependencyTests-1405016702 None] /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-cbb9b9d6-9f8b-4c15-b4c6-7797e78e2b98.info is being set with open permissions: ugo+rw Sep 07 10:20:15 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-c64d08a2-20db-4d00-9bae-8f30e5ac439f tempest-SnapshotDependencyTests-1405016702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-cbb9b9d6-9f8b-4c15-b4c6-7797e78e2b98.info {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:20:15 devstack sudo[108529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-cbb9b9d6-9f8b-4c15-b4c6-7797e78e2b98.info Sep 07 10:20:15 devstack sudo[108529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:20:16 devstack sudo[108529]: pam_unix(sudo:session): session closed for user root Sep 07 10:20:16 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-c64d08a2-20db-4d00-9bae-8f30e5ac439f tempest-SnapshotDependencyTests-1405016702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-cbb9b9d6-9f8b-4c15-b4c6-7797e78e2b98.info" returned: 0 in 0.259s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:20:16 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-c64d08a2-20db-4d00-9bae-8f30e5ac439f tempest-SnapshotDependencyTests-1405016702 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.947s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:20:16 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-c64d08a2-20db-4d00-9bae-8f30e5ac439f tempest-SnapshotDependencyTests-1405016702 None] Create snapshot completed successfully Sep 07 10:20:17 devstack cinder-volume[87515]: DEBUG cinder.volume.flows.manager.create_volume [None req-e743cca9-abcb-408a-b5ea-a4b163bf64e8 tempest-SnapshotDependencyTests-1405016702 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 10:20:17 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-e743cca9-abcb-408a-b5ea-a4b163bf64e8 tempest-SnapshotDependencyTests-1405016702 None] Flow 'volume_create_manager' (e00d845e-47b0-4523-8b51-253e8f722bff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:20:17 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-e743cca9-abcb-408a-b5ea-a4b163bf64e8 tempest-SnapshotDependencyTests-1405016702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6339b28e-8d5c-478d-8908-1784c0a9d650) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:20:17 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-e743cca9-abcb-408a-b5ea-a4b163bf64e8 tempest-SnapshotDependencyTests-1405016702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6339b28e-8d5c-478d-8908-1784c0a9d650) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:20:18Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ff6d444-9385-4cf8-933a-5ae60c64d832,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a0f85c1cbf44db1a37d73b9094c8993',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:20:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=cef94ea7-fefc-4735-9e5a-fc3dbfd9f534,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:20:18Z,use_quota=True,user_id='338eaabf46524a8a9d145ff5270e952d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3a092cd-7947-4cbf-abff-4ba9567becf0),volume_type_id=f3a092cd-7947-4cbf-abff-4ba9567becf0)' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:20:17 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-e743cca9-abcb-408a-b5ea-a4b163bf64e8 tempest-SnapshotDependencyTests-1405016702 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf0bf41f-e1ae-47de-aaf6-0e2628559168) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:20:17 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-e743cca9-abcb-408a-b5ea-a4b163bf64e8 tempest-SnapshotDependencyTests-1405016702 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf0bf41f-e1ae-47de-aaf6-0e2628559168) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:20:17 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-e743cca9-abcb-408a-b5ea-a4b163bf64e8 tempest-SnapshotDependencyTests-1405016702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf00aa02-599e-4071-8141-d409ebaaeda1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:20:17 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-e743cca9-abcb-408a-b5ea-a4b163bf64e8 tempest-SnapshotDependencyTests-1405016702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf00aa02-599e-4071-8141-d409ebaaeda1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '5ff6d444-9385-4cf8-933a-5ae60c64d832', 'volume_name': 'volume-5ff6d444-9385-4cf8-933a-5ae60c64d832', 'volume_size': 1, 'snapshot_id': 'cef94ea7-fefc-4735-9e5a-fc3dbfd9f534'}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:20:17 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-e743cca9-abcb-408a-b5ea-a4b163bf64e8 tempest-SnapshotDependencyTests-1405016702 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93cf3b7e-ed1e-458a-b2da-375e447e1465) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:20:18 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-e743cca9-abcb-408a-b5ea-a4b163bf64e8 tempest-SnapshotDependencyTests-1405016702 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93cf3b7e-ed1e-458a-b2da-375e447e1465) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:20:18 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-e743cca9-abcb-408a-b5ea-a4b163bf64e8 tempest-SnapshotDependencyTests-1405016702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8650ac5-04ee-4d66-b353-a72ee0123284) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:20:18 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-e743cca9-abcb-408a-b5ea-a4b163bf64e8 tempest-SnapshotDependencyTests-1405016702 None] Volume 5ff6d444-9385-4cf8-933a-5ae60c64d832: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-5ff6d444-9385-4cf8-933a-5ae60c64d832', 'volume_size': 1, 'snapshot_id': 'cef94ea7-fefc-4735-9e5a-fc3dbfd9f534'} Sep 07 10:20:18 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-e743cca9-abcb-408a-b5ea-a4b163bf64e8 tempest-SnapshotDependencyTests-1405016702 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:20:18 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-e743cca9-abcb-408a-b5ea-a4b163bf64e8 tempest-SnapshotDependencyTests-1405016702 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:20:18 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-e743cca9-abcb-408a-b5ea-a4b163bf64e8 tempest-SnapshotDependencyTests-1405016702 None] Acquiring lock "cinder-quobyte-cef94ea7-fefc-4735-9e5a-fc3dbfd9f534-5ff6d444-9385-4cf8-933a-5ae60c64d832" by "_create_volume_from_snapshot" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:20:18 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-e743cca9-abcb-408a-b5ea-a4b163bf64e8 tempest-SnapshotDependencyTests-1405016702 None] Lock "cinder-quobyte-cef94ea7-fefc-4735-9e5a-fc3dbfd9f534-5ff6d444-9385-4cf8-933a-5ae60c64d832" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:20:18 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-e743cca9-abcb-408a-b5ea-a4b163bf64e8 tempest-SnapshotDependencyTests-1405016702 None] Creating volume 5ff6d444-9385-4cf8-933a-5ae60c64d832 from snapshot cef94ea7-fefc-4735-9e5a-fc3dbfd9f534 {{(pid=87515) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 07 10:20:18 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-e743cca9-abcb-408a-b5ea-a4b163bf64e8 tempest-SnapshotDependencyTests-1405016702 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:20:18 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-e743cca9-abcb-408a-b5ea-a4b163bf64e8 tempest-SnapshotDependencyTests-1405016702 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:20:18 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-e743cca9-abcb-408a-b5ea-a4b163bf64e8 tempest-SnapshotDependencyTests-1405016702 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:20:18 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-e743cca9-abcb-408a-b5ea-a4b163bf64e8 tempest-SnapshotDependencyTests-1405016702 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:20:18 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-e743cca9-abcb-408a-b5ea-a4b163bf64e8 tempest-SnapshotDependencyTests-1405016702 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:20:18 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-e743cca9-abcb-408a-b5ea-a4b163bf64e8 tempest-SnapshotDependencyTests-1405016702 None] Selected osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c as target Quobyte volume. {{(pid=87515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 10:20:18 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-e743cca9-abcb-408a-b5ea-a4b163bf64e8 tempest-SnapshotDependencyTests-1405016702 None] Acquiring lock "cinder-quobyte-5ff6d444-9385-4cf8-933a-5ae60c64d832" by "_copy_volume_from_snapshot" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:20:18 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-e743cca9-abcb-408a-b5ea-a4b163bf64e8 tempest-SnapshotDependencyTests-1405016702 None] Lock "cinder-quobyte-5ff6d444-9385-4cf8-933a-5ae60c64d832" acquired by "_copy_volume_from_snapshot" :: waited 0.022s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:20:18 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-e743cca9-abcb-408a-b5ea-a4b163bf64e8 tempest-SnapshotDependencyTests-1405016702 None] snapshot: cef94ea7-fefc-4735-9e5a-fc3dbfd9f534, volume: 5ff6d444-9385-4cf8-933a-5ae60c64d832, {{(pid=87515) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 07 10:20:18 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-e743cca9-abcb-408a-b5ea-a4b163bf64e8 tempest-SnapshotDependencyTests-1405016702 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:20:18 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-e743cca9-abcb-408a-b5ea-a4b163bf64e8 tempest-SnapshotDependencyTests-1405016702 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:20:18 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-e743cca9-abcb-408a-b5ea-a4b163bf64e8 tempest-SnapshotDependencyTests-1405016702 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:20:18 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-e743cca9-abcb-408a-b5ea-a4b163bf64e8 tempest-SnapshotDependencyTests-1405016702 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:20:18 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-e743cca9-abcb-408a-b5ea-a4b163bf64e8 tempest-SnapshotDependencyTests-1405016702 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:20:18 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4d954e7-7c55-4856-b9fb-0bca2faba635]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:20:18 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-e743cca9-abcb-408a-b5ea-a4b163bf64e8 tempest-SnapshotDependencyTests-1405016702 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-cbb9b9d6-9f8b-4c15-b4c6-7797e78e2b98.cef94ea7-fefc-4735-9e5a-fc3dbfd9f534 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:20:18 devstack sudo[108532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-cbb9b9d6-9f8b-4c15-b4c6-7797e78e2b98.cef94ea7-fefc-4735-9e5a-fc3dbfd9f534 Sep 07 10:20:18 devstack sudo[108532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:20:18 devstack sudo[108532]: pam_unix(sudo:session): session closed for user root Sep 07 10:20:18 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-e743cca9-abcb-408a-b5ea-a4b163bf64e8 tempest-SnapshotDependencyTests-1405016702 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-cbb9b9d6-9f8b-4c15-b4c6-7797e78e2b98.cef94ea7-fefc-4735-9e5a-fc3dbfd9f534" returned: 0 in 0.382s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:20:18 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-e743cca9-abcb-408a-b5ea-a4b163bf64e8 tempest-SnapshotDependencyTests-1405016702 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cbb9b9d6-9f8b-4c15-b4c6-7797e78e2b98(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87515) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 10:20:18 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ffcba72-3a7b-494c-aac8-cd3ae92e81f8]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:20:18 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-e743cca9-abcb-408a-b5ea-a4b163bf64e8 tempest-SnapshotDependencyTests-1405016702 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-cbb9b9d6-9f8b-4c15-b4c6-7797e78e2b98 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:20:18 devstack sudo[108537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-cbb9b9d6-9f8b-4c15-b4c6-7797e78e2b98 Sep 07 10:20:18 devstack sudo[108537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:20:18 devstack sudo[108537]: pam_unix(sudo:session): session closed for user root Sep 07 10:20:18 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-e743cca9-abcb-408a-b5ea-a4b163bf64e8 tempest-SnapshotDependencyTests-1405016702 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-cbb9b9d6-9f8b-4c15-b4c6-7797e78e2b98" returned: 0 in 0.375s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:20:18 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-e743cca9-abcb-408a-b5ea-a4b163bf64e8 tempest-SnapshotDependencyTests-1405016702 None] will copy from snapshot at /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-cbb9b9d6-9f8b-4c15-b4c6-7797e78e2b98 {{(pid=87515) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 07 10:20:18 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-e743cca9-abcb-408a-b5ea-a4b163bf64e8 tempest-SnapshotDependencyTests-1405016702 None] Creating direct copy from snapshot {{(pid=87515) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 07 10:20:18 devstack cinder-volume[87515]: DEBUG cinder.utils [None req-e743cca9-abcb-408a-b5ea-a4b163bf64e8 tempest-SnapshotDependencyTests-1405016702 None] Path /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-5ff6d444-9385-4cf8-933a-5ae60c64d832 not found in is_blk_device check {{(pid=87515) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 07 10:20:18 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-e743cca9-abcb-408a-b5ea-a4b163bf64e8 tempest-SnapshotDependencyTests-1405016702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-cbb9b9d6-9f8b-4c15-b4c6-7797e78e2b98 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-5ff6d444-9385-4cf8-933a-5ae60c64d832 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:20:18 devstack sudo[108542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-cbb9b9d6-9f8b-4c15-b4c6-7797e78e2b98 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-5ff6d444-9385-4cf8-933a-5ae60c64d832 Sep 07 10:20:18 devstack sudo[108542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:20:23 devstack sudo[108542]: pam_unix(sudo:session): session closed for user root Sep 07 10:20:23 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-e743cca9-abcb-408a-b5ea-a4b163bf64e8 tempest-SnapshotDependencyTests-1405016702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-cbb9b9d6-9f8b-4c15-b4c6-7797e78e2b98 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-5ff6d444-9385-4cf8-933a-5ae60c64d832" returned: 0 in 4.879s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:20:23 devstack cinder-volume[87515]: DEBUG cinder.image.image_utils [None req-e743cca9-abcb-408a-b5ea-a4b163bf64e8 tempest-SnapshotDependencyTests-1405016702 None] Image conversion details: src /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-cbb9b9d6-9f8b-4c15-b4c6-7797e78e2b98, size 1024.00 MB, duration 4.88 sec, destination /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-5ff6d444-9385-4cf8-933a-5ae60c64d832 {{(pid=87515) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 07 10:20:23 devstack cinder-volume[87515]: INFO cinder.image.image_utils [None req-e743cca9-abcb-408a-b5ea-a4b163bf64e8 tempest-SnapshotDependencyTests-1405016702 None] Converted 1024.00 MB image at 209.82 MB/s Sep 07 10:20:23 devstack cinder-volume[87515]: WARNING cinder.volume.drivers.remotefs [None req-e743cca9-abcb-408a-b5ea-a4b163bf64e8 tempest-SnapshotDependencyTests-1405016702 None] /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-5ff6d444-9385-4cf8-933a-5ae60c64d832 is being set with open permissions: ugo+rw Sep 07 10:20:23 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-e743cca9-abcb-408a-b5ea-a4b163bf64e8 tempest-SnapshotDependencyTests-1405016702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-5ff6d444-9385-4cf8-933a-5ae60c64d832 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:20:23 devstack sudo[108556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-5ff6d444-9385-4cf8-933a-5ae60c64d832 Sep 07 10:20:23 devstack sudo[108556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:20:24 devstack sudo[108556]: pam_unix(sudo:session): session closed for user root Sep 07 10:20:24 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-e743cca9-abcb-408a-b5ea-a4b163bf64e8 tempest-SnapshotDependencyTests-1405016702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-5ff6d444-9385-4cf8-933a-5ae60c64d832" returned: 0 in 0.266s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:20:24 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-e743cca9-abcb-408a-b5ea-a4b163bf64e8 tempest-SnapshotDependencyTests-1405016702 None] Lock "cinder-quobyte-5ff6d444-9385-4cf8-933a-5ae60c64d832" released by "_copy_volume_from_snapshot" :: held 5.990s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:20:24 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-e743cca9-abcb-408a-b5ea-a4b163bf64e8 tempest-SnapshotDependencyTests-1405016702 None] Lock "cinder-quobyte-cef94ea7-fefc-4735-9e5a-fc3dbfd9f534-5ff6d444-9385-4cf8-933a-5ae60c64d832" released by "_create_volume_from_snapshot" :: held 6.079s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:20:24 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-e743cca9-abcb-408a-b5ea-a4b163bf64e8 tempest-SnapshotDependencyTests-1405016702 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.096s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:20:24 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-e743cca9-abcb-408a-b5ea-a4b163bf64e8 tempest-SnapshotDependencyTests-1405016702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8650ac5-04ee-4d66-b353-a72ee0123284) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5ff6d444-9385-4cf8-933a-5ae60c64d832', 'volume_size': 1, 'snapshot_id': 'cef94ea7-fefc-4735-9e5a-fc3dbfd9f534'}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:20:24 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-e743cca9-abcb-408a-b5ea-a4b163bf64e8 tempest-SnapshotDependencyTests-1405016702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a6c1f77-78d1-4b41-9fd4-87bf9f03d233) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:20:24 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-e743cca9-abcb-408a-b5ea-a4b163bf64e8 tempest-SnapshotDependencyTests-1405016702 None] Volume volume-5ff6d444-9385-4cf8-933a-5ae60c64d832 (5ff6d444-9385-4cf8-933a-5ae60c64d832): created successfully Sep 07 10:20:24 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-e743cca9-abcb-408a-b5ea-a4b163bf64e8 tempest-SnapshotDependencyTests-1405016702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a6c1f77-78d1-4b41-9fd4-87bf9f03d233) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:20:24 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-e743cca9-abcb-408a-b5ea-a4b163bf64e8 tempest-SnapshotDependencyTests-1405016702 None] Flow 'volume_create_manager' (e00d845e-47b0-4523-8b51-253e8f722bff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:20:24 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-e743cca9-abcb-408a-b5ea-a4b163bf64e8 tempest-SnapshotDependencyTests-1405016702 None] Created volume successfully. Sep 07 10:20:24 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-21c54bb3-c8d0-4e53-a959-780bbadeb08d tempest-SnapshotDependencyTests-1405016702 None] Acquiring lock "cinder-cef94ea7-fefc-4735-9e5a-fc3dbfd9f534-delete_snapshot" by "delete_snapshot" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:20:24 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-21c54bb3-c8d0-4e53-a959-780bbadeb08d tempest-SnapshotDependencyTests-1405016702 None] Lock "cinder-cef94ea7-fefc-4735-9e5a-fc3dbfd9f534-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:20:24 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-21c54bb3-c8d0-4e53-a959-780bbadeb08d tempest-SnapshotDependencyTests-1405016702 None] Acquiring lock "cinder-quobyte-cbb9b9d6-9f8b-4c15-b4c6-7797e78e2b98" by "delete_snapshot" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:20:24 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-21c54bb3-c8d0-4e53-a959-780bbadeb08d tempest-SnapshotDependencyTests-1405016702 None] Lock "cinder-quobyte-cbb9b9d6-9f8b-4c15-b4c6-7797e78e2b98" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:20:24 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-21c54bb3-c8d0-4e53-a959-780bbadeb08d tempest-SnapshotDependencyTests-1405016702 None] Acquiring lock "cinder-quobyte-cef94ea7-fefc-4735-9e5a-fc3dbfd9f534" by "_delete_snapshot" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:20:24 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-21c54bb3-c8d0-4e53-a959-780bbadeb08d tempest-SnapshotDependencyTests-1405016702 None] Lock "cinder-quobyte-cef94ea7-fefc-4735-9e5a-fc3dbfd9f534" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:20:24 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-21c54bb3-c8d0-4e53-a959-780bbadeb08d tempest-SnapshotDependencyTests-1405016702 None] Deleting offline snapshot cef94ea7-fefc-4735-9e5a-fc3dbfd9f534 of volume cbb9b9d6-9f8b-4c15-b4c6-7797e78e2b98 {{(pid=87515) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 10:20:24 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-21c54bb3-c8d0-4e53-a959-780bbadeb08d tempest-SnapshotDependencyTests-1405016702 None] snapshot_file for this snap is: volume-cbb9b9d6-9f8b-4c15-b4c6-7797e78e2b98.cef94ea7-fefc-4735-9e5a-fc3dbfd9f534 {{(pid=87515) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 10:20:24 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[48d6ee4c-1756-48aa-ba03-a5ae533dff53]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:20:24 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-21c54bb3-c8d0-4e53-a959-780bbadeb08d tempest-SnapshotDependencyTests-1405016702 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-cbb9b9d6-9f8b-4c15-b4c6-7797e78e2b98.cef94ea7-fefc-4735-9e5a-fc3dbfd9f534 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:20:24 devstack sudo[108559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-cbb9b9d6-9f8b-4c15-b4c6-7797e78e2b98.cef94ea7-fefc-4735-9e5a-fc3dbfd9f534 Sep 07 10:20:24 devstack sudo[108559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:20:25 devstack sudo[108559]: pam_unix(sudo:session): session closed for user root Sep 07 10:20:25 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-21c54bb3-c8d0-4e53-a959-780bbadeb08d tempest-SnapshotDependencyTests-1405016702 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-cbb9b9d6-9f8b-4c15-b4c6-7797e78e2b98.cef94ea7-fefc-4735-9e5a-fc3dbfd9f534" returned: 0 in 0.389s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:20:25 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-21c54bb3-c8d0-4e53-a959-780bbadeb08d tempest-SnapshotDependencyTests-1405016702 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cbb9b9d6-9f8b-4c15-b4c6-7797e78e2b98(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87515) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 10:20:25 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[14a98296-db47-47bc-8a6d-72538029f126]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:20:25 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-21c54bb3-c8d0-4e53-a959-780bbadeb08d tempest-SnapshotDependencyTests-1405016702 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-cbb9b9d6-9f8b-4c15-b4c6-7797e78e2b98 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:20:25 devstack sudo[108564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-cbb9b9d6-9f8b-4c15-b4c6-7797e78e2b98 Sep 07 10:20:25 devstack sudo[108564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:20:25 devstack sudo[108564]: pam_unix(sudo:session): session closed for user root Sep 07 10:20:25 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-21c54bb3-c8d0-4e53-a959-780bbadeb08d tempest-SnapshotDependencyTests-1405016702 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-cbb9b9d6-9f8b-4c15-b4c6-7797e78e2b98" returned: 0 in 0.590s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:20:25 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-21c54bb3-c8d0-4e53-a959-780bbadeb08d tempest-SnapshotDependencyTests-1405016702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-cbb9b9d6-9f8b-4c15-b4c6-7797e78e2b98.cef94ea7-fefc-4735-9e5a-fc3dbfd9f534 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:20:25 devstack sudo[108570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-cbb9b9d6-9f8b-4c15-b4c6-7797e78e2b98.cef94ea7-fefc-4735-9e5a-fc3dbfd9f534 Sep 07 10:20:25 devstack sudo[108570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:20:26 devstack sudo[108570]: pam_unix(sudo:session): session closed for user root Sep 07 10:20:26 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-21c54bb3-c8d0-4e53-a959-780bbadeb08d tempest-SnapshotDependencyTests-1405016702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-cbb9b9d6-9f8b-4c15-b4c6-7797e78e2b98.cef94ea7-fefc-4735-9e5a-fc3dbfd9f534" returned: 0 in 0.402s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:20:26 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-21c54bb3-c8d0-4e53-a959-780bbadeb08d tempest-SnapshotDependencyTests-1405016702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-cbb9b9d6-9f8b-4c15-b4c6-7797e78e2b98.cef94ea7-fefc-4735-9e5a-fc3dbfd9f534 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:20:26 devstack sudo[108575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-cbb9b9d6-9f8b-4c15-b4c6-7797e78e2b98.cef94ea7-fefc-4735-9e5a-fc3dbfd9f534 Sep 07 10:20:26 devstack sudo[108575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:20:26 devstack sudo[108575]: pam_unix(sudo:session): session closed for user root Sep 07 10:20:26 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-21c54bb3-c8d0-4e53-a959-780bbadeb08d tempest-SnapshotDependencyTests-1405016702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-cbb9b9d6-9f8b-4c15-b4c6-7797e78e2b98.cef94ea7-fefc-4735-9e5a-fc3dbfd9f534" returned: 0 in 0.259s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:20:26 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-21c54bb3-c8d0-4e53-a959-780bbadeb08d tempest-SnapshotDependencyTests-1405016702 None] Lock "cinder-quobyte-cef94ea7-fefc-4735-9e5a-fc3dbfd9f534" released by "_delete_snapshot" :: held 1.748s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:20:26 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-21c54bb3-c8d0-4e53-a959-780bbadeb08d tempest-SnapshotDependencyTests-1405016702 None] Lock "cinder-quobyte-cbb9b9d6-9f8b-4c15-b4c6-7797e78e2b98" released by "delete_snapshot" :: held 1.769s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:20:26 devstack cinder-volume[87515]: DEBUG cinder.quota [None req-21c54bb3-c8d0-4e53-a959-780bbadeb08d tempest-SnapshotDependencyTests-1405016702 None] Created reservations ['28242e95-55c7-4107-9219-5830b3af2fdd', 'a56ea0d2-356a-4a3c-ba52-a6c20fb4d2ef', '1445d638-1b82-4d51-9c34-9e8988c2b16d', '31d1d522-e2c9-4f04-b211-7378eb98be3b'] {{(pid=87515) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:20:26 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-21c54bb3-c8d0-4e53-a959-780bbadeb08d tempest-SnapshotDependencyTests-1405016702 None] Delete snapshot completed successfully. Sep 07 10:20:26 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-21c54bb3-c8d0-4e53-a959-780bbadeb08d tempest-SnapshotDependencyTests-1405016702 None] Lock "cinder-cef94ea7-fefc-4735-9e5a-fc3dbfd9f534-delete_snapshot" released by "delete_snapshot" :: held 1.919s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:20:26 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-5c2aaeb1-899a-4358-bd29-6c47202081e2 tempest-SnapshotDependencyTests-1405016702 None] Acquiring lock "cinder-cbb9b9d6-9f8b-4c15-b4c6-7797e78e2b98-delete_volume" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:20:26 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-5c2aaeb1-899a-4358-bd29-6c47202081e2 tempest-SnapshotDependencyTests-1405016702 None] Lock "cinder-cbb9b9d6-9f8b-4c15-b4c6-7797e78e2b98-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:20:26 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-5c2aaeb1-899a-4358-bd29-6c47202081e2 tempest-SnapshotDependencyTests-1405016702 None] Acquiring lock "cinder-quobyte-cbb9b9d6-9f8b-4c15-b4c6-7797e78e2b98" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:20:26 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-5c2aaeb1-899a-4358-bd29-6c47202081e2 tempest-SnapshotDependencyTests-1405016702 None] Lock "cinder-quobyte-cbb9b9d6-9f8b-4c15-b4c6-7797e78e2b98" acquired by "delete_volume" :: waited 0.016s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:20:26 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cfc92b7-fc0c-4d3d-b0d3-d69c86f42d6e]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:20:26 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-5c2aaeb1-899a-4358-bd29-6c47202081e2 tempest-SnapshotDependencyTests-1405016702 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-cbb9b9d6-9f8b-4c15-b4c6-7797e78e2b98 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:20:27 devstack sudo[108578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-cbb9b9d6-9f8b-4c15-b4c6-7797e78e2b98 Sep 07 10:20:27 devstack sudo[108578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:20:27 devstack sudo[108578]: pam_unix(sudo:session): session closed for user root Sep 07 10:20:27 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-5c2aaeb1-899a-4358-bd29-6c47202081e2 tempest-SnapshotDependencyTests-1405016702 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-cbb9b9d6-9f8b-4c15-b4c6-7797e78e2b98" returned: 0 in 0.356s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:20:27 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-5c2aaeb1-899a-4358-bd29-6c47202081e2 tempest-SnapshotDependencyTests-1405016702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-cbb9b9d6-9f8b-4c15-b4c6-7797e78e2b98 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:20:27 devstack sudo[108583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-cbb9b9d6-9f8b-4c15-b4c6-7797e78e2b98 Sep 07 10:20:27 devstack sudo[108583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:20:27 devstack sudo[108583]: pam_unix(sudo:session): session closed for user root Sep 07 10:20:27 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-5c2aaeb1-899a-4358-bd29-6c47202081e2 tempest-SnapshotDependencyTests-1405016702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-cbb9b9d6-9f8b-4c15-b4c6-7797e78e2b98" returned: 0 in 0.260s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:20:27 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-5c2aaeb1-899a-4358-bd29-6c47202081e2 tempest-SnapshotDependencyTests-1405016702 None] Lock "cinder-quobyte-cbb9b9d6-9f8b-4c15-b4c6-7797e78e2b98" released by "delete_volume" :: held 0.686s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:20:27 devstack cinder-volume[87515]: DEBUG cinder.quota [None req-5c2aaeb1-899a-4358-bd29-6c47202081e2 tempest-SnapshotDependencyTests-1405016702 None] Created reservations ['b229f98d-f35a-40dc-9af6-e0b6ee2b37a6', 'eb0c1cc7-a1d7-43e0-bbeb-72e89067552b', '44f1d1da-244a-479c-a5dd-ad16c1cc7575', '8e444c58-c3ce-4d90-8d92-e811eb028953'] {{(pid=87515) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:20:27 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-5c2aaeb1-899a-4358-bd29-6c47202081e2 tempest-SnapshotDependencyTests-1405016702 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:20:27 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-5c2aaeb1-899a-4358-bd29-6c47202081e2 tempest-SnapshotDependencyTests-1405016702 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:20:27 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-5c2aaeb1-899a-4358-bd29-6c47202081e2 tempest-SnapshotDependencyTests-1405016702 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:20:27 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-5c2aaeb1-899a-4358-bd29-6c47202081e2 tempest-SnapshotDependencyTests-1405016702 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:20:27 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-5c2aaeb1-899a-4358-bd29-6c47202081e2 tempest-SnapshotDependencyTests-1405016702 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:20:27 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-5c2aaeb1-899a-4358-bd29-6c47202081e2 tempest-SnapshotDependencyTests-1405016702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:20:27 devstack sudo[108586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a Sep 07 10:20:27 devstack sudo[108586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:20:27 devstack cinder-volume[87515]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a74f61f-f8be-4006-8624-eae495875105 tempest-ProjectReaderTests-673922549 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 10:20:27 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-0a74f61f-f8be-4006-8624-eae495875105 tempest-ProjectReaderTests-673922549 None] Flow 'volume_create_manager' (0f31f08c-f848-4682-9831-158003f513b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:20:27 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-0a74f61f-f8be-4006-8624-eae495875105 tempest-ProjectReaderTests-673922549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cce74c3e-28b8-49fd-bde3-03f022ff2d31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:20:27 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-0a74f61f-f8be-4006-8624-eae495875105 tempest-ProjectReaderTests-673922549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cce74c3e-28b8-49fd-bde3-03f022ff2d31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:20:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1833439496',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2150c78-c843-4865-adc0-7a3b0a508956,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b28303741af24f3e91b6d8bc9b5ef76b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:20:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:20:28Z,use_quota=True,user_id='b2c3f0b0c5b447e6bd7b8d0530f0f7cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3a092cd-7947-4cbf-abff-4ba9567becf0),volume_type_id=f3a092cd-7947-4cbf-abff-4ba9567becf0)' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:20:27 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-0a74f61f-f8be-4006-8624-eae495875105 tempest-ProjectReaderTests-673922549 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ff38178-7c1a-4a95-9776-7e213f7e6a5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:20:27 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-0a74f61f-f8be-4006-8624-eae495875105 tempest-ProjectReaderTests-673922549 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ff38178-7c1a-4a95-9776-7e213f7e6a5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:20:27 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-0a74f61f-f8be-4006-8624-eae495875105 tempest-ProjectReaderTests-673922549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d33394cf-97ae-4ff4-900e-7f73f0172aa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:20:27 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-0a74f61f-f8be-4006-8624-eae495875105 tempest-ProjectReaderTests-673922549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d33394cf-97ae-4ff4-900e-7f73f0172aa7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd2150c78-c843-4865-adc0-7a3b0a508956', 'volume_name': 'volume-d2150c78-c843-4865-adc0-7a3b0a508956', 'volume_size': 1}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:20:27 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-0a74f61f-f8be-4006-8624-eae495875105 tempest-ProjectReaderTests-673922549 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bfc9cb08-2afa-4a89-9f9b-f0f035e50cfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:20:27 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-0a74f61f-f8be-4006-8624-eae495875105 tempest-ProjectReaderTests-673922549 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bfc9cb08-2afa-4a89-9f9b-f0f035e50cfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:20:27 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-0a74f61f-f8be-4006-8624-eae495875105 tempest-ProjectReaderTests-673922549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0efdee1f-0fdf-4e70-b780-8483509e76e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:20:27 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-0a74f61f-f8be-4006-8624-eae495875105 tempest-ProjectReaderTests-673922549 None] Volume d2150c78-c843-4865-adc0-7a3b0a508956: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d2150c78-c843-4865-adc0-7a3b0a508956', 'volume_size': 1} Sep 07 10:20:27 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-0a74f61f-f8be-4006-8624-eae495875105 tempest-ProjectReaderTests-673922549 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:20:27 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-0a74f61f-f8be-4006-8624-eae495875105 tempest-ProjectReaderTests-673922549 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:20:27 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-0a74f61f-f8be-4006-8624-eae495875105 tempest-ProjectReaderTests-673922549 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:20:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1833439496',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2150c78-c843-4865-adc0-7a3b0a508956,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b28303741af24f3e91b6d8bc9b5ef76b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:20:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:20:28Z,use_quota=True,user_id='b2c3f0b0c5b447e6bd7b8d0530f0f7cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3a092cd-7947-4cbf-abff-4ba9567becf0),volume_type_id=f3a092cd-7947-4cbf-abff-4ba9567becf0)}" {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 10:20:27 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-0a74f61f-f8be-4006-8624-eae495875105 tempest-ProjectReaderTests-673922549 None] Creating volume d2150c78-c843-4865-adc0-7a3b0a508956 {{(pid=87515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 10:20:27 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-0a74f61f-f8be-4006-8624-eae495875105 tempest-ProjectReaderTests-673922549 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:20:27 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-0a74f61f-f8be-4006-8624-eae495875105 tempest-ProjectReaderTests-673922549 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:20:27 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-0a74f61f-f8be-4006-8624-eae495875105 tempest-ProjectReaderTests-673922549 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:20:27 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-0a74f61f-f8be-4006-8624-eae495875105 tempest-ProjectReaderTests-673922549 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:20:27 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-0a74f61f-f8be-4006-8624-eae495875105 tempest-ProjectReaderTests-673922549 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:20:27 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-0a74f61f-f8be-4006-8624-eae495875105 tempest-ProjectReaderTests-673922549 None] Selected osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c as target Quobyte volume. {{(pid=87515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 10:20:27 devstack cinder-volume[87515]: INFO cinder.volume.drivers.remotefs [None req-0a74f61f-f8be-4006-8624-eae495875105 tempest-ProjectReaderTests-673922549 None] casted to osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c Sep 07 10:20:27 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-0a74f61f-f8be-4006-8624-eae495875105 tempest-ProjectReaderTests-673922549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-d2150c78-c843-4865-adc0-7a3b0a508956 1073741824 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:20:27 devstack sudo[108588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-d2150c78-c843-4865-adc0-7a3b0a508956 1073741824 Sep 07 10:20:27 devstack sudo[108588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:20:27 devstack sudo[108586]: pam_unix(sudo:session): session closed for user root Sep 07 10:20:27 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-5c2aaeb1-899a-4358-bd29-6c47202081e2 tempest-SnapshotDependencyTests-1405016702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a" returned: 0 in 0.255s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:20:27 devstack cinder-volume[87515]: DEBUG cinder.manager [None req-5c2aaeb1-899a-4358-bd29-6c47202081e2 tempest-SnapshotDependencyTests-1405016702 None] Notifying Schedulers of capabilities ... {{(pid=87515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:20:27 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-5c2aaeb1-899a-4358-bd29-6c47202081e2 tempest-SnapshotDependencyTests-1405016702 None] Deleted volume successfully. Sep 07 10:20:27 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-5c2aaeb1-899a-4358-bd29-6c47202081e2 tempest-SnapshotDependencyTests-1405016702 None] Lock "cinder-cbb9b9d6-9f8b-4c15-b4c6-7797e78e2b98-delete_volume" released by "delete_volume" :: held 1.160s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:20:27 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-9fc4af05-d33f-40c6-9f19-a1b5deed8da9 tempest-SnapshotDependencyTests-1405016702 None] Acquiring lock "cinder-5ff6d444-9385-4cf8-933a-5ae60c64d832-delete_volume" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:20:27 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-9fc4af05-d33f-40c6-9f19-a1b5deed8da9 tempest-SnapshotDependencyTests-1405016702 None] Lock "cinder-5ff6d444-9385-4cf8-933a-5ae60c64d832-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:20:28 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-9fc4af05-d33f-40c6-9f19-a1b5deed8da9 tempest-SnapshotDependencyTests-1405016702 None] Acquiring lock "cinder-quobyte-5ff6d444-9385-4cf8-933a-5ae60c64d832" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:20:28 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-9fc4af05-d33f-40c6-9f19-a1b5deed8da9 tempest-SnapshotDependencyTests-1405016702 None] Lock "cinder-quobyte-5ff6d444-9385-4cf8-933a-5ae60c64d832" acquired by "delete_volume" :: waited 0.017s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:20:28 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f289b9b-215e-4269-a3ba-e07c4fae0f2e]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:20:28 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-9fc4af05-d33f-40c6-9f19-a1b5deed8da9 tempest-SnapshotDependencyTests-1405016702 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-5ff6d444-9385-4cf8-933a-5ae60c64d832 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:20:28 devstack sudo[108593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-5ff6d444-9385-4cf8-933a-5ae60c64d832 Sep 07 10:20:28 devstack sudo[108593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:20:28 devstack sudo[108588]: pam_unix(sudo:session): session closed for user root Sep 07 10:20:28 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-0a74f61f-f8be-4006-8624-eae495875105 tempest-ProjectReaderTests-673922549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-d2150c78-c843-4865-adc0-7a3b0a508956 1073741824" returned: 0 in 0.471s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:20:28 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-0a74f61f-f8be-4006-8624-eae495875105 tempest-ProjectReaderTests-673922549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-d2150c78-c843-4865-adc0-7a3b0a508956 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:20:28 devstack sudo[108596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-d2150c78-c843-4865-adc0-7a3b0a508956 Sep 07 10:20:28 devstack sudo[108596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:20:28 devstack sudo[108593]: pam_unix(sudo:session): session closed for user root Sep 07 10:20:28 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-9fc4af05-d33f-40c6-9f19-a1b5deed8da9 tempest-SnapshotDependencyTests-1405016702 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-5ff6d444-9385-4cf8-933a-5ae60c64d832" returned: 0 in 0.392s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:20:28 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-9fc4af05-d33f-40c6-9f19-a1b5deed8da9 tempest-SnapshotDependencyTests-1405016702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-5ff6d444-9385-4cf8-933a-5ae60c64d832 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:20:28 devstack sudo[108601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-5ff6d444-9385-4cf8-933a-5ae60c64d832 Sep 07 10:20:28 devstack sudo[108601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:20:28 devstack sudo[108596]: pam_unix(sudo:session): session closed for user root Sep 07 10:20:28 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-0a74f61f-f8be-4006-8624-eae495875105 tempest-ProjectReaderTests-673922549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-d2150c78-c843-4865-adc0-7a3b0a508956" returned: 0 in 0.252s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:20:28 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-0a74f61f-f8be-4006-8624-eae495875105 tempest-ProjectReaderTests-673922549 None] <== create_volume: return (764ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'} {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 10:20:28 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-0a74f61f-f8be-4006-8624-eae495875105 tempest-ProjectReaderTests-673922549 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.766s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:20:28 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-0a74f61f-f8be-4006-8624-eae495875105 tempest-ProjectReaderTests-673922549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0efdee1f-0fdf-4e70-b780-8483509e76e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d2150c78-c843-4865-adc0-7a3b0a508956', 'volume_size': 1}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:20:28 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-0a74f61f-f8be-4006-8624-eae495875105 tempest-ProjectReaderTests-673922549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2daa23e-d835-4556-8b8d-e4132e7172e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:20:28 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-0a74f61f-f8be-4006-8624-eae495875105 tempest-ProjectReaderTests-673922549 None] Volume volume-d2150c78-c843-4865-adc0-7a3b0a508956 (d2150c78-c843-4865-adc0-7a3b0a508956): created successfully Sep 07 10:20:28 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-0a74f61f-f8be-4006-8624-eae495875105 tempest-ProjectReaderTests-673922549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2daa23e-d835-4556-8b8d-e4132e7172e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:20:28 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-0a74f61f-f8be-4006-8624-eae495875105 tempest-ProjectReaderTests-673922549 None] Flow 'volume_create_manager' (0f31f08c-f848-4682-9831-158003f513b1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:20:28 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-0a74f61f-f8be-4006-8624-eae495875105 tempest-ProjectReaderTests-673922549 None] Created volume successfully. Sep 07 10:20:28 devstack sudo[108601]: pam_unix(sudo:session): session closed for user root Sep 07 10:20:28 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-9fc4af05-d33f-40c6-9f19-a1b5deed8da9 tempest-SnapshotDependencyTests-1405016702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-5ff6d444-9385-4cf8-933a-5ae60c64d832" returned: 0 in 0.244s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:20:28 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-9fc4af05-d33f-40c6-9f19-a1b5deed8da9 tempest-SnapshotDependencyTests-1405016702 None] Lock "cinder-quobyte-5ff6d444-9385-4cf8-933a-5ae60c64d832" released by "delete_volume" :: held 0.676s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:20:28 devstack cinder-volume[87515]: DEBUG cinder.quota [None req-9fc4af05-d33f-40c6-9f19-a1b5deed8da9 tempest-SnapshotDependencyTests-1405016702 None] Created reservations ['8abd93ad-ae7f-4b15-a936-25bee8a2218e', '9f535e3d-5261-45c2-ba67-91fd85f74743', '8f47821a-488e-40eb-bf17-9fb399a3fa4e', '60511c97-a224-45ba-9f7d-ff255d1b0f88'] {{(pid=87515) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:20:28 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-9fc4af05-d33f-40c6-9f19-a1b5deed8da9 tempest-SnapshotDependencyTests-1405016702 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:20:28 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-9fc4af05-d33f-40c6-9f19-a1b5deed8da9 tempest-SnapshotDependencyTests-1405016702 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:20:28 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-9fc4af05-d33f-40c6-9f19-a1b5deed8da9 tempest-SnapshotDependencyTests-1405016702 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:20:28 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-9fc4af05-d33f-40c6-9f19-a1b5deed8da9 tempest-SnapshotDependencyTests-1405016702 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:20:28 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-9fc4af05-d33f-40c6-9f19-a1b5deed8da9 tempest-SnapshotDependencyTests-1405016702 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:20:28 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-9fc4af05-d33f-40c6-9f19-a1b5deed8da9 tempest-SnapshotDependencyTests-1405016702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:20:28 devstack sudo[108605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a Sep 07 10:20:28 devstack sudo[108605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:20:29 devstack sudo[108605]: pam_unix(sudo:session): session closed for user root Sep 07 10:20:29 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-9fc4af05-d33f-40c6-9f19-a1b5deed8da9 tempest-SnapshotDependencyTests-1405016702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a" returned: 0 in 0.243s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:20:29 devstack cinder-volume[87515]: DEBUG cinder.manager [None req-9fc4af05-d33f-40c6-9f19-a1b5deed8da9 tempest-SnapshotDependencyTests-1405016702 None] Notifying Schedulers of capabilities ... {{(pid=87515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:20:29 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-9fc4af05-d33f-40c6-9f19-a1b5deed8da9 tempest-SnapshotDependencyTests-1405016702 None] Deleted volume successfully. Sep 07 10:20:29 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-9fc4af05-d33f-40c6-9f19-a1b5deed8da9 tempest-SnapshotDependencyTests-1405016702 None] Lock "cinder-5ff6d444-9385-4cf8-933a-5ae60c64d832-delete_volume" released by "delete_volume" :: held 1.117s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:20:30 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-8d75298b-167d-4c16-b2aa-53b965902c78 tempest-ProjectReaderTests-673922549 None] Acquiring lock "cinder-d2150c78-c843-4865-adc0-7a3b0a508956-delete_volume" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:20:30 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-8d75298b-167d-4c16-b2aa-53b965902c78 tempest-ProjectReaderTests-673922549 None] Lock "cinder-d2150c78-c843-4865-adc0-7a3b0a508956-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:20:30 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-8d75298b-167d-4c16-b2aa-53b965902c78 tempest-ProjectReaderTests-673922549 None] Acquiring lock "cinder-quobyte-d2150c78-c843-4865-adc0-7a3b0a508956" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:20:30 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-8d75298b-167d-4c16-b2aa-53b965902c78 tempest-ProjectReaderTests-673922549 None] Lock "cinder-quobyte-d2150c78-c843-4865-adc0-7a3b0a508956" acquired by "delete_volume" :: waited 0.017s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:20:30 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[34b9ce68-3bcb-4673-9738-9dfc3ba7976c]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:20:30 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-8d75298b-167d-4c16-b2aa-53b965902c78 tempest-ProjectReaderTests-673922549 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-d2150c78-c843-4865-adc0-7a3b0a508956 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:20:30 devstack sudo[108643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-d2150c78-c843-4865-adc0-7a3b0a508956 Sep 07 10:20:30 devstack sudo[108643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:20:30 devstack sudo[108643]: pam_unix(sudo:session): session closed for user root Sep 07 10:20:30 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-8d75298b-167d-4c16-b2aa-53b965902c78 tempest-ProjectReaderTests-673922549 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-d2150c78-c843-4865-adc0-7a3b0a508956" returned: 0 in 0.391s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:20:30 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-8d75298b-167d-4c16-b2aa-53b965902c78 tempest-ProjectReaderTests-673922549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-d2150c78-c843-4865-adc0-7a3b0a508956 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:20:30 devstack sudo[108650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-d2150c78-c843-4865-adc0-7a3b0a508956 Sep 07 10:20:30 devstack sudo[108650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:20:30 devstack sudo[108650]: pam_unix(sudo:session): session closed for user root Sep 07 10:20:30 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-8d75298b-167d-4c16-b2aa-53b965902c78 tempest-ProjectReaderTests-673922549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-d2150c78-c843-4865-adc0-7a3b0a508956" returned: 0 in 0.294s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:20:30 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-8d75298b-167d-4c16-b2aa-53b965902c78 tempest-ProjectReaderTests-673922549 None] Lock "cinder-quobyte-d2150c78-c843-4865-adc0-7a3b0a508956" released by "delete_volume" :: held 0.745s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:20:30 devstack cinder-volume[87515]: DEBUG cinder.quota [None req-8d75298b-167d-4c16-b2aa-53b965902c78 tempest-ProjectReaderTests-673922549 None] Created reservations ['533d6b05-4361-4dd5-ac99-db983185ad9f', 'a61f5491-f8d7-4c4b-84f8-d4cc5208cc22', '17feabc1-cbdf-46e1-aadd-19d091007a5a', 'a621e712-bab5-40f5-a385-8f0828f0a902'] {{(pid=87515) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:20:30 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-8d75298b-167d-4c16-b2aa-53b965902c78 tempest-ProjectReaderTests-673922549 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:20:30 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-8d75298b-167d-4c16-b2aa-53b965902c78 tempest-ProjectReaderTests-673922549 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:20:30 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-8d75298b-167d-4c16-b2aa-53b965902c78 tempest-ProjectReaderTests-673922549 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:20:30 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-8d75298b-167d-4c16-b2aa-53b965902c78 tempest-ProjectReaderTests-673922549 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:20:30 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-8d75298b-167d-4c16-b2aa-53b965902c78 tempest-ProjectReaderTests-673922549 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:20:30 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-8d75298b-167d-4c16-b2aa-53b965902c78 tempest-ProjectReaderTests-673922549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:20:30 devstack sudo[108654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a Sep 07 10:20:30 devstack sudo[108654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:20:31 devstack sudo[108654]: pam_unix(sudo:session): session closed for user root Sep 07 10:20:31 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-8d75298b-167d-4c16-b2aa-53b965902c78 tempest-ProjectReaderTests-673922549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a" returned: 0 in 0.281s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:20:31 devstack cinder-volume[87515]: DEBUG cinder.manager [None req-8d75298b-167d-4c16-b2aa-53b965902c78 tempest-ProjectReaderTests-673922549 None] Notifying Schedulers of capabilities ... {{(pid=87515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:20:31 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-8d75298b-167d-4c16-b2aa-53b965902c78 tempest-ProjectReaderTests-673922549 None] Deleted volume successfully. Sep 07 10:20:31 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-8d75298b-167d-4c16-b2aa-53b965902c78 tempest-ProjectReaderTests-673922549 None] Lock "cinder-d2150c78-c843-4865-adc0-7a3b0a508956-delete_volume" released by "delete_volume" :: held 1.250s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:20:31 devstack cinder-volume[87515]: DEBUG cinder.volume.flows.manager.create_volume [None req-5479398d-6853-470e-82e5-da8324cf9049 tempest-ProjectReaderTests-673922549 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 10:20:31 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-5479398d-6853-470e-82e5-da8324cf9049 tempest-ProjectReaderTests-673922549 None] Flow 'volume_create_manager' (7a6685e7-6906-409c-aac2-5c7614c5012d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:20:31 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-5479398d-6853-470e-82e5-da8324cf9049 tempest-ProjectReaderTests-673922549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cbceabab-0d2c-455c-8ce4-353a3af5598d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:20:31 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-5479398d-6853-470e-82e5-da8324cf9049 tempest-ProjectReaderTests-673922549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cbceabab-0d2c-455c-8ce4-353a3af5598d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:20:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2042025474',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9282428-2962-4f01-bd61-886ffa18a2cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b28303741af24f3e91b6d8bc9b5ef76b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:20:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:20:32Z,use_quota=True,user_id='b2c3f0b0c5b447e6bd7b8d0530f0f7cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3a092cd-7947-4cbf-abff-4ba9567becf0),volume_type_id=f3a092cd-7947-4cbf-abff-4ba9567becf0)' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:20:31 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-5479398d-6853-470e-82e5-da8324cf9049 tempest-ProjectReaderTests-673922549 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e82dc058-d0f5-4100-9295-82867c84814e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:20:31 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-5479398d-6853-470e-82e5-da8324cf9049 tempest-ProjectReaderTests-673922549 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e82dc058-d0f5-4100-9295-82867c84814e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:20:31 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-5479398d-6853-470e-82e5-da8324cf9049 tempest-ProjectReaderTests-673922549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c34fc7b7-9d6a-4dda-80c3-4b7eed21ee17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:20:31 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-5479398d-6853-470e-82e5-da8324cf9049 tempest-ProjectReaderTests-673922549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c34fc7b7-9d6a-4dda-80c3-4b7eed21ee17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b9282428-2962-4f01-bd61-886ffa18a2cb', 'volume_name': 'volume-b9282428-2962-4f01-bd61-886ffa18a2cb', 'volume_size': 1}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:20:31 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-5479398d-6853-470e-82e5-da8324cf9049 tempest-ProjectReaderTests-673922549 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e935efac-0117-41dc-ba06-6211ec06eb68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:20:31 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-5479398d-6853-470e-82e5-da8324cf9049 tempest-ProjectReaderTests-673922549 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e935efac-0117-41dc-ba06-6211ec06eb68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:20:31 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-5479398d-6853-470e-82e5-da8324cf9049 tempest-ProjectReaderTests-673922549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e0a10c4-3c1a-429b-9f8b-afff7263c973) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:20:31 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-5479398d-6853-470e-82e5-da8324cf9049 tempest-ProjectReaderTests-673922549 None] Volume b9282428-2962-4f01-bd61-886ffa18a2cb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b9282428-2962-4f01-bd61-886ffa18a2cb', 'volume_size': 1} Sep 07 10:20:31 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-5479398d-6853-470e-82e5-da8324cf9049 tempest-ProjectReaderTests-673922549 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:20:31 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-5479398d-6853-470e-82e5-da8324cf9049 tempest-ProjectReaderTests-673922549 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:20:31 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-5479398d-6853-470e-82e5-da8324cf9049 tempest-ProjectReaderTests-673922549 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:20:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2042025474',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9282428-2962-4f01-bd61-886ffa18a2cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b28303741af24f3e91b6d8bc9b5ef76b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:20:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:20:32Z,use_quota=True,user_id='b2c3f0b0c5b447e6bd7b8d0530f0f7cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3a092cd-7947-4cbf-abff-4ba9567becf0),volume_type_id=f3a092cd-7947-4cbf-abff-4ba9567becf0)}" {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 10:20:31 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-5479398d-6853-470e-82e5-da8324cf9049 tempest-ProjectReaderTests-673922549 None] Creating volume b9282428-2962-4f01-bd61-886ffa18a2cb {{(pid=87515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 10:20:31 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-5479398d-6853-470e-82e5-da8324cf9049 tempest-ProjectReaderTests-673922549 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:20:31 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-5479398d-6853-470e-82e5-da8324cf9049 tempest-ProjectReaderTests-673922549 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:20:31 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-5479398d-6853-470e-82e5-da8324cf9049 tempest-ProjectReaderTests-673922549 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:20:31 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-5479398d-6853-470e-82e5-da8324cf9049 tempest-ProjectReaderTests-673922549 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:20:31 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-5479398d-6853-470e-82e5-da8324cf9049 tempest-ProjectReaderTests-673922549 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:20:31 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-5479398d-6853-470e-82e5-da8324cf9049 tempest-ProjectReaderTests-673922549 None] Selected osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c as target Quobyte volume. {{(pid=87515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 10:20:31 devstack cinder-volume[87515]: INFO cinder.volume.drivers.remotefs [None req-5479398d-6853-470e-82e5-da8324cf9049 tempest-ProjectReaderTests-673922549 None] casted to osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c Sep 07 10:20:31 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-5479398d-6853-470e-82e5-da8324cf9049 tempest-ProjectReaderTests-673922549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-b9282428-2962-4f01-bd61-886ffa18a2cb 1073741824 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:20:31 devstack sudo[108658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-b9282428-2962-4f01-bd61-886ffa18a2cb 1073741824 Sep 07 10:20:31 devstack sudo[108658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:20:32 devstack sudo[108658]: pam_unix(sudo:session): session closed for user root Sep 07 10:20:32 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-5479398d-6853-470e-82e5-da8324cf9049 tempest-ProjectReaderTests-673922549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-b9282428-2962-4f01-bd61-886ffa18a2cb 1073741824" returned: 0 in 0.417s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:20:32 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-5479398d-6853-470e-82e5-da8324cf9049 tempest-ProjectReaderTests-673922549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-b9282428-2962-4f01-bd61-886ffa18a2cb {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:20:32 devstack sudo[108663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-b9282428-2962-4f01-bd61-886ffa18a2cb Sep 07 10:20:32 devstack sudo[108663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:20:32 devstack sudo[108663]: pam_unix(sudo:session): session closed for user root Sep 07 10:20:32 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-5479398d-6853-470e-82e5-da8324cf9049 tempest-ProjectReaderTests-673922549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-b9282428-2962-4f01-bd61-886ffa18a2cb" returned: 0 in 0.246s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:20:32 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-5479398d-6853-470e-82e5-da8324cf9049 tempest-ProjectReaderTests-673922549 None] <== create_volume: return (708ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'} {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 10:20:32 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-5479398d-6853-470e-82e5-da8324cf9049 tempest-ProjectReaderTests-673922549 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.710s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:20:32 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-5479398d-6853-470e-82e5-da8324cf9049 tempest-ProjectReaderTests-673922549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e0a10c4-3c1a-429b-9f8b-afff7263c973) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b9282428-2962-4f01-bd61-886ffa18a2cb', 'volume_size': 1}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:20:32 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-5479398d-6853-470e-82e5-da8324cf9049 tempest-ProjectReaderTests-673922549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bbaa1b3c-3518-4a17-a94a-3c5bf3bb00c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:20:32 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-5479398d-6853-470e-82e5-da8324cf9049 tempest-ProjectReaderTests-673922549 None] Volume volume-b9282428-2962-4f01-bd61-886ffa18a2cb (b9282428-2962-4f01-bd61-886ffa18a2cb): created successfully Sep 07 10:20:32 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-5479398d-6853-470e-82e5-da8324cf9049 tempest-ProjectReaderTests-673922549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bbaa1b3c-3518-4a17-a94a-3c5bf3bb00c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:20:32 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-5479398d-6853-470e-82e5-da8324cf9049 tempest-ProjectReaderTests-673922549 None] Flow 'volume_create_manager' (7a6685e7-6906-409c-aac2-5c7614c5012d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:20:32 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-5479398d-6853-470e-82e5-da8324cf9049 tempest-ProjectReaderTests-673922549 None] Created volume successfully. Sep 07 10:20:32 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-f020e552-7de4-4077-99c2-d1fb6d563d80 tempest-ProjectReaderTests-673922549 None] Acquiring lock "cinder-b9282428-2962-4f01-bd61-886ffa18a2cb-delete_volume" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:20:32 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-f020e552-7de4-4077-99c2-d1fb6d563d80 tempest-ProjectReaderTests-673922549 None] Lock "cinder-b9282428-2962-4f01-bd61-886ffa18a2cb-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:20:32 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-f020e552-7de4-4077-99c2-d1fb6d563d80 tempest-ProjectReaderTests-673922549 None] Acquiring lock "cinder-quobyte-b9282428-2962-4f01-bd61-886ffa18a2cb" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:20:32 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-f020e552-7de4-4077-99c2-d1fb6d563d80 tempest-ProjectReaderTests-673922549 None] Lock "cinder-quobyte-b9282428-2962-4f01-bd61-886ffa18a2cb" acquired by "delete_volume" :: waited 0.019s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:20:32 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff65941e-ca6d-4e6c-9a23-a3d9d6a03eb4]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:20:32 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-f020e552-7de4-4077-99c2-d1fb6d563d80 tempest-ProjectReaderTests-673922549 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-b9282428-2962-4f01-bd61-886ffa18a2cb {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:20:33 devstack sudo[108666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-b9282428-2962-4f01-bd61-886ffa18a2cb Sep 07 10:20:33 devstack sudo[108666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:20:33 devstack sudo[108666]: pam_unix(sudo:session): session closed for user root Sep 07 10:20:33 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-f020e552-7de4-4077-99c2-d1fb6d563d80 tempest-ProjectReaderTests-673922549 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-b9282428-2962-4f01-bd61-886ffa18a2cb" returned: 0 in 0.380s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:20:33 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-f020e552-7de4-4077-99c2-d1fb6d563d80 tempest-ProjectReaderTests-673922549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-b9282428-2962-4f01-bd61-886ffa18a2cb {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:20:33 devstack sudo[108671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-b9282428-2962-4f01-bd61-886ffa18a2cb Sep 07 10:20:33 devstack sudo[108671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:20:33 devstack sudo[108671]: pam_unix(sudo:session): session closed for user root Sep 07 10:20:33 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-f020e552-7de4-4077-99c2-d1fb6d563d80 tempest-ProjectReaderTests-673922549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-b9282428-2962-4f01-bd61-886ffa18a2cb" returned: 0 in 0.280s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:20:33 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-f020e552-7de4-4077-99c2-d1fb6d563d80 tempest-ProjectReaderTests-673922549 None] Lock "cinder-quobyte-b9282428-2962-4f01-bd61-886ffa18a2cb" released by "delete_volume" :: held 0.713s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:20:33 devstack cinder-volume[87515]: DEBUG cinder.quota [None req-f020e552-7de4-4077-99c2-d1fb6d563d80 tempest-ProjectReaderTests-673922549 None] Created reservations ['7cdef3c0-6d99-423f-96db-c4cc9e0e920b', '89bea146-bfe1-4ad5-9ff8-4748eac891a7', 'e4f44478-4337-47e1-afa8-8134ce52b7c6', '91ff1bb0-9f4e-4b96-9047-c56b1e5dfdc3'] {{(pid=87515) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:20:33 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-f020e552-7de4-4077-99c2-d1fb6d563d80 tempest-ProjectReaderTests-673922549 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:20:33 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-f020e552-7de4-4077-99c2-d1fb6d563d80 tempest-ProjectReaderTests-673922549 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:20:33 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-f020e552-7de4-4077-99c2-d1fb6d563d80 tempest-ProjectReaderTests-673922549 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:20:33 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-f020e552-7de4-4077-99c2-d1fb6d563d80 tempest-ProjectReaderTests-673922549 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:20:33 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-f020e552-7de4-4077-99c2-d1fb6d563d80 tempest-ProjectReaderTests-673922549 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:20:33 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-f020e552-7de4-4077-99c2-d1fb6d563d80 tempest-ProjectReaderTests-673922549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:20:33 devstack sudo[108675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a Sep 07 10:20:33 devstack sudo[108675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:20:34 devstack sudo[108675]: pam_unix(sudo:session): session closed for user root Sep 07 10:20:34 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-f020e552-7de4-4077-99c2-d1fb6d563d80 tempest-ProjectReaderTests-673922549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a" returned: 0 in 0.279s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:20:34 devstack cinder-volume[87515]: DEBUG cinder.manager [None req-f020e552-7de4-4077-99c2-d1fb6d563d80 tempest-ProjectReaderTests-673922549 None] Notifying Schedulers of capabilities ... {{(pid=87515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:20:34 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-f020e552-7de4-4077-99c2-d1fb6d563d80 tempest-ProjectReaderTests-673922549 None] Deleted volume successfully. Sep 07 10:20:34 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-f020e552-7de4-4077-99c2-d1fb6d563d80 tempest-ProjectReaderTests-673922549 None] Lock "cinder-b9282428-2962-4f01-bd61-886ffa18a2cb-delete_volume" released by "delete_volume" :: held 1.260s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:20:34 devstack cinder-volume[87515]: DEBUG cinder.volume.flows.manager.create_volume [None req-3f40594c-8824-4880-b4e5-612b9410cac7 tempest-ProjectReaderTests-673922549 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 10:20:34 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-3f40594c-8824-4880-b4e5-612b9410cac7 tempest-ProjectReaderTests-673922549 None] Flow 'volume_create_manager' (1141dc41-979d-4f0f-9c50-117d16ca2414) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:20:34 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-3f40594c-8824-4880-b4e5-612b9410cac7 tempest-ProjectReaderTests-673922549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb975e40-9655-426d-8528-533cc30dd380) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:20:34 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-3f40594c-8824-4880-b4e5-612b9410cac7 tempest-ProjectReaderTests-673922549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb975e40-9655-426d-8528-533cc30dd380) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:20:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1519806803',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=353647fc-1439-4d4d-ab62-214819525322,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b28303741af24f3e91b6d8bc9b5ef76b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:20:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:20:34Z,use_quota=True,user_id='b2c3f0b0c5b447e6bd7b8d0530f0f7cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3a092cd-7947-4cbf-abff-4ba9567becf0),volume_type_id=f3a092cd-7947-4cbf-abff-4ba9567becf0)' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:20:34 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-3f40594c-8824-4880-b4e5-612b9410cac7 tempest-ProjectReaderTests-673922549 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7853748a-1d08-45c7-9941-a06f88fce89c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:20:34 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-3f40594c-8824-4880-b4e5-612b9410cac7 tempest-ProjectReaderTests-673922549 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7853748a-1d08-45c7-9941-a06f88fce89c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:20:34 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-3f40594c-8824-4880-b4e5-612b9410cac7 tempest-ProjectReaderTests-673922549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (570c8525-aa6b-4089-bb32-ee2f05eb971a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:20:34 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-3f40594c-8824-4880-b4e5-612b9410cac7 tempest-ProjectReaderTests-673922549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (570c8525-aa6b-4089-bb32-ee2f05eb971a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '353647fc-1439-4d4d-ab62-214819525322', 'volume_name': 'volume-353647fc-1439-4d4d-ab62-214819525322', 'volume_size': 1}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:20:34 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-3f40594c-8824-4880-b4e5-612b9410cac7 tempest-ProjectReaderTests-673922549 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2fb6a0d2-67d5-4120-bf36-f4acfa06816a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:20:34 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-3f40594c-8824-4880-b4e5-612b9410cac7 tempest-ProjectReaderTests-673922549 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2fb6a0d2-67d5-4120-bf36-f4acfa06816a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:20:34 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-3f40594c-8824-4880-b4e5-612b9410cac7 tempest-ProjectReaderTests-673922549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d2e2a43-f041-4747-bde7-7b9eee0d4966) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:20:34 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-3f40594c-8824-4880-b4e5-612b9410cac7 tempest-ProjectReaderTests-673922549 None] Volume 353647fc-1439-4d4d-ab62-214819525322: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-353647fc-1439-4d4d-ab62-214819525322', 'volume_size': 1} Sep 07 10:20:34 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-3f40594c-8824-4880-b4e5-612b9410cac7 tempest-ProjectReaderTests-673922549 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:20:34 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-3f40594c-8824-4880-b4e5-612b9410cac7 tempest-ProjectReaderTests-673922549 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:20:34 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-3f40594c-8824-4880-b4e5-612b9410cac7 tempest-ProjectReaderTests-673922549 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:20:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1519806803',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=353647fc-1439-4d4d-ab62-214819525322,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b28303741af24f3e91b6d8bc9b5ef76b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:20:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:20:34Z,use_quota=True,user_id='b2c3f0b0c5b447e6bd7b8d0530f0f7cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3a092cd-7947-4cbf-abff-4ba9567becf0),volume_type_id=f3a092cd-7947-4cbf-abff-4ba9567becf0)}" {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 10:20:34 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-3f40594c-8824-4880-b4e5-612b9410cac7 tempest-ProjectReaderTests-673922549 None] Creating volume 353647fc-1439-4d4d-ab62-214819525322 {{(pid=87515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 10:20:34 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-3f40594c-8824-4880-b4e5-612b9410cac7 tempest-ProjectReaderTests-673922549 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:20:34 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-3f40594c-8824-4880-b4e5-612b9410cac7 tempest-ProjectReaderTests-673922549 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:20:34 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-3f40594c-8824-4880-b4e5-612b9410cac7 tempest-ProjectReaderTests-673922549 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:20:34 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-3f40594c-8824-4880-b4e5-612b9410cac7 tempest-ProjectReaderTests-673922549 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:20:34 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-3f40594c-8824-4880-b4e5-612b9410cac7 tempest-ProjectReaderTests-673922549 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:20:34 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-3f40594c-8824-4880-b4e5-612b9410cac7 tempest-ProjectReaderTests-673922549 None] Selected osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c as target Quobyte volume. {{(pid=87515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 10:20:34 devstack cinder-volume[87515]: INFO cinder.volume.drivers.remotefs [None req-3f40594c-8824-4880-b4e5-612b9410cac7 tempest-ProjectReaderTests-673922549 None] casted to osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c Sep 07 10:20:34 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-3f40594c-8824-4880-b4e5-612b9410cac7 tempest-ProjectReaderTests-673922549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-353647fc-1439-4d4d-ab62-214819525322 1073741824 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:20:34 devstack sudo[108678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-353647fc-1439-4d4d-ab62-214819525322 1073741824 Sep 07 10:20:34 devstack sudo[108678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:20:35 devstack sudo[108678]: pam_unix(sudo:session): session closed for user root Sep 07 10:20:35 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-3f40594c-8824-4880-b4e5-612b9410cac7 tempest-ProjectReaderTests-673922549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-353647fc-1439-4d4d-ab62-214819525322 1073741824" returned: 0 in 0.450s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:20:35 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-3f40594c-8824-4880-b4e5-612b9410cac7 tempest-ProjectReaderTests-673922549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-353647fc-1439-4d4d-ab62-214819525322 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:20:35 devstack sudo[108684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-353647fc-1439-4d4d-ab62-214819525322 Sep 07 10:20:35 devstack sudo[108684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:20:35 devstack sudo[108684]: pam_unix(sudo:session): session closed for user root Sep 07 10:20:35 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-3f40594c-8824-4880-b4e5-612b9410cac7 tempest-ProjectReaderTests-673922549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-353647fc-1439-4d4d-ab62-214819525322" returned: 0 in 0.256s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:20:35 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-3f40594c-8824-4880-b4e5-612b9410cac7 tempest-ProjectReaderTests-673922549 None] <== create_volume: return (775ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'} {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 10:20:35 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-3f40594c-8824-4880-b4e5-612b9410cac7 tempest-ProjectReaderTests-673922549 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.778s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:20:35 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-3f40594c-8824-4880-b4e5-612b9410cac7 tempest-ProjectReaderTests-673922549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d2e2a43-f041-4747-bde7-7b9eee0d4966) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-353647fc-1439-4d4d-ab62-214819525322', 'volume_size': 1}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:20:35 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-3f40594c-8824-4880-b4e5-612b9410cac7 tempest-ProjectReaderTests-673922549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1160f009-e255-4fb5-b2ec-b6e2aba763f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:20:35 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-3f40594c-8824-4880-b4e5-612b9410cac7 tempest-ProjectReaderTests-673922549 None] Volume volume-353647fc-1439-4d4d-ab62-214819525322 (353647fc-1439-4d4d-ab62-214819525322): created successfully Sep 07 10:20:35 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-3f40594c-8824-4880-b4e5-612b9410cac7 tempest-ProjectReaderTests-673922549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1160f009-e255-4fb5-b2ec-b6e2aba763f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:20:35 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-3f40594c-8824-4880-b4e5-612b9410cac7 tempest-ProjectReaderTests-673922549 None] Flow 'volume_create_manager' (1141dc41-979d-4f0f-9c50-117d16ca2414) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:20:35 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-3f40594c-8824-4880-b4e5-612b9410cac7 tempest-ProjectReaderTests-673922549 None] Created volume successfully. Sep 07 10:20:36 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-bdb69fb8-99e2-485f-a85d-c36614c723a7 tempest-ProjectReaderTests-673922549 None] Acquiring lock "cinder-353647fc-1439-4d4d-ab62-214819525322-delete_volume" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:20:36 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-bdb69fb8-99e2-485f-a85d-c36614c723a7 tempest-ProjectReaderTests-673922549 None] Lock "cinder-353647fc-1439-4d4d-ab62-214819525322-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:20:36 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-bdb69fb8-99e2-485f-a85d-c36614c723a7 tempest-ProjectReaderTests-673922549 None] Acquiring lock "cinder-quobyte-353647fc-1439-4d4d-ab62-214819525322" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:20:36 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-bdb69fb8-99e2-485f-a85d-c36614c723a7 tempest-ProjectReaderTests-673922549 None] Lock "cinder-quobyte-353647fc-1439-4d4d-ab62-214819525322" acquired by "delete_volume" :: waited 0.013s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:20:36 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfa9d889-7e6c-446d-ab03-ea2250e3daf8]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:20:36 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-bdb69fb8-99e2-485f-a85d-c36614c723a7 tempest-ProjectReaderTests-673922549 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-353647fc-1439-4d4d-ab62-214819525322 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:20:36 devstack sudo[108688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-353647fc-1439-4d4d-ab62-214819525322 Sep 07 10:20:36 devstack sudo[108688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:20:37 devstack sudo[108688]: pam_unix(sudo:session): session closed for user root Sep 07 10:20:37 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-bdb69fb8-99e2-485f-a85d-c36614c723a7 tempest-ProjectReaderTests-673922549 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-353647fc-1439-4d4d-ab62-214819525322" returned: 0 in 0.378s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:20:37 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-bdb69fb8-99e2-485f-a85d-c36614c723a7 tempest-ProjectReaderTests-673922549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-353647fc-1439-4d4d-ab62-214819525322 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:20:37 devstack sudo[108693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-353647fc-1439-4d4d-ab62-214819525322 Sep 07 10:20:37 devstack sudo[108693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:20:37 devstack sudo[108693]: pam_unix(sudo:session): session closed for user root Sep 07 10:20:37 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-bdb69fb8-99e2-485f-a85d-c36614c723a7 tempest-ProjectReaderTests-673922549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-353647fc-1439-4d4d-ab62-214819525322" returned: 0 in 0.253s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:20:37 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-bdb69fb8-99e2-485f-a85d-c36614c723a7 tempest-ProjectReaderTests-673922549 None] Lock "cinder-quobyte-353647fc-1439-4d4d-ab62-214819525322" released by "delete_volume" :: held 0.678s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:20:37 devstack cinder-volume[87515]: DEBUG cinder.quota [None req-bdb69fb8-99e2-485f-a85d-c36614c723a7 tempest-ProjectReaderTests-673922549 None] Created reservations ['e50a7703-c84a-4e2c-9be7-c469ded651ee', '33657652-b88b-40c5-aa4e-15aca1a171cb', '5370c7ee-a37f-4518-912c-ed4e40ee870e', 'fa5e27cb-e3c6-417b-a0a1-8bd6850e1a4d'] {{(pid=87515) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:20:37 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-bdb69fb8-99e2-485f-a85d-c36614c723a7 tempest-ProjectReaderTests-673922549 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:20:37 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-bdb69fb8-99e2-485f-a85d-c36614c723a7 tempest-ProjectReaderTests-673922549 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:20:37 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-bdb69fb8-99e2-485f-a85d-c36614c723a7 tempest-ProjectReaderTests-673922549 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:20:37 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-bdb69fb8-99e2-485f-a85d-c36614c723a7 tempest-ProjectReaderTests-673922549 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:20:37 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-bdb69fb8-99e2-485f-a85d-c36614c723a7 tempest-ProjectReaderTests-673922549 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:20:37 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-bdb69fb8-99e2-485f-a85d-c36614c723a7 tempest-ProjectReaderTests-673922549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:20:37 devstack sudo[108696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a Sep 07 10:20:37 devstack sudo[108696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:20:37 devstack sudo[108696]: pam_unix(sudo:session): session closed for user root Sep 07 10:20:37 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-bdb69fb8-99e2-485f-a85d-c36614c723a7 tempest-ProjectReaderTests-673922549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a" returned: 0 in 0.305s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:20:37 devstack cinder-volume[87515]: DEBUG cinder.manager [None req-bdb69fb8-99e2-485f-a85d-c36614c723a7 tempest-ProjectReaderTests-673922549 None] Notifying Schedulers of capabilities ... {{(pid=87515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:20:37 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-bdb69fb8-99e2-485f-a85d-c36614c723a7 tempest-ProjectReaderTests-673922549 None] Deleted volume successfully. Sep 07 10:20:37 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-bdb69fb8-99e2-485f-a85d-c36614c723a7 tempest-ProjectReaderTests-673922549 None] Lock "cinder-353647fc-1439-4d4d-ab62-214819525322-delete_volume" released by "delete_volume" :: held 1.198s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:20:38 devstack cinder-volume[87515]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b677c22-7c5d-43d4-8067-29dbcdba1d91 tempest-ProjectReaderTests-673922549 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 10:20:38 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-3b677c22-7c5d-43d4-8067-29dbcdba1d91 tempest-ProjectReaderTests-673922549 None] Flow 'volume_create_manager' (d58edaa2-885a-4622-a296-f9ad7e470d70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:20:38 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-3b677c22-7c5d-43d4-8067-29dbcdba1d91 tempest-ProjectReaderTests-673922549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97b86dab-a4d7-4109-aede-a42c9a921bc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:20:38 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-3b677c22-7c5d-43d4-8067-29dbcdba1d91 tempest-ProjectReaderTests-673922549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97b86dab-a4d7-4109-aede-a42c9a921bc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:20:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-221311506',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=edcae0cc-61e9-45b9-abde-676019aac93e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b28303741af24f3e91b6d8bc9b5ef76b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:20:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:20:38Z,use_quota=True,user_id='b2c3f0b0c5b447e6bd7b8d0530f0f7cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3a092cd-7947-4cbf-abff-4ba9567becf0),volume_type_id=f3a092cd-7947-4cbf-abff-4ba9567becf0)' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:20:38 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-3b677c22-7c5d-43d4-8067-29dbcdba1d91 tempest-ProjectReaderTests-673922549 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c6f72d6-fd90-4760-985b-1096801006c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:20:38 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-3b677c22-7c5d-43d4-8067-29dbcdba1d91 tempest-ProjectReaderTests-673922549 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c6f72d6-fd90-4760-985b-1096801006c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:20:38 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-3b677c22-7c5d-43d4-8067-29dbcdba1d91 tempest-ProjectReaderTests-673922549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (473772c7-9eb4-48ef-8c4d-5ccf52540807) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:20:38 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-3b677c22-7c5d-43d4-8067-29dbcdba1d91 tempest-ProjectReaderTests-673922549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (473772c7-9eb4-48ef-8c4d-5ccf52540807) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'edcae0cc-61e9-45b9-abde-676019aac93e', 'volume_name': 'volume-edcae0cc-61e9-45b9-abde-676019aac93e', 'volume_size': 1}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:20:38 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-3b677c22-7c5d-43d4-8067-29dbcdba1d91 tempest-ProjectReaderTests-673922549 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ed2e4f6-e242-42a9-ac9a-fd291dfe80b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:20:38 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-3b677c22-7c5d-43d4-8067-29dbcdba1d91 tempest-ProjectReaderTests-673922549 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ed2e4f6-e242-42a9-ac9a-fd291dfe80b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:20:38 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-3b677c22-7c5d-43d4-8067-29dbcdba1d91 tempest-ProjectReaderTests-673922549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f05f6e1a-28a5-47ac-80c8-ee06e8046ae6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:20:38 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-3b677c22-7c5d-43d4-8067-29dbcdba1d91 tempest-ProjectReaderTests-673922549 None] Volume edcae0cc-61e9-45b9-abde-676019aac93e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-edcae0cc-61e9-45b9-abde-676019aac93e', 'volume_size': 1} Sep 07 10:20:38 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-3b677c22-7c5d-43d4-8067-29dbcdba1d91 tempest-ProjectReaderTests-673922549 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:20:38 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-3b677c22-7c5d-43d4-8067-29dbcdba1d91 tempest-ProjectReaderTests-673922549 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:20:38 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-3b677c22-7c5d-43d4-8067-29dbcdba1d91 tempest-ProjectReaderTests-673922549 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T08:20:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-221311506',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=edcae0cc-61e9-45b9-abde-676019aac93e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b28303741af24f3e91b6d8bc9b5ef76b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T08:20:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T08:20:38Z,use_quota=True,user_id='b2c3f0b0c5b447e6bd7b8d0530f0f7cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3a092cd-7947-4cbf-abff-4ba9567becf0),volume_type_id=f3a092cd-7947-4cbf-abff-4ba9567becf0)}" {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 10:20:38 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-3b677c22-7c5d-43d4-8067-29dbcdba1d91 tempest-ProjectReaderTests-673922549 None] Creating volume edcae0cc-61e9-45b9-abde-676019aac93e {{(pid=87515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 10:20:38 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-3b677c22-7c5d-43d4-8067-29dbcdba1d91 tempest-ProjectReaderTests-673922549 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:20:38 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-3b677c22-7c5d-43d4-8067-29dbcdba1d91 tempest-ProjectReaderTests-673922549 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:20:38 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-3b677c22-7c5d-43d4-8067-29dbcdba1d91 tempest-ProjectReaderTests-673922549 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:20:38 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-3b677c22-7c5d-43d4-8067-29dbcdba1d91 tempest-ProjectReaderTests-673922549 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:20:38 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-3b677c22-7c5d-43d4-8067-29dbcdba1d91 tempest-ProjectReaderTests-673922549 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:20:38 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-3b677c22-7c5d-43d4-8067-29dbcdba1d91 tempest-ProjectReaderTests-673922549 None] Selected osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c as target Quobyte volume. {{(pid=87515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 10:20:38 devstack cinder-volume[87515]: INFO cinder.volume.drivers.remotefs [None req-3b677c22-7c5d-43d4-8067-29dbcdba1d91 tempest-ProjectReaderTests-673922549 None] casted to osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c Sep 07 10:20:38 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-3b677c22-7c5d-43d4-8067-29dbcdba1d91 tempest-ProjectReaderTests-673922549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-edcae0cc-61e9-45b9-abde-676019aac93e 1073741824 {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:20:38 devstack sudo[108706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-edcae0cc-61e9-45b9-abde-676019aac93e 1073741824 Sep 07 10:20:38 devstack sudo[108706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:20:38 devstack sudo[108706]: pam_unix(sudo:session): session closed for user root Sep 07 10:20:38 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-3b677c22-7c5d-43d4-8067-29dbcdba1d91 tempest-ProjectReaderTests-673922549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-edcae0cc-61e9-45b9-abde-676019aac93e 1073741824" returned: 0 in 0.503s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:20:38 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-3b677c22-7c5d-43d4-8067-29dbcdba1d91 tempest-ProjectReaderTests-673922549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-edcae0cc-61e9-45b9-abde-676019aac93e {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:20:39 devstack sudo[108712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-edcae0cc-61e9-45b9-abde-676019aac93e Sep 07 10:20:39 devstack sudo[108712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:20:39 devstack sudo[108712]: pam_unix(sudo:session): session closed for user root Sep 07 10:20:39 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-3b677c22-7c5d-43d4-8067-29dbcdba1d91 tempest-ProjectReaderTests-673922549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-edcae0cc-61e9-45b9-abde-676019aac93e" returned: 0 in 0.264s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:20:39 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-3b677c22-7c5d-43d4-8067-29dbcdba1d91 tempest-ProjectReaderTests-673922549 None] <== create_volume: return (815ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'} {{(pid=87515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 10:20:39 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-3b677c22-7c5d-43d4-8067-29dbcdba1d91 tempest-ProjectReaderTests-673922549 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.819s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:20:39 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-3b677c22-7c5d-43d4-8067-29dbcdba1d91 tempest-ProjectReaderTests-673922549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f05f6e1a-28a5-47ac-80c8-ee06e8046ae6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-edcae0cc-61e9-45b9-abde-676019aac93e', 'volume_size': 1}' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:20:39 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-3b677c22-7c5d-43d4-8067-29dbcdba1d91 tempest-ProjectReaderTests-673922549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e443c8e-6bd8-43d7-b1c5-c72c7896e294) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 10:20:39 devstack cinder-volume[87515]: INFO cinder.volume.flows.manager.create_volume [None req-3b677c22-7c5d-43d4-8067-29dbcdba1d91 tempest-ProjectReaderTests-673922549 None] Volume volume-edcae0cc-61e9-45b9-abde-676019aac93e (edcae0cc-61e9-45b9-abde-676019aac93e): created successfully Sep 07 10:20:39 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-3b677c22-7c5d-43d4-8067-29dbcdba1d91 tempest-ProjectReaderTests-673922549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e443c8e-6bd8-43d7-b1c5-c72c7896e294) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 10:20:39 devstack cinder-volume[87515]: DEBUG cinder.volume.manager [None req-3b677c22-7c5d-43d4-8067-29dbcdba1d91 tempest-ProjectReaderTests-673922549 None] Flow 'volume_create_manager' (d58edaa2-885a-4622-a296-f9ad7e470d70) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 10:20:39 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-3b677c22-7c5d-43d4-8067-29dbcdba1d91 tempest-ProjectReaderTests-673922549 None] Created volume successfully. Sep 07 10:20:40 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-012f0348-bde4-4738-b34c-8a1a4528dbc3 tempest-ProjectReaderTests-673922549 None] Acquiring lock "cinder-edcae0cc-61e9-45b9-abde-676019aac93e-delete_volume" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:20:40 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-012f0348-bde4-4738-b34c-8a1a4528dbc3 tempest-ProjectReaderTests-673922549 None] Lock "cinder-edcae0cc-61e9-45b9-abde-676019aac93e-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:20:40 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-012f0348-bde4-4738-b34c-8a1a4528dbc3 tempest-ProjectReaderTests-673922549 None] Acquiring lock "cinder-quobyte-edcae0cc-61e9-45b9-abde-676019aac93e" by "delete_volume" {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 10:20:40 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-012f0348-bde4-4738-b34c-8a1a4528dbc3 tempest-ProjectReaderTests-673922549 None] Lock "cinder-quobyte-edcae0cc-61e9-45b9-abde-676019aac93e" acquired by "delete_volume" :: waited 0.015s {{(pid=87515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 10:20:40 devstack cinder-volume[87515]: DEBUG oslo.privsep.daemon [-] privsep: reply[55231c71-128e-492d-9cf2-7a95c6a52d81]: (4, 'qcow2') {{(pid=88332) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 10:20:40 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-012f0348-bde4-4738-b34c-8a1a4528dbc3 tempest-ProjectReaderTests-673922549 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-edcae0cc-61e9-45b9-abde-676019aac93e {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:20:40 devstack sudo[108716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-edcae0cc-61e9-45b9-abde-676019aac93e Sep 07 10:20:40 devstack sudo[108716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:20:40 devstack sudo[108716]: pam_unix(sudo:session): session closed for user root Sep 07 10:20:40 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-012f0348-bde4-4738-b34c-8a1a4528dbc3 tempest-ProjectReaderTests-673922549 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-edcae0cc-61e9-45b9-abde-676019aac93e" returned: 0 in 0.365s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:20:40 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-012f0348-bde4-4738-b34c-8a1a4528dbc3 tempest-ProjectReaderTests-673922549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-edcae0cc-61e9-45b9-abde-676019aac93e {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:20:40 devstack sudo[108721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-edcae0cc-61e9-45b9-abde-676019aac93e Sep 07 10:20:40 devstack sudo[108721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:20:41 devstack sudo[108721]: pam_unix(sudo:session): session closed for user root Sep 07 10:20:41 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-012f0348-bde4-4738-b34c-8a1a4528dbc3 tempest-ProjectReaderTests-673922549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a/volume-edcae0cc-61e9-45b9-abde-676019aac93e" returned: 0 in 0.243s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:20:41 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-012f0348-bde4-4738-b34c-8a1a4528dbc3 tempest-ProjectReaderTests-673922549 None] Lock "cinder-quobyte-edcae0cc-61e9-45b9-abde-676019aac93e" released by "delete_volume" :: held 0.646s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:20:41 devstack cinder-volume[87515]: DEBUG cinder.quota [None req-012f0348-bde4-4738-b34c-8a1a4528dbc3 tempest-ProjectReaderTests-673922549 None] Created reservations ['03471011-28cc-4c89-bdd3-58ad23433f5e', '7430bdcf-6f12-4238-b8b9-78f4161fe50c', '8441fb73-626b-41d5-bed5-8d77d6697242', '0900bd38-bbf7-4e51-a5f5-3f05a5eef58b'] {{(pid=87515) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 10:20:41 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-012f0348-bde4-4738-b34c-8a1a4528dbc3 tempest-ProjectReaderTests-673922549 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 10:20:41 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-012f0348-bde4-4738-b34c-8a1a4528dbc3 tempest-ProjectReaderTests-673922549 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 10:20:41 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-012f0348-bde4-4738-b34c-8a1a4528dbc3 tempest-ProjectReaderTests-673922549 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 10:20:41 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-012f0348-bde4-4738-b34c-8a1a4528dbc3 tempest-ProjectReaderTests-673922549 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b4500ed-e0c1-4a68-88f6-ab13ab07e14c'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 10:20:41 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-012f0348-bde4-4738-b34c-8a1a4528dbc3 tempest-ProjectReaderTests-673922549 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 10:20:41 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-012f0348-bde4-4738-b34c-8a1a4528dbc3 tempest-ProjectReaderTests-673922549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 10:20:41 devstack sudo[108724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a Sep 07 10:20:41 devstack sudo[108724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 10:20:41 devstack sudo[108724]: pam_unix(sudo:session): session closed for user root Sep 07 10:20:41 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-012f0348-bde4-4738-b34c-8a1a4528dbc3 tempest-ProjectReaderTests-673922549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdc5cde6216eb15955b399e54bc8276a" returned: 0 in 0.241s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 10:20:41 devstack cinder-volume[87515]: DEBUG cinder.manager [None req-012f0348-bde4-4738-b34c-8a1a4528dbc3 tempest-ProjectReaderTests-673922549 None] Notifying Schedulers of capabilities ... {{(pid=87515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 10:20:41 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-012f0348-bde4-4738-b34c-8a1a4528dbc3 tempest-ProjectReaderTests-673922549 None] Deleted volume successfully. Sep 07 10:20:41 devstack cinder-volume[87515]: DEBUG cinder.coordination [None req-012f0348-bde4-4738-b34c-8a1a4528dbc3 tempest-ProjectReaderTests-673922549 None] Lock "cinder-edcae0cc-61e9-45b9-abde-676019aac93e-delete_volume" released by "delete_volume" :: held 1.138s {{(pid=87515) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 10:20:51 devstack cinder-volume[87515]: DEBUG dbcounter [-] [87515] Writing DB stats cinder:SELECT=52,cinder:INSERT=23,cinder:UPDATE=90,cinder:DELETE=8 {{(pid=87515) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 10:20:51 devstack cinder-volume[87515]: DEBUG dbcounter [-] [87515] Writing DB stats cinder:SELECT=76,cinder:UPDATE=85,cinder:DELETE=7,cinder:INSERT=21 {{(pid=87515) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 10:21:03 devstack cinder-volume[87515]: DEBUG dbcounter [-] [87515] Writing DB stats cinder:SELECT=1 {{(pid=87515) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 10:21:03 devstack cinder-volume[87515]: DEBUG dbcounter [-] [87515] Writing DB stats cinder:UPDATE=1 {{(pid=87515) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}